Research
Current genome model is an attention-based model pretrained on billions of genes, with a classifier bolted on top. We think the models that come next will look very different, and they will need to read a genome as a living system, not a string to predict.
Current genome foundation models may not be sufficient for function, phenotype, or the behaviour of an organism in its environment. They plateau with scale and often fail to beat simple baselines. Labs across world models, self-supervised learning, robotics, and multimodal AI are building architectures around persistent internal state and interaction with the environment. Genome models should be no different, built to capture a living cell’s complex, dynamic interactions.