Connects single-chain protein folding to a general-purpose language model, using its residue representations to drive a pretrained structure generator. Current results show weaker performance on longer chains and reduced scores on a general-knowledge test after protein training.
Details the Xing 4 model architecture, Ascend-scale pretraining systems, and agentic post-training, including a 285B-parameter training run on 8,192 Ascend 910C cards.
Examines whether Transformers are necessary when LLMs write model weights without gradient training. When allowed to design the architecture, the tested LLMs compile facts into sparse tables, reaching up to 54.4% accuracy on ARC.