Scaling Large Language Models for Next-Generation Single-Cell Analysis
The authors propose an autoregressive language model-based framework for single-cell gene expression modeling, using causal attention and multi-cell context. They discuss limitations of their approach, including unidirectionality and potential for hallucinations, and suggest architectural enhancements to mitigate these issues.