ResearchResearch paperLarge Language Models1 source · Oct 6, 2026

GeneICL: A Tabular Foundation Model for Bulk Transcriptomics

Towards this end, we introduce GeneICL, a 4.2M-parameter tabular foundation model combining a semi-synthetic pretraining prior built from measured bulk expression profiles with a parameter-efficient recurrent architecture.

Key points

  • Gene expression is widely measured in biomedicine, yet clinical outcome prediction remains challenging due to high dimensionality, strong feature correlations, and limited labeled data.
  • Large self-supervised transcriptomic foundation models often fail to outperform simple supervised baselines.
  • We evaluate GeneICL on 80 clinical outcome-prediction tasks spanning classification, regression, and survival.
  • Tabular foundation models consistently outperform self-supervised transcriptomic models, while GeneICL achieves the best overall rank among evaluated foundation models and tuned baselines.

Sources (1)

  • [1]GeneICL: A Tabular Foundation Model for Bulk Transcriptomics
    arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 6, 05:10 PM
    Towards this end, we introduce GeneICL, a 4.2M-parameter tabular foundation model combining a semi-synthetic pretraining prior built from measured bulk expression profiles with a parameter-efficient recurrent architecture.
    Gene expression is widely measured in biomedicine, yet clinical outcome prediction remains challenging due to high dimensionality, strong feature correlations, and limited labeled data.

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 6, 2026Build a voice travel concierge with Amazon Bedrock AgentCore, Managed Knowledge Base and Nova Sonic
  2. Oct 6, 2026Adversarially Trained Linear Transformers Are Optimal Robust In-Context Learners for Gaussian Mixtures
  3. Oct 6, 2026Improving Synthetic Data Generation for Argument Mining via Adversarial Reinforcement Learning
  4. Oct 4, 2026SheetSage2: Coherent Lead-Sheet Transcription with Synthetic Supervision
  5. Oct 2, 2026Inside-Out AI: Rebuilding Airbnb Behind the Scenes and Across the Guest Experience
  6. Sep 29, 2026In-context Robot Learning Made Simple: A Democratized Recipe for Manipulation Tasks

Related