ResearchResearch paperReinforcement Learning · Large Language Models · Business, Funding & Industry1 source · Oct 19, 2026

TaQFormer: A Treatment-as-Query Transformer with Data-Fusion for Multidimensional Treatment Modeling in Coupon Allocation

We present TaQFormer, a treatment-as-query Transformer for this multidimensional treatment setting.

Key points

  • We study coupon allocation on an online marketplace offering multiple service categories.
  • Issuing coupons requires choosing a vector of category-specific discounts, accounting for both their direct effects and cross-category demand shifts.
  • To combine large but policy-biased observational logs with a smaller stream of randomized controlled trial data, we use a two-stage pipeline: observational pretraining learns general outcome patterns, followed by LoRA fine-tuning on RCT data with a request-specific fusion gate.
  • The deployment illustrates how multidimensional treatment modeling and observational pretraining, combined with adaptation using RCT data, can support effective joint discount decisions in production.

Sources (1)

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 19, 2026TorchNeuron: running HF models on AWS Trainium is easier than ever
  2. Oct 19, 2026Scaling Parameter-Efficient Fine-Tuning for Brain Encoding
  3. Oct 19, 2026TokenGate: Adapting LLMs for Fast and Memory-Efficient Prefill with Learned Token Pruning
  4. Oct 18, 2026BatchParScale: Sparse Batch-Mixing for Sequence Models
  5. Oct 17, 2026Dual Task Vector Merging: Leveraging Emotion and ASR Knowledge for Low-Resource Alzheimer's Disease Detection
  6. Oct 16, 2026Hugging Face ❤️ TorchTPU: TPUs, Natively

Related