ResearchResearch paperLarge Language Models · Efficiency & Inference1 source · Oct 19, 2026

PFedQFT: Personalized Federated Quantum-Inspired Fine-Tuning for Medical Large Language Models

We propose PFedQFT, a quantum-inspired framework for personalized federated fine-tuning with a compact shared adapter.

Key points

  • Medical data remain fragmented across institutional silos because of privacy, governance, and ownership constraints.
  • Federated learning enables medical institutions to adapt large language models (LLMs) collaboratively without transferring raw records.
  • However, independently parameterized low-rank adapters incur repeated parameter and communication costs across Transformer projections, while uniform aggregation may limit adaptation to heterogeneous institutional data.
  • Specifically, PFedQFT constructs reusable orthonormal adaptation bases from compact skew-symmetric generators using a truncated matrix-exponential approximation followed by QR orthonormalization.

Sources (1)

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 19, 2026From Black Box to Controller: Inference-Time Steering of LLM via Feature Amplification
  2. Oct 19, 2026TokenGate: Adapting LLMs for Fast and Memory-Efficient Prefill with Learned Token Pruning
  3. Oct 17, 2026Medical Fine-Tuning Reshapes, Not Reduces, Patient-Facing AI Risk: A Rubric-Based, LLM-Judge Evaluation Framework
  4. Oct 17, 2026AdamPM: Memory-Efficient LLM Optimization via Moment Pooling
  5. Oct 16, 2026Hugging Face ❤️ TorchTPU: TPUs, Natively
  6. Oct 16, 2026Prefix-Tuning for Arbitrary Output Sequences on Pretrained Transformers

Related