MedEvo: Medical Reasoning Evolution through Knowledge Navigation
We propose MedEvo, which uses medical knowledge, namely a tag taxonomy and error-type diagnosis, to navigate both trajectory repair and data selection.
ProofPaper ↗
Key points
- Medical multimodal reasoning models are typically trained on teacher-generated rationales, discarding the valid reasoning in students' own failed trajectories, while general-domain correction methods offer little guidance for errors in image reading, anatomical context, or differential diagnosis.
- After each round, MedEvo identifies capability gaps across medical tags on a held-out feedback set and prioritizes related questions for new rollouts and repairs.
- With supervised fine-tuning (SFT) alone, MedEvo raises Qwen3.5-9B mean accuracy across seven benchmarks from 65.57% to 69.12% (47.40% to 54.50% on the multimodal track of MedXpertQA (MedXpertQA-MM)), surpassing teacher-distillation SFT (66.93%).
- Our analyses show that failed trajectories contain reasoning worth preserving, that repair success does not imply learning value, and that independent feedback is key to sustained improvement.
Sources (1)
- [1]MedEvo: Medical Reasoning Evolution through Knowledge NavigationarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 13, 04:11 AM
We propose MedEvo, which uses medical knowledge, namely a tag taxonomy and error-type diagnosis, to navigate both trajectory repair and data selection.
Medical multimodal reasoning models are typically trained on teacher-generated rationales, discarding the valid reasoning in students' own failed trajectories, while general-domain correction methods offer little guidance for errors in image reading, anatomical context, or differential diagnosis.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 13, 2026DisaggKD: Efficient Knowledge Distillation through Teacher-Student Disaggregation and a Fused Loss
- Oct 13, 2026GroundGUI: GUI Grounding by High-Quality Data and Distillation-to-Reinforcement Learning
- Oct 12, 2026[AINews] Meta Muse Wonder & Wonder Full: MSL’s Claude 5.5-tier Frontier Model
- Oct 12, 2026Strengthening our defenses against distillation attacks
- Oct 11, 2026autotrust/JEV-35B-NVFP4
- Oct 11, 2026History Replays Itself: Unleashing Long-Context Capability in Linear Attention