CheckDistill: Adaptive Checklist Distillation for Efficient Distributional Reward Modeling in Image Editing
Reinforcement learning for instruction-guided image editing requires reward models that provide reliable, accurate, and efficient feedback.
ProofPaper ↗
Key points
- Direct scalar prediction compresses multidimensional editing preferences, whereas generative evaluators can expose their judgment through explicit reasoning.
- We introduce CheckDistill, a pointwise reward modeling framework that internalizes instruction-adaptive checklists.
- We decompose each editing condition into atomic, independently verifiable requirements and construct four-dimensional scoring labels together with structured verification evidence.
- A reliability-weighted on-policy self-distillation objective adjusts supervision at score tokens according to agreement between the teacher's expected scores and reference labels, while retaining candidate probability weights in a truncated token support.
Sources (1)
- [1]CheckDistill: Adaptive Checklist Distillation for Efficient Distributional Reward Modeling in Image EditingarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 19, 05:05 PM
Reinforcement learning for instruction-guided image editing requires reward models that provide reliable, accurate, and efficient feedback.
Direct scalar prediction compresses multidimensional editing preferences, whereas generative evaluators can expose their judgment through explicit reasoning.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 19, 2026Not Every Rollout Needs Distillation: Correctness-Filtered On-Policy Self-Distillation
- Oct 19, 2026Long-Horizon Multi-Object Rearrangement via Distilled Tree Search over Continuous Actions
- Oct 19, 2026ToolOPD: Credit-Aware On-Policy Distillation for Tool-Use Agents
- Oct 18, 2026TILDE: Teacher-in-the-Loop Distillation from Embodied Foundation Models
- Oct 18, 2026ClinSDT: LLM-Encoded Clinical Semantic Guidance for Sepsis Treatment via Decision Transformer
- Oct 18, 2026Policy Is Not Capability: Some Safety Benchmarks Measure Which Definition of "Unsafe" You Trained On