ResearchResearch paperLarge Language Models · Interpretability1 source · Oct 12, 2026

UZHCL_for_the_win at Touche: Encoder Fine-Tuning, Synthetic Augmentation, and an Underpowered Encoder-LLM Comparison

Online discussions on platforms like Reddit are a productive testbed for fallacy detection: short texts, broad topical range, and the full inventory of informal fallacies.

Key points

  • The Touche 2026 lab at CLEF formalises this as a shared task on a Reddit-derived corpus that combines fallacy detection with argument-scheme classification.
  • This paper describes our participation in all three subtasks (ST1 binary fallacy detection, ST2 eight-way fallacy classification, ST3 four-way argument-scheme classification) and both evaluation tracks.
  • Our submitted systems are fine-tuned RoBERTa-large encoders with task-specific heads, augmented with a small batch of LLM-generated synthetic contrastive pairs; for ST2 and ST3 on the enhanced track we additionally added confidence-filtered pseudo-labelled examples from the unlabelled pool.
  • A wider backbone comparison spanning additional encoders (DeBERTa-v3, ModernBERT) and an LLM track (four Qwen variants from 3B to 32B, zero-shot through CoT-LoRA) showed no validated benefit over RoBERTa-large at this corpus scale, with 5-fold variance wide enough that we call the comparison underpowered rather than settled.

Sources (1)

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 12, 2026unslothai/unsloth v0.1.906-beta: Browser Use + Qwen-Image-2.1-Turbo
  2. Oct 12, 2026AReA: Adaptive Receptive-Field Attention for Efficient High-Resolution Diffusion Transformers
  3. Oct 12, 2026AUGUstus: Autonomous Driving VLA Model with Unified Generation and Understanding
  4. Oct 11, 2026MCP - Qwen2.1 Turbo + Kandinsky Lite Video Gen on 8GB VRAM
  5. Oct 10, 2026Beyond Adjacent Layers: Graph-Guided Layer Fusion for Compressing Large Language Models
  6. Oct 10, 2026PGSB: Pretrained-Guided Shared Basis for LoRA Model Merging

Related