EPS
← All batches·2605.06903

MELD: Multi-Task Equilibrated Learning Detector for AI-Generated Text

topic: general_aitop score: 100released: 2026-05-12first surfaced: 2026-05-11arXivPDFnew_researchthreats2026-05-112026-05-12

Authors: Chenjun Li, Cheng Wan, Johannes C. Paetzold

arXiv · PDF

Summary

The authors built MELD, a detector for AI-generated text that goes beyond binary human-vs-AI classification by adding auxiliary tasks: predicting which model family generated the text, what kind of adversarial attack was applied, and what domain it came from. They train all four tasks together on a shared encoder, balancing the losses with learned uncertainty weights, and use teacher-student distillation (clean teacher, attack-augmented student) plus a hard-negative ranking loss to widen the score gap between AI text and confusable human text. At inference, the auxiliary heads are discarded, so MELD costs the same as a standard detector. On the public RAID leaderboard, MELD is the strongest open-source detector and competes with commercial models, especially under attack and at low false-positive rates.

Main takeaways:

  • Most AI-text detectors optimize only binary human/AI classification, so the representation doesn't learn fine-grained structure (generator, attack type, domain) once the binary task saturates.
  • MELD adds three auxiliary heads (generator family, attack type, source domain) to a shared encoder, forcing the representation to capture richer signal.
  • Losses are balanced with learned homoscedastic uncertainty weights (i.e., the model learns how much to weight each task).
  • Teacher-student distillation with attack augmentation on the student improves robustness; hard-negative ranking enlarges the margin between AI and hard-to-distinguish human text.
  • MELD tops open-source detectors on the RAID leaderboard and matches or beats supervised baselines on held-out benchmarks, especially at low false-positive rates and under adversarial rewrites.

Relevance

Not directly related to my persona or midtraining work—this is about detecting AI-generated text rather than installing or probing behaviors. Included because multi-task auxiliary learning is a general technique that could be adapted to probe persona geometry or marker uptake if I wanted richer representations.

Threat model

Potential threat/caveat for clean result "Fine-tuning one persona on a two-marker chunk and another on the start marker plants the end marker at every donor answer's end, not chained to the start (LOW confidence)": this item discusses negative, robustness, adversarial, evaluation, benchmark.

Abstract

arXiv:2605.06903v1 Announce Type: new Abstract: Large language models are now embedded in everyday writing workflows, making reliable AI-generated text detection important for academic integrity, content moderation, and provenance tracking. In practice, however, a detector must do more than achieve high aggregate AUROC on clean, in-distribution human and AI text: it should remain robust to attacks and adversarial rewrites, transfer to unseen generators and domains, and operate at low false-positive rates (FPR). Most existing detectors optimize a single AI/Human objective, giving the representation little incentive to learn generator, attack, or domain structure once the binary task saturates. We introduce MELD (Multi-Task Equilibrated Learning Detector), a deployable detector for AI-generated text that enriches binary detection with auxiliary supervision. MELD attaches generator-family, attack-type, and source-domain heads to a shared encoder, and balances the four losses with learned homoscedastic uncertainty weights. To improve robustness, an EMA teacher predicts on clean inputs while an attack-augmented student is distilled toward the teacher. MELD further uses a hard-negative pairwise ranking loss to enlarge the score margin between AI-generated texts and the most confusable human texts. At inference, all auxiliary heads are discarded, giving MELD the same interface and cost as a standard detector. On the public RAID leaderboard, MELD is the strongest open-source detector and is competitive with leading commercial models, especially under attack and at low FPR. Across standard held-out benchmarks, MELD matches or outperforms supervised baselines. We further introduce MELD-eval, a held-out evaluation pool built from recent chat models released by four major LLM providers. Without additional finetuning, MELD achieves 99.9% TPR at 1% FPR on MELD-eval, while many baselines degrade sharply.