Calibrating LLM Judges: Linear Probes for Fast and Reliable Uncertainty Estimation
arXiv:2512.22245v1 Announce Type: new Abstract: As LLM-based judges become integral to industry applications, obtaining well-calibrated uncertainty estimates efficiently has become critical for production deployment. However, existing techniques, such as verbalized confidence and multi-generation methods, are often either poorly calibrated or…
