Archives AI News

Forget What You Know about LLMs Evaluations — LLMs are Like a Chameleon

arXiv:2502.07445v2 Announce Type: replace-cross Abstract: Large language models (LLMs) often appear to excel on public benchmarks, but these high scores may mask an overreliance on dataset-specific surface cues rather than true language understanding. We introduce the Chameleon Benchmark Overfit Detector…

THOR: Tool-Integrated Hierarchical Optimization via RL for Mathematical Reasoning

arXiv:2509.13761v1 Announce Type: new Abstract: Large Language Models (LLMs) have made remarkable progress in mathematical reasoning, but still continue to struggle with high-precision tasks like numerical computation and formal symbolic manipulation. Integrating external tools has emerged as a promising approach…

Mirror-Consistency: Harnessing Inconsistency in Majority Voting

arXiv:2410.10857v2 Announce Type: replace-cross Abstract: Self-Consistency, a widely-used decoding strategy, significantly boosts the reasoning capabilities of Large Language Models (LLMs). However, it depends on the plurality voting rule, which focuses on the most frequent answer while overlooking all other minority…

Database-Augmented Query Representation for Information Retrieval

arXiv:2406.16013v2 Announce Type: replace-cross Abstract: Information retrieval models that aim to search for documents relevant to a query have shown multiple successes, which have been applied to diverse tasks. Yet, the query from the user is oftentimes short, which challenges…