🧑‍🔬 Austin Xu

🏛️ Affiliations

🏢SalesforceSan Francisco · United States2024–2026 · 16 paperscurrent🎓Georgia Institute of TechnologyAtlanta · United States2020–2024 · 6 papers

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 1 more institution on single bylines are not listed.

🧭 Fields, topics and concepts

Of its works in our library, with the number of works on each.

📅 Works by year

2020s

📄 Papers

The most cited first (OpenAlex and our library).

1. Direct Judgement Preference Optimization (2025 · 35 citations)
   LLM-as-judge models are usually trained with supervised finetuning on fairly small datasets and cover only narrow evaluation formats, often just pairwise comparison.
2. Does Context Matter? ContextualJudgeBench for Evaluating LLM-based Judges in Contextual Settings (2025 · 14 citations)
   LLM judges are often marketed as general-purpose evaluators, but they are rarely tested on contextual tasks such as RAG and summarization, where a response must be grounded in supplied external material.
3. J4R: Learning to Judge with Equivalent Initial State Group Relative Policy Optimization (2026 · 3 citations)
   LLM-as-judge models handle simple tasks like chat quality well, but they struggle to evaluate reasoning-heavy outputs.
4. Hard2Verify: A Step-Level Verification Benchmark for Open-Ended Frontier Math (2026 · 2 citations)
   Frontier LLMs now write Olympiad-level proofs, such as the gold-medal results at IMO 2025. Training and evaluating such systems requires automatic verifiers that can judge each step of a proof, not just the final answer. Existing step-level benchmarks have weaknesses: they use easy questions, outputs from weak…

All works

5 works of theirs in our library, the most cited first; 4 with a page here, the others link their original until we summarise them.

1. A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systems ↗arXiv:2504.09037 · no summary yetZixuan Ke et al.2025 · 39 citations
2. Direct Judgement Preference OptimizationConference on Empirical Methods in Natural Language Processing (EMNLP)PeiFeng Wang, Austin Xu, Yilun Zhou, et al.2025 · 35 citations
3. Does Context Matter? ContextualJudgeBench for Evaluating LLM-based Judges in Contextual SettingsAnnual Meeting of the Association for Computational Linguistics (ACL)Austin Xu, Srijan Bansal, Yifei Ming, et al.2025 · 14 citations
4. J4R: Learning to Judge with Equivalent Initial State Group Relative Policy OptimizationAnnual Meeting of the Association for Computational Linguistics (ACL)Austin Xu, Yilun Zhou, Xuan-Phi Nguyen, et al.2026 · 3 citations
5. Hard2Verify: A Step-Level Verification Benchmark for Open-Ended Frontier MathAnnual Meeting of the Association for Computational Linguistics (ACL)Shrey Pandit, Austin Xu, Xuan-Phi Nguyen, et al.2026 · 2 citations

🤝 Co-authors here

8 co-authors with a page, the most papers together first.

• Shafiq Joty ×4
• Caiming Xiong ×3
• Xuan-Phi Nguyen ×2
• Yifei Ming ×2
• Yilun Zhou ×2
• PeiFeng Wang
• Semih Yavuz
• Srijan Bansal

Venues

Where their works here were published, the most works first, with the editions of those that have a page.

• Annual Meeting of the Association for Computational Linguistics (ACL) ×3: ACL 2026 ×2, ACL 2025
• Conference on Empirical Methods in Natural Language Processing (EMNLP): EMNLP 2025

🔗 Cited by

Papers of our library cite their works 83 times (of the 149,439 papers whose bibliographies we read); 17 citing papers with a page here →.

Updated 31 October 2026

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/austin-xu/