The Faithfulness of LLMs as Solvers and Autoformalizers in Legal Reasoning
This paper evaluates whether LLMs faithfully solve and autoformalize legal reasoning problems. It finds that while LLMs show some proficiency in translating legal text to formal logic and reasoning with it, significant faithfulness gaps remain, particularly in complex legal contexts.