Can LLM Agents Infer World Models? Evidence from Agentic Automata Learning

This paper tests whether LLM agents can infer world models by interacting with unknown automata environments. Results show LLMs can track some hidden states but generally fail to learn complete world models, often relying on shallow pattern matching instead.