So, Where Does Next-Token Prediction Leave Us?

The article examines next-token prediction's limits in LLMs, arguing it enables capable models but fundamentally constrains reasoning and planning. Progress may need architectures beyond pure autoregressive prediction.