The article examines whether large language models are actually improving, analyzing recent benchmark results and questioning if apparent progress is real or just due to test data contamination. It discusses the challenges of measuring true capability gains versus superficial improvements.
Gemini can identify public figures in images, while ChatGPT and Claude currently do not offer this capability. This represents a functional difference between major AI models regarding image recognition of people.
The article examines whether modern large language models can accurately count the number of 'b's in the word "blueberry," testing their ability to handle this specific adversarial question.
The article discusses using large language models to predict coffee preferences and suggests benchmarking with physical experiments. It explores the potential of AI models to understand and forecast individual coffee taste patterns.