One common issue with personalization in all LLMs is how distracting memory seems to be for the models. A single question from 2 months ago about some...
Andrej Karpathy notes a common issue with LLM personalization: memory features are often too distracting. A single past query can be treated as a deep, lasting interest, leading the model to mention it excessively and inappropriately over time.