Big LLMs weights are a piece of history

The author argues that large language models serve as a lossy but valuable compressed archive of internet content that is disappearing over time. While supporting traditional preservation efforts like the Internet Archive, the piece emphasizes preserving publicly released LLM weights as historical records of digital culture.