RT Nick Levine: New work with @AlecRad and @DavidDuvenaud: Have you ever dreamed of talking to someone from the past? Introducing talkie, a 13B model ...
Researchers have developed "talkie," a 13-billion parameter language model trained exclusively on text from before 1931. The project aims to study how language models generalize by creating vintage-style AI that can communicate as if from the past, with questions raised about whether such a model can learn modern tasks like coding.