Skip to content
TopicTracker
From HackerNewsView original
TranslationTranslation

Training NanoGPT on Slurm with a Nix-Pinned Environment

This article describes how to train a NanoGPT model on an HPC Slurm cluster using a reproducible, Nix-pinned software environment including Python, CUDA, PyTorch, and CUDA cuDNN, with source available on GitHub.