Training NanoGPT on Slurm with a Nix-Pinned Environment
This article describes how to train a NanoGPT model on an HPC Slurm cluster using a reproducible, Nix-pinned software environment including Python, CUDA, PyTorch, and CUDA cuDNN, with source available on GitHub.