Archive of posts with category 'LLM'

Running a 70B LLM on Pure RISC-V: The MilkV Pioneer Deployment Journey

When the 40GB download completed and the model loaded into memory, I wondered: would a 70-billion parameter language model actually run on a RISC-V CPU? No GPU. No CUDA. Just...