@cjzafir: I pay Google $13.99 CAD to train a 9B LLM model on A100 80GB GPU. It takes: > 10 minutes to step notebook > 7 hours to …
Summary
A user shares a workflow for training a 9B LLM on an A100 GPU using Google Colab for $13.99 CAD, noting the overnight process and the ease of training small language models.
View Cached Full Text
Cached at: 05/22/26, 07:58 PM
I pay Google $13.99 CAD to train a 9B LLM model on A100 80GB GPU.
It takes:
10 minutes to step notebook 7 hours to train the model 1.5 hour for eval testing 1.25 hours for validation testing 30 minutes for GGUF/MLX conversion
Overnight, I run codex (with computer use chrome extension) on new notebook.
In the morning I get a new custom trained model.
It’s not hard to train SLMs anymore. Wake up.
Similar Articles
@h100envy: Google engineer explained how to fine-tune a tiny LLM from 46% to 90% accuracy on your phone in 21 minutes - better tha…
A Google engineer shares a method to fine-tune a Gemma 270M model from 46% to 90% accuracy in 21 minutes on a phone, using synthetic data, LoRA, int4 quantization, achieving 2000 tokens per second offline.
@akshay_pachaar: Google just dropped a new LLM! You can run it locally on just 8GB RAM. Let's fine-tune this on our own data (100% local…
Google dropped a new LLM that can run locally on just 8GB RAM. The tweet demonstrates fine-tuning it on personal data entirely locally.
@LottoLabs: A very cool model for the GPU poor bros Trained on an ungodly amount of tokens for a 8b a1b model Gonna be super fast e…
LottoLabs announces LiquidAI's LFM2.5-8B-A1B-GGUF model, an 8B parameter model trained on a massive token count and optimized for fast inference on limited GPU hardware, with support for llama.cpp, Ollama, vLLM, and more.
@analogalok: my 8 GB VRAM gaming laptop is absolutely going to hate me for this. but I still did it. ran a 31b dense model (Gemma 4 …
User runs Gemma 4 31B dense model on 8GB VRAM gaming laptop at ~3 tokens/sec using llama.cpp with MTP speculative decoding, demonstrating feasibility of running a 31B dense model on consumer hardware and proposing agentic workflows where a fast MoE model routes to this slower dense model for hard tasks.
@LiorOnAI: You now convert any LLM into a faster one without retraining from scratch. NVIDIA just did this to their 30B model. Her…
NVIDIA proposes a method to convert any LLM into a faster one by splitting it into two copies: one frozen for context, the other trained to generate multiple tokens in parallel, achieving 2.4x speedup with ~99% quality retention using only 8% of training data.