veristamp reposted this
🦖 I taught a 32M text classifier to play Chrome T-Rex. No game AI. No PPO. It just reads emit a single decision. Every frame the board becomes one English sentence: “Dino y=93, vy=0, spd=6, ground. Obs1: CACTUS_SMALL, dist=120px, time=20f, win=[1,140]px. Action:” GLiClass scores RUN / JUMP / DUCK. Highest number wins. ~11ms a move. That’s the engine. Snake was 20k SFT and it worked. T-Rex needed more because the timing window is unforgiving. So this run was SFT → DAgger → DPO. No PPO. didn’t need it. reverse-engineered Chromium’s official `runner.js`, built a verified oracle, and cloned the expert. The journey: ❌ Zero-shot: dead in 10–20 steps. Confident. Always ducks. 📊 v1 (SFT + DAgger): 2000/2000 steps, ~30 obstacles. Then DPO on easy pairs. Loss 0.037 → 0.0017. Policy went RUN 100%. 87 steps. 0 obstacles. 20/20 deaths. It learned “don’t jump.” ✅ v2 (balanced boundary pairs + a closed-loop gate): 20/20 games. 6000 steps. 0 deaths. ~97 obstacles cleared. Same failure mode as Snake when the objective is sloppy: it takes the safe shortcut and dies. Same tech stack.. 1. Free Kaggle single T4. Same 32M GliClass edge model from Knowledgator. took 33 min to train e2e. 2. Real Chrome physics from original source. 3. A perfect expert beat PPO. Model stays local for now. Write-up and codes coming. #MachineLearning #AI #NLP #PyTorch #Kaggle #BuildInPublic #GliClass #KnowledgeGator