Om Agrawal

Portfolio · 2026

I build things end-to-end and write about it.

CS at UT Austin. Researching inference systems with UTNS. Joining Anduril this summer. Trained GPT-2 from scratch on 4 A100s; writing about the stack as I learn it.

Om Agrawal
Now Researching diffusion-model inference caching at UTNS. Austin · TX

Selected work

2024 — 2026 · 13 projects
01/ Reproducing GPT-2 on 4× A100s Full reproduction of 124M GPT-2 from scratch — bfloat16, torch.compile, FlashAttention, DDP. Trained on FineWeb-Edu 10B; beats the reference eval score on HellaSwag. PyTorch · Transformers · DDP · FlashAttention 02/ Arbor A Git-like chat session manager for coding agents. Open-source MCP server + a modified mini-swe-agent for benchmarking. Python · MCP · SWE-Agent Arbor 03/ LLM Stack from First Principles Worked through Karpathy's Zero to Hero — autograd engine, MLP, batchnorm, WaveNet, char-level transformer, BPE, GPT-2. Wrote a technical blog covering each. PyTorch · Neural Nets · Transformers LLM Stack from First Principles 04/ Cornucopia AI-powered fridge inventory tracker that reduces food waste and suggests recipes from CV-detected items. 1st place + Best Use of GenAI at IEEE UT's 2025 Techathon. Python · Gemini · ESP32 · PostgreSQL Cornucopia

Recent writing

10 posts
Mar 20, 2026 Reproducing GPT-2 on 4 A100 GPUs read → Feb 21, 2026 Tokenization read → Feb 19, 2026 Building GPT read → Aug 28, 2025 Building a WaveNet-Inspired MLP Architecture read → Aug 18, 2025 Backprop on Tensors: Understanding PyTorch's Autograd Engine read →

Experience

Summer 2026
Anduril Software Engineering Intern INCOMING
2025 — present
UT Networked Systems Research Student Researcher
Designing a caching mechanism to speed up inference for video-generation diffusion models, with postdoc Saurabh Agarwal and Prof. Aditya Akella.
Summer 2025
ForeFlight Software Engineering Intern
Built a multithreaded Rust UDP client to unify networking across ~50 hardware devices, replacing disparate protocols with a single scalable solution.
Summer 2024
Federal Aviation Administration Intern, Office of Senior Technical Experts
Built an algorithm over 50M ADS-B datapoints to detect aircraft GPS "jumps"; shipped a flight-track viewer in Kepler.gl + Streamlit.
2024
UT Austin CS Course Assistant — Discrete Mathematics
Led discussion sections on prop logic, proof techniques, graph theory, asymptotics.

Get in touch