Skip to content
Radion Balan

Electronics, software and AI

Notes from my own projects: microcontrollers and sensors, solar and heat pumps, and language models I build from scratch to understand them.

Newest article

A laptop in a dark room, its screen showing an AI assistant that asks “What do you want to know?” above an “Ask anything” box.
NewAI & LLMsPart 1 · Diving into LLMs

Diving into LLMs, part 1: how LLMs work, explained simply

ChatGPT felt like magic, so I started building a tiny language model myself, following Andrej Karpathy's Zero to Hero course. How an LLM learns and writes, in plain words and animations: next-word prediction, gradients, training, attention and the full pipeline.

8 min read

More articles

Sections

Topics