- theory
- math
- applied
- code
- philosophy
- external-services
•
•
•
•
•
-
Representation Analysis, A Reading Path
Eleven years of geometric thinking about embedding spaces, distilled into eight papers. From Mikolov's linear analogies (2013) to Bricken et al.'s sparse autoencoders (2023), discover, fix, diagnose, exploit. The throughline is one conjecture refined over a decade, high-level concepts are encoded as directions in representation space.
-
Model2Vec, A Static-Embedding Distillation Algorithm, Explained
How to compress a sentence-transformer into a static lookup table that runs on CPU in three lines of NumPy. A re-implementation guide covering the full pipeline, vocab prep, per-token forward, PCA whitening, SIF/Zipf weighting, optional vocab quantization, and dtype quantization, with a ~80-line reference implementation.
-
Agentic AI - From Symbolic Planning to Autonomous Software Engineers
Three decades of teaching machines to act. From STRIPS and BDI, through ReAct and Toolformer, to GRPO-trained agents solving real GitHub issues at superhuman rates. Covers the full lineage of agentic harnesses, tool-use training, end-to-end RL, and the MCP era. Includes open problems and portfolio projects.
-
Personal Identity Problem and Mutability Immutability - Engineers Are Philosophers in Reverse
The personal identity problem asks whether something remains the same after it changes. Philosophers have long debated this through famous examples like the Ship of Theseus. In programming, mutability and immutability echo the same question - when something changes, is it still the same object? Software engineers unknowingly reinvent the personal identity problem each time they design systems.
-
Why Python is Irreplaceable for Data Science, AI, and Automation - a Design Perspective
Python is currently the most popular programming language for machine learning and data science. In this post, I will share my subjective experience on why I've stuck with Python for the last 3 years, and why I think Python's design is the future (for general purposes, not only AI, Data Science, and Automation).