My thoughts on the future of agent evaluation
What I’ve been learning about agent evaluation, and why I want to study memory, harnesses, and the decisions agents make on behalf of users.
Thoughts on AI, research, products, and whatever else is on my mind.
What I’ve been learning about agent evaluation, and why I want to study memory, harnesses, and the decisions agents make on behalf of users.
I learn better when I start with the hard thing, see why it matters, and work backwards into the foundations.
Started the day looking for a startup idea, ended up back in the foundations. Notes on decision processes, belief, and why perfect information can be worth nothing.
Started the day on routing evals, spent it on reinforcement learning instead. RL, observability, causal inference and alignment all seem to be the same question from different angles.
A place to track what I'm reading and building while I move from the engineering side toward research.