One number, the pointwise mutual information between a line and its setup, tested on jokes, three thousand songs, four thousand Lean proofs and an EEG rig.
Talk notes: from the transistor to the LLM in three steps, the automaton, the neural network, the language model, with the links to redo everything yourself.
Notes from a talk to a panel of ethicists: why "intelligence" is the wrong word, what next-token prediction is and is not, and what a tailor-made religion would cost.
