For centuries, the book was a difficult technology. Producing a single manuscript required months of skilled labor, such as scribes painstakingly copying letter by letter onto prepared animal skins, grounding and mixing pigments by hand, and stitching and pressing bindings. The cost of a book could rival that of a house or a plot of land. Even after the printing press was invented, the price of paper, the weight of metal type, and the economics of distribution kept books out of most people's hands for generations. Literacy was a technical skill restricted by class, wealth, gender, and access to instruction.

What made books progressively more legible to wider audiences wasn't only the printing press or smoother paper, but the slow development of margins, interlinear gaps, glosses, and marginalia––that is, the development of spaces where readers could intervene, and comment, discuss with, and possibly contest the text.

Today's large language models are in their pre-margin era. Chat windows and explanation dashboards tell users what a model did; they rarely let users work with how it did it. And while explanation are complementary, what is needed are opportunities to interpret the material of AI.

Interpretative Interfaces is an exploration of what it would look like to make engagement with an LLM's intermediate layers as fundamental to the interaction as prompting. We present a series of prototype interface designs that treat these intermediate layers as a space for engagement. The prototypes are objects to think with; proposals for what AI interfaces could become if we designed them for interpretative engagement.