I Shipped AI Features on .NET 10 Across 9 Production Apps — Here's the Playbook
Start with the Mental Model: LLMs Are Stateless Functions If you're a .NET developer encountering generative AI for the first time, here's the framing that clicked for me: an LLM is a very expensive, stateless function. It takes text in, breaks it into subword units called tokens, maps those tokens to high-dimensional vectors (embeddings), finds patterns, and predicts what comes next. There's no memory between calls. There's no session state. Every invocation is independent unless you provide the context. Three concepts drive everything else. First, tokens — not words, but subword fragments that govern both pricing and context limits. "Unhappiness" might consume three tokens. Second, embeddings — numerical vectors that capture semantic meaning. T