An LLM is a lossy zip file of the internet; tools and context make it useful.
Start a new chat when the topic changesOld tokens distract the model and cost slightly more to sample, so keep the context window short.
Know exactly which model and tier you are onFree gives GPT-4.0 mini, $20 per month gives GPT-4.0 with limits, $200 per month gives Pro, O1 Pro mode and deep research.
Reach for tools whenever facts are fresh or exactSearch, file upload and the Python interpreter beat the model's hazy recollection — and every citation still needs checking.
Executive SummaryAI
Andre opens a practical follow-up to his Deep Dive into LLMs video, promising examples, settings and the way he actually uses these tools in work and life.
He explains the model as a roughly one terabyte file holding about one trillion parameters, built in two stages: a costly pre-training that compresses the internet and leaves a knowledge cutoff, then post-training on human-written conversations that gives it the assistant persona.
He urges starting a new chat when the topic changes because context tokens are a precious resource, and being deliberate about tiers: the free tier serves GPT-4.0 mini, $20 per month buys Plus with 80 messages every three hours on GPT-4.0, and $200 per month buys Pro with O1 Pro mode and deep research.
Tool use is the next jump: internet search let ChatGPT, Perplexity and Grok answer when White Lotus season three airs while Claude, stuck at its April 2024 cutoff, and Gemini 2.0 Pro could not, and deep research spent about ten minutes and 27 sources writing a report on CA-AKG.
He closes with code and modalities: a Python interpreter that does the multiplications the model would otherwise hallucinate, Claude Artifacts building a flashcards app and mermaid diagrams, Cursor's Composer vibe coding a tic-tac-toe game with confetti, and voice input via Super Whisper plus true audio in advanced voice mode.
Key Quote
“I am a one terabyte zip file.”
— Andre
Key Quote
“And so think of the tokens in the context window as a precious resource.”