Uncategorized

Model distillation in large language models

How a small model learns to do one job as well as a large one, what it costs, and when it is the wrong idea. Conceptual and procedural guide. Last reviewed August 2026. What this covers Distillation is the technique behind most small models that punch above their weight, and behind a large share of…

Uncategorized

Context compaction is not a compression problem

Three days ago I argued that the fix for long-context failure is to send the model less. That was right, and it was incomplete. It tells you to shrink the context. It does not tell you what to keep. The default answer to that second question has been recursive summarization. Every few turns, compress the…

Uncategorized

Lost in the Middle : Pourquoi les modèles de langage oublient et comment y remédier

Vous avez récupéré les bons documents. Vous les avez tous mis dans le prompt. Le modèle est quand même passé à côté de la réponse. Cet article explique le mécanisme derrière cet échec, et ce qu’il faut faire. En résumé : un transformeur ne traite pas toutes les positions de son entrée de la même…

Uncategorized

Lost in the Middle: Why Language Models Forget and How to Fix It

You retrieved the right documents. You put them all in the prompt. The model still missed the answer. This article explains the mechanism behind that failure “Lost in the Middle” and what to do about it. The short version: transformers do not treat all input positions equally. Recall follows a U-shaped curve. Information at the…

Uncategorized

Frameworks de développement piloté par l’IA : le pourquoi, le quoi et le comment

Un benchmark pratique de Spec Kit, OpenSpec, Superpowers, BMAD Method, GBrain, des skills de Matt Pocock, et de quelques challengers. Quelque part entre « l’IA va remplacer les développeurs » et « l’IA écrit n’importe quoi », une histoire plus discrète s’est jouée : les développeurs ont arrêté de débattre des modèles pour débattre du…

Uncategorized

AI-Driven Coding Frameworks: The Why, the What, and the How

A hands-on benchmark of Spec Kit, OpenSpec, Superpowers, BMAD Method, GBrain, Matt Pocock’s skills, and a few challengers. Somewhere between “AI will replace developers” and “AI writes garbage,” a quieter story has been playing out: developers stopped arguing about the models and started arguing about the process. In 2025 the debate was which agent to…

Uncategorized

Claude Opus 5 full review : I ran the benchmarks

HANDS-ON REVIEW  ·  26 JULY 2026 Claude Opus 5 Anthropic’s fourth model in two months arrived with a pitch that sounds modest: near-frontier intelligence at half the price. The pitch undersells it. One score in this release moved twenty-fold, on the one benchmark specifically designed to resist the tricks labs use to inflate numbers. This…

Uncategorized

CDLC : The Context Development LifeCycle

The bottleneck moved Coding agents write features now. They fix bugs, scaffold services, and open pull requests that a reviewer can plausibly approve. Whether that is a good development is a separate argument, and a real one. It is also not the argument most teams are having on a Tuesday morning. The question in front…

Artificial Intelligence

GPT-5.6: OpenAI Ships a Family, Not a Model

On July 9, OpenAI moved the GPT-5.6 family to general availability, two weeks after a limited preview. There is no single “GPT-5.6.” There are three: Sol, Terra, and Luna. If you write code for a living, this release is worth ten minutes of your attention, and a bit of skepticism. Why it matters The headline…