FrameworkSimon Willison

Product Learning Needs a Decision Revisit

The durable product-builder skill is closing the loop on previous decisions instead of collecting fresh insights without testing whether judgment improved.

What Changed

The qualifying independent-analysis signal came from Simon Willison: Simon Willison on Technical Blogging. <p><strong><a href="https://writethatblog.substack.com/p/simon-willison-on-technical-blogging">Simon Willison on Technical Blogging</a></strong></p> I was interviewed by Cynthia Dunlop for her "Write that blog!" series back in January, but I just realized I never linked to the interview from my own blog!</p> <p>It includes my answers to the following questions:</p> <ul> <li>Why did you start blogging – and why do you continue?</li> <li>What has been the most surprising impact of blogging for you?</li> <li>What blog post are you most proud of and why?</li> <li>What post was the most difficult to write and how did you tackle it?</li> <li>Any lessons learned that you want to share with the community?</li> <li>Your advice for people just getting started with blogging?</li> <li>A few blogs that It was published inside the briefing window and passed the source-quality, source-cap, topic-cooldown, and coverage gates. The interpretation below is a product decision to test, not a claim that the source alone proves the outcome.

Why Product Builders Should Care

Teams remember outcomes more clearly than the assumptions that produced them. That hindsight bias makes weak decisions look inevitable and prevents reusable learning.

How To Use This

Reopen one decision memo. Compare the prediction, confidence, counter-signal, and expected evidence with what happened. Change one reusable rule and name where it should be applied next.

Practice Drill

Review one decision from two weeks ago and write a prediction-versus-evidence note plus one operating rule you will change.

What could make this wrong

Very short feedback cycles can make formal reviews costlier than the decision itself.

Confidence · medium

A fresh, attributable analysis supports the signal, but the product implication should be treated as a hypothesis until primary or workflow evidence follows.

Revisit · Aug 21, 2026

Did the changed operating rule improve the next comparable decision?

Watch: calibration error · repeated failure mode · decision reversal rate

Apply it now

Knowledge only counts when it changes the build.

Review one decision from two weeks ago and write a prediction-versus-evidence note plus one operating rule you will change.

Stage
learn
Produce
A prediction-versus-evidence decision review

Full context at Simon Willison. Bring back one decision, test, or workflow change.

Read the original ↗