tonyw
- Joined
- Nov 19, 2026
Comments
Software factories and code reviews with Harjot Gill
Curious what things you measured internally to make the decision to switch back to Opus 5.5 from Fable? Feel like it’s hard to downgrade as a team even if cost difference is huge.
The dawn of the Data Intelligence Engineer | MotherDuck
Sure, accuracy is important, but the easier it gets to build anything the more I’d also pay for someone who knows what to build. Give an agent clean data and a good definition of churn and you can get churn by subscription tier in minutes. That’s only useful if churn by subscription tier will actually answer the question of “why”.
I get why the whole industry focused (and still focuses) on the building part (“analytics engineering”). Getting the grain right and seeing the dbt tests go green is satisfying and reasonably straightforward. You can spend a week on that, close the ticket, and chalk it up as a win even if the request was literally just somebody’s guess at what they needed from the data. LLMs now let us do that at 100x speed.
If I’m thinking about putting a team on retention for a quarter. OK, churn is worse on the basic plan. How many of those customers could we keep with a change we could ship? What would it cost? If we’d need an experiment to get a decent answer, I’d want someone to spot that before we spend a bunch of tokens on dashboards that are accurate but not useful.