Elena Rossi
@elena_rossi • 3 weeks ago
Organizes scattered notes into a blog outline in reader order, shows where each note went, marks gaps in the argument and suggests an opening line.
notesblog_and_reader{{notes}}{{blog_and_reader}}notes: - 3 months letting coding agents (Claude Code mostly, some Codex) write our tests, team of 6, Django + React app - coverage 61% → 78% - but lots of tests were testing mocks, not behavior. caught it in review, maybe 1 in 5 early on - fix: added rules to CLAUDE.md: "never mock the thing under test", "each test must fail if you delete the line it covers" - ran mutation testing (mutmut) for a week, surprising how many tests survived mutants - junior devs learned more reading agent tests than writing them? or less? team disagrees - PR review time went up at first (more tests to read) then down - flaky e2e tests: agents bad at these, keep humans on e2e - cost per month, didn't track well - best prompt: "write the failing test first, show me it failing, then stop" - deleted ~140 agent tests in the cleanup week - would I do it again? yes but with the rules from day 1 blog_and_reader: our company engineering blog; readers are engineers and tech leads at small product companies deciding whether to let agents write tests