Flutterby™! (short)

Evaluating AGENTS.md: Are Repository-Level Context Files Helpful for Coding Agents?

Surprisingly, we find that providing context files does not generally improve task success rates, while increasing inference cost by over 20% on average. This observation holds across different LLMs, coding agents, and for both LLM-generated and developercommitted context files. Specifically, we find that while instructions in the context files are well followed by coding agents, repository overviews, although popular and recommended by model providers, are not helpful. We conclude that while context files are useful for specifying non-standard coding practices, any attempts to improve performance should be rigorously evaluated before deployment.

Last night Charlene and I went to Evie Ladin calling Traditional square dances, with a mix of circles and longways, at Tara Firma. Lots I'm thinking about, but "this is how they used to do Tinder" is probably not a vibe I can bring to a Modern Western Square Dance club night.

At a celebration of life for J. Alistair Hamilton, mariner, and neighborhood character. Sailed with the Rainbow Warrior, among other adventures.

And owner of this amazing sextant.