What to ask
Six questions that decide whether a coding agent is any good
Take these to Meta’s documentation when Muse Code is specified, or to any other coding agent you are weighing up today. They outrank benchmark scores, and the first one outranks the other five.
Does it edit your files, or propose a diff?
The single most consequential design choice in the category. An agent that writes directly into your working tree can be genuinely faster; an agent that proposes a change for you to accept puts a human between a misunderstanding and your code.
Why it comes first: it determines the blast radius of every other failure. Everything else on this list is a quality question; this one is a safety question.
Can it run your tests, and does it act on the result?
There is a large difference between an agent that writes code and one that writes code, runs the suite, sees a failure and fixes it. The second is a qualitatively different tool.
Why it matters: this is the feature that uses the oracle your repository already provides. Without it you are the test runner, and most of the promised time saving goes back into your afternoon.
What is its unit of work?
Completing a line, rewriting a function, or making a change that spans a dozen files and a migration are three different products that get described with the same words. Ask which one it actually does well.
Why it matters: the failure modes scale with the unit. A wrong line is obvious; a wrong change across twelve files is where drift hides.
How much of the repository can it see?
The open file, the files you name, or the project as a whole including the conventions, the helper that already does this, and the reason the odd-looking line is odd.
Why it matters: most unhelpful output from coding tools is not wrong so much as ignorant of context that existed three directories away. A large context window is not the same as having read your codebase.
What does it do when it is unsure?
Ask for the behaviour, not the marketing: does it stop and ask, flag the assumption in the diff, or quietly pick the most plausible option and carry on?
Why it matters: silent guessing is the dominant failure across every agent this site has looked at, and in code it arrives dressed as a clean, readable change that does the wrong thing.
Where does your code go, and for how long?
Whether source is sent off the machine, how long it is kept, whether it trains anything, and what that means for work under a client agreement or an employer’s policy.
Why it matters: it is the question developers skip and the one an employer cares about most. For commercial work the answer belongs in writing from the provider, not in a summary from anybody else including us.
None of these can be answered for Muse Code from public material today. That is the honest reason they are framed as questions rather than as a review.