Multi-step tasks that use tools
Clearly better
Work that chains actions together searching then comparing then drafting, or anything agent-shaped where the model has to decide what to do next several times before it is finished.
What supports this: both improved benchmarks are multi-step tool-use tests, so this is the one case where the gains were measured directly rather than inferred. It is also why Muse, which is built entirely out of such sequences, is the product most likely to feel the difference.
Careful reading of long documents
Measurably worse
Contracts, reports, research papers, long transcripts anything where the answer turns on a detail buried deep in the text rather than on the general gist of it.
What supports this: the independently measured drop from 83% to 79%. The practical response is not to avoid the task but to stop treating a confident summary as a reading, and to check the specific clause or figure yourself.
Ordinary chat, drafting and tidying
Probably unchanged
Rewriting a paragraph, answering a question, summarising something short. The bulk of what people actually do with an assistant on a Mac, and the part nobody publishes benchmarks about.
What supports this: no published figure, in either direction. Nothing measures everyday use, so the truthful answer is that the release probably did not change it much and that nobody has shown otherwise.
Anything built on the old behaviour
Worth re-checking
Prompts you tuned carefully, workflows that depended on the model's habits, instructions that worked because 1.2 interpreted them a particular way. A more literal model reads those differently.
What supports this: the reported shift in feel, plus the structural fact that a hosted model changes under you. If something you rely on started behaving oddly in early September, the model moving is a likelier explanation than anything you did.