It was interesting to see how weak a model Claude 4.5 Haiku is, compared with other frontier models, even inside a good harness like Claude Code.
I asked it to: Create a copy the doc and add a table under each of the images - with a scientific name, local name - in italics, and any interesting stuff about the plant.
.
Here's the chat which roughly went:
italic to i... plant-images-haiku-3.docx... and the fourth attempt got it right.
In contrast, other models / agents one-shotted it.
| Model | Output |
|---|---|
| Claude 5 Haiku | plant-images-haiku-4.docx |
| Claude 5 Opus | plant-images-opus.docx |
| GPT 5.6 Luna | plant-images-luna.docx |
| GPT 5.6 Sol | plant-images-spl.docx |