What Automation Can and Cannot Catch
Know the roughly 30 percent ceiling of tooling.
What Automation Can and Cannot Catch is a free Web Accessibility Academy lesson on CoddyKit — lesson 1 of 4. You can read the complete lesson below for free — then practise it hands-on in the browser with a built-in code editor and a 24/7 AI tutor. It is part of the Web Accessibility Academy learning path, one of 4 lessons in the course, and your progress syncs across the web and the CoddyKit app.
Automation Is a Helper, Not a Judge
Automated tools scan your page and flag likely problems in seconds. They are a powerful first pass, but they cannot tell you if a page truly works for real people.
The Famous 30 Percent Ceiling
Studies suggest automated tools catch only around 30 percent of accessibility issues. The other seventy percent still need a human to find them.
What Machines Are Great At
Tools excel at mechanical checks: missing alt attributes, empty buttons, low contrast ratios, and duplicate id values. These rules are easy to verify with code.
A Rule a Tool Can Check
An image with no alt attribute is a clear, machine-detectable miss. A scanner flags this instantly because the rule is simply yes or no.
<img src="chart.png">What Machines Cannot Judge
A tool sees that alt text exists, but not whether it is meaningful. The word image as alt passes the check yet helps no one.
<img src="chart.png" alt="image">Meaning Needs a Human
Is the link text clear out of context? Is the reading order logical? Does the error message actually help? These judgments need a person.
False Positives Happen
Sometimes a tool flags something that is actually fine. Treat each result as a question to investigate, not an automatic verdict of failure.
False Negatives Are Worse
A green score does not mean accessible. A page can pass every automated rule and still be a maze for a keyboard or screen reader user.
The Right Mental Model
Think of automation as a spell checker. It catches obvious typos fast, but it never tells you whether your writing is any good.
Where Automation Pays Off
Its real superpower is speed at scale. Run it on every commit and it guards thousands of pages against the easy regressions humans miss.
The Winning Combination
The best strategy pairs automation with manual testing: let tools clear the low-hanging fruit so your human time goes to the hard, high-value checks.
Quick Check
Think about what a scanner can really verify.
Recap: Trust, but Verify
Automation finds the easy wins fast but tops out near thirty percent. Pair it with human testing, and never mistake a passing score for an accessible page. 🤝
Frequently asked questions
Is the “What Automation Can and Cannot Catch” lesson free?
Yes — the full text of “What Automation Can and Cannot Catch” is free to read here on the web, and the Web Accessibility Academy course includes 4 lessons in total. To practise it interactively (a built-in code editor and a 24/7 AI tutor) and unlock the rest of the Web Accessibility Academy course, upgrade to CoddyKit PRO.
What will I learn in “What Automation Can and Cannot Catch”?
Know the roughly 30 percent ceiling of tooling. You practise Web Accessibility Academy with hands-on code you run directly in the browser, and a 24/7 AI tutor answers your questions as you work through the lesson.
Do I need any experience to start Web Accessibility Academy?
No prior experience is required. Web Accessibility Academy on CoddyKit is structured for beginners through advanced learners; this is — lesson 1 of 4, so you can start here or from the beginning and move at your own pace.
How long does the “What Automation Can and Cannot Catch” lesson take?
Most CoddyKit lessons take about 5–10 minutes. Each one is bite-sized and interactive, so you make steady progress and pick up exactly where you left off across the web and the app.
Can I write and run code in this Web Accessibility Academy lesson?
Yes. Every Web Accessibility Academy lesson includes a built-in code editor, so you write and run real code right in your browser and get instant AI feedback — no local setup required.
All lessons in this course
- What Automation Can and Cannot Catch
- Scanning With axe DevTools and Lighthouse
- Wiring axe-core Into Playwright Tests
- Linting and CI Gates for Accessibility