The XOR Problem: Why One Neuron Isn't Enough
The limit that demands hidden layers.
The XOR Problem: Why One Neuron Isn't Enough is a free Deep Learning Academy lesson on CoddyKit — lesson 4 of 4. You can read the complete lesson below for free — then practise it hands-on in the browser with a built-in code editor and a 24/7 AI tutor. It is part of the Deep Learning Academy learning path, one of 4 lessons in the course, and your progress syncs across the web and the CoddyKit app.
Meet XOR
The XOR rule outputs 1 when exactly one input is 1, and 0 otherwise. It looks simple, yet it broke early neural networks. 🤔
The XOR Truth Table
XOR gives 0 for (0,0) and (1,1), but 1 for (0,1) and (1,0). The matching pairs say no, the mismatched pairs say yes.
Plot the Four Points
Place the four inputs on a grid. The two yes points sit on opposite corners, with the no points filling the other two.
No Single Line Works
Try to split the yes corners from the no corners with one straight line. You simply cannot do it. The classes interlock diagonally.
Not Linearly Separable
XOR is the classic example of data that is not linearly separable. A single neuron, limited to a straight boundary, can never solve it.
The Perceptron Stalls
Train a perceptron on XOR and it never converges. The weights keep wobbling because no line satisfies all four examples at once.
A Historic Roadblock
This XOR limit, exposed in 1969, helped trigger an AI winter. People doubted neural nets could ever handle hard problems.
Add a Hidden Layer
The fix is to stack neurons. A hidden layer lets the network combine several lines into a more complex shape.
Bend the Boundary
With a hidden layer plus nonlinearity, the network can bend its boundary. Now it wraps around the yes corners and ignores the no ones.
Two Neurons Solve It
Just two hidden neurons feeding one output neuron can crack XOR. Each hidden unit draws a line, and the output combines them.
Why Depth Matters
XOR is the smallest proof that depth matters. Stacking layers is what lets networks learn curves, corners, and real-world complexity.
Quick Check
Recall why XOR defeats a single neuron.
Recap
XOR is not linearly separable, so one neuron fails. Adding a hidden layer lets the network bend its boundary and solve it. Depth unlocks power. 🚀
Frequently asked questions
Is the “The XOR Problem: Why One Neuron Isn't Enough” lesson free?
Yes — the full text of “The XOR Problem: Why One Neuron Isn't Enough” is free to read here on the web, and the Deep Learning Academy course includes 4 lessons in total. To practise it interactively (a built-in code editor and a 24/7 AI tutor) and unlock the rest of the Deep Learning Academy course, upgrade to CoddyKit PRO.
What will I learn in “The XOR Problem: Why One Neuron Isn't Enough”?
The limit that demands hidden layers. You practise Deep Learning Academy with hands-on code you run directly in the browser, and a 24/7 AI tutor answers your questions as you work through the lesson.
Do I need any experience to start Deep Learning Academy?
No prior experience is required. Deep Learning Academy on CoddyKit is structured for beginners through advanced learners; this is — lesson 4 of 4, so you can start here or from the beginning and move at your own pace.
How long does the “The XOR Problem: Why One Neuron Isn't Enough” lesson take?
Most CoddyKit lessons take about 5–10 minutes. Each one is bite-sized and interactive, so you make steady progress and pick up exactly where you left off across the web and the app.
Can I write and run code in this Deep Learning Academy lesson?
Yes. Every Deep Learning Academy lesson includes a built-in code editor, so you write and run real code right in your browser and get instant AI feedback — no local setup required.
All lessons in this course
- Weights, Bias & the Weighted Sum
- The Step Function & Linear Decisions
- Code a Perceptron from Scratch
- The XOR Problem: Why One Neuron Isn't Enough