ICT | Artificial Intelligence and Machine Learning Prep Guide (for tutors) | Train/Test Split, Confusion Matrix, Overfitting
- 2026-11-19
Students hear 90 percent accuracy and assume the model is good, without asking how many positives the test set holds or whether answering no to everything already scores 85 percent. This lesson turns machine learning into three repeatable moves: split the data, read the four cells, then ask whether the model is cheating.
01 Prerequisites (3-minute check)
If any of these fails, fix it before the lesson starts.
| Skill | Quick check | Pass mark |
|---|---|---|
| Percentages and fractions | What percentage is 170 out of 200 | 85 percent; divide then multiply by 100 |
| Bits and bytes | Twenty-eight by twenty-eight pixels at one byte each, how many bytes | 784 bytes |
| Averages | Mean of the losses 0.64, 0.32, 0.16 and 0.08 | 0.30 |
02 Lesson flow (60 minutes)
| Time | Stage | Tutor does | Student does |
|---|---|---|---|
| 0-6 min | Opening diagnostic | Ask whether 90 percent accuracy means a good model | Each writes one reason, class compares |
| 6-18 min | Splitting the data | Show 1,000 samples split into 800 and 200; the test set is seen once | Split a set and write both numbers |
| 18-32 min | The four cells | Fill the spam example and compute all four metrics | Recompute the same four metrics |
| 32-44 min | Baseline and metric trade-offs | Show that always answering not-spam scores 85 percent | Compare accuracy and recall of two models |
| 44-54 min | Overfitting and data bias | Show 0.98 train and 0.72 test, a 26 point gap | Decide which model overfits |
| 54-60 min | Exit check | Collect two questions and mark them, naming the faulty cell or formula | Work independently |
03 Teaching script (read it out)
Scene 1: Step one is always the split, and the test set is seen once
Students do: split 1,000 samples 80/20 and write both counts.
Students explain: why the test set cannot be watched during training.
Students repeat: training tunes parameters, the test set is reported once.
Scene 2: The confusion matrix: fill the cells first, then compute
Students do: derive accuracy 0.89, precision 0.60 and recall 0.80 from the cells.
Students explain: why precision and recall pull in opposite directions.
Students repeat: the four cells sum to the total; precision watches false positives, recall watches false negatives.
Scene 3: Baseline, overfitting and bias: ask whether the model is cheating
Students do: compute the accuracy and recall of the all-majority baseline.
Students explain: what a 26 point train-test gap tells you.
Students repeat: check the baseline, then the overfitting gap, then bias and cost.
04 Question types and worked steps
| Type | Example | Steps | Answer |
|---|---|---|---|
| Train/test split | 1,000 samples at 80/20 | Multiply by the ratio and state both counts | 800 and 200 |
| Confusion matrix | 30 positives, 40 flagged, 24 true positives | Fill all four cells so they sum to the total | TP 24, FP 16, FN 6, TN 154 |
| Metrics | Same four cells | Accuracy (TP+TN)/N, precision TP/(TP+FP), recall TP/(TP+FN), F1 harmonic mean | 0.89 / 0.60 / 0.80 / 0.686 |
| Baseline and overfitting | All-majority guess; 0.98 train vs 0.72 test | Compute the majority share, then the gap | 0.85 with zero recall; gap 26 points |
05 Independent practice (3 questions)
| Question | Answer | What to watch | |
|---|---|---|---|
| Split | 2,000 samples at 90/10 | Check both counts are written | 1,800 and 200 |
| Precision | TP 18, FP 6 | Check the denominator is TP+FP | 0.75 |
| Recall | TP 18, FN 12 | Check the denominator is TP+FN | 0.60 |
06 Common mistakes and what to say
| Mistake | Student writes | Say this |
|---|---|---|
| Reporting accuracy on the training set | Writes 98 percent accuracy over 1,000 samples | The test set is seen once; state which batch you are reporting. |
| Cells that do not sum to the total | Writes TP 24, FP 16, FN 12, TN 154 | That is 206 out of 200; get false negatives from 30 minus 24. |
| Swapping precision and recall | Writes precision 0.8 and recall 0.6 | Precision asks how many flagged are real (24/40); recall asks how many real ones were caught (24/30). |
| Accepting a high accuracy | Writes 90 percent accuracy, ship it | Compute the all-majority baseline first, then recall; a model that catches no positives is useless. |
07 Homework (paper, section and question numbers)
- ICT chapter index — Every chapter in this subject
- All prep guides — Matching chapters in other subjects
- Redo this chapter — Practice questions 1 to 3: split, precision, recall
08 Exit check (last 5 minutes)
| Question | Answer | Decision |
|---|---|---|
| Split | Train tunes, test reports once | Wrong roles mean repeating act one |
| Confusion matrix | Cells sum to the total | A wrong sum means two more cells to fill |
| Metrics | Precision watches FP, recall watches FN | Swapped means one extra computation |
09 Tutor FAQ
What if the class has no probability yet
Avoid symbols entirely; every metric is counting cells divided by a total, and the confusion matrix is just counting.
Should formulas be derived
No. Require students to write the four cells and two divisions; that is enough at this level.
Can this be taught without computers
Yes. Paper cells and a calculator carry the whole lesson; the goal is the meaning of the metrics, not code.
Find a tutor — freeTutor Registration →
A TutorZone lesson-prep guide. Written by the TutorZone team; questions and lesson flow are original and are not taken from any school or publisher material.



