Elena' s AI Blog

Lesson 3: The Neural Network

07 Jan 2026 / 7 minutes to read

Elena Daehnhardt


What is AI? Cover
Course: What is AI?
Lesson 3 of 7 42%


TL;DR: Layers of nodes pass information to make complex decisions.

The Web of Decisions ๐Ÿ•ธ๏ธ

Neural networks process information through layers

Your brain uses Neurons (brain cells). AI uses Nodes (artificial neurons). They are connected in a giant web!

Human Brain:           Artificial Neural Net:
โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”          โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚  Neuron  โ”‚          โ”‚   Node   โ”‚
โ”‚    โ—โ”€โ—   โ”‚          โ”‚    โ—โ”€โ—   โ”‚
โ”‚   โ—โ”€โ—โ”€โ—  โ”‚    VS    โ”‚   โ—โ”€โ—โ”€โ—  โ”‚
โ”‚  โ—โ”€โ—โ”€โ—โ”€โ— โ”‚          โ”‚  โ—โ”€โ—โ”€โ—โ”€โ— โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜          โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
 (Billions!)            (Millions!)

How Computers โ€œSeeโ€ ๐Ÿ‘๏ธ

Computers donโ€™t see pictures like we do. They see NUMBERS.

A black and white image is just a grid of numbers from 0 (Black) to 255 (White).

What WE see:     What AI sees:
   ๐Ÿ˜Š            โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
                 โ”‚ 255 255 255 โ”‚
                 โ”‚  0   0   0  โ”‚
                 โ”‚ 100  50 100 โ”‚
                 โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                   (Just numbers!)

Color images? Three grids! One for Red, one for Green, one for Blue!

๐ŸŽฎ Real-World Connection

When you apply a Snapchat filter, the AI reads your face as millions of numbers (pixels), finds the pattern for โ€œeyes,โ€ โ€œnose,โ€ โ€œmouth,โ€ then adds the filter perfectly! All in milliseconds! โšก

The Detective Squad (Layers) ๐Ÿ•ต๏ธ

Neural network layers work like detectives passing clues

Imagine layers of detectives passing notes to each other:

Layer 1 (Input):    Layer 2 (Hidden):    Layer 3 (Output):
    โ—โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ†’โ—โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ†’โ—
    โ—โ”€โ”€โ”€โ”           โ—โ”€โ”€โ”€โ”€โ”€โ”             โ”‚
    โ—โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ†’โ—โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ†’โ—
    โ—โ”€โ”€โ”€โ”˜           โ—โ”€โ”€โ”€โ”€โ”€โ”˜             โ”‚
                                        โ†“
                                   "It's a CAT!"

The Flow of Information:

Layer 1 (Input): Sees raw pixels โ€œI see lots of numbersโ€ฆ 255, 128, 64โ€ฆโ€

Layer 2 (Feature Detection): Finds simple patterns โ€œAha! I see a vertical line here!โ€ โ€œI see a curve there!โ€ โ€œI see a dark spot!โ€

Layer 3 (Shape Recognition): Combines patterns โ€œThese curves look like an eye!โ€ โ€œThese lines look like whiskers!โ€

Layer 4 (Output): Makes decision โ€œEyes + whiskers + pointy ears = CAT!โ€ ๐Ÿฑ

This is called Deep Learning because the network is Deep (many layers).

Simple Network:      Deep Network:
Input โ†’ Output      Input โ†’ Hidden โ†’ Hidden โ†’ Hidden โ†’ Output
   (Shallow)           (DEEP - better at complex tasks!)

Activity: Draw Your Own Neural Network! โœ๏ธ

How a neural network detects a smile

Get a piece of paper. Letโ€™s design a Smile Detector!

INPUT LAYER          HIDDEN LAYER         OUTPUT LAYER
(What AI sees)      (What it detects)    (Decision)

   โ—                     โ—                    โ—
  Eyes              Mouth shape           SMILE!
   โ—                     โ—                    
                                             โ—
   โ—                     โ—                 NOT SMILE
  Nose              Eye position
   โ—                     โ—

   โ—
  Mouth
   โ—

How it works:

  1. Input sees: Curved line at bottom of face (mouth position)
  2. Hidden layer notices: โ€œThe mouth corners are UP!โ€
  3. Output decides: โ€œThatโ€™s a SMILE!โ€ ๐Ÿ˜Š

Now imagine a straight line:

  1. Input sees: Straight line at bottom
  2. Hidden layer notices: โ€œThe mouth is FLATโ€
  3. Output decides: โ€œNOT a smileโ€ ๐Ÿ˜

๐Ÿš€ Try This Activity!

Draw different mouth shapes:

  • ๐Ÿ˜Š Smile (curve up)
  • ๐Ÿ˜ Neutral (straight)
  • โ˜น๏ธ Sad (curve down)

For each one, trace with your finger how information would flow through your network!

The Magic of Connections ๐Ÿ”—

Each arrow (connection) has a weight (importance).

Example:
โ— Eyes position โ”€โ”€(weight: 0.3)โ”€โ”€โ†’ โ— Smile Detector
โ— Mouth curve โ”€โ”€โ”€(weight: 0.9)โ”€โ”€โ†’ โ— Smile Detector

The mouth curve is 3x more important!
(0.9 vs 0.3)

During training, the AI adjusts these weights until it gets good at detecting smiles!

Why โ€œDeepโ€ is Better ๐Ÿ”๏ธ

Shallow Network (1-2 layers): Can learn simple patterns โ€œRed = Appleโ€

Deep Network (Many layers): Can learn complex patterns โ€œRed + Round + Shiny + Has Stem + Specific texture = Probably Apple (unless itโ€™s a ball!)โ€

Task Complexity:

Simple (Shallow OK):     Complex (Needs Deep):
- Is it red? โ—โ”€โ—         - Is this a cat? โ—โ”€โ—โ”€โ—โ”€โ—โ”€โ—
- Is it > 10? โ—โ”€โ—        - What emotion?  โ—โ”€โ—โ”€โ—โ”€โ—โ”€โ—
                         - Is this spam?  โ—โ”€โ—โ”€โ—โ”€โ—โ”€โ—

Real Examples:

  • Spam filter: Shallow network (just keywords)
  • Face recognition: Deep network (complex patterns)
  • Self-driving car: VERY deep network (life-or-death decisions!)

Connecting It All Together ๐Ÿงฉ

Letโ€™s see how a Neural Network recognizes a cat photo:

STEP 1: Image becomes numbers
๐Ÿฑ โ†’ [255, 200, 180, 100, ...]

STEP 2: Input layer receives numbers
[โ—โ—โ—โ—โ—...] (one node per pixel!)

STEP 3: Hidden layers find patterns
Layer 1: "I see edges and lines"
Layer 2: "These edges form shapes"
Layer 3: "These shapes look like eyes and ears"

STEP 4: Output layer decides
โ— Cat (95% confident)
โ— Dog (3% confident)
โ— Bird (2% confident)

RESULT: "I think it's a CAT!"

๐ŸŽ‰ Achievement Unlocked: Neural Navigator! Level: Intermediate (3/6 complete)

๐Ÿ“ Todayโ€™s Key Concepts

Neural Network:
- Inspired by human brain
- Made of nodes (artificial neurons)
- Connected in layers

Layers:
- Input: Receives raw data (pixels)
- Hidden: Finds patterns
- Output: Makes decision

Deep Learning:
- Many hidden layers
- Can learn complex patterns
- "Deep" = many layers

How it works:
Raw data โ†’ Input โ†’ Hidden layers โ†’ Output โ†’ Decision!

Quick Quiz ๐Ÿ“

  1. What is an artificial neuron called?
  2. What does โ€œDeepโ€ mean in Deep Learning?
  3. What does a โ€œLayerโ€ consist of?
  4. Do computers โ€œseeโ€ pictures as colors or numbers?
  5. True or False: A single neuron is smarter than a network.
Click for Answers! **Answers:** 1. **A Node** (or artificial neuron) 2. **Many layers!** (Deep = lots of hidden layers) 3. **A group of Nodes** working together at the same stage 4. **Numbers!** (Pixels are just numbers 0-255) 5. **False!** The power comes from CONNECTIONS between many nodes! **Your Score:** - 5/5: ๐ŸŒŸ Neural Network Expert! - 3-4/5: โญ Good Understanding! - 1-2/5: ๐Ÿ’ซ Review the lesson!

๐Ÿ” AI Detective Says:

โ€œWhen someone says โ€˜Deep Learning,โ€™ they just mean a neural network with LOTS of layers! The deeper it is, the more complex patterns it can learn. But it also needs more data and more time to train!โ€

๐Ÿ’ก Parent/Teacher Activity

Build a Physical Network!

  1. Get 10 pieces of paper
  2. Write โ€œINPUTโ€ on 3, โ€œHIDDENโ€ on 4, โ€œOUTPUTโ€ on 3
  3. Lay them out in layers
  4. Use string/yarn to connect them
  5. Trace a โ€œsignalโ€ flowing through!

This makes the abstract concept concrete!

๐ŸŒŸ Fun Facts About Neural Networks

  • The first neural network was created in 1958! (Called the Perceptron)
  • GPT-3 (the AI behind ChatGPT) has 175 BILLION connections!
  • Your brain has about 100 TRILLION connections!
  • A single layer can have thousands of nodes!

๐ŸŽจ Creative Challenge

Design your own detector!

  • What would a โ€œHappy Song Detectorโ€ look like?
  • What features would the hidden layers detect? (Fast tempo? Major key? Upbeat lyrics?)
  • Draw the network with your own labels!

Next up: How AI creates NEW things! Weโ€™ll explore Generative AI and learn to talk to these machines!


This post is part of the What is AI? series.

desktop bg dark

About Elena

Elena, a PhD in Computer Science, simplifies AI concepts and helps you use machine learning.

Citation
Elena Daehnhardt. (2026) 'Lesson 3: The Neural Network', daehnhardt.com, 07 January 2026. Available at: https://daehnhardt.com/courses/book_ai/03-neural-nets/
Course Library