Upper Elementary

Computer Science

Machine Learning: Face Sensing

Students will be able to use Face Sensing blocks to explore machine learning in Scratch Lab.

Objective

Data: A collection of information gathered by observations, questions, or measurements

Vocabulary

Artificial Intelligence (AI): the imitation or mimicking of human intelligence by machines, especially computers

Vocabulary

Machine Learning: a part of AI that focuses on the use of data and algorithms to imitate the way that humans learn, gradually improving its accuracy

Vocabulary

Artificial Intelligence or AI is the ability of a computer program or a machine to learn. AI mimics human cognition (reasoning, memory, thinking or problem-solving skills.)

What is Artificial Intelligence?

• You can create projects that respond to different parts of your face.
• These blocks can sense human faces, pet faces, hand-drawn faces, and even stuffed animal faces.

Let’s explore Face Sensing blocks!

• Face Sensing blocks use your webcam to see your face.
• They learned about faces from lots of pictures.
• They can find your eyes, nose, ears, and mouth.

How do Face Sensing blocks work?

Let's dive deeper into how machines "learn" to recognize faces!

• Machine learning is a type of AI. It helps computers recognize patterns, like faces, by learning from lots of examples.
• Face-sensing technologies are used in many popular apps and social media platforms.

How do they use Machine Learning?

You will add accessories to your face and use the Face Sensing blocks to program the accessories to follow your face when you move.

Here is what we’ll make today!

It works best seeing faces that are brightly lit and close to the camera.

Move Scratch Cat off of your face.

Open the Scratch Lab Face Sensing site.

Choose a sprite that you can ‘wear’ on your face or head.

Add a sprite from the fashion tab.

Many sprites have several costumes to choose from.

Select the costume for the sprite.

The block is sensing the size of your face. What happens if you move closer and click it again?

Resize the sprite to your face size.

The block is sensing the location of your face. What happens if you move to the side?

Choose the location of your sprite looks best.

Move the sprite to the best location.

Now what happens if you move to the side?

​

What happens if you move back?

Add a “forever” loop to the program.

What happens if you move your head outside of the camera’s view and back again?

Make your program run when a face is detected.

What happens if you tilt your head to the left?

​

What happens if you tilt your head to the right?

Change the direction of the sprite.

What happens when your ear touches the cat sprite?

Program the cat sprite to meow.

1. Choose a sprite that you can ‘wear’ on your face or head.

​

• Resize the sprite to your face size.

​

• Move the sprite to the best location.

​

• Change the direction of the sprite.

​

• Add a “forever loop” to the program.

​

• Make your program run when a face is detected.

Add and program a new fashion sprite.

• Test your program with a drawn face.
• Continue exploring the Face Sensing blocks and use them to build a game.

If you have more time…