Video summary
In this episode of the Quarky Intellio series, the video introduces viewers to building a voice assistant using the Intelio device and PictoBlox block coding environment. The tutorial begins by explaining how to connect the Intelio hardware, which features an omnidirectional MEMS microphone and a high-resolution speaker, to a computer via Wi-Fi or Bluetooth. Viewers are guided through setting up the connection on the 2.4 GHz network, identifying the device's serial number, and verifying the successful link through the color changes of the RGB LED indicator before moving into the coding phase.
The core of the project focuses on developing a music player that responds to both physical buttons and voice commands. Initially, the tutorial demonstrates a simple setup where pressing specific buttons records audio for a set duration and plays it back immediately. The complexity increases as the creator integrates an SD card to store multiple songs, allowing users to play different tracks by pressing numbered buttons or using mapped keys. Subsequently, the project evolves into a voice-controlled system that utilizes speech recognition extensions to interpret commands like "play song one" or "stop," enabling hands-free interaction with the music library.
Beyond playing music, the video showcases an advanced interactive desk companion capable of holding basic conversations and responding with pre-decided answers to questions about feelings, daily activities, and favorite foods. To enhance this experience, a TFT display is added to show animated emotional reactions, making the device more engaging. The episode concludes by suggesting that these foundational skills in listening, decision-making, and responding can be expanded to create smart home IoT devices or even AI assistants similar to Alexa, while also inviting viewers to experiment with creating walkie-talkies and preparing for future projects involving cameras and ChatGPT integration.
Read the full video transcript
Have a nice day.
Can I play your favorite song?
>> Oh, yes. Play number five.
>> [bell and music]
>> Okay, until you stop.
Hey, hey everyone. This is Avni and
welcome back to our quirky Intelio
series. Today, we are exploring how
Intelio can listen, talk, play your
favorite music, and interact with voice
commands using its microphone and
speaker. So, let's get started. Intelio
is equipped with omnidirectional
>> [music]
>> MEMS microphone and a powerful
high-resolution 1 W speaker.
Now, step one. Let's power on Intelio
>> [music]
>> and connect to PictoBlox via Wi-Fi
router method.
If you are already connected via
PictoBlox, you can totally skip this
step.
Open PictoBlox and choose the block
coding environment. Then, click on board
and select Intelio as a board and choose
the first Wi-Fi router option.
Now, enter the same Wi-Fi name and
password to which your laptop is
connected currently and make sure your
Wi-Fi is running on 2.4 GHz band as
Intelio supports only 2.4 GHz network.
[music]
To know more about this connection
method, you can obviously watch our
previous video where we have explained
it in more detail.
Check if your system's Bluetooth is
turned on or not. If it is turned on,
great. [music]
Now, as the next step, click on next. Do
select your Intelio serial number which
is next to the power switch over here.
[music] Mine is AD2A.
Intelio's RGB LED will turn green as you
can see on Bluetooth connecting
successfully.
>> [music]
>> Now, its RGB LED will blink yellow while
connecting. Once the connection is
successful, you will see the RGB LED
glow yellow continuously. [music]
Then click on go to editor. So, let's
start with something super simple.
>> [music]
>> I want that when I press the left
button, it starts recording my voice for
let's say 3 seconds, and when I press
the R button, it stops recording and it
plays my recording. Okay, so let's code
[music] for that.
So, first I'm going to put when green
flag clicked as an event.
And then [music] I'm putting a forever.
Inside this we will put two if blocks.
First if block is for when [music] L
pressed, and the second if block for R
pressed.
Now, for [music] the first if block, I
am going to go to mic
and I will take this block
>> [music]
>> to start recording in a flash memory.
Then [music] I want it to play, so for
that I will go to speaker and I will
take this block to play from the flash,
which means the current memory. [music]
Now, let's try it.
I'm going to press green flag.
And now I will press the L button.
I love Intelio.
Now, let's press
>> [music]
>> R button.
>> I love Intelio.
>> Yes, it worked, right? Okay, now let's
level up by playing the songs using an
SD card. So, I have added SD card in a
card reader and I have added this five
songs [music]
in this. All right, now I want to play
them in PictoBlox. Let's see how we can
do that in coding. [music] So, as you
can see the code over here, when I press
the one button, it will play the first
song. When I press number two, it will
play the second song. When [music] I
press number three, it will play the
third song and so on. So, let me just
add the SD card
in Intelio over here.
Let's see if this works.
>> [music]
>> I'll press number one.
>> [music]
>> Okay, now to stop it, I'll press space.
Now let's play another song.
I'm pressing number three.
>> [music]
>> Space.
That was interesting, right? Now we can
also level up by mapping the buttons L
and [music] R. So if I press L button,
it will play the first song. And when I
press R button, it [music] will stop.
Let's do that.
I'm changing this event to when L button
pressed, it will play first song.
[music]
When R button pressed, it will stop the
song.
Now when I press L button, let's see.
>> [music]
>> I'll press R button now.
It stopped. [music] Interesting. Now we
can also level up by adding voice
recognition in this. For example,
[music]
if I say play song one, it will play the
first song. If I say number two, it will
play the second song. And when [music] I
say stop, it will automatically stop. So
for that, we will also have to add a
speech recognition extension in this.
Now let's check out the code over here.
As you can see, I've added speech
recognition extension,
>> [music]
>> and these are the speech recognition
extension blocks. Below that, in the
forever loop, I have added some if
conditions. When I say one, it will play
song number one. When I say number two,
it will play song number two, and so on
till five. When I say stop, it will stop
playing the song. So, let's try and
check this. I'll press the green flag.
One.
Now, I'll say stop.
>> [music]
>> Interesting, isn't it? So, this was your
voice recognized music player.
So, I have also created this interactive
desk companion, where we are using
speech recognition for some basic
[music] conversation, and which it will
reply from pre-decided responses through
speaker. So, let's see if it works. I'll
press the green flag.
>> [music]
>> How are you?
>> I'm feeling fine.
>> Great. How was your day?
>> [music]
>> It was fabulous.
>> What is your favorite food?
>> [music]
>> I love carrots.
>> Wow, that was quite interesting, right?
[music]
And oh, I have also added this TFT
display with some animation of emotions
to make it more interactive. And this
was an advanced project where Intelio
listens, understands the command, and
give controlled responses.
Now, you can also make something like
IoT house with Intelio, in which it
turns on the fan or light based on your
voice command. Fan off.
All these projects follow the same idea.
Listen, decide, and respond. If you can
do the activities from today's video,
you're already on your path to create
more innovative voice-based AI projects,
where you wouldn't need pre-recorded
responses anymore. We [music] can try
creating something like Alexa.
As an activity for you, you can try
making walkie-talkie using PictoBlox.
But, do let me know in the comments
below your project names. In the next
video, we will combine camera, mic, and
speaker to create [music] smart AI desk
companion. Spoiler alert, we will also
use ChatGPT extension in that.
>> [music]
>> So, make sure you like, subscribe, and
hit the bell icon. Until then, happy
learning.