Ep03: Quarky Intellio Camera Features | Capture Images, Live Stream Video with ESP32-S3 | PictoBlox

Duration: 7:21 1062 transcript words EN summary

Video summary

This video introduces the advanced camera capabilities of the Intelio robot, demonstrating how it can capture images, live stream video, and perform various AI-driven tasks such as object detection, lane following, and face recognition. The tutorial begins by guiding viewers through the initial setup process, which involves powering on the device and connecting it to the PictoBlox software via a Wi-Fi router. It is important to note that this connection requires a 2.4 GHz network, and users must ensure their system's Bluetooth is enabled to successfully pair with the robot using its unique serial number. Once connected, the interface displays Intelio's powerful 5-megapixel autofocus camera, allowing users to view the real-world feed directly within the editor. The core of the demonstration focuses on utilizing PictoBlox's block coding environment to manipulate the camera's functions. Viewers learn how to activate the camera and take photos by attaching specific blocks to a "when green flag clicked" event, resulting in captured images that can be reviewed instantly. The tutorial further explores creative applications by showing how to apply various filters to these images, such as adding bunny ears or other costumes, which adds a playful element to the robot's interactions. Additionally, the video explains how to repurpose the Intelio device as a dash cam for vehicles equipped with motors and servos, enabling it to store footage on an SD card for later playback while capturing forward, backward, and side movements controlled by keyboard inputs. The true potential of the camera is unlocked when combined with machine learning models to create interactive projects like the "Howdy Robot" and the "Doorbot." In these examples, the robot uses trained models to recognize gestures or faces; for instance, waving a hand triggers the robot to wave back via a servo motor, while detecting a specific face can automatically unlock a door. The video also hints at more complex applications achievable through Python coding, such as vehicle speed detection and augmented reality games using AR markers. These projects illustrate a fundamental workflow where the camera captures visual data, analyzes it using AI extensions like speech recognition or object detection, and executes corresponding actions to bridge the gap between digital code and physical interaction. In conclusion, the video positions the Intelio robot's camera as a versatile foundation for building a wide array of creative AI and vision projects beyond simple photography. By mastering these core concepts—turning on the camera, analyzing visual input, and taking automated actions—learners are encouraged to explore additional features like speech recognition and object detection to build their own unique applications, such as a desk monitor or pet monitoring system. The presenter invites viewers to share their project ideas in the comments and promises that future episodes will delve into audio features involving microphones and speakers, ensuring that the journey into robotics and artificial intelligence continues with even more exciting possibilities.

Read the full video transcript

Hey, pretty robot. You are looking beautiful today. Can I click your picture? >> Oh, thanks. Of course, you can click my picture. Intelio not just click pictures, there's lot more. In this video, we will see how Intelio can live stream video, detect objects, [music] follows lanes, recognizes faces or gesture and so [music] on. Hey, hey. This is Avni. Welcome back to our Intelio series. I hope you're ready to see the world from Intelio's eyes. So, let's get started. Now, step [music] one, let's power on Intelio and connect to Pictoblox via Wi-Fi router method. If you are already connected via Pictoblox, so you can totally skip this step. Open Pictoblox and choose the block coding environment. Then click on board and select Intelio as a board and choose the first Wi-Fi router option. [music] Now, enter the same Wi-Fi name and password to which your laptop is connected currently. [music] And make sure your Wi-Fi is running on 2.4 GHz band as Intelio supports only 2.4 GHz [music] network. To know more about this connection method, you can obviously watch our previous video where we have explained it in more detail. Check if your system's Bluetooth is turned [music] on or not. If it is turned on, great. Now, as a next step, click on next. Do select your Intelio serial number which is next to the power switch over here. Mine is AD2A. Intelio's RGB LED will turn green as you can see [music] on Bluetooth connecting successfully. Now, its RGB LED will blink yellow while connecting. Once the connection is successful, you will see the RGB LED glow yellow >> [music] >> continuously. Then click on go to editor. Click on the camera icon over here and you can see Intelio's camera [music] view. It's an indication that we have successfully connected. Now, you are seeing Intelino's powerful 5-megapixel OV5640 autofocus camera with a wide 72° field [music] of view. It captures clear and accurate visuals, enabling your robot to truly understand and see the world around it. So, first, let's start with something super simple. Now, you can see all these are Intelino's blocks over here. Today, we will explore [music] all the camera blocks. We will use this block to turn on the camera and attach a when green flag clicked event. And this block to click a picture. Now, let's click on green flag and smile. Right, that was interesting. Now, you can check the pictures like this over here. You can also add more creativity to this program by adding filters. Like, you can see in this example, I have put a turn off camera block and turn on in the forever. >> [music] >> Then, I'm analyzing my image from the camera, and we are choosing the X and Y position to actually settle the filter. >> [music] >> And then, when the space clicked, I'm clicking the picture. All right, you can obviously choose, you know, more filters as well. >> [music] >> So, let me try. Let's click on green flag and press space. Interesting, isn't it? You can also try other filters by going to costumes and choose something else. Like, I want to choose maybe bunny ears. Okay. Let's try it once again. Press on green flag. Press space. Looks cute, right? Let's go to step two. I have made this spy car [music] with some construction blocks and two motors at the bottom, servo over here for vertical movement of spy car to increase the field of vision. And let me show you the code in brief. On the when green flag, I have put some initial blocks for the variables. And if I press W, it moves forward. If I press S, it should move backward. When I press A, it will go left. When I press D, it will go right. [music] And similarly to control the vertical movement, I am controlling the servo with these blocks. When I press 8, it goes this way. And when I press 2, it goes this way [music] and changes the angle. Now, let's see if it works. Forward. Backward. Left. [music] Right. And now, let's control the servo motor. Down. And up. Perfect. Great. Now, let's see it in action. Or you can also use Intelio as a car dash cam [music] by storing the footage on SD card and playing it whenever you want. So, this is the base for most of your AI and vision [music] projects. Selfies and videos are just the beginning. The real magic happens when we combine camera with AI and ML. Let's [music] see. Check out this howdy robot, which I have created using some construction parts and one servo motor. So, basically when I wave at him, it waves back at me. >> [music] >> Let's see. Let me explain you the code over here. When green flag clicked, it is turning on the camera. Okay, we are opening the recognition window. In the ML environment, I have trained my hand. So, whenever it detects my hand, the servo [music] will start moving. Now, similarly, if it does not detect, then it will stay at 90°. Very simple code, right? Let me show you another interesting project, doorbot. It's trained on my face. So, when it detects me, the door [music] unlocks automatically. Or a advanced project like vehicle speed detection [music] by coding in Python. And you can do many more projects like lane following, detecting objects, or just streaming like CCTV on any device to monitor your pet, or use AR markers to play exciting AR games like this. All these projects use the same core idea. Turn the camera on, analyze what it sees, and take action. If you can do these projects, you're already on your path to make many more creative AI projects. [music] Now, it's your turn to explore AI extension like speech recognition, object detection, face recognition, and build some cool projects like maybe desk monitor, or try your own idea. But, do share your ideas in the comments below. In the next video, we'll explore mic and speaker features and blocks with some exciting projects. [music] So, get ready. Things are getting more exciting from here. Make sure you like, subscribe, and hit the bell icon. Until then, happy learning.