Submind YouTube summaries
Thumbnail for Ask the Experts  Helping Blinded Veterans Get the Most out of Their Ray Ban Meta Glasses

Ask the Experts Helping Blinded Veterans Get the Most out of Their Ray Ban Meta Glasses

Watch on YouTube

Video summary

This session, hosted by TechSoup and the Blinded Veterans Association, brings together Meta representatives and BVA leaders to guide blinded veterans in maximizing the utility of their Ray-Ban Meta glasses. The presentation begins with essential setup instructions, noting that the glasses arrive fully charged but require users to remove protective plastic tabs from the arms and case before charging or pairing via Bluetooth. While a USB-C cable is not included, users must provide their own charger or battery pack. To connect the device, an iPhone running iOS 11 or later, or an Android device with the free Meta AI app installed, is required along with a Meta account linked through Facebook, Instagram, email, or phone number. For visually impaired users navigating this process, accessibility tools like VoiceOver on iPhone and TalkBack on Android are crucial, alongside magnification features to view screens during setup. Once configured, the glasses offer a range of hardware controls and software capabilities designed for hands-free interaction. Key features include a power switch on the left arm, an eye-tracking camera at the top right frame, and a touch panel on the right arm that manages volume, audio playback, and calls with simple taps. Users can customize their audio experience by adjusting voice speed or selecting different voices to accommodate hearing needs, while keeping firmware updated unlocks advanced features like "detailed responses" for richer environmental descriptions. Specific commands allow users to ask the device to look around and describe surroundings, read documents or greeting cards, locate specific places like smoothie stands at airports, and control music from services such as Apple Music, Spotify, and iHeartRadio. Additional technologies like Live Translation enable real-time language conversion, and Conversation Focus filters background noise to isolate speakers in loud environments. Beyond standard functions, the glasses integrate with third-party visual interpretation services that significantly expand their utility for daily tasks. Services like Be My Eyes, which is free, and Aira allow volunteers or professionals to view through the user's camera to assist with reading furniture assembly instructions or describing the printed world. The speakers emphasize that there is no fixed list of commands; instead, users can ask almost anything, often discovering capabilities beyond their initial expectations. For those seeking more information, basic command resources are available on the Blind Veterans Australia website under their programs and resources section. The session concludes by acknowledging partners such as Scribe Me, Orion, and Microsoft's Seeing AI, and invites the public to an upcoming accessible webinar hosted by BVA on August 31st at 3:00 PM Eastern Standard Time.
Read the full video transcript
Hi everyone, and welcome. I'm Jackie from TechSoup. Thank you so much for joining us today. This session is an overview and interactive Q&A for blinded veterans designed to help you get the most out of your Ray-Ban Meta glasses. So, whether you've had yours for a while or you're still getting familiar with them, this is your chance to ask questions on setup and use and get practical answers. We're joined by Katie and Gus from Meta first, followed by the team at Blinded Veterans Association. So, between the two, you've got both deep product knowledge and lived experience in the room with you. And with that, I'll pass it over to Katie from Meta. Take it away, Katie. >> Hi everybody. It is so great to get to meet/see everybody on this call. My name is Katie Jordan and I'm at Meta, where I am leading our program to deliver 130,000 Ray-Ban Meta glasses to blinded veterans in the US. So, I am so excited to be chatting with y'all today um and just incredibly grateful to our partners over at the BVA and at TechSoup. And with that, I'll turn it over to my colleague Gus, who's the director of design prototyping for accessibility and a long-time champion of this work internally. >> Thanks for the kind intro, Katie. Uh yeah, I'm Gus. Uh um I've been working with uh designing and and building uh AI devices and glasses at Meta for the past 7 and 1/2 years. Um this is a topic that's near and dear to my heart. I have low vision, my mom's blind, and uh a lot of veterans in my family as well. My grandfather was US Air Force and uncle was US Army. Um and uh I'm here to help answer any questions you have about the product and hopefully help them become as useful as possible for y'all. And with that, I'll hand it back to Jackie. Thank you. >> Thanks, Gus. Uh very helpful. Next, I'll hand it over to our friends at the Blinded Veterans Association to kick things off. Take it away, Leah and Dominique. >> Hi everybody. My name is Leah Rome, the National Executive Director with the Blinded Veterans Association and we are very excited to kind of do a walk-through of the glasses this morning to kind of show the highlighting and tactile descriptions of the device itself and walk you through the pairing process. BVA is here to support you. If you have any questions, we are more than glad to answer them. You can either put them in the chat um and we can answer them at the end. So, that way we can be able to follow it from start to finish throughout that process. Additionally, on bva.org underneath programs, underneath resources, there is additional training guides and in the future we will have videos as well so that you can be able to reference specific points of the start setup process so that you're not trying to go through an entire manual to get that one question asked. Additionally, if you are needing additional follow-up, you can join our other Q&A sessions that are on the BVA calendar. At this time, I'd like to pass it off to Ms. Dominique Lawless who is our National Program Director with the Blinded Veterans Association. >> Hi everybody. It is so great to be with you today. Leah, can you guys hear me okay? >> We can. >> Perfect. All right. So, I know some of you have had your Meta glasses for a little while and some you might have just got them in the mail. So, I think that we should go over how to set up the glasses and some of the basic commands that we can use. I'm blind. I've had my Meta glasses for about two years and I kind of push the limits on them every day to find out new things that they can do. So, I'm excited to get you started with your pair of Meta glasses. So, when you receive them, they are going to come in just a regular box that has the Ray-Ban Meta logo on them and the easiest way, although not the prettiest way, is to feel for like a perforated tab on the long flat edge of the box and pull that open. And once you do that, the box kind of you know, just unfolds like a piece of paper. And so, you can easily take out the glasses. These are the Gen 1 Wayfarers. And um most of the glasses that we are distributing have a transition lens. So, they're going to stay clear when you're inside, and then when you go outdoors, they're going to get a little bit darker. Um these glasses are fully charged. Please note that um unfortunately, a USB-C cable does not come included in the package. So, that's something you'll need to provide for yourself. But, a lot of the newer iPhones and Androids have those um as you know, as chargers. So, I'm I'm sure you'll have one floating around the house. If not, an external battery pack will do as well. Um but these are nice and charged. Um so, we are going to go ahead and explore the case first. So, if you are holding your case, you're going to feel the opening to that and have that face you. And if you notice, that kind of opens up like an envelope does. So, if we open it up, we'll feel that the glasses are in the case with the lenses facing out. And there's only one way to put them back in the case, and that's again with the lenses facing you. Um otherwise, they will not charge. And uh we don't want to damage them by forcing them in a way that they're not going to fit. So, when we close the case, if you notice, there is uh what feels like a button. That is actually an indicator. One to make sure the case is closed, but two to make sure that it's charging. So, um I tell people, you know, if it's red, it's dead. If it's green, it's good to go. Um so, we want to make sure that that color is green. Um otherwise, you will need to charge your case. Uh reminder that the glasses are charged by the case, but the case itself actually needs to be charged from time to time as well. If we >> Yes, ma'am. >> Just out of curiosity, if I'm charging my device and it seems like it's not connected, is there anything in the device or inside the case that might be preventing that from taking place? >> Absolutely. So, when you get your glasses and you open the box, the arms of the glasses are going to have kind of a protective wrapping. You want to take those off, but also if you feel inside the case, there's almost going to be like a clip um where the glasses are housed securely, and there's going to be a piece of plastic, like a tab, that you're going to want to gently pull out because that's what's going to allow you to Bluetooth pair the glasses as well as to charge the glasses themselves. So, yes, that is a great point. Thank you. Um if we turn the case over to the smooth flat side, towards the bottom, you will feel a round button. This doesn't protrude a lot, um but it is textured, so hopefully you'll be able to feel it. Um and in most cases, this is what we're going to press to pair the device. Um sometimes they come ready to go, uh and are you don't have to press the button, but for most of the glasses, you're going to press the button on the back until the button on the front turns blue. Um and then if we go to the bottom of the case, you'll feel where that USB-C charging port is. All right. So, let's jump into pairing because that is the part that um you know, it's a little bit it's it's fairly easy, um but sometimes we ink you know, encounter some troubleshooting areas from time to time. >> Miss Monique, >> Yes, ma'am. >> What am I pairing the glasses to? >> That is a great question. So, in order for the glasses to function um as they are intended, you're going to need an Android or an iPhone. I'm going to be using an iPhone today to demonstrate this, but um you want to make sure that you are using an iPhone that has a version that is supported by Meta. Um so, that way you can receive their app updates. So, I'd say anything, you know, 11 or higher if you're using an iPhone and I am not familiar enough with Android to to advise you on the operating system, but you at least want to have an iPhone or an Android um to be able to pair the device. >> And what particular software am I needing to download in order to pair this particular device? >> I was going for that next. Um so, you want to download the Meta AI app. Um so, if you go into your app store or your Google Play Store, um you are going to type in m e t a space a i and that should bring up an app that is free. There are no purchases necessary for the app to download. Um and if you have someone who can see the icon of the app, it then Meta folks, correct me if I'm wrong, uh but it should be a white background with a bluish purplish circle on the front, but it says uh Meta AI. And once you have that downloaded, what uh you need to do is to have a Meta account that can be associated with your glasses. And so, this could be a Facebook account, an Instagram account, a WhatsApp account, or you can create a Meta account using your email or mobile phone number. Um it's easiest if you already have a Facebook or Instagram account and it's they just need it for account creation purposes, not to actually post what you're using the glasses for on Facebook. So, you're uh protected in that way because, you know, no one's no one on your feed is is seeing how you use the glasses, but it's just helpful to have one of those accounts or to create one using um a mobile number or an email. In this case, I already have a Meta account linked um on the on the AI app and so, we are going to go to add um to add a new device. So, I'm already >> Siri 001 >> I'm a voice over user. Um so, you may hear that in the background. Um so, what I'm going to do is there's already a picture of glasses on my screen and I'm going to swipe until I hear add device. And I'm going to activate that link. And then on the screen the first thing that comes up is Wayfarer, but it already detects the glasses that are close to me. So, I'm going to go ahead and press connect. And it says that it's pairing. I'm keeping my glasses nearby and we're just waiting for it to finish pairing. It is still pairing the glasses right now. Um so this sometimes can be a tricky part if we're at group events and we have lots of meta glasses that need to be paired at the same time. But if you're, you know, in your own home where there's only one or two pairs of Ray-Ban meta glasses, then your your right serial number and right pair of glasses should pop up after um after you start the pairing process. Do we have any questions so far? All right. So, I got a notification that said a device would like to pair with my phone. And we're going to press the pair button. A notification that said could not pair glasses and this happens from time to time, so we're going to make sure that I've pressed that button on the back. That's going to turn the light blue and we're going to try pairing again. And hopefully this will go a little bit faster. All right. So, when you initially pair your glasses, it's going to give you an onboarding tutorial. Um this can be helpful. It shows you the different spots on the glasses that are touch panel, where the capture button is, different things you can say like that. I'm going to press skip on this for now because I'm actually going to give you the tutorial. So, unless Leah you want me to go through the tutorial. >> No, I I think you're doing a great job, Don. >> All right. So, what it's it's going to bring you to a dialogue box next that tells you about meta AI and asks if you want it to to be turned on. We are going to You can read through all that. Essentially, it tells you what Meta AI does. We're going to press continue because we definitely want to use the Meta AI feature in this. So, it gives you the opportunity as well to connect your apps to this. So, especially for music, if you use Apple Music, Spotify, Amazon Music, you can actually, I think, connect iHeart Radio to it as well. Um, but there is an opportunity for you to connect your music so that way you can say things like, you know, "Hey Meta, play jazz." Or, "Hey Meta, play Dolly Parton music." Um, and we can listen to our music and control what we're playing from our glasses specifically. So, I'm actually going to press connect and connect this to my music. I'm going to play connect Apple Music. So, it's just asking me if I want to connect everything. It's always double-checking that there are permissions granted. And we're going to press allow. And then it shows in this panel of settings that it is connected and gives you an option to disconnect if you so choose. All right. So, we now have the option to connect phone calls and text messaging to this as well, which is what I like to get a lot of folks set up with, if they ask. So, what you need to do for this once you hit the connect button is you actually need to pull out the glasses and have them open. Um, and I'm going to put them on so that way I can hear voiceover. And so, it's giving you instructions. So, I need to go to my Bluetooth settings and find, um, my Ray-Ban Meta glasses and make sure that I can sync contacts and hear who's sending me a text message. So, we're going to go over to our Bluetooth settings. All right, so we're in iPhone Bluetooth settings and I'm going to click on more info under the right meta glasses. And I'm going to allow message notifications. So this means that my meta glasses will say, I have a message from Leah Roe. Would I like to hear it or respond? And I can choose what I want to do with that message. I'm also going to activate sync contacts. So on the screen both of those are that those toggle switches are on. Um and now I am going to go back to the meta AI app and press continue. And I have to decide if I want to allow full contact or if I want to limit those contacts. So I'm going to allow full contact access. And so in contacts access in your settings, I'm going to allow access to all contacts and apparently I've increased my number of contacts to over 700. So this could take a minute. Um but we are going to press the button that says allow full access. So now we're going to go back to meta and it brings us to the settings that say, you know, just your meta AI settings. So if we need anything related to the glasses in the top right corner, we're going to press the button in the top right corner. It should bring up a pair of glasses and show that it's connected. So that is how we pair the app and get our contacts associated with everything and now we can move into the orientation and layout of the glasses unless anybody has any questions. All right. So there's a few things that are important to note on the glasses. While you can use your voice to command, you know, to make commands and get descriptions, there are just a few little pieces of hardware that are important to remember. So if you are holding the glasses on the inside um left arm, there is a little button. It's more of a switch, but it feels like a button. And if you switch that towards your ear with your finger or your fingernail, that's going to power your glasses off. If you switch it towards your nose, that's going to power your glasses on. And in most situations, you don't need to turn them off or on unless you're experiencing a little bit of a glitch or you want privacy or if you're in a room full of people who have meta glasses and everybody's saying, "Hey meta." Um that's usually when I power mine off. Um but mo- most often than not, I don't even bother with the power switch unless I just need to do a quick hard reset. Um if you are holding the glasses as if you were going to put them on in the top right corner of the right lens on the frame, there is a camera. Um so, we kind of tell folks, "Where you point your nose, the camera goes." And if you are looking at a greeting card, you might hold your head down a little bit or in front of you. Whereas, if you're looking for the gate number in an airport or at the McDonald's menu, you might look a little bit more up. So, just remember where you're pointing your nose, that camera is oriented. Um so, that is at the top right corner of the frame of the glasses. And then on the top of the right arm, there is a long rectangular button. That is the capture button. So, if I press that once, it just took a picture. If I press and hold it for a second or two, it's going to start or stop taking videos. So, this is great if you find that uh you know, your your hands are a little unsteady with your smartphone or your camera or you can't get the the angle that you want. This is a great way to be able to take pictures and capture those special moments as well. On the right arm of the glasses is a touch panel. This touch panel will allow you to do a few things. First, if you do a short swipe towards your ear, that is going to increase your volume. If you do a short swipe towards your nose, that is going to lower the volume. Um and that's only one of the ways. There are about three ways you can control the volume on the glasses. This is one. Um, I will show you my two favorite ways to do that in just a moment. If you take one finger and tap on the glasses on the right arm, that will activate or stop your most recent audio. So, if you've been listening to music or an audio book or a podcast, that will stop or start as you touch it. Say for example, you're getting a phone call. If Leah's calling me and I don't want to answer the phone right now. I might uh decline that call or to accept it, I would take one finger and tap twice. So, if I wanted to talk to Leah, I would take one finger and tap twice and then when we were finished with that conversation, I would take that same finger and tap twice again to disconnect the call. All right. So, if we're going to go back to volume, um, sometimes the glasses come at at varying levels of volume and um, there are different ways to kind of check on that. My favorite command for this, I'm going to see if you guys can hear it. Is to say, "Hey Meta, what's my volume level?" >> Volume 55%. >> So, it's telling me that volume is 55%. So, I'll say, "Hey Meta, raise volume to 75%." And just to confirm that it is, I'll say, "Hey Meta, what's my volume level?" >> Volume 75%. >> Volume is now at 75%. >> Dominique, >> Yes, ma'am. >> what was that sound it was making after you said "Hey Meta"? >> So, when you say the wake word "Hey Meta", it's going to make a we call it the water drop sound because that sounds better than just going "Boing." Um, but that essentially tells you that the app is ready to listen and the AI is ready to process your command. Um, and so, what I kind of tell folks to do is instead of just saying, "Hey Meta, can you tell me what time it is and what the weather is in Cupertino, California?" "Hey Meta, stop." We need to slow it down a little bit. So, we want to say Hey Meta, pause, and then say, "What's the weather in Washington, D.C.?" >> In Washington, District of Columbia, it is currently mostly cloudy and 85° F. Today, expect a high of 87° F and a low of 69° F. >> So, it just gave me the weather for Washington, D.C., but it's important to remember um especially as you're getting started that you want to speak clearly, that you want to say the wake words, "Hey Meta," and that right after you say that, you almost want to pause just long enough to clap your hands. So, I'll say, "Hey Meta, what's the weather in Washington, D.C.?" And that's about as long as you need to to pause to get it to respond to you. All right. Um And so, that that is absolutely a great question in terms of, you know, what that sound is and what it does. Um there is an alternative called Live AI, and we can touch on that later, but when using that, you don't actually have to wait for that water drop sound. You can kind of have more of a continuous conversation with the glasses and the AI. The third way to adjust the volume is to simply um press the volume buttons on your smartphone, and that will um manually adjust the volume on your Meta glasses, as well. All right. So, moving forward, um we there are I did want to touch on one more thing. Um so, when it comes to volume and hearing, in um in the glasses settings and the devices settings, there is an option to change the or to change the language, voice, and speed of the voice of your glasses. And so, we're going to make sure I've got the right pair of glasses. I'm going to double tap on those. So, this is the screen that talks about updates and general information, things like that. We are going to go down to Meta AI and activate that. And one of the first things that comes up is language and voice. We are going to double tap that and it gives you different options. So, you know, my native language is English, that's what the glasses are set to and it also gives me the opportunity to control how fast the AI talks to me. I like it a little bit faster cuz that's just my listening speed, but some folks might like it a little bit slower and so there is a slider that you can adjust the speed um and that will let you slow or increase the speed of your speech from the glasses. And then below that are options for different voices. So, it gives you some higher pitched and lower pitched options. One of my favorites, I usually have my personal glasses set to Keegan-Michael Key cuz it's easy to hear and I can hear it in a variety of environments. So, you can sample the different voices and then just make sure that what you choose, go back to the top right corner and press apply. So, I'm going to quickly change the setting on this. >> While Dominique is doing that, the reason why we wanted to make sure we showed this feature is that if you need to hear a deeper tone voice, it is easier to pick up for you to be able to hear that they have those features available. Whereas some people might need a softer voice maybe because of the hearing aids or other different conditions. So, this will be able to allow you to customize it based on your particular needs and including the speed of the voice because if you need to have a little bit of a slower um rate of speech for comprehension reasons, this is a feature that you're able to do to be able to customize it for you. Take it back, Mr. Dominique. >> All right. So, I should have successfully changed my voice. Um so, let's test it out and see. So, if you remember before I was using one of the female higher pitched voices, so we're We're to test and see what it says now. Hey Meta. What's the weather in Washington, D.C.? >> In Washington, District of Columbia, it is currently partly cloudy and 85° F. Today, expect >> stop. And Dominique, would you mind doing that again, but holding the mic closer to the back, please? >> Absolutely. Hey Meta. What is the weather in Washington, D.C.? >> 85° F. Today, expect a high of 87 and a low of 70° F with rain and thunderstorms forecast for later this evening. >> It's not Virginia if there aren't thunderstorms. All right. So, hopefully everybody was able to hear that. And so, that's just something that we like to like Leah said is folks have all levels of hearing and processing. And so, this just kind of allows you to customize what you need for for the glasses to make them the best tool for you. Um one thing to that you know about is the glasses are going to come with differing levels of software and firmware. So, when you have your glasses paired, um it's important to go in and check what update you have. And so, if you are on Okay. If you're in the device settings, the first thing that you should see is updates. And you want to make sure automatic updates are on. And that way it automatically lets you know when it's ready to download and install that update. And it actually says that I have an update for these glasses, and I'm not going to install it now because it can take a little bit of time. But just know that you need to be connected to your Wi-Fi network and make sure that your glasses have a good amount of charge on them. And it's good to make sure that you're at the most recent firmware and software levels because that will give you more options to Meta's latest features, um as well as the detailed response feature. So, that will be the difference between saying, you know, if I'm asking for a description of the environment, of it saying, "Oh, you're in a living room." to "You're in a cozy living room with a fireplace and a mantelpiece and there's a dog on the bed and, you know, or on the couch." and, you know, all the different things like that. So, if you want the option for detailed responses, we're just going to make sure that your glasses are up to date. Otherwise, I think we can jump into the functionality of the glasses. >> Real quick, Dominique, we do have one question that did come through that I wanted to give you an opportunity to answer before we move into the next segment. How can they navigate and tap things on the phone if they are visually impaired? Will they actually need another person to help them set it up first? >> That is a fantastic question and that's what I love about these glasses because they lead into other opportunities and possibilities. Um, so, like I said, I'm blind um, and I use a program on my iPhone called VoiceOver. And so, this program uh, will read out everything that's on the read out everything that's on the screen in apps that are accessible. So, I use this to check my email, I use it to make phone calls, uh, to do my online banking and bill pay, and essentially it because it talks to you um, and because we can't see as well, if we tap the screen, we don't want to just activate anything. Um, so, we kind of use gestures like swiping and double tapping to uh, really get the best functionality out of the glasses. So, I kind of picture it like a long like my finger is a long white cane and I'm moving from app to app and if my finger is over an app or a specific area on the screen, it's reading out what that is. Now, if you don't necessarily need the speech on iPhones, there is a program called Zoom, which is different than the Zoom that we're on. Um, it simply magnifies it and so, I can take, you know, three fingers and increase the size of my whole phone screen. Um, so, I can explore different parts and see, you know, see the text at different sides. Android does have this functionality. Um, their program is called TalkBack. Um, and it kind of just depends on what model of Android phone you have. Um, I believe there's also large print settings and magnification. One of the things that I like about the iPhone as well, and I don't know the official name for for this, um, but they Apple created a function for folks who needed a smartphone but didn't want to use the smartphone functionality. So, they could limit what's on the screen to just one or two apps and a few contacts that they want to call. So, that's in assistive settings as well, but there's so many ways to be able to use your smartphone as a person who's blind and vision impaired. And if that's something that you're interested in, um, I would love to talk with you about that further and you can reach out to me at BVA. All right. So, do we have any other questions, Lea? >> I do have one if you wouldn't mind touching on it before we move into the functionality features. We did have a, uh, question come in about some of the devices that are the smart Motorola consumer cellular service plans. Would you mind touching on that and what we've learned about that through our experiences at the events? >> Yes. So, phones that are distributed for, uh, strictly for making phone calls, text messages, those type of assistant phones, um, are are such a wonderful option in the community, but they typically have something called multi-device management software on them that prohibits you from downloading other apps, especially ones that are perceived as being used for games or social media, things like that. And so, unfortunately, with these types of phones, they at present do not allow you to download the Meta AI app, uh, because like we said, they're they're being perceived as just social media when we know this is an accessibility tool. So, unfortunately, those phones will not work with um with the Meta AI app. >> Thank you, Dominique. Can you show us some of the features now? >> Absolutely. So, like I said, I use these glasses in my everyday life, and I use them for everything from reading cooking instructions to greeting cards to um all sorts all sorts of things. Um and one of my favorite commands is to say, "Hey Meta, look and describe what's around me." >> Dominique, that is some >> Hey Meta, look and describe what's around me. >> But, would you mind >> describe what's around me. And so, it told me that there was a laptop open, that there were cables on the desk, a phone on the desk, that there was a framed photo in front of me, things like that. Um and I love this command because as a blind person, I don't always have someone to, you know, describe the environment I'm around or to describe it to the level that I would prefer necessarily. Um and you know, because folks are busy. They have stuff to do, and they can't always take time to describe. So, if I can ask my glasses, then I can get the information that I need. And so, if I'm going to do a presentation or I'm in a new space, I still want to take time to personally explore that with my cane, but it's really helpful too to have that layout of um you know, of what that room looks like, of who's in the room, uh things like that. One of the things that I also use it for is to um read greeting cards or business cards, things like that. Um and so, I am actually going to see if it will read One of the the commands that I use is look and read this document. We want to be very specific about the commands that we're using. I can't get that out of the box, so we'll just have to read the >> While Dominique is doing that, um one thing that we want to be very clear on is to explore the way that you ask questions and think through the information that you're wanting to get from the device. So, for example, when Dominique said, "Look, hey Meta, look and read." Um it's going to read either a summary or you can ask it for a full description or you can ask it to search specific words or concepts that you're trying to gather from that device. I'll pass that back to you, Dom. >> Okay. Thank you, ma'am. And so, I actually have the the glasses and I'm going to see what uh the glasses can read. So, I'll say, "Hey Meta, look and read what's in my hand." >> It says "Wait box" you're holding with "Listen" "Call" "Live stream" above it. >> That sounded very enthusiastic. Um were you able to hear that, Lea? >> Yes, we could. >> Okay, excellent. Um so, like Lea said, we're specific about what we're asking. Sometimes I work with folks and they they'll say, "Hey Meta, what can I see?" Hey Meta, stop. Um and that's a great question, but Meta needs us to be a little bit more specific. Um so, some of the areas where I find this to be very helpful in my life is if I feel like making a freezer meal and I don't want to cook that night, I can pull out a box and Hey Meta, stop. Um I can, you know, have it read those instructions to me. I use it to check the thermostat on my grill when I'm grilling. Um I apparently go through the airports now every couple of days and one of the things that I like to do is to ask it to read the gate numbers to me. Um and where it can also be very helpful is say, for example, I want a smoothie. Um I can say Hey Meta, stop. I can say, you know, "I'm in the Atlanta airport in terminal B and I'd love to buy a smoothie. Can you tell me where I can do that?" And it'll pull up a map and show you and tell you where the closest smoothie station is and then you can use your O&M skills, your orientation and mobility skills and figure out where to go from there. Um, so those are some things that have been very helpful in my personal life. Also, I love getting greeting cards and I love giving greeting cards, but I'm not a fan of picking out greeting cards because I usually have to get someone from the store to stand with me and read the cards and I feel like I'm using up all their time and so with my glasses, I can ask it to look and read this card or look and read what's in my hand. And if I want to, I can stand there all day long and read every single greeting card in that store. And that for me was absolutely worth the money of the glasses is to give me back a little bit more of that freedom. Um, so I would love if we have any questions or if there's anything else you want to touch on, Leah? >> No, I think that you've done a really great job on kind of going over all of those different features. Um, at this time, do you have anything you want to add, Dominique, before we open up to live question and answers? >> Absolutely. So, I know especially depending on the stage of technology, um, you know, you're using that these can seem intimidating or you may not necessarily know if they're going to be right for you. Um, what I would suggest in this area is just to play with them, ask it questions, figure out how this is going to be most applicable in your life because the way that I use them might not be the way that you use them and that's absolutely okay because these are a tool in our toolbox to help us maintain and gain independence and um, in that regard, these are a very powerful tool, but they're not ready to replace your existing skills of blindness and your independent living skills. So, keep using your long white cane, keep using your guide dogs, keep using the skills that you're using, but make sure that you're also finding a way to incorporate this powerful tool into your toolbox. >> I do have one question for you, Dominique. >> Yeah. >> Um one of our um participants talked about the language translation services or the language feature. Could you mind touching on that? >> Absolutely. Um so there is a program called live translation. Um and what it does essentially, and I'm going to find this, if you go into your glasses, let me get to the right setting. So I Oh, I want to touch on another thing, too. Um so if you're on this home screen where it shows like your glasses are connected and your glasses are most up-to-date, there's going to be a feature called live translation that you enable on your phone and you enable through the glasses. So you're going to say your wake word, hey m e t a, and you are going to say start live translation and make sure this is enabled on your phone. And so what this does is if someone is speaking Spanish or Chinese or, you know, name a language, if you're looking at them, the glasses are picking up on what they're saying and they're translating it to you into your chosen language. Um you know, so for me it would be Spanish to English. Um and then if I wanted to communicate with that person, I would show them my phone and they could see what I'm saying and it would translate it from English to Spanish. So we could more easily communicate than uh maybe some other apps have, you know, right now. So I think this is a great way to to do this. It does have a little bit of limitations. It tends to work better if you're facing the person. Um and so I I still need to play with this more a little bit myself. I've not extensively used this feature. Um but it is from what I've used, it's been immensely helpful so far. Um the other thing that I wanted to mention is there is a there's a feature called conversation focus. So as a blind person, my hearing is great. However, if I'm in a really loud situation like a crowded restaurant where they have like the the raised warehouse ceilings or I'm out with a, you know, a large group of friends, sometimes it's hard to process and hear that information. So, if you make sure your glasses are most up-to-date, um there is a feature called conversation focus that you can turn on through early access. And so, what this does is it allows me to again look at the person that I'm speaking with and the glasses actually kind of funnel what they're saying towards me and kind of blur out some of that background noise. So, that is very helpful for folks who have hearing impairments or folks who just hear all the things like me and need to funnel some of that out. >> Thank you for sharing that, Dominique. We really appreciate all of that information. At this time, Aretha, do you want to open the floor up for any questions that anybody might have in the chat? >> Great job, Dominique. I was on mute for a second. Everybody's saying great job job, Dominique. I did see somebody ask about a command about getting a radio station, but Dominique, you've already answered that question. You just say, "Hey Meta, tell me what radio station turn to." Um Shane said AI. Uh I think this is an organization G G W O T veteran. I'm familiar with Oakley more than Ray-Ban. So, this might be a question for Meta if um Gus wants to come on and see if there's any other brand they're going to be bringing on board. >> Yeah, sure thing. Um I put a comment in the chat thread as well, but we currently offer Oakley, uh Halston, and Wayfarers. The Wayfarer style is probably the one you're familiar with with the wrap-around. Um and there's also Halston, which is more of like a rounded frame. There's Ray-Ban uh Wayfarer, which is sort of this classic square rectangular look, Headliner, which is round look, Skyler, which is more of a teardrop kind of feminine look. Um there is the Meta glasses which just released with uh um we have actually a few really cool models including a collaboration with with Kylie Jenner. Um for those that are into that, um we have our Optics Ray-Ban Optics series, which are a little bit more of like the classic style or the style for like putting prescription lenses in. Um and uh uh we have our Meta Ray-Ban display glasses, which include all these feature sets along with the small uh built-in display, which could be interesting for folks with low vision but still some vision. Um and that's the portfolio today, but we are going to be pushing out more styles in the future. So, hopefully that covered it, and Katie, please keep me honest if I missed any. >> No, spot on. >> Awesome. And feel free to put your questions, if you have another question, in the chat. And while you that, I do want to remind you that this is being recorded. You're going to get the recording uh probably later today or early in the morning. And there's a comment here from somebody. I'm also thankful to you for offering this to our blind veterans and who are visually impaired. You all rock. Yes, you do, BVA and Meta. Thank you so much for being here. It looks like we've answered the question as they were coming in. So, I want to make sure that we didn't miss anybody. Gus, was there anyone that you wanted to repeat so that people can hear it audibly if they watch this on the replay that you feel is worth um being uh told on the replay, the video replay? >> Uh sure thing. There were a couple really great questions that came in on the chat. Um one of them, which I think Dominick covered really well, was around the screen reading capabilities of the mobile devices that many of you already have. Uh VoiceOver for uh iPhone um and TalkBack for Android. Um so, I just want to really double click on that cuz that's super powerful. Um for the radio station question specifically, I think you were asking about um a San Antonio station in 107.5. So, in that case, the iHeart radio integration, which is a integration available on Meta AI, would work. And once you've connected that, you would say, "Hey Meta, play KVBH." Or, "Hey Meta, play Vibe 107.5." You do have to use the name of the station um for that because there's number of different places that are 107.5, but I think the one in in San Antonio is the one I just mentioned if my if my Google skills are correct. Um and I think the other thing which I think Dominique did a great job of just showing, um the best way to use these honestly is just to like try stuff out. So, there's no one set rule with how you can use prompts and often you'll discover things that maybe even we at Meta don't know about. Um what I found to be really useful when I'm using these with uh friends and family who are are blind um or even when I'm using them myself is really nailing down the prompt. Um so, for example, if I'm reading a a financial statement, credit card bill, that kind of thing, sometimes I want to read me exactly what's in front of me and not summarize it. And when I do that, I'll say, "Hey Meta, please read me verbatim what's in front of me." Um so, sometimes even giving that prompt ahead of time or even saying, "Hey Meta, I am blind, so describe exactly what is I'm looking at." It'll give you a better answer. Um and then lastly, inside of the accessibility menu uh on our device, um in the same place in settings where you you saw stuff like conversation focus, there's a there's a section called accessibility and in that section, there's a couple really cool features. There's detailed descriptions, which I think Dominique touched on, but if you turn that on, the AI will be a little bit more detailed with the answers it gives you. Um so, sometimes instead of just glossing over and saying, "Hey, there's a can of soda in front of you." it'll it'll read, "Hey, this is a can of Coca-Cola. It's got such and such many calories." or whatever it is. Um and there's another feature on there which is great called Be My Eyes. Um for those >> I didn't get to touch on that, so I'm glad you are. >> Go for it. Um go for it, Dominique, actually. >> didn't want to steal your thunder. No, I just just saying I was I didn't get to touch it. So, um there are a few visual interpretation services. One is Be Be Eyes and the other is Aira. And you can link both of those to your glasses and have the interpreter look out through your glasses. So, what these are great for is if I call Be My Eyes, I'm connected with a volunteer who can read things for me or help me put together IKEA furniture by reading those little hieroglyphics. Um and it's great because, you know, I'm used to doing it with my phone, so I'd hold my phone up and search and scan, but if I need to do something hands-free or I need a specific point of view, they can look out of my glasses. So, this is a great way for, if you think about like a language interpreter or an American Sign Language interpreter, this person's a visual interpreter. So, they're interpreting the visual world and the printed world around me um and just giving me those descriptions. So, both services are great. Aira is paid. Um Be My Eyes is free, but they both connect so easily to the glasses. So, which thank you, Meta, for that. >> Yep, thank you. And I think that's a really great touchpoint. I see Dr. David Tharp just asked, are there a list of prompts? I That's a really good question because the beauty of the prompts is that it tries to respond to you uh as though or a person. So, there's not some fixed list of things. It's not like one of those old, you know, text-based computer games from the '80s where there was only five things you could ask. You can ask it pretty much anything and um like I mentioned, sometimes you'll actually discover it's able to do things that even we at Meta weren't uh necessarily aware of. So, we have some good examples and the BVA has some great examples of things to get started, kind of like what what was shown during this session. But, I recommend once you you have them, just taking them for a spin and and trying stuff out cuz you might discover something that even others could benefit from and and share with them. And and definitely huge shout-out and thank you to all our third-party partners like Aira, Be My Eyes. Um we have some really great um AI-based ones like Scribe Me and Orion and um Seeing AI from Microsoft in beta right now and and hopefully we'll be launching a bigger uh um splash with that pretty soon. So there's a lot of really great apps out there in addition to what we offer first party on the glasses that we're going to be building support in and we're really looking forward to seeing how we can build it out with our partners. So thank you. >> There was a question that came through about a list of prompts or commands. There is a list on BVA's website at bva.org underneath programs underneath resources. There is some basic commands to help you navigate specific questions or different things that you're wanting for it to do. Feel free to look at that. It is completely accessible on our website. >> And speaking of that, BVA is going to be giving a another webinar on their website on August 31st. Did you want to mention that as well? >> No, yes, absolutely. So we understand that sometimes it's hard to get navigated to the right link, to the right information. So we just wanted to be able to provide an additional resource. It is available on our calendar. It is open to anybody who would like to join. bva.org underneath our calendar and we have that scheduled for 3:00 Eastern Standard Time on August 31st. >> Awesome. Well, I think we answered all the questions. I would love to thank Meta for being here. Thank you for everybody in the background and especially TechSoup. Thank you Jackie for holding down the fort for Connie. You did a great job. Dominique, always always I'm always learning new things from you Leah. Thank you so much for being here. Gus came in and gave the great advice. We appreciate you so much Gus. Just a friendly reminder, this is being recorded and you're going to get the recording later today or early in the morning. Have a great day everybody. Bye-bye. >> Thank you. >> Thank you everyone. >> Bye.