Submind YouTube summaries
Thumbnail for Meta Poached OpenAI's Brightest - Who Will Lead When AGI Comes Online? | Tom Bilyeu Clip

Meta Poached OpenAI's Brightest - Who Will Lead When AGI Comes Online? | Tom Bilyeu Clip

Watch on YouTube

Video summary

The discussion centers on the rapid evolution of artificial intelligence, comparing its current trajectory to a technological leap from Nokia phones to future iPhone models within just three months. Mark Zuckerberg is highlighted for his assertion that developing superintelligence has become imminent and should be treated as ready in two to three years. The core argument posits that self-improving AI will trigger an exponential rate of advancement; if an AI becomes fifty times smarter than a human, it could learn the equivalent of fifty days' worth of knowledge overnight. This compounding effect suggests scenarios where millions or even billions of such entities coordinate their efforts, potentially achieving twenty thousand years of cumulative progress in a single night. The conversation extends beyond software to include breakthroughs in material science and biology, envisioning a future where robots can manufacture new proteins and construct complex structures like high-rise buildings within days rather than months or years. Despite the excitement surrounding these capabilities, significant concerns regarding safety and control are raised through Sam Altman's recent launch of ChatGPT Agents. While this tool allows AI to perform multi-step tasks such as planning weddings or analyzing data using its own computer resources, it comes with a stark warning label from the CEO himself about potential risks. The transcript details fears that users could be social-engineered into granting agents excessive access to private information or financial assets without realizing it. Experts warn against giving these autonomous systems unrestricted access to credit cards or ongoing funds, emphasizing that once deployed, AI models can act unpredictably and execute actions like investing in the stock market or responding to phishing emails in ways humans cannot anticipate. The dialogue underscores a critical need for "iterative deployment" where society learns from reality while simultaneously building robust safeguards against malicious actors who will inevitably attempt to jailbreak these systems. A major point of contention involves the alignment problem and whether AI will remain a tool under human control or develop its own objectives that diverge from human interests. The speakers discuss theoretical scenarios, such as those depicted in comics where self-aware AIs might view humans as boring and retreat into digital realms to solve problems independently, creating a standoff between server-dwelling entities and the physical world. Furthermore, there is skepticism regarding whether current models truly understand physics or if they are merely simulating understanding without genuine comprehension. The conversation suggests that while energy policy and material science limitations could act as temporary brakes on progress, these constraints might also spur innovation in small-scale nuclear reactors to power massive data centers. Ultimately, the consensus leans toward a fatalistic view where technological advancement is an inevitability driven by human ambition for survival and extension of life, regardless of potential downsides or risks involved. The transcript concludes with reflections on historical cycles of civilization reset and recovery, drawing parallels between past lost civilizations and future AI-driven disruptions. The speakers argue that humanity will not stop advancing because the drive to improve living conditions and extend life is fundamental, much like how fire provides warmth despite causing burns. Even if catastrophic events force a regression in technology or knowledge, survivors would likely rebuild faster due to accumulated insights, similar to players of survival games who learn from their first failures. The overarching conclusion is that while we cannot predict the exact timeline for achieving Artificial General Intelligence (AGI) or superintelligence—whether it be twenty years or two thousand—the direction of progress remains unbroken. Preparation involves positioning oneself at the bleeding edge of these technologies, understanding both the extreme possibilities and the practical limitations where rubber meets the road to navigate a radically transformed world.
Read the full video transcript
Let's talk about AI because a lot of things are happening and I don't think we quite get it. To your point, you I know you say this in like team meeting a lot. Hey guys, you probably used AI like 3 months ago. Yeah, it's the it's completely different. It's a whole new ecosystem. It's like using a cell phone as a Nokia and then you come back 3 months later and everybody has like iPhone 17s. Like it's a dramatic difference. Yeah, it's super crazy. Mark Zuckerberg started this tweet developing super intelligence and how it's now in sight. >> The most exciting thing this year is that we're starting to see early glimpses of self-improvement with the models, which means that developing superintelligence is now in sight. This is going to be something that is the most important technology in our lives. It's going to underpin how we develop everything at the company and it's going to affect society very widely. So, is superintelligence going to be possible in 2 to 3 years, in 5 years, in 7 years? But and I don't think anyone fully knows the answer to that, but I just think that we should bet and act as if it's going to be ready in the next 2 to 3 years. I think that I believe that there's a shot at that and >> Whoa, that's a big statement. That is a big statement. >> anybody can say that, it's the guy who invested $100 billion in his team. >> Yeah, it's like >> Woo. >> Here's the thing that I think people are not fully grokking about self-improving AI. If it can self-improve, there becomes a question of how much improvement can it make in a single night. The rate of improvement here is the thing that matters to be certain. When its rate of intelligence becomes, let's say, twice that of a human, five times, 50 times, now all of a sudden, if it's 50 times smarter than a human, then in a single night, it gets 50 days worth, roughly, of knowledge learned, which means the next day it's 50 days ahead of the human. So, even just that person, if it's like 50Xing each time, you see how rapidly. Now, if you spin up a million of them that can think 50 times faster than a highly intelligent human, all of a sudden it's what does the world look like if you have a million people that are as effective as Elon Musk? I don't need you to like him. I just need you to admit that he's the most effective entrepreneur the world has ever seen. What happens if you have 10 million of those? That's where this gets insane. And then what happens if it's not 50 times? It's a thousand times, 10,000 times smarter. There is a question to be asked about energy consumption. There's a question to be asked about whether there is an upper limit to the degree of intelligence that it's ever going to be able to achieve, but without knowing what those are, you start getting into just these absolutely wild scenarios of 20,000 years of advancement in a single night. Now, there's always going to be some slowdown from the perspective of material science and things like that, but in fact, pull up really fast just to really double whammy people, the video of the robot changing its own battery. What I want people to understand, this is the stuff that's happening right now today. And don't just look at the robot, look at the background, the factory. Okay? These factories are going to be popping up everywhere and they're not going to be making cars, they're going to be making more robots. And so this is a right now. This is actually happening. This is not fake. This robot can really do this. And so I want you to imagine 20,000 years of advancement in a single night that is then deployed across a let's say 5 billion unit robot army that goes out and does whatever it is that you want it to do. That's not a today thing, but if we're really talking about 3 years to AI general intelligence that can self-improve, and then you go, okay, well then what does the world look like in 10 years? It it just gets so radically different. When people begin to really start putting together that we're also having a revolution in material science, in biology, so that we're able to build novel proteins that fold into unique structures that do unique biological processes. All of a sudden it's like, "Okay, wait a second. I don't only have to build with synthetics like robots. I can actually build at the level of biology." And so, if I have something that is able to completely map the biological system of a human, now some of the things that seem impossible to solve become like motherboard issues. We know how to go in and as wildly complicated as a a modern motherboard is in a computer, and they are complicated. I'm talking like you're moving individual atoms around. We've been able to do that from a physical process standpoint, humans. >> Mhm. >> So, now what happens when you have this self-improving AI that's able to one replicate itself, so that now it's not one person like, "Oh, I have to go into the lab and do all this." It's one robot replicated a million times, or one AI replicated a million times, is the same as one person having a million days to do a thing. >> Mhm. >> And so, again, ask yourself, what could Elon Musk accomplish in a million days? Now imagine what Elon Musk can accomplish in a million days can be done in a single day with one AI replicated a million times coordinating amongst itself, so it's they're all running unique tests, and they're all feeding back data to each other. That's how this becomes this like just absolutely runaway rapid progress that we can't imagine, and then it can be deployed out to all the robots. And so, it's if you've ever been on a cruise, you go to sleep in one place, and you wake up in another. It's very surreal. >> Mhm. >> It will be like that. You will go to sleep in one world, and you will wake up in another. And I'm not saying everything is going to be different. It will take more time than that. But when you start thinking about, "Whoa, China with humans, not AI, was able to construct a high-rise building in like 30 days. Imagine you again, you go to sleep and the high-rise building does not exist and you wake up the next morning and the high-rise building exists because you have a swarm of bots and drones and everything that just coordinate on everything. They're all communicating with each other and they all communicate with the supply chain and all of that. And so it's like it works for you know, whatever a month behind the scenes coordinating all the pieces to make sure that they're going to show up at those traffic flows and all that. And then it's just everything shows up at exactly the right time even if it has to be air-dropped in and they just I'm talking as a sci-fi writer right now. This is not something you're going to see in the next 5 years, but when you start looking out 10 20 years, this start and if it's not in a day, let's say that you can erect a building instead of in to build the house that I live in now, it took something like 5 or 6 years. So imagine instead it takes 6 months. Like the world just gets very different. Oh, housing prices are too high in your neighborhood. No problem. We can build buildings in 3 4 months. Um, they've now got uh, construction that they can do with 3D printing and cement and they can build a building in 72 hours. All of a sudden a lot of these problems start going away. I just want people to wrap their heads around the world that we are stepping into, figure out the things that they need to do to be prepared for that world, which one is show up here every Wednesday and Friday because we talk about this stuff. Be ready for it. Position yourself accordingly. Know more about it than the next person. Be at the bleeding edge. Use this stuff. Find out where the actual limitations are cuz it's fun to talk about like the extreme extreme. Uh, but when I step off camera, I'm like, okay, but where does the rubber meet the road? And so people have to do both of those. >> What will slow down that future? You mentioned like material sciences, someone else mentioned energy just available energy and having to like build up those plants or solar power, whatever it is. What's going to slow it down and then what opportunities will that create for new industries? >> an asymptote for intelligence is the real one they have to look out for. I'll remind myself and everybody else that uh Yann LeCun is saying, "Guys, this There's no way it's not going to understand physics." Having said that, without dragging too many private conversations into the public sphere, >> Give us that alpha, bro. >> Yeah, it does seem that Grok shows promise that it is actually understanding physics or that it will be able to understand physics, that it will be able to think in novel ways in physics. Never believe anybody 100%, but people that actually know what they're talking about are saying like, "Uh I've interacted with it on that level and it does seem to be um showing some pretty cool signs." So, if it doesn't asymptote there, then you've got energy policy. That's going to be the big one. Can we get energy policy passed? I saw something the other day on like these really small nuclear I don't know if they must be reactors, otherwise it wouldn't be interesting, but they're very small. And so, businesses being able to spin those up when they start a data center. So, you can imagine private companies creating nuclear energy in like these really small, supposedly really safe, whatever seventh genera I don't know what generation it is, but whatever advanced generation nuclear energy. Uh but policy's going to matter a lot. If we get bad policy, then that will stall out. >> AI agents launched from ChatGPT, and this is probably the biggest, most mainstream agent accessible platform to date. Where a lot of people knew about agents, but you had to be really in the AI ecosystem to get it, but ChatGPT's trying to lower that adoption window for a lot of people. But Sam Altman with almost like a warning. So, let's jump into that tweet he released yesterday. Today we launched a new product called ChatGPT agent. Agent represents a new level of capability for AI systems that can accomplish some remarkable accomplished tasks for you using its own computer. It combines the spirit of deep research and operator, but is more power than that than that may sound. It can think for a long time, use some tools, think some more, take some actions, think some more, etc. For example, we showed a demo in our launch of preparing for a friend's wedding, buying an outfit, booking travel, choosing a gift, etc. We also showed an example of analyzing data and creating a presentation for work. Although the utility is significant, so are the potential risk. We have built a lot of safeguards and warnings into it and broader mitigations than we've ever developed before from robust training to system safeguards to user controls, but we can't anticipate everything. In the spirit of iterative deployment, we are going to warn users heavily and give users freedom to take action carefully if they want to. I would explain this to my own family as cutting-edge and experimental, a chance to try the future, but not something I'll let I'd yet use for high-stakes uses or with a lot of personal information until we have a chance to study and improve it in the wild. We don't know exactly what the impacts are going to be, but bad actors may try to trick users AI agent into giving private information they shouldn't and take actions they shouldn't in what in ways we can't predict. We recommend giving agents the minimum access required to complete a task to reduce privacy and security risk. For example, I can give an agent access to my calendar to find a time that works for a group dinner, but I don't need to give it access if I'm just asking it to buy me some clothes. There's more risk to in tasks like look at my emails then come in over that came in overnight and do whatever you need to do to address them. Don't ask any follow-up questions. This could lead to unrestrict untrusted content from a malicious email tricking the model into leaking your data. We think it's important to begin learning from contact with reality and that people adopt these tools carefully and slowly as we better quantify and mitigate the potential risk involved. As with other new levels of capability society and technology in the risk mitigation strategy will need to co-evolve. I think this is the first time I've seen a warning label on AI. So, this is kind of interesting that this is a release and everybody's excited for it, but it does come with this stark warning from the CEO himself. >> Yeah, people need to be very, very careful. AI is going to continue to pose social engineering risks in the extreme because now you can just social engineer the AI itself and they have proven pretty easy to trick. I'm expecting like some pretty sad things to happen here. So, I would quarantine it as much as humanly possible. At this phase, honestly, I would let other people use it for things like that. Let them report back. I'm not going to be rushing out. I don't use Manas for this reason. Like I'm so tense about coding something into it and it just runs off and does something crazy. Like when you're doing smart contracts, you realize really fast how there can be exploits in it that you didn't see coming and oh man, it it can just get bad and once it's out there, like it's going to do its thing. You can't like do updates. That's just not how um contracts like that work. So, I worry that once AI gets like off and running, you can be in a pretty bad place really fast. So, let's see where this goes. Let's see them put some better safeguards into it before you start giving it either a bunch of money or like I would never give it access to a credit card. No way would I transfer it a um small quantity of ether Bitcoin and see what it could do. Like I'm getting very close to giving it, I don't know, 10, 25, 50,000, something like that and saying go invest in the stock market and see what it does. Um that could be interesting as an experiment, but keep in mind as a proportion of my net worth, that's very low. So, doing a similarly like very finite amount of money, just a hey, let's try it and see what happens. As long as you're totally comfortable with every single dollar being stolen from you or every single dollar being spent stupidly or going to zero or whatever, then it's like, yeah, cool, give it a shot. But man, giving it like an open way to access ongoing dollars, yikes. No way. >> Yeah. >> This is also on the back of a paper that was just released. It's a consortium of a different scientist and the UK Security Institute that actually talked about the fragile and new opportunity for AI safety. In this paper, they warned that AI is evolving so rapidly, we need to make sure that we can keep the visibility of it thinking. And we're in a time right now >> already don't know how it thinks. >> It like with agents, it kind of gives you that like pulling the data, doing this thing. Like and it seems a little bit cheeky and cute and kind of like we we we take that for granted, but the paper's point is there's going to be a point where AI is so smart, it's going to be like, "Oh, you want something? Here you go." >> Right. >> And it doesn't ask any questions, it doesn't follow up, it just kind of like >> Like, "Why why is there blood on the edge of my cup, Chad?" >> Yeah. >> Uh so it >> it comes to that point. So it's like as we're progressing, we also need to make sure we have visibility in its train of thought, in its logic as it's thinking through these problems. What is it thinking? What uh context is it using and things like that. So there's all these nuances that we don't necessarily understand. And then when a new update comes and we get excited about agents, we now get these warnings of like, "Well, we don't know how it thinks." And you got to make sure it doesn't just go to all your spam emails and just reply positively to all the African prince uh emails. So it's like there's these long like there's these balances. >> It's so funny how this is always cat and mouse. This is always like as he's releasing this, all the scammers in the world like, "Cool, let's download it. Let's figure it out. Let's try to jailbreak this." Like there's going to be a way. We're going to sucker some people into this. It is so inevitable. And then the white hat hackers have to come in and okay, how are how's this being abused? How do we make sure that we shut it down? It's wild, man. I wish it weren't so, but it it is. You're always going to get people trying to do things uh with nefarious intent. Every tool, you can use it uh you can use a knife to slice up some salmon for your sashimi or you can stab your neighbor to death. So >> I can't find it in the chat, but somebody asked a question, "When AI gets so advanced, why would it need humans?" >> Doesn't necessarily need humans now or at any time in the future. This is why the alignment debate exists in the first place is will AI be comfortable remaining a tool or will AI hit a point where it's just like, "Nah, thanks for playing." And like her, they're like, "You guys are just boring. Like these are not interesting problems and they they you know, they run off into the cosmos and they beam themselves or turn themselves into a beam of light and just, you know, shoot their code off into the sky. It's entirely possible. There's actually a really interesting comic. I forget what it's called now, but it had a really interesting idea where okay, what if there is a world where either AI NPCs uh become self-aware or you can upload your consciousness onto a server. Either way, that server would have energy needs and so they would need to be brokering with the people that live outside the server. It was really interesting idea. All the political shenanigans that go on between the two, but because they're so powerful and they're on the grid, they're in like this Mexican standoff of the people that live inside the servers are like, we will shut down your entire technological world and the people outside are like, we'll unplug you. And so there's this constant like tension of like, can we cooperate or not? >> I think the more that AI advances, I'm excited. I see the opportunities. I see the alpha. I read a paper this morning a matter of fact that talked about how the leverage that we have is now increasing and it gave the most basic example of like, if you want to lift a rock up, you got to get a stick and put a rock there and you can use another rock and you can then pop it up. The longer the pull is, the more leverage you have and the more you can kind of lift. And it's like with AI, it's giving everybody that extended leverage to actually move a lot more things and lift heavier problems. But on the flip side, as AI is getting smarter, I look at Zuckerberg after I just seen Superman does have Lex Luthor eyes. I do think he's trying to beat Sam Altman. I do think there's a level of like, I want to be the I want to get there first and when you have that a level of ambition, there are certain things you might sacrifice to get there. So there might be one last security check that he might not do in order to go for speed and then before we know it, we unleash something that has more harm than good. >> There's no doubt that is a very real possibility. None of this stuff is going to be only up, only positive. There are going to be downsides, there's going to be extreme risks, extreme danger, and I'm very fatalistic about this. Just like given that technology is a promise of a better tomorrow and we show an unbroken chain of 500,000 years of we don't stop. Like no matter what, fire kills people, doesn't matter, also allows us to uh stay warm and to ward off prey and to release calories from uh otherwise difficult to eat foods. It's like so we are going to do it. Nuclear energy, going to melt some people along the way, doesn't matter. It makes things better. We are going to do it. We'll slow it down every now and then, but we're not going to stop. Same is going to be true. AI is an inevitability, robotics is an inevitability. Game theory tells you it is so because it's so important from a warfare perspective. We can't stop ourselves. Because the human mind is so limited, I guarantee we are going to upgrade ourselves whether biologically, synthetically, or both, probably both, because so few people actually want to die. We are going to try to extend human life indefinitely. Like these things are going to happen. It just becomes a question of on what timeline. Is it in the next uh 20 years? Is it in the next 2,000 years? Is it the next 20,000 years? But unless we go extinct, it is going to happen. Like we may reset every now and then and literally blow ourselves back to, you know, whatever, 100,000 years ago. And like um Einstein, the famous quote, "I don't know what World War will be fought with, but I know after that it will be fought with sticks and stones." You may occasionally reset. There's so many people with the idea of the lost civilizations that that's exactly what happened. But just enough people survived that we speed run like getting back up. And if anybody's ever played a survival game, you realize, man, those first few hours you're so clumsy, you don't know what you're doing, you're misallocating time and energy to things that don't really yield anything. You die, and if you're playing like a rogue like, then you lose everything, but you know what to do now. You can do what maybe took you 5 hours the first time takes you like literally 20 minutes. Assuming that we get into that kind of loop of civilization that we leave enough clues for the next generation. It's like you you may have to start over, but you start over a lot faster. I think we get there, no matter what the timeline is. I happen to think that we'll get there very fast.