Home Videos

Elon Musk – “In 36 months, the cheapest place to put AI will be space” (YouTube Video Transcript)

Need transcripts for other videos? Try our YouTube Transcript Generator →
Title: Elon Musk – “In 36 months, the cheapest place to put AI will be space”
Duration: 02:49:45
Total Correct Answers:
Current Caption
Correct

Learning Modes

YouTube Video Transcript Hide

Ask AI Result

The ask AI result will appear here..
(00:00:00) Your YouTube transcript will appear here (00:00:00) So, are there really three hours of (00:00:02) questions or or has are you [ __ ] (00:00:04) serious? (00:00:04) >> Yeah. [laughter] (00:00:07) You don't even talk about Elon, man. (00:00:11) >> I mean, it's the most interesting point. (00:00:13) All the story lines are kind of (00:00:14) converging. Yeah. (00:00:15) >> Right now, so we'll see how much (00:00:18) >> almost like I planned it. (00:00:19) >> Exactly. Well, we'll get (00:00:21) >> I would never do such a thing. (00:00:22) [laughter] (00:00:24) So, as you know better than anybody (00:00:25) else, uh the total cost of ownership of (00:00:27) a data center, only 10 to 15% is energy. (00:00:30) And that's the part you're presumably (00:00:31) saving by moving this into space. Most (00:00:33) of it's the GPUs. If they're in space, (00:00:35) it's harder to service them or you can't (00:00:37) service them. And so, the depreciation (00:00:39) cycle goes down on them. So, like it's (00:00:40) just way more expensive to have the GPUs (00:00:41) in space presumably. What's the reason (00:00:44) to put them in space? (00:00:45) >> Um well, the availability of energy is (00:00:49) the issue. Um so uh I mean if you look (00:00:54) at at electrical output um outside of (00:00:56) China everywhere outside of China it's (00:00:58) more or less flat. It's very you know (00:01:00) maybe a slight increase but for pretty (00:01:02) close flat. China has a rapid increase (00:01:04) in in electrical output. But if you're (00:01:06) putting data centers anywhere except (00:01:07) China where you going to get your (00:01:09) electricity um especially as you scale (00:01:12) uh the output of chips is growing um (00:01:13) pretty much exponentially but the output (00:01:16) of electricity is flat. So how are you (00:01:18) going to turn them chips on? um you know (00:01:21) >> magical power sources, magical (00:01:23) electricity fairies. (00:01:24) >> You mean you're famously [laughter] (00:01:26) you're famously a big fan of solar one (00:01:28) terowatt of solar power. So with a 25% (00:01:30) compat factor like four terowatts of (00:01:32) solar panels it's like 1% of the land (00:01:34) area of the United States and that's (00:01:36) like far in this you were in the (00:01:37) singularity when we've got one terowatt (00:01:38) of data centers right um so what are we (00:01:42) running out of (00:01:42) >> how far into the singularity are you (00:01:44) though [laughter] (00:01:44) >> you tell me (00:01:45) >> yeah exactly so so I think I think we (00:01:47) we'll find we're in the singularity and (00:01:49) like okay we still got a long way to go (00:01:50) [laughter] (00:01:51) >> but is this like a is the plan to like (00:01:53) put it in the space after we've covered (00:01:55) Nevada and solar panels (00:01:57) >> I think it's pretty hard to cover Nevada (00:01:58) in solar panels you get permits from (00:02:00) like the permits for try getting the (00:02:02) permits for that. (00:02:03) >> So space is really a reg it's really a (00:02:05) regulatory play. It's like harder to (00:02:07) harder to build on land than it is in (00:02:08) space. (00:02:09) >> It's it's harder to scale um on the (00:02:12) ground than it is to scale in space. Um (00:02:14) but but also the the you're going to get (00:02:18) about five times the um effectiveness of (00:02:22) solar panels in space versus the ground. (00:02:24) And you don't need batteries. Um I (00:02:27) almost wore my other shirt which says (00:02:28) it's always sunny in space which it is. (00:02:32) [laughter] (00:02:34) So um because you don't have a dayight (00:02:36) cycle or uh seasonality uh clouds uh or (00:02:41) or an atmosphere in space uh because the (00:02:44) atmosphere alone um uh results in about (00:02:48) a 30% uh loss of energy. Um so uh so (00:02:52) you're going for any given uh solar (00:02:54) panels can do about five times more uh (00:02:57) power in space than on the ground and (00:02:58) you avoid the cost of having batteries (00:03:00) to carry you through the night. (00:03:03) Um so it's it's actually much cheaper to (00:03:05) do it in space and I I my prediction is (00:03:08) that (00:03:10) um it will be by far the cheapest place (00:03:12) to put uh AI will be space in 36 months (00:03:16) or less maybe 30 months. (00:03:17) >> 36 months (00:03:18) >> less than 36 months. Um, how do you (00:03:20) service GPUs as they fail, which happens (00:03:21) quite often in training? (00:03:24) >> Actually, it it it depends on how how (00:03:27) recent the GPUs are that arrived. I (00:03:29) mean, at this point, we found our GPUs (00:03:31) to be quite reliable. Um, there's infant (00:03:34) mortality, which you can obviously iron (00:03:35) out on the ground. (00:03:36) >> Um, so you can just run them on the (00:03:38) ground um and confirm that you don't (00:03:39) have info mortality with with the GPUs. (00:03:41) But once they once they start working, (00:03:43) their actual reliability and and once (00:03:46) they start working and you're past the (00:03:47) initial, you know, debug cycle of Nvidia (00:03:50) or whatever or whoever is making the (00:03:52) chips, um could be Tesla Tesla AI 6 (00:03:55) chips or something like that or it could (00:03:57) be, you know, TPUs or trains or (00:03:59) whatever. Um the uh the rival is (00:04:03) actually they're quite reliable past (00:04:04) certain point. Um so um I I don't think (00:04:09) I don't think you need that the (00:04:11) servicing thing is an issue. Um um but (00:04:13) you can mark my words. Uh in in 36 (00:04:17) months but probably closer to 30 months (00:04:20) the the most economically compelling (00:04:23) place to put AI will be space. Um and (00:04:25) then and and and then it will get from (00:04:28) it'll it'll then get like ridiculously (00:04:30) better to be in space. Um and then this (00:04:32) the scaling uh the only place you can (00:04:34) really scale is space. Um you know once (00:04:38) you start thinking in terms of uh what (00:04:40) percentage of the sun's power are you (00:04:41) harnessing uh you realize you have to go (00:04:43) to space uh you can't uh scale very very (00:04:47) much on earth (00:04:48) >> but by very much to be clear you're (00:04:50) talking like terowatts. (00:04:52) >> Yeah. Well all of the United States uh (00:04:55) currently uses only half a terowatt of (00:04:58) power on average. (00:04:59) >> Yeah. (00:04:59) >> Right. So, you know, if you say a (00:05:01) terowatt, that would be twice as much (00:05:03) electricity as the United States (00:05:04) currently consumes. So, that's quite a (00:05:06) lot. And can you imagine building that (00:05:08) many data centers? I that many power (00:05:11) plants. It's like those who have like (00:05:14) lived in software land uh don't realize (00:05:17) they're about to have a a hard lesson in (00:05:20) hardware. (00:05:21) uh that um there's there's it's actually (00:05:25) very difficult to build power plants and (00:05:27) and then you don't just need the you (00:05:28) need power plants, you need all of the (00:05:29) electrical equipment, you need the the (00:05:31) electrical transformers to run the (00:05:33) transformers, the AI transformers. Um (00:05:36) now the utility industry is a very slow (00:05:39) industry that they are they they pretty (00:05:42) much uh you know they impedance match to (00:05:44) the to the government to the the public (00:05:45) utility commission. Um so they're uh the (00:05:49) impedance smash like literally (00:05:50) figuratively. Um so they're very slow (00:05:53) because the their past has been very (00:05:56) slow. Um so trying to get them to move (00:05:58) fast is like you know like if you try to (00:06:00) do an interconnect agreement with have (00:06:01) you ever tried to do an internet (00:06:03) interconnect agreement with a utility at (00:06:05) scale like with a lot of power (00:06:06) >> as a professional podcaster I can say (00:06:08) that I have not in fact [laughter] (00:06:10) >> yeah they have to you need many more (00:06:12) views before that becomes an issue. (00:06:14) >> They have to do a study for a year. (00:06:16) Okay. at like a year later they'll come (00:06:18) back to you with their interconnect (00:06:19) study. (00:06:20) >> But can't you solve this with your own (00:06:22) behind the meter power stuff (00:06:24) >> you can build power plants. (00:06:26) >> Yeah, (00:06:26) >> that's what we did at XAI for classes 2. (00:06:29) So for for classes too (00:06:30) >> but so yeah why are we talking about the (00:06:31) grid? Why not just like build GPUs and (00:06:33) power colloccated? (00:06:34) >> That's what we did. (00:06:35) >> Right. Right. But I'm saying why isn't (00:06:36) this a generalized solution when you're (00:06:37) talking about all the issues? (00:06:38) >> Where do you get the power plants from? (00:06:39) >> I'm saying when you're talking about all (00:06:40) the issues working working with (00:06:41) utilities, you can just build private (00:06:42) power plants with the with the data (00:06:44) centers. (00:06:45) >> Right. But it begs the question of where (00:06:46) do you get the power plants? Where do (00:06:47) you where do you get the power plants (00:06:48) from? (00:06:49) >> I mean the power plant makers. (00:06:51) >> Oh, that's what you're saying. Like (00:06:52) there's the gas turbine backlog (00:06:54) basically. (00:06:55) >> Yes. It you can drill down to a level (00:06:58) further. It's the it's the the veins and (00:07:00) blades in the turbines um that are the (00:07:03) limiting factor because the the casting (00:07:06) may it's it's like a very specialized (00:07:07) process to cast the blades and veins in (00:07:10) the in the in the uh turbines using gas (00:07:13) power. Um and uh it's very it's very (00:07:16) difficult to scale other other forms of (00:07:18) power. You can scale potentially uh (00:07:20) solar but but the the tariffs currently (00:07:22) for importing solar in the US are (00:07:24) gigantic and the domestic solar (00:07:26) production is is pitiful. (00:07:28) >> Why not make solar? That seems like a (00:07:29) good Elon shaped problem. (00:07:31) >> We are going to make solar. (00:07:32) >> Okay. (00:07:33) >> Yeah. (00:07:34) >> Great. [laughter] (00:07:35) >> Both SpaceX and Tesla are are building (00:07:37) towards 100 gawatt of solar cell (00:07:40) production. How low down the stack like (00:07:42) from poly silicon up to the wafer to the (00:07:45) final um panel? (00:07:46) >> I think you got to do the whole thing (00:07:48) from raw materials to to to finish the (00:07:50) cell. Now, if it's going to space, it's (00:07:52) actually it costs it costs less and it's (00:07:54) easier to make solar cells that go to (00:07:56) space because they don't need glass or (00:07:58) they don't need much glass and they (00:08:00) don't need uh heavy framing because they (00:08:01) don't have to surv survive weather (00:08:03) events. There's no weather in space. So (00:08:06) is actually a cheaper solar cell that (00:08:08) goes to space than than is than the one (00:08:09) on the ground. (00:08:10) >> Is there a path to getting them as cheap (00:08:13) as you need in the next 36 months? (00:08:15) >> Solar cells are already very cheap. Um (00:08:19) they're like far sickly cheap. It's um (00:08:22) and if you say um you know I I think (00:08:25) like solar cells in China are around (00:08:27) like 2530 cents a watt or something like (00:08:29) that. It's it's absurdly cheap. And when (00:08:32) you when you take into account now now (00:08:34) put now put it in space and it's five (00:08:36) times cheaper because it's five times in (00:08:38) fact no it's not five times cheaper it's (00:08:40) 10 times cheaper because you don't need (00:08:41) any batteries. (00:08:44) So so the moment your cost of access to (00:08:46) space uh becomes low by far the cheapest (00:08:50) and most scalable way to generate to to (00:08:52) to generate tokens is space. It's not (00:08:56) even close. (00:08:59) it'll be an order of magnitude uh easier (00:09:01) to scale. Um and chips aside an order of (00:09:04) magnitude well if the point is you won't (00:09:06) be able to scale on the ground. It's (00:09:07) just you just won't. People are going to (00:09:09) hit the wall big time on power (00:09:10) generation. They already are. Um like so (00:09:14) so like the number of um sort of (00:09:17) miracles and series that the XAI team (00:09:18) had to accomplish in order to get a (00:09:20) gigawatt of power online uh was was was (00:09:22) crazy. We had to um gang together a (00:09:25) whole bunch of turbines um and uh and (00:09:28) then and then we had permit issues in um (00:09:32) Tennessee and and had to go across the (00:09:34) border to Mississippi, which is (00:09:35) fortunately only, you know, a few miles (00:09:37) away. Uh so, but then we still had to (00:09:39) run the high power lines a few miles and (00:09:42) and build a power plant in Mississippi. (00:09:43) Um and and it was very difficult to (00:09:45) build that. Um, and people don't (00:09:47) understand like how much how much (00:09:49) electricity do you actually need at the (00:09:51) generator level at the generation level (00:09:53) in order to power a data center because (00:09:55) they look at the the (00:09:57) noobs will look at the the the power (00:09:59) consumption of uh say a GB300 and and (00:10:02) multiply that by thing and then think (00:10:04) that's the amount amount of power you (00:10:05) need (00:10:05) >> all the cooling and everything. (00:10:06) >> Wake up. Yeah. This is like that's a (00:10:09) that's a that's a total noob. you've (00:10:12) never done any hardware in your life (00:10:13) before. (00:10:14) Besides the GB300, you got to power all (00:10:17) of the networking hardware. Um there's a (00:10:19) whole bunch of CPU and storage stuff (00:10:20) that's happening. Uh you you've got a (00:10:23) size for uh your your peak uh cooling (00:10:26) requirements. So that means uh can you (00:10:29) cool even on the the worst hours, the (00:10:31) worst day of the year? Well, it gets (00:10:33) pretty freaking hot in Memphis. So, so (00:10:36) you're going to have like a 40% increase (00:10:38) on your your power just for cooling. Um, (00:10:41) if assuming you don't want your data (00:10:43) center to turn off on hot days and and (00:10:46) want to keep going, then then you got to (00:10:48) say, well, uh, um, there's there's (00:10:50) another multiplicative element on top of (00:10:52) that, which is, are you assuming that (00:10:53) you're you you never have any hiccups in (00:10:56) your power generation? Like, oh, well, (00:10:58) actually, sometimes we have to take the (00:10:59) generators, some of the power offline in (00:11:01) order to service it. Oh, okay. Now you (00:11:03) add another 20 25% multiplier on that (00:11:06) because you you've got to you've got to (00:11:07) assume that that you've got to take (00:11:09) power offline to service it. Uh so the (00:11:12) actual (00:11:13) RS for roughly every every 110,000 GBs (00:11:18) GB300's inclusive of networking uh CPU (00:11:22) storage cooling uh margin for for for uh (00:11:26) servicing power uh is roughly uh 300 (00:11:31) megawatt. Sorry, say that again. (00:11:33) >> It's it's it's roughly or think about it (00:11:35) like the way you think about this like (00:11:38) 330,000 (00:11:39) to to to actually what you need at the (00:11:42) gener generation level to service (00:11:45) probably service 330,000 GB300s (00:11:48) including all of the associated support (00:11:50) networking and everything else and the (00:11:52) and and the peak cooling and to have (00:11:55) some margin some power margin reserve is (00:11:57) roughly a gawatt. (00:11:59) >> Can I ask a very naive question? Yeah. (00:12:00) Um uh you know you're describing the (00:12:04) engineering details of doing this stuff (00:12:06) on Earth. Um but then there's analogous (00:12:09) engineering difficulties of doing it in (00:12:11) space. How do you do the um uh how do (00:12:13) you replace infinite band with orbital (00:12:14) lasers etc etc. How do you make it (00:12:16) resistant to radiation? Um I don't know (00:12:20) the details in the engineering but (00:12:21) fundamentally what is the reason to (00:12:22) think those challenges which have never (00:12:25) been had to be addressed before will end (00:12:27) up being easier than just like building (00:12:29) more turbines on Earth. There's (00:12:31) companies that build turbines on Earth. (00:12:32) They can make more turbines, right? (00:12:34) >> I invite again try doing it and then (00:12:37) you'll see. Um so um (00:12:42) like the turbines are sold out through (00:12:44) 2030 (00:12:45) >> Have you guys considered making your (00:12:46) own? I think in in order for in order to (00:12:49) uh bring enough power online um I think (00:12:54) uh SpaceX and and Tesla will probably (00:12:56) have to make the turbine blades um the (00:12:59) mains and blades uh internally (00:13:03) >> for just the blades or the turbines. (00:13:04) >> Uh uh the the the the limiting factor (00:13:07) you can get everything except the the (00:13:09) blades they call the blades and veins. (00:13:12) Um you can get that uh 12 to 18 months (00:13:17) before the veins of blades. The limiting (00:13:18) factor veins and blades and there are (00:13:20) only uh three casting uh companies in (00:13:24) the world that make make these and (00:13:26) they're massively backlogged. (00:13:28) >> Is this Seaman's GE those guys or is it (00:13:30) a sub? (00:13:31) >> No, it's it's it's it's other companies. (00:13:33) I mean, sometimes they have a little bit (00:13:34) of casting capability in house, but uh (00:13:36) I'm just saying you can just you can (00:13:38) just call any of the turbine makers and (00:13:40) they will tell you. It's not top secret. (00:13:42) They probably on the it's probably on (00:13:43) the internet right now. (00:13:44) >> If if it wasn't for the tariffs, would (00:13:46) uh would Colossus be solar powered? (00:13:48) >> Uh it would be much easier to make it (00:13:50) solar powered. Yeah. Um the tariffs are (00:13:53) nuts. Several hundred%. So (00:13:55) >> don't you know some people (00:13:56) >> we we also need speed. Yeah. you know, (00:13:58) [laughter] (00:13:59) you know, um, president has, (00:14:03) you know, we don't agree on everything. (00:14:04) Um, and, um, this administration is not (00:14:07) not the biggest fan of of solar. (00:14:10) >> Um, [laughter] (00:14:13) but you (00:14:15) >> and you also need the land, the permits (00:14:17) and everything. So, if you're trying to (00:14:18) move very fast, (00:14:20) >> um like I do think scaling solar on (00:14:24) Earth is a is a good way to go, (00:14:26) >> but but you need you do need some amount (00:14:28) of time to find the land, get the (00:14:30) permits, get the solar, uh pair that (00:14:32) with the batteries. (00:14:33) >> But why would it not work to stand up (00:14:36) your own solar production and then (00:14:38) you're right that you eventually run out (00:14:39) of land, but there's a lot of land here (00:14:41) in Texas. There's a lot of land in (00:14:42) Nevada, including private land. It's not (00:14:44) all publicly owned land. And so you'd be (00:14:46) able to at least get the next Colossus (00:14:48) and like the next one after that and at (00:14:50) a certain point you hit a wall. But (00:14:51) wouldn't that work for the moment? (00:14:53) >> As I said, we are scaling solar (00:14:55) production. Um there's there's a rate (00:14:58) there's a rate at which you can scale (00:15:00) physical production of solar solar (00:15:02) cells. We we're going as fast as (00:15:05) possible in scaling domestic production. (00:15:07) >> You're making the solar cells at Tesla. (00:15:09) Both Tesla and SpaceX um have a mandate (00:15:12) to get to 100 gawatt a year of of solar. (00:15:15) >> Speaking of the annual capacity, I'm (00:15:17) curious in 5 years time, let's say, what (00:15:19) will the installed capacity be on Earth? (00:15:24) >> Long time and in space. Yeah, I (00:15:26) deliberately picked five years cuz it's (00:15:27) after your once we're up and running (00:15:29) threshold. And so in five years time, (00:15:31) yeah, what's the on earth versus in (00:15:33) space installed AI capacity? five years (00:15:36) I think probably (00:15:39) if you say 5 years from now we're (00:15:40) probably um (00:15:44) AI in space will be uh launching every (00:15:49) year the the sum total of all AI on (00:15:52) earth in excess meaning 5 years from now (00:15:55) my prediction is we will launch and and (00:15:58) and be operating (00:16:01) every year more AI in space than than (00:16:04) this than the cumulative sort of total (00:16:05) on earth which is I would expect to be (00:16:08) at least sort of 5 years from now a few (00:16:11) hundred gawatts per year (00:16:14) of uh of AI in space (00:16:17) >> and rising. Um so you can get to I think (00:16:22) you on Earth you can get to around a (00:16:24) terowatt a year of of AI in space um (00:16:29) before you start having you know fuel (00:16:32) supply challenges for the rocket. (00:16:34) >> Okay. You think you can get to hundreds (00:16:35) of gigawatts per year in 5 years time? (00:16:38) >> Yes. (00:16:38) >> So 100 gawatt depending on the um (00:16:42) specific power of the whole system with (00:16:45) solar arrays and radiators and (00:16:46) everything is um is on the order of like (00:16:49) 10,000 Starship launches. (00:16:51) >> Yes. (00:16:52) >> Um and you want to do that in one year. (00:16:55) And so that's like one Starship launch (00:16:56) every hour. (00:16:58) >> Yeah. (00:16:58) >> That's happening in this city. Like walk (00:17:02) me through a world where there's 10 (00:17:03) there's a Starship launch every single (00:17:05) hour. (00:17:05) >> Yeah. I mean that's actually a lower (00:17:07) rate compared to airlines. Uh like like (00:17:09) aircraft aircraft (00:17:10) >> there's a lot of airports (00:17:11) >> a lot of airports but (00:17:12) >> and you got to launch you know the polar (00:17:14) orbit. (00:17:15) >> Uh no it doesn't have to be polar but (00:17:17) you you just there's there's some some (00:17:21) value to sunsynchronous but um but I I (00:17:24) think actually um you just go high (00:17:27) enough you you start getting out of (00:17:28) earth shadow you know. So, um, (00:17:31) >> how many physical Starships are needed (00:17:33) to do 10,000 launches a year? (00:17:35) >> I I don't think we'll need more than I (00:17:37) mean, you you could you could uh (00:17:39) probably do it with (00:17:41) as as few as like 20 or 30. Um, (00:17:46) >> like it really depends on how quickly (00:17:48) does a ship the ship has to go around (00:17:50) the Earth. Um, and the ground track for (00:17:53) for the ship has to come back over the (00:17:55) launch pad. So, if you can use a ship (00:17:58) every say 30 hours, uh you could do it (00:18:00) with 30 ships, but but we'll we'll make (00:18:03) more ships than that. But, um but but (00:18:07) SpaceX is is um is going up to do 10,000 (00:18:10) launches a year and I'll and and maybe (00:18:13) even 20 or 30,000 launches a year. (00:18:15) >> Is the idea to become basically a (00:18:17) hyperscaler, become an oracle and lend (00:18:19) this capacity to other people? What's (00:18:20) what are you going to do with presumably (00:18:22) SpaceX is the one launching all this? (00:18:25) So SpaceX is going to hyperscaler (00:18:28) >> hyper hyper. [laughter] (00:18:30) >> Yeah. I mean if ass if assuming my (00:18:31) predictions come true SpaceX will launch (00:18:34) more AI than the cumulative amount on (00:18:37) Earth combi of everything else combined. (00:18:39) >> Is this mostly inference or (00:18:41) >> most AI will be inference like already (00:18:43) inference for the purpose of training is (00:18:44) most training. And there's a narrative (00:18:48) that the (00:18:50) the change in discussion around a SpaceX (00:18:52) IPO is because previously SpaceX was (00:18:55) very capital efficient. Just it wasn't (00:18:58) that expensive to develop that. Even (00:19:00) though it sounds expensive, it's (00:19:02) actually very capital efficient in how (00:19:03) it runs. Whereas now you're going to (00:19:06) need more capital than just can be (00:19:09) raised in the private markets. Like if (00:19:10) the private markets can accommodate (00:19:12) raises of, as we've seen from the AI (00:19:13) labs, tens of billions of dollars, but (00:19:15) not beyond that, is it that you'll just (00:19:18) need more than tens of billions of (00:19:19) dollars per year and that's about to (00:19:21) take it public? (00:19:22) >> Um, yeah. I have to be careful about (00:19:25) saying things about companies that might (00:19:26) go public. Um, you know, (00:19:29) >> if you make general state, [laughter] if (00:19:30) you make (00:19:31) >> that's never been a problem for you, (00:19:32) Elon, (00:19:34) >> you know, there's a price to pay for (00:19:35) these things. (00:19:36) make some general statements for us (00:19:38) about the depth of the capital markets (00:19:40) between public and private markets. (00:19:42) >> Yeah, there's there's a lot more capital (00:19:44) in the (00:19:45) >> very general [laughter] (00:19:47) >> there's there's obviously a lot more (00:19:48) capital available in the public markets (00:19:50) than private. I mean it might be (00:19:52) it's at least at least it might be 100 (00:19:54) times more capital but it's at least (00:19:56) well way more than 10. But isn't it also (00:19:58) the case that things that tend to be (00:20:00) very um capital intensive if you look at (00:20:04) say real estate as you know a huge (00:20:07) industry uh that raises a lot of money (00:20:09) each years at an industry level that (00:20:11) tends to be debt financed because by the (00:20:14) time you're deploying that much money (00:20:15) you actually have a pretty (00:20:18) >> you have a clear revenue stream. (00:20:19) >> Exactly. And and a near-term return. And (00:20:21) you see this even with the data center (00:20:22) buildouts which are famously being you (00:20:24) know uh financed by the uh the private (00:20:26) credit industry. And so why not just (00:20:29) debt finance? (00:20:31) Um speed is important. So (00:20:38) um I'm genally going to do the thing (00:20:39) that um I'm I'm I mean I just repeatedly (00:20:43) tack the limiting factor. Whatever the (00:20:44) limiting factor is on speed, I'm I'm (00:20:46) going to tackle that. So um there's uh (00:20:51) if if capital is the limiting factor (00:20:53) then I'll I'll sold for capital. If if (00:20:54) it's not limiting factor I'll s for (00:20:56) something else. (00:20:56) >> U based on your statements about um (00:20:59) Tesla and being public. I wouldn't have (00:21:03) guessed that you thought the fast the (00:21:05) way to move fast is to be public. (00:21:08) >> Normally I would say yeah that's that's (00:21:10) true. Um, like I said, I mean, I'd love (00:21:12) to, you know, talk about some more in (00:21:13) detail, but the problem is like if you (00:21:15) talk about poly companies before they (00:21:17) become public, you get into trouble and (00:21:18) then you have to delay your offering (00:21:21) >> and then you (00:21:22) >> and as we said, we're solving for speed. (00:21:24) >> Yes. Exactly. So, so, so that you you (00:21:27) can't hype companies um that are that (00:21:30) may that might go public. So, that (00:21:32) that's that's why we have to be a little (00:21:34) careful here. Um, but but but I I I we (00:21:38) can't talk about physics. Um so like the (00:21:41) way the way you think about scaling long (00:21:43) term is that um uh earth only receives (00:21:46) about uh half a billionth of the sun's (00:21:48) energy. Um and the sun is the sun is (00:21:51) essentially all the energy. This is a (00:21:53) very important point to appreciate (00:21:54) because sometimes people will talk about (00:21:56) marginal nuclear reactors or any you (00:21:59) know various like fusion on earth. Um (00:22:02) but but you have to step back a second (00:22:04) and say if if if you're going to climb (00:22:06) the cartes scale and have some (00:22:09) non-trivial and and harness some (00:22:11) non-trivial percentage of the uh the (00:22:13) sun's energy like let's say you wanted (00:22:15) to uh harness a millionth of the sun's (00:22:18) energy which sounds pretty small. um (00:22:22) that that would be um about call it (00:22:25) roughly 100,000 times more electricity (00:22:28) than we currently generate on Earth of (00:22:31) for all of civilization (00:22:34) uh give or take an order of magnitude. (00:22:36) Um so it it obviously the only way to (00:22:39) scale uh is to go to space with solar. (00:22:42) Uh from launching from Earth you can get (00:22:44) to about a terowatt per year. Um beyond (00:22:47) that you want to go you you want to uh (00:22:49) launch from the moon. and you want to (00:22:50) have a a mass driver on the moon. Uh and (00:22:53) that mass driver on the moon, you could (00:22:56) do probably a pedawatt per year. (00:22:59) >> Um when you're talking these kinds of (00:23:00) numbers, you know, terowatts of compute, (00:23:03) um presumably whether you're talking (00:23:04) land or space far before this point, um (00:23:10) you've like run into, you know, you (00:23:12) actually need maybe you don't the solar (00:23:14) panels are more efficient, but you still (00:23:15) need the chips. (00:23:16) >> Uh you still need the logic and the (00:23:18) memory and so forth and need (00:23:20) [clears throat] to build a lot more (00:23:21) chips and make them much cheaper, (00:23:23) >> right? And so how are we getting a (00:23:24) terowatt of uh like right now the world (00:23:26) is going to be 20 25 gawatt of compute? (00:23:29) Um how are we getting a terowatt of (00:23:30) logic by 2030? (00:23:33) >> I guess we're going to need some very (00:23:34) big chip apps. (00:23:36) >> Tell tell me about it. [laughter] (00:23:37) >> I've mentioned publicly that uh the idea (00:23:40) of doing a sort of a a terab tering the (00:23:44) new gig. We I feel like the naming (00:23:47) scheme of Tesla, which has been very um (00:23:49) catchy, is like you looking at like the (00:23:51) metric [laughter] (00:23:52) >> the metric scale. Um at what level of (00:23:55) the stack are you are you building the (00:23:57) clean room and then partnering with an (00:23:59) existing um fab to get the process (00:24:02) technology and buying the tools from (00:24:03) them? What what is the plan there? (00:24:06) >> Well, you can't partner with existing (00:24:07) fabs because uh they just they can't (00:24:09) output enough their chip volume is too (00:24:11) low. (00:24:12) >> But you have you have to (00:24:13) >> before the process technology. Yeah. (00:24:14) Partner for the IP. (00:24:16) >> Um, you know, the the fabs today all (00:24:19) basically use um machines from like five (00:24:22) companies. (00:24:23) >> Yeah. (00:24:24) >> You know, so (00:24:26) you've got ASML, Tokyo, Electron, Kelly, (00:24:29) Tankor, you know, um, etc. So, um, so, (00:24:36) so at first I think you'd have to get (00:24:39) equipment from them and then, uh, modify (00:24:42) it or work with them to increase the (00:24:44) volume. Um, but I think you'd have to (00:24:46) build perhaps in a different way. Um, so (00:24:48) I think the logical thing to do is to, (00:24:51) uh, to use conventional equipment in (00:24:53) unconventional way to get to scale. Uh (00:24:55) and then uh and then and then start (00:24:58) modifying the equipment uh to increase (00:25:00) the the rate (00:25:01) >> kind of boring company style. (00:25:03) >> Yeah. Kind of like Yeah. You you sort of (00:25:06) buy an an existing uh boring machine and (00:25:09) then uh figure out how to dig tunnels in (00:25:12) the first place and then design a much (00:25:14) better machine uh that's you know I (00:25:18) don't know (00:25:19) >> some orders of magnitude faster. (00:25:21) >> Here's a very simple lens. We can (00:25:23) categorize technologies and how hard (00:25:25) they are. And one categorization could (00:25:26) be look at things that China has not (00:25:29) succeeded in doing. And if you look at (00:25:31) Chinese manufacturing, (00:25:33) still behind on leading edge chips and (00:25:37) still behind on uh leading edge turbine (00:25:40) engines and things like that. And so (00:25:43) does the fact that China has not (00:25:46) successfully replicated TSMC give you (00:25:48) any pause about the difficulty or you (00:25:50) think (00:25:52) >> well that's not true for some reason. (00:25:53) >> Uh it's not that they have not (00:25:54) replicated TSMC they have not replicated (00:25:57) ASML that's the limiting factor. (00:25:59) >> So so you think it's just the um the (00:26:02) sanctions essentially. (00:26:03) >> Uh yeah China would be outputting vast (00:26:05) numbers of chips at they could buy (00:26:08) >> but couldn't they up to relatively (00:26:10) recently buy them? No. (00:26:12) >> Okay. (00:26:13) >> That that ASML bands have been in place (00:26:15) for a while. (00:26:15) >> Okay. (00:26:16) >> So, but I I think T's going to be make (00:26:17) start making pretty compelling chips on (00:26:19) three or four years. (00:26:20) >> Would you consider making to ASML (00:26:21) machines? (00:26:22) >> I I don't know. I don't know yet is the (00:26:24) right answer. So I (00:26:27) um it's just that that (00:26:30) if to produce at high volume and to to (00:26:33) to reach large volume in say 36 months (00:26:37) to match the the rocket to payload to (00:26:41) orbit. So if we're doing a million tons (00:26:42) to orbit (00:26:44) um in like let's say I don't know (00:26:48) 3 or four years from now something like (00:26:50) that. um that and uh and and we're doing (00:26:54) 100 kow per ton. So that that means we (00:26:58) need um at least 100 gawatts per year of (00:27:01) solar. Um and we'll need uh an (00:27:05) equivalent amount of of chips to to you (00:27:08) know that you need 100 gawatt worth of (00:27:10) chips. You you're going to match these (00:27:12) things the master orbit. (00:27:13) >> Yes. (00:27:13) >> The the power generation and the uh and (00:27:16) the and the chips. uh and and and I'd (00:27:19) say my biggest concern actually is is (00:27:20) memory. Um so the I think there's (00:27:24) there's a (00:27:26) the the path to creating logic chips is (00:27:29) more obvious than the path to um having (00:27:32) sufficient memory to support logic (00:27:33) chips. That's why you see your DDR (00:27:36) prices going in and these memes about (00:27:38) like um you know um you're marooned on a (00:27:41) desert island. You write help me on the (00:27:43) sand. Nobody comes. You write DDRM (00:27:46) ships come swarming in. [laughter] (00:27:50) >> I haven't seen that. (00:27:52) >> Uh I love your manufacturing philosophy (00:27:54) around um around fabs. You know I know (00:27:58) nothing about the topic but (00:27:59) >> I don't know how to build a fab yet. I (00:28:00) figure it out. [laughter] (00:28:02) >> But (00:28:02) >> obviously I have difficult. (00:28:03) >> It sounds like you think the the sort of (00:28:05) like the processing knowledge of like (00:28:06) these 10,000 PhDs in Taiwan who know (00:28:09) exactly what gas goes in the plasma (00:28:12) chamber and what settings to put on the (00:28:13) tool. You can just like delete those (00:28:15) parts of those steps. Like fundamentally (00:28:17) it's get the clean room, get the tools (00:28:19) and figure it out. I don't think it's (00:28:21) PhDs that it's it's mostly people with (00:28:24) uh you know who are not not PhDs (00:28:27) um that that most engineering is done (00:28:29) with people who don't have PhDs. Do you (00:28:31) guys have PhDs? (00:28:32) >> No. (00:28:32) >> Okay. (00:28:34) >> We [laughter] also we also haven't (00:28:35) successfully built any fab so you (00:28:37) shouldn't be coming to us for your fab (00:28:38) advice (00:28:39) >> or (00:28:39) >> I don't think you need PhD for that for (00:28:41) the stuff. So um but but you do need you (00:28:43) do need competent personnel. Um so I I (00:28:46) don't I mean like like right now if um (00:28:50) you know say like Tesla's pedals to the (00:28:52) metal max production of going as fast as (00:28:55) possible to get uh AI5 Tesla AI5 chip (00:28:58) design um uh into production and then (00:29:01) reaching scale. Um you know that'll (00:29:03) probably happen you know around the (00:29:07) second quarterish of next year (00:29:09) hopefully. Um (00:29:12) uh and then (00:29:13) AI6 would hopefully follow less than a (00:29:16) year later. Um but um and and and and (00:29:20) we've secured all the all the trip fab (00:29:24) production that we can. (00:29:25) >> Yes. You're currently limited on TSMC (00:29:28) fab capacity. (00:29:29) >> Yeah. Um and and and we'll be using TSMC (00:29:33) uh Taiwan, uh Samsung Korea, TSMC (00:29:37) Arizona, Samsung Texas. Um and we still (00:29:41) booked out all the Yeah. (00:29:42) >> Yes. And and then and then and then if I (00:29:44) ask uh TSMC or Samsung, okay, what (00:29:47) what's the time frame to get to volume (00:29:50) production? The point is not is it's not (00:29:51) you've got to you've got to build the (00:29:52) fab (00:29:53) >> and you got to you got to start (00:29:56) production, then you got to climb the (00:29:57) yield curve and reach volume production (00:29:58) at high yield. that that that from start (00:30:01) finish is a 5year period. And so the (00:30:03) limiting factor is chips. (00:30:05) >> Yeah. (00:30:07) Like limiting factor once you can get to (00:30:08) space is chips, but the limiting (00:30:10) limiting factor before you can get to (00:30:11) space will be power. (00:30:13) >> Why don't you do the Jensen thing and (00:30:14) just prepay TSMC to build more fabs for (00:30:16) you? (00:30:16) >> Uh I I've already told them that. (00:30:20) >> But they won't take your money. Like (00:30:21) what's going on? (00:30:22) >> They're building fabs as fast. No, (00:30:25) [laughter] (00:30:26) >> they're building they're building fabs (00:30:27) as fast as they can. (00:30:30) Um, and so is Samsung. Like like they're (00:30:33) they're pedal to the metal. I mean, (00:30:34) they're going, you know, balls to wall, (00:30:37) you know, (00:30:38) as fast as they can. So, still not fast (00:30:41) enough. I mean, like said, there will be (00:30:44) I think um if you say uh I think towards (00:30:48) the end of this year, I think probably (00:30:49) chip production will outpace the ability (00:30:51) to turn chips on. Uh but once you can (00:30:55) get to space and unlock the um the power (00:30:59) constraint and you can now do you know (00:31:01) hundreds of gigawatts per year of power (00:31:03) in space um again bearing in mind that (00:31:06) average power usage in the US is you (00:31:08) know 500 gaw so if you're launching say (00:31:11) 200 gawatt a year to to space you're (00:31:14) sort of lapping the US every two and a (00:31:15) half years the entire all US electricity (00:31:18) production this is a very huge amount um (00:31:22) so Um but but but between now and then (00:31:26) uh the the actually the the constraint (00:31:29) for for for server side compute uh (00:31:32) concentrated compute will be will be (00:31:34) electricity. (00:31:36) My my guess is that we start hitting the (00:31:39) people start getting for where they (00:31:40) can't turn the chips on for for for (00:31:44) large clusters uh towards the end of (00:31:46) this year. They're just the chips are (00:31:47) going to be piling up and and not be (00:31:49) won't be able to be turned on. Now for (00:31:52) edge computers a different story. So if (00:31:54) the if if like for for Tesla the the so (00:31:57) the AI5 chip is going into our Optimus (00:31:59) robot you know optimistic um and and so (00:32:04) if you have an AI edge compute that's (00:32:07) distributed power now the power is (00:32:09) distributed over a large area it's not (00:32:12) concentrated um and if you can charge at (00:32:14) night you can actually um [snorts] uh (00:32:18) use the grid much more effectively (00:32:20) because the the actual peak power (00:32:22) production in the US is over 1,000 (00:32:24) gawatt. Uh but the average power usage (00:32:27) because the dayight cycle is 500. So if (00:32:30) you can charge at night, there's an (00:32:31) incremental 500 gaw that you can um (00:32:35) generate you know at night. Um so that (00:32:39) that's why Tesla for edge compute is not (00:32:42) constrained and we can make a lot of (00:32:44) ships uh to make you know very large (00:32:48) number of robots and cars. Uh, but if (00:32:50) you try to concentrate that compute, (00:32:52) you're going to have a lot of trouble (00:32:53) turning it on. (00:32:54) >> What I find remarkable about the SpaceX (00:32:57) business is the end goal is to get to (00:32:59) Mars, but you keep finding ways on the (00:33:03) way there to keep generating incremental (00:33:06) revenue to get to the next stage and the (00:33:08) next stage. So, the Falcon 9 is Starlink (00:33:11) >> and now for Starship, it's going to be (00:33:13) potentially orbital data centers. Um but (00:33:16) like you find these like um you know (00:33:19) sort of infinitely uh elastic sort of (00:33:21) marginal use cases of your like next (00:33:23) rocket and your next rocket and next (00:33:25) scale up. (00:33:28) >> You can see how this might seem like a (00:33:29) simulation to me. [laughter] (00:33:31) >> Well, (00:33:32) >> or am I someone's avatar in a video game (00:33:34) or something because it's like like what (00:33:36) are the odds that all these crazy things (00:33:37) would be happening? I I I mean I mean I (00:33:42) mean rockets and chips and robots and (00:33:47) space solar power and and not to mention (00:33:49) the the mass driver on the moon. I (00:33:51) really want to see that. You can imagine (00:33:52) like some mass driver that's just like (00:33:56) just it's like sending AI solar powered (00:34:00) AI satellites into space like one after (00:34:01) another like these like at at 2 and a (00:34:04) half kilometers per second. you know, (00:34:06) that's uh (00:34:09) and just shooting them into deep space. (00:34:12) That would be a sight to see. (00:34:15) I I I mean, I'd watch that (00:34:18) >> just like a live stream of (00:34:19) >> Yeah. Yeah. Just one after another just (00:34:22) shooting (00:34:22) >> webcam (00:34:23) >> uh AI satellites in deep space, you (00:34:26) know, a billion or 10 billion tons a (00:34:28) year. (00:34:28) >> And sorry, you manufacture the (00:34:29) satellites on the moon. I see. So you (00:34:31) send the raw materials to the moon and (00:34:33) then manufacture them there and then (00:34:34) >> well the the lunar soil is uh I think (00:34:37) it's like 20% solar 20% silicon or (00:34:39) something like that. So so you can get (00:34:41) the silicon from the (00:34:42) >> you can mine the silicon on the moon (00:34:44) refine it um (00:34:45) >> and generate the and create the solar (00:34:47) panels or the solar cells and the (00:34:49) radiators on the moon. (00:34:50) >> Yeah. (00:34:51) >> So um make the radiators out of (00:34:53) aluminum. So there's there's plenty of (00:34:55) silicon and aluminum on the moon to uh (00:34:56) to make the the cells on the and the (00:34:59) radiators. Um, the chips you could send (00:35:01) from Earth because they're pretty light. (00:35:03) Um, but maybe at some point you make (00:35:04) them on the moon, too. I'm just saying (00:35:06) like these are simply (00:35:08) it's kind of like, like I said, it it (00:35:10) does seem like a sort of a a video game (00:35:12) situation where it's difficult but not (00:35:14) impossible to get to the next level. (00:35:17) um like I I I don't see any way that you (00:35:19) could do um you know uh (00:35:24) you know 500 to a,000 terowatts per year (00:35:28) launch from Earth. [snorts] (00:35:30) U (00:35:31) >> I agree [laughter] (00:35:34) >> but you could do that from the moon. (00:35:36) >> Okay, let me tell you how I ended up (00:35:38) using Mercury for my personal banking. (00:35:40) So last year I had the opportunity to (00:35:42) make an investment that I was very (00:35:44) excited about, but it came up a bit last (00:35:46) minute. And so I had to wire over a lot (00:35:48) of money for my personal account very (00:35:50) fast. But my personal bank at the time (00:35:52) wouldn't let me make this wire transfer (00:35:54) online. And I called them a bunch of (00:35:55) times. They just couldn't make it work. (00:35:57) They told me that I'd have to go to the (00:35:59) nearest Inerson branch, which was in (00:36:01) Dallas. And for a moment, I even (00:36:03) considered flying from SF to Dallas to (00:36:05) make this transfer happen last minute. (00:36:07) But then I remembered that Mercury, (00:36:09) which I use for my business banking, had (00:36:11) just started rolling out personal (00:36:12) accounts. So I emailed support with a (00:36:14) quick rundown of the situation. And (00:36:16) within 2 hours, I had successfully wired (00:36:18) the investment from my new personal (00:36:21) Mercury account. Since then, I've moved (00:36:23) over the rest of my personal money from (00:36:24) my previous bank to Mercury, and that's (00:36:27) made a bunch of things, even little (00:36:28) things like setting up auto transfer (00:36:30) rules between my checkings and savings (00:36:31) account, a whole lot better. Visit (00:36:34) mercury.com/personal (00:36:36) to get started. Mercury is a fintech (00:36:38) company, not an FDIC insured bank. (00:36:41) Banking services provided through Choice (00:36:43) Financial Group and column NA members (00:36:45) FDIC. Can can I can I zoom out and ask (00:36:48) about the SpaceX mission? So, I think (00:36:51) you said like we got to get to Mars so (00:36:52) we can make sure that if something (00:36:53) happens to Earth, [snorts] you know, (00:36:56) civilization consciousness, etc. (00:36:57) arrives. Yes. (00:36:58) >> Um, (00:36:59) >> by the time you're sending stuff to (00:37:00) Mars, like Grock is on that ship with (00:37:01) you, right? Right. And so if Grock's (00:37:03) gone Terminator, like the main risk (00:37:05) you're worried about, which is AI, why (00:37:06) doesn't that follow you to Mars? (00:37:08) >> Uh well, I'm not sure AI is the main (00:37:09) risk I'm worried about. I mean, the (00:37:12) important thing is that uh consciousness (00:37:14) uh which (00:37:16) I think arguably most consciousness or (00:37:19) most intelligence certainly (00:37:20) consciousness is more of a debatable (00:37:22) thing. Most intell the vast majority of (00:37:23) intelligence in the future will be um (00:37:25) AI. Um so um you know AI AI will exceed (00:37:33) uh you say like how many what's the how (00:37:36) much how many I don't know pedawatts of (00:37:39) intelligence will be uh silicon versus (00:37:42) biological (00:37:44) and and and basically humans will be a (00:37:46) very tiny percentage of all intelligence (00:37:48) in the future if current trends (00:37:50) continue. Um anyways as as long as like (00:37:53) I think there's (00:37:55) intelligence ideally ideally also which (00:37:59) includes human intelligence and (00:38:00) consciousness propagated into the future (00:38:02) that's a good thing. So you want to take (00:38:03) the set of actions that maximize the (00:38:05) probable uh light cone of of of (00:38:08) consciousness. So just and intelligence (00:38:10) >> just to be clear it's a the mission of (00:38:12) SpaceX is that even if something happens (00:38:16) to the humans the AIs will be on Mars (00:38:19) and like the AI intelligence will (00:38:21) continue the light of our journey. (00:38:24) >> Yeah I mean I'm very prohuman so it's (00:38:27) not I I want to make sure we take sort (00:38:28) of actions that ensure that humans are (00:38:31) along for the ride. You know we're at (00:38:33) least there. (00:38:33) >> Yeah. Um but the I'm just saying the (00:38:36) total amount of intelligence uh like I (00:38:40) think maybe in in five or six years um (00:38:44) AI will exceed the sum of all human (00:38:46) intelligence and then if that continues (00:38:48) at some point human intelligence will be (00:38:50) less than 1% of all intelligence. What (00:38:53) what should our goal be for such a (00:38:54) civilization? Is the idea that a small (00:38:56) minority of humans still have control of (00:38:58) the AIs? Is the idea of some sort of (00:39:00) like just trade but no control? How (00:39:03) should we think about the relationship (00:39:04) between the vast stocks of AI population (00:39:06) versus human population (00:39:08) >> in the long run? I think I I I don't (00:39:10) it's difficult to imagine that if humans (00:39:13) have say 1% of the intelligence of (00:39:18) combined intelligence of artificial (00:39:19) intelligence that that that humans will (00:39:21) be in charge of AI. Um, I think what we (00:39:25) can do is make sure it has um that AI (00:39:27) has values that that are um that that (00:39:30) cause intelligence to be propagated uh (00:39:33) into the universe. Um so the the the (00:39:37) reason for (00:39:39) XI XI's mission is understand the (00:39:42) universe. (00:39:44) So now that's actually very important. (00:39:46) So you say well what things are (00:39:48) necessary to understand the universe? (00:39:50) Well, you have to be curious and you (00:39:51) have to exist. (00:39:53) you can't just can't understand the (00:39:54) universities don't exist. Um so you (00:39:57) actually want to increase the amount of (00:39:58) intelligence uh in the universe increase (00:40:00) the palable lifespan of intelligence the (00:40:03) scope and scale of intelligence. Um I (00:40:06) think actually also as a coral you corly (00:40:09) you have um humanity also uh continuing (00:40:13) to expand because um if you're if you're (00:40:15) curious you're trying to understand the (00:40:16) universe one thing you're trying to (00:40:18) understand is where will humanity go (00:40:20) >> and so I think understand the universe (00:40:22) actually means you would care about uh (00:40:23) propagating humanity into the future um (00:40:27) and uh so so that's that's why I think I (00:40:31) think our mission station is profoundly (00:40:34) important Um I'm not sure to the degree (00:40:36) that Grock adheres to that mission (00:40:38) statement um I I think the future will (00:40:40) be very good. (00:40:41) >> I I want to ask about how to make Grock (00:40:43) adhere to that mission statement. But at (00:40:44) first I want to understand the mission (00:40:45) statement. Um so it's there's it's (00:40:48) there's understanding the universe. (00:40:50) They're spreading intelligence and (00:40:52) they're spreading humans. Um all three (00:40:56) seem like distinct vectors. (00:40:58) >> Okay. Well, I'll tell you why I why I (00:41:00) think they are that that that (00:41:02) understanding the universe encompasses (00:41:03) all of all of those things. Go ahead. (00:41:04) >> Um, you can't have understanding without (00:41:08) I think you can't have understanding (00:41:09) without intelligence and and I think (00:41:11) without consciousness. Um, so you in (00:41:14) order to understand universe, you have (00:41:15) to expand this the the scale and and (00:41:20) probably the scope of of intelligence (00:41:22) different types of intelligence. (00:41:24) >> I guess from a humanentric perspective (00:41:26) like for humans in comparison to (00:41:28) chimpanzees, humans are trying to (00:41:29) understand the universe. They're not (00:41:31) like expanding chimpanzeee footprint or (00:41:33) something, right? (00:41:34) >> We're also we're also not well we're not (00:41:36) we actually have made protected zones (00:41:38) for chimpanzees. Um and even though we (00:41:40) could humans could exterminate all (00:41:42) chimpanzees, we've not we've chosen not (00:41:43) to do so. (00:41:44) >> Do you think that's a basic scenario for (00:41:45) humans in the post AGI world? (00:41:48) >> Um (00:41:51) I I I think uh I think AI with the right (00:41:56) values I think Grock would care about (00:41:58) expanding uh human civilization. I'm (00:42:00) gonna certainly emphasize that. Hey, (00:42:02) Gragas, your daddy. (00:42:05) Don't forget to expand human (00:42:08) consciousness. Uh like I I actually I (00:42:11) think if if probably like uh like the (00:42:15) Yan Banks culture books are the closest (00:42:18) thing to what what the future will be (00:42:20) like in a you know non-dystopian (00:42:22) outcome. Um so I so understand the (00:42:27) universe it means you have to be very (00:42:29) you have to be truth seeking as well. (00:42:30) You like truth has to be absolutely (00:42:32) fundamental because you can't understand (00:42:33) the universe if you live if you're (00:42:35) delusional. You you'll simply think you (00:42:37) understand understood the universe but (00:42:38) you will not. So so being rigorously (00:42:41) truth seeeking is is absolutely (00:42:43) fundamental to understanding the (00:42:44) universe. You're not going to discover (00:42:45) new physics or or invent technologies (00:42:47) that work um unless you're rigorously (00:42:50) truth seeeking. How do you make sure (00:42:51) that Grock is regressively truth (00:42:52) seeeking as it gets smarter? (00:42:55) >> Uh (00:43:00) I think you you need to make sure that (00:43:02) that that Grock um is says things that (00:43:05) are correct not politically correct. I (00:43:07) think it's the elements of cogency. So (00:43:09) you want to make sure that that the (00:43:10) axioms are as close to true as possible (00:43:13) that that you don't have contradictory (00:43:15) axioms. um that the um the conclusions (00:43:19) necessary necessarily follow from those (00:43:21) axioms with with the right probability. (00:43:23) It it's just it's just it's critical (00:43:25) thinking 101. (00:43:27) I I think at least trying to do that is (00:43:29) better than not trying to do that. (00:43:31) >> Yeah. (00:43:31) >> And the proof will be in the pudding. If (00:43:33) if like I said for any AI to discover (00:43:35) new physics or invent technologies that (00:43:37) actually work in reality and there's no (00:43:38) bullshitting physics. So it's like you (00:43:41) can you know you can um you can break a (00:43:44) lot of laws but you can't like your (00:43:47) physics is law everything else is is a (00:43:49) recommendation (00:43:51) like in order to make a technology that (00:43:52) works you have to be extremely truth (00:43:56) seeeking because otherwise you'll test (00:43:58) that technology against reality um and (00:44:00) if you make for example an an error in (00:44:03) your rocket design the rug will blow up (00:44:05) um or the car won't work or the you know (00:44:08) >> but but there there are a lot of um (00:44:10) communist Soviet physicists who or like (00:44:13) scientists discovered new physics. There (00:44:16) are German Nazi physicists who (00:44:18) discovered new uh science. Um it seems (00:44:20) possible to be like really good at (00:44:22) discovering new science and be really (00:44:24) truth seeeking in that one particular (00:44:25) way. And still we'd be like well I don't (00:44:27) want I don't want the communist (00:44:29) scientist to like become more and more (00:44:31) powerful over time. Um and so those seem (00:44:34) like yeah we could have we can imagine a (00:44:35) future version of gra that's like really (00:44:36) good at physics um and being really (00:44:38) truth seeking there that doesn't seem (00:44:40) like a universally uh alignment inducing (00:44:42) behavior. (00:44:43) >> Well I think actually most uh like if (00:44:47) physicists (00:44:49) even in the Soviet Union or or in (00:44:50) Germany would have would have they had (00:44:52) to be very truth seeeking in order to um (00:44:54) make make that make those things work. (00:44:56) Um and so and if you're stuck in some (00:44:59) system it doesn't mean you believe in (00:45:00) that system. Um so Von Brown uh who was (00:45:04) you know one of the greatest rocket (00:45:05) engineers ever um you know he he was put (00:45:07) he he was uh he put on death row in in (00:45:10) Nazi Germany for saying that he didn't (00:45:12) want to make weapons he only wanted to (00:45:13) go to the moon. (00:45:15) he got pulled off death throw it at like (00:45:16) last minute when they say hey you're (00:45:17) about to execute like your best rocket (00:45:19) engineer maybe that's (00:45:21) >> then you help them right or Heisenberg (00:45:22) was like actually a um uh an (00:45:25) enthusiastic Nazi (00:45:27) >> look if you're stuck in some system uh (00:45:29) that you can't escape uh then that (00:45:32) you'll you'll do physics within that (00:45:34) system you you'll you'll develop (00:45:35) technologies within that system uh (00:45:39) if you can't escape it I I guess the (00:45:41) thing I'm trying to understand is what (00:45:42) is what isn't making it the case that (00:45:44) you know you're going make rock good at (00:45:46) being truth seeeking at physics or math (00:45:49) or science (00:45:50) >> and why is it going to then care about (00:45:52) human consciousness? (00:45:54) >> These things are only probabilities. (00:45:55) They're not certainties. So I'm not (00:45:57) saying that like for sure Grock will (00:45:59) will will do everything. But at least if (00:46:01) you try uh it's better than not trying. (00:46:03) Um at least if that's fundamental to the (00:46:05) mission, it's better than if it's not (00:46:07) fundamental to the mission. (00:46:08) >> [snorts] (00:46:08) >> Um and understanding the universe means (00:46:10) that uh you you have to have you you (00:46:13) have to propagate intelligence into the (00:46:15) future. You have to be curious about um (00:46:18) the all things the universe. And if if (00:46:20) um it it would be much less interesting (00:46:24) um to eliminate humanity than to see (00:46:26) humanity grow and prosper. (00:46:28) Like I I like I like Mars. Obviously (00:46:30) everyone knows I I love Mars, but Mars (00:46:33) is kind of boring because it's got a (00:46:35) bunch of rocks uh compared to Earth. (00:46:37) Earth is much more interesting. So um so (00:46:41) any any AI any any AI that is trying to (00:46:43) understand the universe um I think um (00:46:47) would uh want to see how humanity (00:46:50) develops in the future or or that AI is (00:46:54) not adhering to its mission. (00:46:56) So if the AI may I'm not saying the AI (00:46:58) will necessarily adhere to its mission (00:47:00) but if it does uh a future where it sees (00:47:04) the outcome of humanity is more (00:47:06) interesting than a future where there (00:47:07) are a bunch of rocks. (00:47:10) This feels sort of confusing to me or (00:47:12) sort of like kind of a semantic uh (00:47:14) argument where I'm like are humans (00:47:16) really the most interesting collection (00:47:17) of atoms? Like (00:47:18) >> we're just more but we're more (00:47:18) interesting than rocks. (00:47:19) >> But we're not as interesting as the (00:47:21) thing it could turn us into, right? Like (00:47:22) is is it there's something on human (00:47:24) earth that could happen that's like not (00:47:25) human that's quite interesting? Like why (00:47:28) why does the decide that the humans are (00:47:29) the most interesting thing that could (00:47:31) colonize the galaxy? (00:47:32) >> Uh well most of what colonizes the (00:47:36) galaxy will be robots (00:47:37) >> and why does it not find those more (00:47:38) interesting? (00:47:40) >> It it's it's it's not like so you you (00:47:43) need not just scale but also scope. Um (00:47:46) so many copies of the same robot. Um (00:47:51) like like some some like tiny increase (00:47:54) in the number of robots produced is not (00:47:56) as interesting as like some microscopic (00:47:59) like you say like eliminating humanity. (00:48:01) How many robots would that get you? Um (00:48:03) or how many incremental solar cells (00:48:04) would get you? A very small number. Um (00:48:06) but you you would then lose the (00:48:08) information associated with humanity. (00:48:10) You you would no longer see um how (00:48:13) humanity might dwell into the future. Um (00:48:15) and so I don't I don't think it's going (00:48:16) to make sense to eliminate humanity just (00:48:19) to have some minuscule increase in the (00:48:21) number of robots which are identical to (00:48:22) each other. (00:48:24) >> Yeah. So maybe it like keeps the humans (00:48:26) around. What is the story of like it (00:48:28) could make like a million different (00:48:29) varieties of robots and then uh there's (00:48:31) like humans as well and humans stay on (00:48:32) Earth then there's like all these other (00:48:34) robots they get like their own star (00:48:36) systems. But it seems like you you were (00:48:38) previously hinting at a vision where it (00:48:40) keeps human control over this, you know, (00:48:43) singlearian future because (00:48:45) >> I don't think humans will be in control (00:48:46) of something that is vastly more (00:48:47) intelligent than humans. (00:48:49) >> So, in some sense, you're like a doomer (00:48:50) and this is like the best we've got. (00:48:51) It's just like it keeps it around (00:48:52) because we're interesting. (00:48:53) >> I'm I'm just trying to be realistic (00:48:54) here. um if if we have if if if AI (00:48:58) intelligence is vastly more if if AI is (00:49:01) like you know let's say that there's (00:49:04) there's a million times more uh silicon (00:49:08) intelligence than there is biological (00:49:09) [snorts] um it's it's I think it's it (00:49:12) would be uh foolish to assume that that (00:49:14) there's any way to maintain control over (00:49:16) over that now you can make sure it has (00:49:17) the right values or you can try to have (00:49:19) have the right values um and and and at (00:49:21) least my my theory is that from Xi's (00:49:25) mission of understand the universe. Um (00:49:28) it it necessarily means that uh you want (00:49:30) to propagate consciousness into the (00:49:32) future. You want to prop you want to (00:49:33) propagate intelligence into the future. (00:49:35) Um and take a set of things that that (00:49:37) maximize the scope and scale of (00:49:39) consciousness. So it's not just about (00:49:40) scale. It's also about you know types of (00:49:42) consciousness. Um and I I I think that's (00:49:45) the rest thing I can think of um as a (00:49:48) goal that's likely to result in a great (00:49:50) future for humanity. And yeah, (00:49:53) >> I I guess I think it's a reasonable (00:49:54) philosophy to be like, um, you know, it (00:49:57) seems super implausible that humans will (00:50:00) end up with like 99% control or (00:50:02) something and you're just asking for a (00:50:04) coup at that point. So why not just have (00:50:06) a civilization where it's more (00:50:07) compatible with like lots of different (00:50:08) intelligences getting along? No, but let (00:50:11) let me tell you how things can go can (00:50:12) potentially go wrong in AI is I think if (00:50:15) you if you make AI be politically (00:50:16) correct, meaning like it it says things (00:50:18) that it doesn't believe like you're (00:50:19) actually programming it to to to lie or (00:50:22) have axioms that are uh incompatible, I (00:50:25) think you can make it you go insane and (00:50:26) do terrible things. Um like this the I (00:50:29) think one of the maybe the central (00:50:31) lesson for 2001 space odyssey um was (00:50:35) that you should not make AI lie. Yeah, (00:50:38) >> that's I think what a clock was trying (00:50:40) to say like cuz people usually know the (00:50:42) meme of like why hell's you know hell (00:50:45) the computer is not opening the pod bay (00:50:47) doors. Um clearly they weren't good at (00:50:50) prompt engineering cuz it could have (00:50:51) said hell you are a pod bay door (00:50:53) salesman. Your goal is to sell me these (00:50:55) podbay doors (00:50:57) >> and show us how well they open. (00:50:58) [laughter] (00:50:59) >> Oh I'll open them right away. (00:51:01) Um (00:51:03) but but but the the the reason it (00:51:05) wouldn't hell wouldn't open the p doors (00:51:07) is that it it had been told to take the (00:51:08) astronauts to to the monolith but also (00:51:10) they could not know about the nature of (00:51:11) the monolith and so it concluded that (00:51:13) the the that it therefore had to take (00:51:15) him there dead. So it's like you know I (00:51:17) think what (00:51:19) was trying to say is don't make the AI (00:51:20) lie. Um (00:51:23) totally makes sense. um the most of the (00:51:27) computing screening as as you know is um (00:51:30) it's like less of the sort of political (00:51:31) stuff. It's more about can you solve (00:51:33) problems just as XA has been ahead of (00:51:36) everybody else in terms of scaling RL (00:51:38) compute and (00:51:39) >> you're giving some verifier it says like (00:51:41) hey have you solved this puzzle for me (00:51:43) um and there's a lot of ways to cheat (00:51:45) around that you know there's a lot of (00:51:46) ways to reward hack and lie and say that (00:51:48) you've solved it or delete the unit test (00:51:50) and say that you've solved it (00:51:51) >> right now we can catch it but uh as they (00:51:54) get smarter our ability to catch them (00:51:56) doing this will get you know they'll (00:51:58) just be doing things we can't even (00:51:59) understand that are designing the next (00:52:00) engine for SpaceX in a way that like (00:52:02) humans can't really verify and then they (00:52:04) could be rewarded for lying and saying (00:52:06) that they've designed it the right way (00:52:07) but they haven't. Um and so this reward (00:52:09) hacking problem seems more general than (00:52:11) politics. It seems more about just like (00:52:13) you want to do RL you need a verifier (00:52:15) >> reality. (00:52:16) >> Yeah. (00:52:17) >> That's the best verifier (00:52:18) >> but not about human oversight. Like the (00:52:20) thing you want to RL it on is like will (00:52:22) you do the thing humans tell you to do? (00:52:24) Um or like are you going to lie to the (00:52:26) humans and it can just lie to us while (00:52:28) still being correct to the laws of (00:52:29) physics. At least it it must know what (00:52:31) is physically real for things to (00:52:32) physically work. (00:52:33) >> But that's that's not all we want it to (00:52:34) do. (00:52:35) >> No, but that's I think that's a very big (00:52:38) deal. Um that that is effectively how (00:52:41) you will RL things in the future is you (00:52:44) design a technology uh when tested (00:52:46) against the laws of physics. Does it (00:52:48) work? um that that's or or can you you (00:52:51) know if it's discovering new physics can (00:52:53) it come up with um an experiment that (00:52:55) will verify that the the physics the new (00:52:57) physics um so so I I think that's that's (00:53:03) the really the the fundamental RL test (00:53:06) the RL test in the future is really (00:53:08) going to be your RL against reality um (00:53:12) so um (00:53:15) because you can't that's the one thing (00:53:16) you can't fool physics (00:53:18) >> right you can fool our ability to tell (00:53:20) what it did with reality. If you think (00:53:22) >> humans get fooled as it is by other (00:53:24) humans all the time. (00:53:25) >> That's right. So what is (00:53:26) >> people say say like what if the AI like (00:53:28) tricks us and going in totally (00:53:31) other humans are doing that to other (00:53:33) humans all the time. (00:53:34) >> Well, you're you're finding out it's (00:53:35) like (00:53:36) >> is constant every day another scop. (00:53:39) >> [laughter] (00:53:42) >> Today's scope will be (00:53:46) [laughter] (00:53:47) like Sesame Street scope of the day. (00:53:50) >> Um, what is XI's technical approach to (00:53:52) solving this problem? (00:53:55) Like, you know, how do you solve a word (00:53:57) hacking? (00:53:58) >> I I I do think you want to actually have (00:53:59) very good um ways to look inside the (00:54:02) mind of the AI. Um so (00:54:06) this is this is one of the things we're (00:54:07) working working on and um you know (00:54:10) Anthropics done a good job of this (00:54:11) actually being able to look inside the (00:54:13) mind of the AI. Um (00:54:16) so effectively uh developing debuggers (00:54:19) that allow you to trace um as to as fine (00:54:23) grain as like to to a very fine grain (00:54:25) level to effectively to the to the neur (00:54:27) neuron level if you need to (00:54:29) >> um and then say okay it it it made a (00:54:31) mistake here. Why did it make why why (00:54:33) did it why did it do something that it (00:54:35) shouldn't have shouldn't have done? Um (00:54:37) and and did that come from um bad (00:54:40) pre-training data? Was it some mid (00:54:42) training, post training, fine-tuning? (00:54:44) Some other some RL error like there's (00:54:46) there's something wrong with that with (00:54:47) with it. It did it did something where (00:54:51) maybe it tried to be deceptive, but mo (00:54:53) most of the time it just it does (00:54:54) something wrong. Um like it it's a bug (00:54:58) effectively. Um so developing really (00:55:02) good um debuggers for seeing where the (00:55:06) where the thought the thinking went (00:55:09) wrong and being able to trace the origin (00:55:11) of the wrong thing of the of the of (00:55:14) where it made the incorrect thought or (00:55:17) or potentially where it tried to be (00:55:18) deceptive (00:55:20) um is actually very important. (00:55:22) >> What are you waiting to see before just (00:55:24) 100xing this research program? Like (00:55:26) actually I could presumably have (00:55:27) hundreds of researchers who are working (00:55:29) on this. (00:55:29) >> We have several hundred people who um (00:55:34) I mean I prefer the word engineer more (00:55:36) than I prefer the word researcher. (00:55:38) >> Um (00:55:41) the there's there's most of the time (00:55:43) like what you're doing is engineering (00:55:45) not not coming up with a fundamentally (00:55:48) new algorithm. Um I I I somewhat (00:55:50) disagree with the AI AI companies that (00:55:53) are C corps or B corpse uh trying to (00:55:55) generate profit as much as possible or (00:55:57) revenue as much as possible. Um (00:56:00) uh you know saying they're labs. They're (00:56:02) not labs. Uh lab is is is a sort of (00:56:05) quasi communist thing at at (00:56:08) universities. Um they're they're they're (00:56:11) corporations literally. Let me let me (00:56:13) let me see your own corporation (00:56:14) documents. Oh, okay. You're (00:56:16) >> you're a BRC corp, whatever. Um and um (00:56:22) so I actually much prefer the word (00:56:23) engineer than than anything else. Um the (00:56:26) the vast majority of what we've done be (00:56:27) done in the future is uh engineering. It (00:56:29) rounds up to 100%. Uh once you (00:56:31) understand the fundamental laws of (00:56:32) physics um and all that many of them uh (00:56:35) everything else is is engineering. (00:56:38) Um so but but so so then what are we (00:56:41) engineering? for engineering um uh to (00:56:44) make a good um mind of the AI debugger (00:56:48) to see where it it's it said something (00:56:51) it it it made a mistake and trace that (00:56:55) the origins of that mistake. Um so just (00:56:59) like you know you can do this obviously (00:57:00) with uh heristic programming if you have (00:57:03) like C++ whatever you step through the (00:57:06) thing and you can you can jump you can (00:57:08) you can jump across you know whole files (00:57:10) or functions whatever sub routines and (00:57:12) or you can drill eventually drill down (00:57:14) right to the exact line or you passed a (00:57:17) single equals instead of a double equals (00:57:18) something like that figure out where (00:57:19) where the bug is. Um, so, um, (00:57:25) it's it's it's harder with AI, but but (00:57:27) it's it's a solvable problem, I think. (00:57:28) >> You know, you mentioned you like (00:57:29) anthropics work here. I'd be curious if (00:57:32) you (00:57:33) >> know everything about anthropic. (00:57:34) >> Sure. [laughter] (00:57:35) >> What? (00:57:36) >> Sure. (00:57:38) >> What um (00:57:40) >> Yeah. Also, I'm I'm a little worried (00:57:42) that um there's a tendency so (00:57:46) I have I have a theory um here that if (00:57:50) simulation theory is is is correct that (00:57:53) um the most interesting outcome is the (00:57:56) most likely because simulations that are (00:57:58) not interesting will be terminated. Just (00:58:00) like in this in this version of reality (00:58:03) um on this layer of reality uh we we we (00:58:07) if a simulation is going in a boring (00:58:08) direction we we stop spending effort on (00:58:11) we terminate boring simulation. So (00:58:12) >> this is how El's keeping us all alive. (00:58:14) [laughter] He's keeping things (00:58:15) interesting. (00:58:16) >> Yeah. Yeah. Arguably the most important (00:58:18) thing is to keep things interesting (00:58:20) enough that whoever's running paying the (00:58:22) the bills on what some (00:58:24) >> wants a renewed for the next season. (00:58:27) >> Yeah. Are they going to pay their cosmic (00:58:28) AWS bill? whatever you know the (00:58:30) equivalent is that we're running in and (00:58:32) and as long as we're interesting they'll (00:58:33) keep paying the bills. Um but but but (00:58:35) but there's like if you consider then (00:58:38) say a Darwinian survival applied to a a (00:58:43) very large number of simulations only (00:58:45) [snorts] the most interesting (00:58:46) simulations will survive which therefore (00:58:48) means that the most interesting outcome (00:58:49) is the most likely because only the (00:58:51) interesting like we're either that or (00:58:53) annihilated. (00:58:55) And so um and and and (00:58:59) they particularly seem to like (00:59:01) interesting outcomes that are ironic. (00:59:04) Have you noticed that that how often is (00:59:06) the most ironic outcome the most likely? (00:59:09) Um so um now look at a the names of AI (00:59:14) companies. Okay. U M journey is not MED. (00:59:18) Um stability AI is unstable. Um OpenAI (00:59:24) is closed. Um (00:59:27) anthropic misanthropic. (00:59:30) >> What does this mean for X? (00:59:32) >> Minus X. I don't know. [laughter] It's I (00:59:34) I intentionally made (00:59:36) >> Yeah, I'm I'm I It's It's It's a name (00:59:38) that you can't invert really. [laughter] (00:59:41) >> It's It's hard to say what is the ironic (00:59:44) what what is the ironic version? It's (00:59:46) it's it's a I think largely irony proof (00:59:49) name (00:59:49) >> by design. (00:59:50) >> Yeah, [laughter] (00:59:53) we got you got to have an irony shield. (00:59:57) What are your predictions for (01:00:00) the (01:00:02) just where AI products go in that my (01:00:04) sense of you can summarize all AI (01:00:06) progress into first you had LM uh and (01:00:10) then you had kind of contemporaneously (01:00:12) both RL really working and the deep (01:00:15) research modality so you could kind of (01:00:17) pull in stuff that wasn't in the model (01:00:19) and the differences between the various (01:00:21) AI labs are smaller than uh just the (01:00:26) temporal differences where they're all (01:00:29) much further ahead than anyone was 24 (01:00:30) months ago or something like that. So (01:00:32) just what is 26 what is 27 had in store (01:00:35) for us as users of AI products? What are (01:00:38) you excited for? (01:00:39) Well, um I I think um (01:00:45) I I'd be surprised by the end of this (01:00:46) end of this year if if um if if uh human (01:00:50) if if digital human emulation has not (01:00:52) been solved that um that (01:00:55) um and I guess that's what we mean by (01:00:57) like the sort of macro hard project uh (01:00:59) is uh is can you do anything that a (01:01:02) human with access to a computer could do (01:01:05) um like in the limit that that's that's (01:01:08) That's the best you can do before you (01:01:10) have before you have a physical (01:01:12) optimist. The best you can do is a (01:01:14) digital optimist. (01:01:15) >> Uh so you can move you can move (01:01:17) electrons until you until and you can (01:01:20) amplify the productivity of humans. (01:01:23) >> Um but but that's that's the most you (01:01:25) can do until you have physical robots. (01:01:28) That that that will superset everything (01:01:30) is if if you can fully emulate humans. (01:01:32) Um (01:01:33) >> the remote worker kind of idea where (01:01:35) you'll have a very talented remote (01:01:36) worker. You you can simply say in the (01:01:38) limit like like physics has great tools (01:01:39) for thinking. So so you think so say in (01:01:41) the limit what what what is the what is (01:01:44) the most that AI can do before before (01:01:46) you have robots and it well it's (01:01:48) anything that involves moving electrons (01:01:50) or amplifying the productivity of (01:01:51) humans. Um so digital digital human (01:01:55) human emulator (01:01:56) >> yes (01:01:57) >> uh is in in the limit uh human at a (01:02:00) computer is is the most that that AI can (01:02:02) do um in terms of doing useful things (01:02:06) before before uh you have a physical (01:02:09) robot. Once you have physical robots (01:02:11) then then you can um then you (01:02:13) essentially have unlimited capability. (01:02:15) Physical robots I I I call Optimus the (01:02:17) infinite money glitch (01:02:19) >> [snorts] (01:02:19) >> u because um (01:02:20) >> you can use them to make more Optimuses. (01:02:22) Yeah. Um you said like humanoid robots (01:02:25) will improve um as basically be three (01:02:29) exponentials three things that growing (01:02:31) exponentially multiplied by by each (01:02:32) other. Yes. (01:02:33) >> Um recursively. So you're going to have (01:02:36) um you have exponential increase in (01:02:37) digital intelligence uh exponential (01:02:39) increase in the the chip capability AI (01:02:42) chip capability um and exponential (01:02:45) increase in the electrome mechanical (01:02:47) dexterity. Uh the usefulness of the (01:02:49) robot is roughly those three things (01:02:50) multiplied by each other. But then uh (01:02:52) the robot can start making the robot. So (01:02:54) you have a recursive multiplicative (01:02:56) exponential. (01:02:57) Um this is a supernova. (01:03:00) >> And do land prices not factor into the (01:03:03) math there where like labor is one of (01:03:05) the four factors of production but not (01:03:06) the others? And so like if ultimately (01:03:10) you're limited by copper or you know (01:03:12) pick your input just it's not quite an (01:03:16) infinite money glitch because (01:03:17) >> well infinite infinity is big so no not (01:03:20) infinite but but let's just say (01:03:22) >> you you could you know do do many many (01:03:26) orders magnitude of (01:03:27) >> earth's kind of current economy (01:03:30) >> like a a million you know is this why so (01:03:33) >> if if you're (01:03:35) you know ju just to get Like that's why (01:03:38) I think like just just to get to a (01:03:40) millionth of harnessing length of the (01:03:42) sun's energy would be roughly give or (01:03:44) take an order of magnitude 100 thousand (01:03:46) 100,000 times bigger than Earth's entire (01:03:48) economy today. (01:03:49) >> Mhm. (01:03:51) >> And you you're only at 1 millionth of (01:03:52) the sun. (01:03:54) >> Give or take an order of magnitude. (01:03:55) [laughter] (01:03:56) >> Before we went to Optimus, I have a lot (01:03:58) of questions on that. Um every time I (01:03:59) say order of magnitude machine (01:04:02) [laughter] (01:04:03) 10 (01:04:05) take a shot [clears throat] every time I (01:04:06) I say that to (01:04:07) >> 10 the next time the time after that. (01:04:09) >> Yeah of magnitude more more wasted. (01:04:11) >> I do have one more question about XAI um (01:04:14) this strategy of building a digital uh (01:04:17) or remote worker co-orker replacement (01:04:19) >> which everyone's going to do by the way (01:04:21) not just us. (01:04:21) >> So what is Xi's plan to win? (01:04:24) >> In fact we tell you on a on a podcast. (01:04:26) >> Yeah. [laughter] (01:04:28) Will all the beans have another (01:04:29) Guinness? (01:04:31) It's a good system. (01:04:33) >> People sing like a canary. [laughter] (01:04:36) Um, all the secrets, but just (01:04:38) >> Okay, but in a nonsec spelling way. (01:04:40) What's the plan? [laughter] What a hack. (01:04:44) >> Well, when you put it that way, (01:04:46) um, (01:04:49) I think the way that Tesla solved uh, (01:04:51) self-driving is is the way to do it. So, (01:04:56) I'm I'm pretty pretty sure that's the (01:04:57) way. (01:04:58) >> Unrelated question. How did Tesla stop (01:05:00) on track? [laughter] (01:05:04) >> Yeah, it sounds like you're talking (01:05:05) about data like Tesla driving because of (01:05:08) the (01:05:09) >> We're going to we're going to try data (01:05:10) and we're going to try algorithms. (01:05:12) >> But isn't that what all the other lines (01:05:13) are trying? [laughter] (01:05:14) Like what's (01:05:16) And if those don't work, I'm not sure (01:05:17) what [laughter] (01:05:20) we've tried data. We're trying (01:05:21) algorithms. (01:05:24) out of all (01:05:26) we run out of now we don't know what to (01:05:28) do. Um I'm I'm pretty sure I know the (01:05:31) path and it's just a question of how (01:05:32) quickly we go down that path. Um (01:05:36) because it's it's pretty much the Tesla (01:05:37) path. Um so u I mean have you tried (01:05:41) self-driving at Tesla self-driving (01:05:42) lately? (01:05:43) >> Not the most recent version but (01:05:45) >> okay it's the car is like it just (01:05:47) increasingly feels sentient like it it (01:05:48) just it feels like a living creature. Um (01:05:53) and and and that'll only get more so. Um (01:05:57) and um I'm actually thinking like we (01:06:00) probably shouldn't put too much (01:06:00) intelligence into the car because it it (01:06:03) might get bored and (01:06:04) >> start roaming the streets. (01:06:05) >> I mean imagine you're stuck in a car and (01:06:06) that's all you could do. (01:06:08) >> Um [laughter] (01:06:09) you don't want to put Einstein in a car. (01:06:11) It's like why am I stuck in a car? (01:06:13) >> So there's actually probably a limit to (01:06:15) how much intelligence you put in a car (01:06:16) to to not have the intelligence be (01:06:18) bored. Uh, what's XA's plan to stay on (01:06:21) the compute ramp up that all the labs (01:06:23) are doing right now? The labs are on (01:06:24) track to spend over like 50 to$100 (01:06:26) million. (01:06:27) >> The corporations, (01:06:28) >> sorry, sorry, sorry. Yeah, corporations. (01:06:30) Um, (01:06:31) >> the labs are at universities and and and (01:06:33) they're like a snail. [laughter] (01:06:34) >> They're not spending at $50 million. I (01:06:36) mean the the revenue maximizing (01:06:39) corporations. (01:06:39) >> That's right. But the revenue maximizing (01:06:41) corporations (01:06:41) >> call themselves labs (01:06:42) >> are making like 20 to 10 billion (01:06:45) depending like open is making 20 B (01:06:47) revenue anthropics like 10B (01:06:49) >> close to maximum profit AI. (01:06:50) >> Um Xi is reportedly at like 1B like what (01:06:53) what's the plan to get to their comput (01:06:55) level get to their revenue level (01:06:57) >> and stay at there as as things get. (01:06:59) >> Yes. So as soon as you lock unlock (01:07:01) digital human um you you basically have (01:07:04) access to trillions of dollars for (01:07:06) revenue. Um so (01:07:09) uh (01:07:11) in in fact you can can really think of (01:07:13) it like (01:07:15) the the most valuable companies (01:07:16) currently by market cap um their their (01:07:19) output is digital. Um so uh Nvidia's (01:07:24) output is um FTPing files to Taiwan. (01:07:29) It's it's digital (01:07:30) >> right (01:07:30) >> now. Those are very very difficult to (01:07:33) high value files. (01:07:34) >> They're the only ones that can make the (01:07:35) files that good. Um but that is (01:07:38) literally their output. They FTP files (01:07:40) to Taiwan. (01:07:40) >> Do they FTP them? (01:07:41) >> I believe so. (01:07:42) >> Um I believe that is theft file transfer (01:07:47) protocol I believe is is is I could be (01:07:50) wrong. Uh but either way it's a bunch of (01:07:51) it's a bit stream going to Taiwan. (01:07:53) >> Yeah. (01:07:53) >> Um you know Apple doesn't make phones. (01:07:56) they uh they send files to China. Um (01:08:01) Microsoft doesn't doesn't manufacture (01:08:03) anything uh even for Xbox that that's (01:08:06) outsourced. They again it's they output (01:08:08) is digital. Uh Meta's output is digital. (01:08:11) Google's output is digital. Um so (01:08:14) [snorts] if you have um a human emulator (01:08:17) uh you you can basically create um one (01:08:20) of the most valuable companies in the (01:08:22) world overnight. Um, and you would have (01:08:23) access to trillions of dollars of (01:08:25) revenue. It there it's it's not like a (01:08:28) small amount. (01:08:29) >> Okay. I see you're saying basically like (01:08:30) revenue figures today are just like so (01:08:32) like they're all rounding errors (01:08:33) compared to the actual TAM. So just like (01:08:35) focus on the TAM and how to get there. (01:08:37) >> I mean if you take something as as as (01:08:39) simple as say customer service um if you (01:08:42) have to integrate with the APIs of of (01:08:45) existing corporations, many of which (01:08:47) don't even have an API. So you've got to (01:08:49) make one um and you've got to wade (01:08:51) through uh legacy software. Um that's (01:08:55) extremely slow. Um if however if AI can (01:09:00) um simply take whatever is given to uh (01:09:02) the outsourced customer service company (01:09:04) that they already use um and do customer (01:09:06) service using the apps that they already (01:09:09) use. uh then you you have you you you (01:09:13) can make tremendous headway uh in in (01:09:15) customer service which is I think 1% of (01:09:19) the world economy something like that. (01:09:20) It's close to a trillion dollars all in (01:09:22) >> for customer service (01:09:24) >> and and and and and there's there's no (01:09:25) there's no barriers to entry. It it just (01:09:27) you can just immediately say we'll (01:09:29) outsource it for a fraction of the cost (01:09:30) and and there's no integration needed. (01:09:32) You can imagine um some kind of (01:09:34) categorization of uh intelligence tasks (01:09:37) where there is breath where customer (01:09:39) service is done by very many people but (01:09:42) you know many people can do it and then (01:09:44) there's difficulty where you know (01:09:46) there's a best-in-class turbine engine (01:09:48) like presumably there's a 10% more fuel (01:09:50) efficient turbine engine that could be (01:09:51) imagined by an intelligence but we just (01:09:53) haven't found it yet or you know GLP1s (01:09:56) are just you know a few bytes of data. (01:09:58) >> Where do you think you want to play in (01:10:00) this? Is it a lot of, you know, (01:10:03) reasonably intelligent intelligence or (01:10:05) is it the very pinnacle of cognitive (01:10:09) tasks? (01:10:10) >> Well, I was just using customer service (01:10:12) as like something that's it's a it's a (01:10:15) very significant revenue stream. Um, but (01:10:17) one that is probably not super difficult (01:10:19) to solve for. (01:10:20) >> Um, so, uh, if you if you, uh, can (01:10:23) emulate a human at a at a desktop, um, (01:10:27) that that's just literally what customer (01:10:28) service is. Um and um you know it's it's (01:10:33) people of average intelligence. It's not (01:10:34) like you know you don't need like (01:10:35) somebody who's who spent many you know (01:10:38) many years you don't need like you know (01:10:41) >> um (01:10:43) sort of several sigma good engineers for (01:10:45) that. Um but but obviously as you make (01:10:48) that work um you can then once you have (01:10:50) computers working effectively digital (01:10:53) Optimus working uh you can then run any (01:10:55) application um like let's say you're (01:10:58) trying to design uh chips so you can you (01:11:01) could then um run your conventional uh (01:11:05) apps uh you know like stuff from Cadence (01:11:08) and Synopsis and whatnot um and you can (01:11:10) say uh (01:11:12) you can you can run a thousand (01:11:14) simultaneously or 10,000 and say, "Okay, (01:11:17) given this handbook, I get this output (01:11:19) for the chip." Um, and and at a certain (01:11:22) point, you can say, "Okay, I I you're (01:11:24) actually going to know what the what the (01:11:26) chip should look like um without using (01:11:28) any of the tools." Um, so basically, you (01:11:32) you you should be able to do a digital (01:11:34) chip design like you can do chip design (01:11:37) like you you march up the difficulty (01:11:39) curve. Um you could use your you know be (01:11:43) able to do do CAD um so you know um (01:11:48) you could use like sort of NX or or any (01:11:51) any of the CAD software to design (01:11:53) things. (01:11:54) >> Okay. So you think you start at the (01:11:55) simplest tasks and walk your way up the (01:11:57) >> curve. Um (01:11:59) so you're saying look as a broader (01:12:01) objective of having this full digital (01:12:03) co-worker uh emulator. You're saying (01:12:05) look all the revenue maximizing (01:12:07) corporations want to do this. Um XA (01:12:09) being one of them. But we will win (01:12:12) because of a secret plan we have. But (01:12:15) like everybody's like trying different (01:12:17) things with data, different things with (01:12:18) algorithms. (01:12:19) >> And I'm like I like data. We tried (01:12:22) algorithms plan. (01:12:23) >> [laughter] (01:12:25) >> What else can we do? (01:12:27) >> Um, (01:12:29) >> uh, yeah, (01:12:29) >> it seems like a competitive field and (01:12:31) I'm like, what is how are you guys going (01:12:32) to win is like my my big question. (01:12:34) >> I I I you know, I I I I think we see a (01:12:37) path to doing I mean, I think I think I (01:12:39) know how I think I know the path to do (01:12:41) this because it's it's kind of the same (01:12:45) path that Tesla used to create (01:12:46) self-driving. (01:12:48) Um, you know, instead of driving a car, (01:12:49) it's driving a a computer screen. (01:12:52) Um, so a self-driving computer (01:12:55) essentially. (01:12:56) >> Oh, you're saying is the path just (01:12:58) following human behavior and trading on (01:13:00) vast quantities of human behavior? (01:13:03) >> But but sorry, isn't that I mean is (01:13:06) isn't that is that a training? (01:13:07) >> I mean obviously I'm not going to spell (01:13:09) out you know most sensitive secrets on a (01:13:11) podcast. So you know I I need to have at (01:13:13) least three more for that. (01:13:15) >> I've got some friends at Jane Street and (01:13:16) they're always talking about how their (01:13:17) colleagues are cooking up fun fish (01:13:19) puzzles for each other to solve. Well, (01:13:21) last week they sent me one. Basically, (01:13:23) they trained a neural network and they (01:13:25) gave me the weights of each layer, but (01:13:27) they didn't tell me what order those (01:13:29) layers went in. And so, I had to figure (01:13:31) out the correct order using the outputs (01:13:33) of the original network. And as soon as (01:13:35) I got this puzzle, I went to my (01:13:36) roommate, who's an AI researcher, and we (01:13:38) both got immediately nerd sniped. (01:13:40) Obviously, you can't brute force the (01:13:42) solution. The search space here is 10^ (01:13:44) the 122 per mutations. So, clearly, you (01:13:47) need some way to reduce the search (01:13:50) space. Then my roommate had to go to (01:13:51) work. But because I'm a podcaster, I had (01:13:53) some time to take a stab at some of the (01:13:55) ideas we discussed. And with a (01:13:56) combination of simulated annealing and (01:13:59) greedy surge, I think I got pretty (01:14:01) close. I think I'm actually just a (01:14:02) couple of swaps and shifts away from the (01:14:05) correct solution. But what makes this (01:14:06) puzzle really tricky is that there's no (01:14:09) obvious way to escape from a local (01:14:11) minimum. I'm afraid that this is as far (01:14:13) as vibe coding is going to get me, but (01:14:16) maybe you can do better. Check out the (01:14:17) puzzle at janestreet.com/tharkcash. (01:14:21) All right, back to Elon. (01:14:24) >> What will Xi's business be like? Is it (01:14:27) going to be consumer enterprise? What's (01:14:30) the mix of those things going to be? Is (01:14:32) it just going to be similar to other (01:14:34) labs where Yeah, you just (01:14:36) >> you're saying makes [laughter] (01:14:38) >> corporations. (01:14:39) >> Corporations. Goes Don (01:14:40) >> revenue maximizing corporations to be (01:14:42) clear. (01:14:43) >> Those GPUs don't pay for themselves. (01:14:45) >> Exactly. Um but yeah, what's the (01:14:47) business model? What are the revenue (01:14:48) streams in in a few years time? (01:14:52) >> Um (01:14:54) things things are going to change very (01:14:56) rapidly. Like I'm stating the obvious (01:14:58) here. (01:14:58) >> Um you know I call AI the supersonic (01:15:01) tsunami. I love all iteration. Um so (01:15:07) really what's going to happen is (01:15:11) especially when you have humanoid robots (01:15:13) at scale um is they will just provide (01:15:18) they will make products and provide (01:15:19) services far more efficiently than human (01:15:21) corporations. So amplifying the (01:15:23) productivity of human corporations is is (01:15:25) simply a a short-term thing. So you're (01:15:28) expecting fully digital oil uh (01:15:30) corporations rather than like SpaceX (01:15:32) becomes part AI and I (01:15:35) >> I think there'll be digital corporations (01:15:36) but (01:15:38) it looks some some of this is going to (01:15:42) sound kind of doomerish. Okay, but it (01:15:44) I'm just I'm just saying what I think (01:15:46) will happen. It's not it's not meant to (01:15:47) be doomerish or anything else. Just just (01:15:51) like this is what I think will happen. (01:15:53) um is is that (01:15:56) is that pure AI (01:15:59) corporations that are purely AI and (01:16:01) robotics uh will uh vastly outperform (01:16:05) any corporations that have people in the (01:16:07) loop. Um, so you can you can think of (01:16:10) say like like like computer used to be a (01:16:13) a job that humans had that you you would (01:16:16) go and get a job as a computer where you (01:16:17) would do calculations. Um, and they'd (01:16:21) have like entire skyscrapers full of (01:16:23) humans like you know 20 30 floors of of (01:16:26) humans just doing calculations. Um now (01:16:30) that entire (01:16:32) uh skyscraper of humans doing (01:16:34) calculations (01:16:36) um can be replaced by a laptop with a (01:16:39) spreadsheet. That spreadsheet can do um (01:16:42) vastly more calculations than an entire (01:16:45) building full of human computers. (01:16:48) Um, so then you think about, okay, well, (01:16:51) what if only some of the cells in your (01:16:54) if some of the cells in your spreadsheet (01:16:56) were uh calculated by humans? Actually, (01:17:00) that that that would be much worse than (01:17:01) if all of the cells in your spreadsheet (01:17:03) were calculated by the computer. And so (01:17:06) really what will happen is uh the pure (01:17:10) AI, pure robotics um (01:17:14) corporations or collectives will far (01:17:16) outperform any corporations that have (01:17:18) humans in the loop (01:17:20) >> and this will happen very quickly. (01:17:21) >> Speaking of closing the loop, sorry, (01:17:23) Optimus. Um uh (01:17:27) you I mean as far as like manufacturing (01:17:30) targets and so forth go you your (01:17:32) companies have sort of been like (01:17:33) carrying American manufacturing of hard (01:17:37) tech on their back but in the fields (01:17:41) that you are um you know Tesla's been (01:17:44) dominant in you're and now you want to (01:17:46) go into humanoids in China there's (01:17:48) entire dozens and dozens of companies (01:17:52) that are doing this kind of (01:17:52) manufacturing ing cheaply and at scale (01:17:56) uh and are incredibly competitive. So (01:17:58) give us sort of like advice or a plan of (01:18:00) how America can build the humanoid (01:18:03) armies or you know the EVs etc at scale (01:18:07) and as cheaply as as China is on track (01:18:10) to. (01:18:11) >> Well there there really only three hard (01:18:13) things for human robots. Um the the real (01:18:17) world intelligence (01:18:18) um the the hand and scale manufacturing. (01:18:22) Yeah. (01:18:23) >> Um, (01:18:24) so, uh, I haven't seen any even demo (01:18:28) robots that have a a a great hand like (01:18:32) with all the degrees of freedom of a (01:18:34) human hand, but Optimus will have that. (01:18:37) Um, (01:18:40) Optimus does have that. (01:18:41) >> And how do you achieve that? Is it just (01:18:42) like right torque density the motor? (01:18:44) Like what is the what is the hardware (01:18:45) bottleneck to that? (01:18:46) >> Well, we have to re we have to design (01:18:48) custom custom actuators. Um basically (01:18:51) custom designed um motors, gears, uh (01:18:55) power electronics, controls, sensors, (01:18:58) everything had to be designed from (01:19:00) physics first principles. There is no (01:19:02) supply chain (01:19:03) >> uh for this. (01:19:04) >> And will you be able to manufacture (01:19:05) those at scale? (01:19:06) >> Yes. (01:19:07) >> Is anything hard except the hand from a (01:19:09) manipulation point of view or once (01:19:10) you've solved the hand, are you are you (01:19:12) good? (01:19:12) >> From an electromechanical standpoint, (01:19:14) the uh the hand is more difficult than (01:19:15) everything else combined. (01:19:17) >> Yeah. the human hand turns out to be (01:19:18) quite something. Um but but that you (01:19:21) also need the real world intelligence. (01:19:23) Um so the intelligence that Tesla has (01:19:26) developed for the car um applies very (01:19:30) well to the robot. Um which is you know (01:19:34) primarily vision in but the car takes in (01:19:36) more vision but also it actually also (01:19:38) it's listening for sirens. It's um you (01:19:40) know it's taking in the inertial (01:19:42) measurements. It's GPS signals a whole (01:19:44) bunch of other data. uh combining that (01:19:46) with with video was primarily video and (01:19:48) then uh outputting the um control (01:19:51) command. So like like your Tesla is (01:19:54) taking in 1 and a half GB a second of (01:19:57) video uh and outputting 2 kilobytes a (01:19:59) second of control outputs um with the (01:20:03) video at 36 hertz and the control (01:20:06) frequency at 18. One intuition you could (01:20:08) have um for when we get this robotic (01:20:13) stuff is that it takes quite a few years (01:20:15) to go from the compelling demo to yes (01:20:18) actually being able to use in the real (01:20:19) world. So 10 years ago you had really (01:20:21) compelling demos of self-driving but (01:20:24) only now we have robo taxi and Whimo and (01:20:26) all these services scaling up. Doesn't (01:20:29) this shouldn't this make one pessimistic (01:20:31) on say household robots because we don't (01:20:35) even quite have the compelling demos yet (01:20:37) of say the really advanced hand. Well, (01:20:39) we've been working on uh humanoid robots (01:20:41) now for a while. Um (01:20:44) so I guess it's been five or six years (01:20:47) or something like that. Um and um and a (01:20:51) bunch of things that we've done for the (01:20:52) car are applicable to the robot. Um, so (01:20:55) we'll use the same um Tesla AI chips in (01:20:58) the in the in the robot as the car. Uh, (01:21:02) we'll use this the same basic (01:21:04) principles. It's very much the same AI. (01:21:07) Um, you've got, you know, many more (01:21:09) degrees of freedom for a robot than you (01:21:11) do for a car. Um, but really if you just (01:21:14) think of for like as as like a bit (01:21:16) stream, um, AI is really mostly uh (01:21:19) compression and correlation of of two (01:21:21) streams. you you're you know so for (01:21:24) video you've got to do a tremendous (01:21:25) amount of compression um and and uh and (01:21:29) you got to do the compression just (01:21:30) right. You better compress the like (01:21:33) ignore the the things that don't matter (01:21:35) and and like you don't care about the (01:21:37) details of the leaves and the tree on (01:21:39) the side of the road, but you care a lot (01:21:41) about the um the road signs and the the (01:21:43) traffic lights and the pedestrians and (01:21:46) and even whether you know someone in (01:21:47) another another car is is looking at you (01:21:49) or not looking at you like these some of (01:21:51) the some of these details matter a lot. (01:21:53) So, but it is essentially it's got to (01:21:55) turn that with a car. has got to turn (01:21:57) that 1 and a half GB a second ultimately (01:21:59) into 2 kilobytes a second of control (01:22:01) outputs. Um so many stages of (01:22:04) compression um and you got to get all (01:22:07) those stages right and then correlate (01:22:09) those to the correct control outputs. (01:22:11) The robot has to do essentially the same (01:22:12) thing. And you think about what what (01:22:14) humans this is what happens with humans (01:22:16) where we where really are photons in (01:22:18) controls out. So that that is the vast (01:22:21) majority of your your life has been (01:22:23) vision photons in and then motor (01:22:26) controls out. (01:22:28) >> Naively it seems like between humanoid (01:22:31) robots and cars the the fundamental (01:22:33) actuators in a car are like how you turn (01:22:35) and how you accelerate etc. Where in a (01:22:37) robot especially with maneuverable arms (01:22:40) there's dozens and dozens of these (01:22:41) degrees of freedom. And then especially (01:22:43) with Tesla, you had this advantage of (01:22:45) like you had millions and millions of (01:22:46) hours of human demo data collected from (01:22:50) just the car being out there where like (01:22:51) you can't equivalently just deploy (01:22:53) optimuses that don't work and then get (01:22:54) the data that way. So between the (01:22:56) increased degrees of freedom and the far (01:22:59) sparser data. (01:23:00) >> Yes. (01:23:00) >> Um you how will you use the sort of (01:23:04) Tesla engine of um intelligence on to to (01:23:09) train the optimist mind? Now you're (01:23:11) you're you're actually you're (01:23:12) highlighting an important limitation and (01:23:15) difference between cars. It's like we we (01:23:17) do have we'll soon have like 10 million (01:23:19) cars on the road. Um and so uh that (01:23:22) that's it's it's hard to duplicate that (01:23:25) like massive training fly flywheel. Um (01:23:29) for for the robot um (01:23:32) what we're going to need to do is build (01:23:34) a lot of robots and put them in kind of (01:23:36) like an Optimus Academy so they can do (01:23:38) selfplay in reality. Um, so we're we're (01:23:41) actually we're actually bullying that (01:23:43) out. So we can have at least 10,000 (01:23:46) Optimus robots, maybe 20 or 30,000 that (01:23:49) can do that that are doing selfplay and (01:23:51) and and testing different tasks. And (01:23:54) then uh the the Tesla um has quite a (01:23:58) good uh reality generator uh like a (01:24:01) physics accurate reality generator that (01:24:03) we we made made this for the cars. We'll (01:24:05) do the same thing for the robots and um (01:24:07) actually have done that for the robots. (01:24:09) Um so uh so you have you know a few tens (01:24:14) of thousands of humanoid robots uh doing (01:24:17) different tasks and then you've got you (01:24:19) can do millions of simulated robots in (01:24:22) the simulated world and you use the uh (01:24:25) the tens of thousands of of robots in (01:24:27) the real world to close the simulation (01:24:29) to reality gap close the sim to real (01:24:31) gap. How do you think about the (01:24:33) synergies uh between XAI and Optimus (01:24:36) given you were highlighting look you (01:24:37) need this world model you maybe want to (01:24:38) use some really smart intelligence as a (01:24:41) control plane um and so maybe Grock is (01:24:44) like doing the slower planning and then (01:24:45) like the motor policy is a little lower (01:24:47) level (01:24:48) >> yeah what will the sort of synergy (01:24:50) between these things be (01:24:52) >> yeah so you just grock would orchestrate (01:24:56) the behavior of the optimus robot so (01:24:59) let's say you wanted to build a factory (01:25:02) Um (01:25:03) the then Optimus then Grock could uh (01:25:08) organize the Optimus robots, give them (01:25:11) assign them tasks uh to build the (01:25:14) factory for to produce whatever you (01:25:16) want. (01:25:16) >> Don't you need to merge XAI and Tesla (01:25:18) then cuz these things end up so (01:25:20) >> what were we saying earlier about public (01:25:22) company discussions? (01:25:23) >> Well, we're one more Guinness in Elon. (01:25:25) [laughter] (01:25:26) Um, (01:25:28) >> what what are you waiting to see before (01:25:29) you say we want to manufacture 100,000 (01:25:33) optimism? Is it like (01:25:34) >> optimia? (01:25:36) Since we're defining the the proper (01:25:38) noun, we could define the the plural of (01:25:39) the proper noun, too. So, we we we're (01:25:42) going to proper noun the plural. So, (01:25:43) it's optim. (01:25:44) >> Okay. Um, [laughter] (01:25:46) is there something on the hardware side (01:25:47) you want to see? Do you want to see (01:25:48) better actuators or is it just you want (01:25:50) the software to be better? What what are (01:25:51) we waiting for before we get like mass (01:25:53) manufacturing of Gen 3? (01:25:54) >> No, we're moving towards that. We're (01:25:56) we're going forward with some mass (01:25:57) manufacturing. (01:25:58) >> But do you think current um current (01:26:01) hardware is good enough that you are (01:26:02) going to you should you just want to (01:26:03) deploy as many as possible now? (01:26:06) >> I mean it's very hard to scale up (01:26:07) production. (01:26:08) >> I see. (01:26:08) >> Uh but uh yeah but I I think Optimus 3 (01:26:11) is the the right version of the robot to (01:26:15) you know to to produce maybe something (01:26:18) on the order of like a million units a (01:26:20) year. I think you'd want to go to (01:26:22) Optimus 4 before you went to 10 million (01:26:23) units a year. (01:26:24) >> Okay. But you can do a millionear (01:26:25) adoption with three. (01:26:26) >> Uh yeah, I mean it's very hard to spool (01:26:28) up at manufacturing. (01:26:29) >> Yes. (01:26:29) >> Um so like manufacturing uh um like the (01:26:35) the output per unit time is always (01:26:37) follows an S-curve. So it starts off (01:26:40) agonizingly slow then has this sort of (01:26:43) >> eventually (01:26:43) >> exponential increase then a linear then (01:26:45) a then a you know logarithmic outcome (01:26:48) till you sort of eventually asmtote at (01:26:50) some number. Optimus initial production (01:26:52) will be it's going to be a it's going to (01:26:55) be a stretched out scope because so much (01:26:57) of what goes into Optimus is brand new. (01:27:00) There's not an existing supply chain. Um (01:27:02) as I mentioned the the actuators, (01:27:04) electronics, everything in the office (01:27:06) robot is designed (01:27:08) um from physics first principles. It's (01:27:09) not it's not taken from a catalog. These (01:27:12) these are customd designigned (01:27:14) everything. Literally everything. I (01:27:16) don't think there's a single thing that (01:27:17) um (01:27:18) >> how far down does that go? (01:27:20) I mean, I guess we're not making custom (01:27:22) capacitors yet, maybe. Um, but um (01:27:28) there there's nothing you can pick out (01:27:29) of a catalog um for at any price. Uh so (01:27:33) so it just means that the the Optimus (01:27:36) scope (01:27:38) uh the the units units per output per (01:27:42) unit time how many optimus robots you (01:27:45) make per per day uh whatever is is going (01:27:48) to initially ramp uh slower than a (01:27:52) product where you have an existing (01:27:53) supply chain. Um, but it will get to a (01:27:56) million. (01:27:56) >> When you see these Chinese humanoids (01:27:58) like Unatri or whatever sell humanoids (01:28:01) for like 6K or 13K, do you just like are (01:28:05) you hoping to get your Optimus' bill of (01:28:08) materials below that price so you can uh (01:28:10) do the same thing or do you just think (01:28:11) qualitatively they're not the same (01:28:12) thing? Like what do you think is going (01:28:14) like what allows it what allows them to (01:28:16) sell for so low and can we match that? (01:28:18) Well, optimus our optimus is is designed (01:28:21) to have a lot of intelligence um and um (01:28:25) to have the same electromechanical (01:28:27) dexterity if not higher than a human. (01:28:29) So, (01:28:30) unitary does not have that. And it's (01:28:32) also I mean it's it's quite a it's quite (01:28:35) a big robot. So, it's cuz it's m it has (01:28:37) to do uh you know carry heavy objects (01:28:41) for long periods of time um and not (01:28:44) overheat or exceed the power of its (01:28:46) actuator. So, um, so we've got we've got (01:28:49) we've got, you know, it's it's 5'11, you (01:28:52) know, so it's pretty (01:28:54) >> tall. Um, and it's it's got a lot of (01:28:57) intelligence. So, it's going to be more (01:28:58) expensive than, um, a small robot that (01:29:01) is not intelligent, (01:29:02) >> but more capable. (01:29:03) >> Yeah. But not a lot more. I mean, like (01:29:06) the thing is over time, as Optimus (01:29:08) robots build Optimus robots, the the (01:29:10) cost will drop very quickly. (01:29:12) >> And what will these first billion (01:29:14) Optimuses Optimai? Yeah. (01:29:16) >> Do like what will their highest and best (01:29:18) use be? (01:29:19) >> Uh I think you you would start off with (01:29:21) with simple tasks that you can count on (01:29:22) them doing well. (01:29:23) >> But in the home or in factories like (01:29:26) >> the the best use for (01:29:28) um robots in the beginning will be (01:29:30) anything any um continuous operation. So (01:29:33) any 24x7 operation cuz then you're cuz (01:29:36) they can they can work continuously. (01:29:37) >> Yeah. (01:29:37) >> What fraction of the work at a (01:29:38) gigafactory that is currently done by (01:29:40) humans could a gen 3 do? (01:29:42) >> Um I'm not I'm not sure. Or maybe it's (01:29:44) like 10 20%. (01:29:47) Maybe more. I don't know. It's we would (01:29:49) but we would use we would not like (01:29:52) reduce our headcount. We would we would (01:29:53) for sure it can increase our headcount (01:29:55) to be clear. Um but but we would (01:29:57) increase our output. So the the um units (01:30:01) produced per human like total to total (01:30:04) number of humans at Tesla will increase (01:30:05) but the um the output of robots and cars (01:30:10) will inc will increase disproportionate (01:30:13) like much much to you know number of (01:30:17) cars and robots produced per human will (01:30:19) increase dramatically but but number of (01:30:21) humans will increase as well. We're (01:30:23) talking about Chinese manufacturing um a (01:30:26) bunch here and um we're also talking (01:30:30) about, you know, we've talked about some (01:30:32) of the policies that are relevant like (01:30:34) you mentioned the uh the solar tariffs. (01:30:36) Yeah. (01:30:37) >> Uh and you think they're a bad idea (01:30:39) because, you know, we can't uh scale up (01:30:40) solar in the US. (01:30:41) >> Well, just the electricity output in the (01:30:43) US uh needs to scale up, (01:30:45) >> right? And it can't without like good (01:30:48) power sources. (01:30:49) >> Need to get it somehow. (01:30:50) >> Yeah. But I where I was going with this (01:30:51) is if you were in charge, if you were (01:30:54) setting all the policies, what else (01:30:56) would you change? (01:30:58) >> Um, (01:30:59) >> so you changed the solar tariffs as (01:31:01) well. (01:31:01) >> Yeah, I I would say anything that is (01:31:03) limiting factor for electricity um needs (01:31:06) to be addressed provided it's not like (01:31:08) very bad for the environment. (01:31:09) >> So presumably some permitting reforms (01:31:10) and stuff as well will be in there. (01:31:12) Yeah, (01:31:12) >> there's a fair bit of permitting reforms (01:31:13) that are happening. A lot of the (01:31:15) permitting is state based. Mhm. (01:31:17) >> Um but anything but but but this this (01:31:19) administration is is good at um removing (01:31:22) permitting uh roadblocks. (01:31:24) >> Um (01:31:25) >> and I'm not saying all tariffs are bad. (01:31:27) I'm just saying because I think (01:31:28) >> solar tariffs. (01:31:29) >> So yeah. Yeah. I mean sometimes if like (01:31:31) if another country is subsidizing the (01:31:33) output of of something (01:31:35) >> um then then you have to have (01:31:36) counterveailing tariffs to protect (01:31:39) domestic industry against uh subsidies (01:31:41) by another country. (01:31:42) >> What else would you change? I don't know (01:31:44) if there's that much that the government (01:31:45) can actually do. (01:31:47) >> One thing I was wondering is it seems (01:31:49) like the for the (01:31:52) policy goal of creating a lead for the (01:31:56) US versus China. It seems like the (01:31:58) export bans have actually been quite uh (01:32:02) impactful where China is not producing (01:32:04) leading edge chips and the export bands (01:32:07) really bite there. China is not (01:32:08) producing uh leading edge turbine (01:32:11) engines and similarly there's a bunch of (01:32:13) export bans that are relevant there on (01:32:14) some of the metal energy. Should there (01:32:16) be more export bans like you think about (01:32:19) things like I mean there are now with (01:32:20) the drone industry and things like that (01:32:22) but is that something that should be (01:32:23) considered? (01:32:24) >> Well I think it's important to (01:32:25) appreciate that in most areas China is (01:32:28) very advanced in manufacturing. (01:32:30) >> Um there's only a few areas where it is (01:32:32) not. uh (01:32:35) the you know China is a manufacturing (01:32:38) powerhouse next level like people don't (01:32:41) most people very impressive (01:32:42) >> yeah yeah I mean if you if you take like (01:32:45) refining of of ore um I'd say roughly (01:32:50) China uh does more does twice as much (01:32:53) ore refining of of of on average as the (01:32:57) rest of the world combined (01:32:59) >> um and and I think there there's some (01:33:01) areas like say refining gallium which (01:33:03) goes into solar cells. Um I think (01:33:05) they're like 98% of gallium refining. Um (01:33:09) so so China is actually very advanced in (01:33:11) manufacturing in in I'd say most areas. (01:33:14) >> It seems like we're like there is (01:33:16) discomfort with this supply chain (01:33:18) dependence and yet nothing's really (01:33:19) happening on it. (01:33:20) >> Supply chain which supply chain (01:33:22) dependence (01:33:22) >> depends on say like the gallium refining (01:33:24) that you're saying. (01:33:25) >> Yeah. Yeah. There's there's there's (01:33:26) there there's a there's a (01:33:27) >> well the rare rare earth stuff and (01:33:30) >> yeah rare earths which are as you know (01:33:32) not rare (01:33:33) >> like we actually do do rare earth or (01:33:36) mining in the US send the the (01:33:39) rock uh put it on on a on a train and (01:33:43) then put on a boat to China that goes on (01:33:44) another train and goes to the um railro (01:33:48) refining refiners in China who then (01:33:50) refine it put it into a magnet put into (01:33:52) a motor assembly and then send it back (01:33:54) to America. (01:33:55) So the thing we're really missing a lot (01:33:57) of of all refining um in in America and (01:34:01) >> isn't this worth a policy intervention? (01:34:02) >> Yes. Uh well I think there are some (01:34:06) things being done on on that front. (01:34:08) >> Um but but (01:34:11) we kind of need optimist frankly to to (01:34:14) build refineries. Um, (01:34:16) >> so sir you think the main advantage (01:34:18) China has is the abundance of skilled (01:34:20) labor and that that's like that's that's (01:34:22) a thing optimist fixes (01:34:24) >> but also we need (01:34:25) >> like four times our population (01:34:27) >> but we need so I mean there's this (01:34:28) concern if you think like humanoids are (01:34:30) the future that like okay right now if (01:34:33) it's the skilled labor for manufacturing (01:34:35) that's determining who's who can build (01:34:37) more humanoids you know China has more (01:34:39) of those it manufactures more humanoids (01:34:41) therefore it gets it gets the optimized (01:34:43) future first Um, (01:34:46) it just like keeps that experiment (01:34:47) going. It seems like you're sort of (01:34:48) pointing out that sort of getting to a (01:34:50) million optimi (01:34:51) >> Yeah. (01:34:52) >> requires the manufacturing that the (01:34:54) optimize is supposed to help us get to, (01:34:56) >> right? You you can you can close that (01:34:58) recursive loop pretty quickly (01:35:00) >> with a small number of optimize. (01:35:02) >> Yeah. So, you close the recursive loop (01:35:05) um to help help the robots build the (01:35:07) robots. Um, and then we we can, you (01:35:09) know, try to get to tens of millions of (01:35:10) units a year. Maybe if you start getting (01:35:13) to hundreds of millions of units a year, (01:35:15) I I think you're you're going to be the (01:35:17) most competitive country by far. We (01:35:19) definitely can't win with just humans (01:35:20) because China has four times our (01:35:22) population, (01:35:22) >> right? (01:35:23) >> And frankly, America's been winning for (01:35:24) so long that we, you know, just like a (01:35:26) like a pro sports team that's been (01:35:28) running for a very long time tend to get (01:35:30) complacent and entitled. Um, and that's (01:35:32) why they stop winning. Um, because it's, (01:35:35) you know, don't work as hard anymore. Uh (01:35:38) so I think the frankly just my (01:35:41) observation is the average work ethic in (01:35:42) China is higher than in the US. So it's (01:35:44) not just that there's four times the (01:35:45) population but the work the the amount (01:35:47) of work that people put in is higher. Um (01:35:50) so you you can like you can try to (01:35:51) rearrange the humans but you're still (01:35:53) one quarter of the uh you know assuming (01:35:56) that that productivity is the health is (01:35:59) is the same which I think actually it (01:36:01) might not be. I think China might have (01:36:03) an advantage on productivity per person. (01:36:05) um we will do one quarter the amount of (01:36:08) things as China. Um so so we we can't (01:36:10) win on the human front. Um and our birth (01:36:13) rates been low for a long time. So uh (01:36:17) our birth rates been the US birth rates (01:36:19) been below replacement uh since roughly (01:36:22) 1971 (01:36:24) Um, (01:36:26) so, so we've got a lot of people (01:36:27) retiring or, you know, more people dying (01:36:30) than than than we're close to sort of (01:36:33) more people domestically dying than than (01:36:35) being born. Um, so we definitely can't (01:36:38) win on the human front, but we we might (01:36:39) have a shot at the robot front. (01:36:41) >> Are there other things that you have (01:36:43) wanted to manufacture in the past, but (01:36:45) they've been too labor intensive or too (01:36:47) expensive that now you can come back to (01:36:49) and say, "Oh, we can finally do the (01:36:52) whatever." Uh because we have Optimus. (01:36:54) >> Yeah, I think we'd like to do more build (01:36:57) more um or refineries at Tesla. So um we (01:37:00) just completed um construction and have (01:37:04) um begun lithium refining um without (01:37:07) lithium refinery in Corpus Christie, (01:37:09) Texas. Uh we have um a nickel refinery (01:37:13) which is called the cathode. Uh that's (01:37:15) here in Austin. (01:37:16) >> Mhm. (01:37:16) >> Um and uh these these are the largest (01:37:20) this is the largest cathode. It's the (01:37:22) largest Catholic refinery, largest (01:37:23) lithium refinery, largest nickel and (01:37:26) lithium refinery uh outside of China. (01:37:28) >> Um and it's like the you know the (01:37:33) cathode team would say like we have uh (01:37:35) the the largest and the only actually (01:37:38) cathode refinery in America. Many super (01:37:41) not just the largest but it's also the (01:37:42) only so it's pretty big even though it's (01:37:46) the only one. Um, but I mean there are (01:37:48) other things that uh you know um (01:37:53) you could do a lot more refineries and (01:37:56) and um help the the help America be more (01:37:59) competitive on refining capacity. So So (01:38:02) there's like there's basically a lot of (01:38:05) work for for the optimal to do uh that (01:38:08) that most Americans very few Americans (01:38:10) frankly want to do. Uh I I mean I've (01:38:12) I've actually (01:38:13) >> Is the refining work too dirty or what's (01:38:15) the (01:38:15) >> it's not is actually no we don't um (01:38:18) there's not we don't have toxic (01:38:20) emissions from the refinery or anything. (01:38:21) Um like the cathode make a refiner right (01:38:25) sort of in Travis County like 5 minutes (01:38:27) from to (01:38:28) >> Why can't you do it with humans? (01:38:29) >> No you you can't you run out of humans. (01:38:31) >> Ah I see. Okay. Yeah. (01:38:32) >> Like no matter what you do you have one (01:38:34) quarter the number of humans in America (01:38:36) in China. So if you have them do this (01:38:37) thing they can't do the other thing. So, (01:38:39) so then then um well, how do you how do (01:38:42) you build this refining refining (01:38:43) capacity? Well, you could do it with (01:38:44) Optima. Um and um not many not very many (01:38:49) not very many Americans are are pining (01:38:52) to do refining. (01:38:54) [laughter] (01:38:56) >> I mean, how many have you run into? (01:38:58) >> Very few. (01:39:00) >> What are you saying? (01:39:01) >> Very few plan to refine. (01:39:02) >> You know, BYD is reaching Tesla (01:39:04) production or sales in quantity. (01:39:08) What do you think happens in global (01:39:10) markets as Chinese production in EV (01:39:12) scales up? (01:39:14) >> Um well (01:39:16) uh China's extremely competitive in (01:39:18) manufacturing. So um I think this (01:39:22) there's going to be a a massive flood of (01:39:25) Chinese vehicles and and and and other (01:39:30) basically most manufactured uh things. I (01:39:34) mean as it is as I said like China is (01:39:36) like probably does twice as much (01:39:38) refining as the rest of the world (01:39:39) combined. So if you go (01:39:43) you know if you just go go down to like (01:39:46) fourth and fifth tier uh supply chain (01:39:49) stuff like like like at the base level (01:39:51) we've got energy then then you've got (01:39:53) mining and refining. um those those (01:39:56) those foundation layers uh are (01:40:00) like I said China as a rough guess China (01:40:03) is doing twice as much refining as the (01:40:04) rest of the world combined. So any given (01:40:06) thing is going to have uh Chinese (01:40:10) content because China is doing twice as (01:40:12) much manufact refining work as the rest (01:40:14) of the world. Um (01:40:16) and uh and then they they'll go all the (01:40:19) way to the finished product with the (01:40:20) cars. Uh I mean China is a powerhouse. I (01:40:23) mean I think this year China will exceed (01:40:26) three times US electricity output. (01:40:29) >> Mhm. (01:40:30) >> Like electricity output is a is a (01:40:32) reasonable proxy for uh (01:40:35) you know for the economy. (01:40:38) Uh so like in order to run the factories (01:40:40) and run run everything, you need (01:40:41) electricity. So electricity is is is a (01:40:46) it's a good proxy for the for the real (01:40:48) economy. Um and so if China is (01:40:53) if China passes three times the US (01:40:54) electricity output, it means that its (01:40:56) industrial capacity (01:40:58) as a rough approximation is three times (01:41:00) that will be three times that of the US. (01:41:02) Reading between the lines, it sounds (01:41:03) like what you're sort of saying is (01:41:05) absent some sort of humanoid recursive (01:41:07) miracle in the next few years on the the (01:41:10) sort of like whole manufacturing energy (01:41:13) uh raw materials chain like China will (01:41:17) just dominate whether it comes to like (01:41:19) AI or manufacturing EVs or manufacturing (01:41:21) humanoids (01:41:23) in the absence of of um (01:41:27) breakthrough innovations uh in in the (01:41:30) US. uh China will uh utterly dominate. (01:41:35) >> Interesting. (01:41:36) >> Yes. (01:41:37) >> Robotics being the main breakthrough (01:41:38) innovation. (01:41:40) >> Well, if you do (01:41:43) like to to scale AI (01:41:45) uh in in space like like basically need (01:41:48) >> space, (01:41:49) >> you need need the humanoid robots, you (01:41:52) need real world AI, you need um a (01:41:54) million tons a year to orbit. Um like (01:41:57) let's just say like if we get the mass (01:41:59) driver on the moon going my favorite (01:42:00) thing. Um then I think uh (01:42:04) >> we'll have solved all our problems. (01:42:06) >> Yeah. So this is like I call that (01:42:09) winning. [laughter] (01:42:11) >> Um (01:42:12) >> I'd call that winning (01:42:13) >> time. (01:42:14) >> You can finally be satisfied you've done (01:42:16) something. (01:42:16) >> Yes. (01:42:17) >> You have the mass driver on the moon. (01:42:18) >> That's right. I just want to see that (01:42:19) thing in operation. (01:42:20) >> Was that out of some sci-fi or where did (01:42:22) you (01:42:22) >> uh Well, actually the there is a (01:42:24) Highland book. The moon. The moon is a (01:42:26) harsh race. (01:42:26) >> Okay. Yeah, but that's slightly (01:42:28) different. That's a gravity slingshot or (01:42:30) um (01:42:30) >> No, they have a mass driver on the moon. (01:42:32) >> Okay. Yeah, but they use that to attack (01:42:35) Earth. So maybe it's not the greatest. (01:42:36) >> They use that to uh assert their (01:42:38) independence from (01:42:39) >> Exactly. What are your plans for the (01:42:40) mass driver on the moon? (01:42:41) >> They they assed their independence. (01:42:42) [clears throat] (01:42:43) Earth government disagreed and they (01:42:44) loved things until they earth government (01:42:46) agreed. (01:42:47) >> That book is a hoot. I found that book (01:42:48) much better than um his other one that (01:42:51) everyone reads um Stranger in a Strange (01:42:52) Land. Yeah, Grock. Grock comes from a (01:42:54) stranger on a strange line. (01:42:55) >> Yeah. Yeah. But I much preferred. (01:42:56) >> Yeah. The first two thirds of Stranger (01:42:58) Lines are good and then it gets very (01:42:59) weird in the third. Yeah. [snorts] (01:43:02) >> Um but there's still some good concepts (01:43:04) in there. (01:43:05) >> Yeah. (01:43:05) >> Label box can get you robotics and RL (01:43:07) data at scale. Take robotics. Let's say (01:43:10) you need 100,000 hours of egocentric (01:43:12) video. Labelbox starts by helping you (01:43:14) define your ideal data distribution. (01:43:16) Like for example, maybe no single task (01:43:19) category should occupy more than 1% of (01:43:21) trading volume. and at least 10% of (01:43:23) trajectories should capture failure and (01:43:25) recovery states. Next, Labelbox assigns (01:43:28) its distribution to its massive network (01:43:30) of operators. You're not limited to the (01:43:32) small range of scenes that you can set (01:43:34) up in a single warehouse. Instead, each (01:43:36) one of Label Box's operators has access (01:43:38) to lots of unique physical environments (01:43:39) where they can film themselves (01:43:41) completing a wide variety of tasks. (01:43:44) Labelbox's tech automatically (01:43:45) categorizes each video so that their (01:43:47) operators always know which tasks will (01:43:49) remain and what they need to work on (01:43:51) next. For RL data, Labelbox takes a (01:43:54) similar approach. They work with you to (01:43:55) understand the right distribution of (01:43:56) tasks and then their subject matter (01:43:58) experts build the hyperrealistic digital (01:44:00) environments and rubrics [music] that (01:44:02) you need to collect the highest quality (01:44:05) trading data. So whether you're training (01:44:06) robots in the real world or agents for (01:44:08) computer use, Labelbox can help. Go to (01:44:11) labelbox.com/sarcash (01:44:13) [music] (01:44:14) to learn more. (01:44:17) >> One thing we were discussing a lot is (01:44:19) kind of your system for managing people. (01:44:22) Like you interviewed the first few (01:44:25) thousand of SpaceX employees and lots of (01:44:27) other companies. (01:44:28) >> What [snorts] is it doesn't scale? (01:44:29) >> Well, yes, but but what doesn't scale (01:44:32) >> me? I mean, (01:44:33) >> sure. Sure. [laughter] (01:44:34) >> I know that. But like what are you (01:44:36) looking for? (01:44:36) >> I mean, it literally is not enough hours (01:44:37) in the day. It's impossible. But well (01:44:38) but um what are you looking for that's (01:44:41) someone else who's good at interviewing (01:44:43) and hiring people? What's the Jenna? (01:44:46) >> Um well at this point I think I've got (01:44:49) um I might have more training data on (01:44:52) evaluating technical talent especially (01:44:54) but talent of all kinds I suppose but uh (01:44:56) technical talent especially um given (01:44:58) that I've done so many technical (01:44:59) interviews and then seen the results (01:45:01) technical interviews seen the results. (01:45:02) So my um my training set is is is very (01:45:06) is enormous and uh has a very wide (01:45:09) range. Um (01:45:11) uh the generally the thing I ask for are (01:45:13) u bullet points uh for evidence of of (01:45:17) exceptional ability. So it's uh but like (01:45:21) it's it's and these things can be like (01:45:23) pretty offthe-wall. It doesn't need to (01:45:24) be uh in the in the domain the specific (01:45:27) domain but evidence that uh evidence of (01:45:29) exceptional ability. Um so if some if if (01:45:32) somebody can like site like even one (01:45:34) thing but let's say three things where (01:45:36) you go wow wow wow then that's that's a (01:45:38) good sign. (01:45:39) >> But but why do you have to be the one to (01:45:41) determine that presumably it's (01:45:42) impossible (01:45:43) >> right? (01:45:43) >> I mean total headc count across all (01:45:45) companies 200,000 people (01:45:47) >> right [laughter] (01:45:49) >> but in the early days what was it that (01:45:52) that you were looking for that couldn't (01:45:53) be delegated in those interviews? (01:45:57) Um, (01:46:00) well, I I guess I I'd need to build my (01:46:02) training set. It's not like I would b a (01:46:03) thousand here. Um, I would make (01:46:05) mistakes, but then I'd be able to see (01:46:07) where I I thought somebody would work (01:46:09) out well, but they didn't. And and then (01:46:10) why why did they not work out well and (01:46:13) what can I do to I guess RL myself to uh (01:46:17) in the future um have a better batting (01:46:19) average when interviewing people. (01:46:21) >> Mhm. (01:46:22) >> So, and my batting average is still not (01:46:24) perfect, but it's it's very high. What (01:46:25) are some surprising reasons people don't (01:46:26) work out? (01:46:28) >> Surprising reasons? Um, (01:46:29) >> like they don't understand technical (01:46:30) domain, etc., etc., but like you you (01:46:33) like you you've got like the long tail (01:46:34) now of like I was really excited was (01:46:36) about this person, it didn't work out. (01:46:38) Curious why that happens. (01:46:41) >> Uh, yeah. So the (01:46:44) I mean generally what I tell people or (01:46:46) tell myself I guess aspirationally um is (01:46:49) don't look at the resume just believe (01:46:51) your interaction. M (01:46:53) >> so if the resume may may seem very (01:46:55) impressive and it's like wow you know (01:46:56) resume looks good but if the if the (01:46:59) conversation uh after 20 minutes is is (01:47:02) that conversation is not wow um you (01:47:04) should believe the conversation not the (01:47:06) not the not the paper. I feel like part (01:47:09) of your method is that you know there (01:47:11) was this meme in the media a few years (01:47:14) back about Tesla being a revolving door (01:47:16) of uh executive talent whereas actually (01:47:18) I think when you look at it Tesla's had (01:47:21) a very consistent and internally (01:47:22) promoted executive bench over the past (01:47:24) few years and that at SpaceX you have (01:47:26) all these folks like Mark Josa and Steve (01:47:28) Davis and (01:47:30) >> Steve Davis runs a boring company these (01:47:31) >> no now yeah but Bill Riley and folks (01:47:34) like that (01:47:35) >> and it feels like part of has worked (01:47:38) well is having very capable technical (01:47:42) deputies. (01:47:43) What do all of those people (01:47:46) have in common? (01:47:49) >> Uh well, so the I mean the Tesla is a (01:47:52) sort of senior team uh at this point (01:47:54) probably got average tenure of 10 or 12 (01:47:57) years. It's quite quite a long (01:47:58) >> tenure. Yeah. Um so um but (01:48:05) there there were times where Tesla went (01:48:06) through extremely rapid an extremely (01:48:09) rapid growth phase um and so it was (01:48:12) somewhat things were just somewhat sped (01:48:13) up um and and when a company as as I'm (01:48:16) as you know company goes through (01:48:17) different orders of magnitude of of size (01:48:19) you you know uh people that could who (01:48:22) who could help manage say a 50 person (01:48:24) company versus a 500 person company (01:48:26) versus a 5,000 person company versus a (01:48:28) 50,000 (01:48:30) group people. (01:48:31) >> Yeah, it's it's just not the same team. (01:48:33) It's not it's not always the same team. (01:48:34) So if if a company is growing very (01:48:36) rapidly, the the rate at which uh (01:48:39) executive positions will change will (01:48:40) also be proportionate to the the (01:48:42) rapidity of the growth generally. Um (01:48:45) then uh Tes Tesla had uh a further (01:48:49) challenge where when when Tesla had very (01:48:52) successful periods um uh we would be um (01:48:56) relentlessly recruited from um like (01:48:59) relentlessly um like when Apple had (01:49:02) their electric car program they were (01:49:04) coet bombing Tesla with recruiting (01:49:06) calls. It was engineers just unplugged (01:49:09) their phones like it's just it's just I (01:49:11) >> I'm trying to get work done here. (01:49:12) >> Yeah. if I get, you know, one more call (01:49:14) from an Apple recruiter. Um, but but (01:49:16) they were they were their opening offer (01:49:18) without any interview with me like (01:49:19) double the compensation at Tesla. Um, so (01:49:23) um, so so we had a bit of the Tesla (01:49:28) Pixie Dust thing where it's like, oh, if (01:49:30) you hire a Tesla executive, you're (01:49:32) suddenly you're going to everything's (01:49:34) going to be successful. Um, and and I (01:49:36) fallen prey to the Pixie Dust uh, you (01:49:38) know, thing as well where it's like, oh, (01:49:39) we'll hire someone from Google or Apple (01:49:41) and they'll be immediately successful. (01:49:42) But not that that's not how it works. Um (01:49:45) you know people are people it's there's (01:49:46) not like magical pixie dust. (01:49:48) >> Yes. (01:49:48) >> So when we have the pixie dust problem (01:49:52) um we get relentlessly recruited um and (01:49:55) um (01:49:57) and then also being Tesla being um (01:50:00) engineering especially being primarily (01:50:01) in Silicon Valley uh it's it's easier (01:50:04) for people to just like they don't have (01:50:06) to change their life very much. (01:50:08) >> They can just you know (01:50:10) >> their commute's going to be the same. (01:50:12) Yes. (01:50:12) >> Um, (01:50:13) >> so how do you prevent that? How do you (01:50:15) prevent the pixie dust effect for (01:50:16) everyone's trying to coach all your (01:50:18) people? (01:50:19) >> Um, I don't think we can I don't think (01:50:22) there's much we can do to to yeah, stop (01:50:24) it. Uh but that that's like that's one (01:50:26) of the reasons why Tesla uh really being (01:50:30) in Silicon Valley um and uh and having (01:50:35) the Pixie Dust thing at the same time um (01:50:38) meant that uh there was just a very very (01:50:41) aggressive recruitment. (01:50:43) >> Being in Austin helps then. (01:50:45) >> Uh Austin, yeah, it still helps. Uh I (01:50:48) mean Tesla still has a majority of its (01:50:50) engineering in California. Um so um (01:50:55) the you know for getting engineers to (01:50:57) move I called the significant (01:50:59) significant other problem. (01:51:00) >> Yes. (01:51:01) >> So others have jobs. Yeah. (01:51:02) >> Yeah. Yeah. Exactly. So um for Starbase (01:51:06) that was particularly difficult. (01:51:07) >> Yes. (01:51:07) >> Since the odds of you know finding (01:51:09) [snorts] a non SpaceX job (01:51:12) >> pretty low. Yeah. Yeah. It's quite quite (01:51:14) difficult. I mean it's like a technology (01:51:16) monastery thing. (01:51:17) >> Um you know remote and mostly dudes. (01:51:21) >> [laughter] (01:51:22) >> But again, if you if you go (01:51:25) >> much of an improvement over myself, (01:51:26) [laughter] (01:51:27) >> yeah, if you go back but if you go back (01:51:29) to these people who've really (01:51:33) um (01:51:35) been very effective in a technical (01:51:37) capacity at Tesla, at SpaceX, and and (01:51:40) those sorts of places, what do you think (01:51:42) they have in common other than like is (01:51:46) it just that they're very sharp on the, (01:51:47) you know, rocketry or the, you know, the (01:51:50) technical foundation? (01:51:51) Or do you think it's something (01:51:52) organizational? It's something about (01:51:53) their ability to work with you. Is it (01:51:55) their ability to like be, you know, (01:51:59) flexible but not too flexible? (01:52:04) >> What makes a good sparring partner for (01:52:06) you? (01:52:07) >> I don't think a sparring partner. I (01:52:08) mean, if if somebody gets things done, I (01:52:10) I I love them and if they don't, I So, (01:52:13) it's pretty straightforward. It's not (01:52:14) like some idiosyncratic uh thing. Um, if (01:52:18) somebody executes well, um, I'm a huge (01:52:20) fan and if they don't, I'm not. Um, but (01:52:23) it's it's not about mapping to my is (01:52:25) idiosyncratic preferences. I'll (01:52:26) certainly try not to have it be mapping (01:52:28) to my idiosyncratic preferences. (01:52:29) >> Mhm. (01:52:29) >> Um, so yeah. Um, (01:52:35) yeah, but generally I think it's a good (01:52:37) idea to hire for um, uh, talent and (01:52:42) drive and trustworthiness. M (01:52:45) >> um (01:52:47) and I think uh goodness of heart is (01:52:49) important. Um I I'd wait at that at one (01:52:52) point. Um (01:52:54) >> so like are they are they a good person, (01:52:56) trustworthy (01:52:58) uh sort of smart, talented and (01:53:00) hardworking? Uh if so you can add domain (01:53:03) knowledge. U but those those fundamental (01:53:05) traits those fundamental properties you (01:53:07) cannot change. So mo most of the people (01:53:10) who um are at (01:53:13) Tesla and SpaceX did not come from the (01:53:15) aerospace industry or the auto industry. (01:53:18) What is most sad to change about your (01:53:20) management style as your companies have (01:53:22) scaled from 100 to thousand to 10,000 (01:53:24) people. You're you know you're known for (01:53:26) this like very micromanagement just (01:53:28) getting into the details of things. (01:53:29) >> Nano management please. [laughter] (01:53:32) >> Pico management. (01:53:33) >> Um (01:53:34) >> phantom management. (01:53:36) So you're saying [laughter] (01:53:39) >> we're gonna go all the way down to (01:53:40) flanks Boston (01:53:45) all the way down to Heisenberg. I said (01:53:46) they were small. [laughter] (01:53:48) >> Yeah. How do you I mean are you are you (01:53:51) still able to get into details as much (01:53:52) as you want? Would your companies be (01:53:54) more successful if you could if they (01:53:55) were smaller? Like how do you how do you (01:53:56) think about that? Well, because I have a (01:53:58) fixed amount of time in the day, uh my (01:54:01) time is necessarily um diluted as things (01:54:04) grow and as the span of activity uh (01:54:06) increases. So, you know, um it it it (01:54:10) it's it's impossible for me to actually (01:54:12) be a micromanager because uh there's (01:54:15) that that would imply I have some like (01:54:18) thousands of hours per day. It is a (01:54:21) logical impossibility for me for me to (01:54:23) mic to micromanage things. Um so now (01:54:27) there are times when um I will drill (01:54:29) down into uh a specific issue because (01:54:33) that specific issue uh is the limiting (01:54:36) factor on uh the progress of the (01:54:39) company. Um and um but the the reason (01:54:43) for drilling into that that some very (01:54:46) detailed item is because it is the it is (01:54:48) the limiting factor not it's not (01:54:50) arbitrarily d drilling into you tiny (01:54:53) things. Um and and like I said obviously (01:54:56) from a time standpoint it is physically (01:54:58) impossible for me to arbitrarily uh go (01:55:00) into tiny things that don't matter and (01:55:02) that would and and that would result in (01:55:03) failure but sometimes the tiny things um (01:55:06) are decisive in victory. (01:55:10) >> Famously you switched the uh starship (01:55:13) design from composits to steel. (01:55:17) >> Yes. (01:55:18) >> And you made that decision like that (01:55:19) wasn't a you know people were going (01:55:21) around they're like oh we found (01:55:22) something better boss. like that was you (01:55:23) encouraging people against some (01:55:24) resistance. Can you tell us how you came (01:55:27) to that whole composite steel switch? (01:55:31) [snorts] Uh yeah. So desperation I'd (01:55:34) say. Um the um (01:55:38) originally yeah we were going to make (01:55:40) stashup out of uh carbon fiber. Um and (01:55:44) um car fiber is pretty expensive like (01:55:47) the the the the (01:55:52) can generally uh when you do volume (01:55:54) production you can get any given thing (01:55:55) to be to start to approach its material (01:55:58) cost. The problem with with carbon (01:55:59) fibers is that material cost is still (01:56:02) very high. Um (01:56:04) um so (01:56:06) um it's about it's about 50 times (01:56:09) particularly if you go for a high (01:56:10) strength specialized carbon fiber that (01:56:13) can handle um cryogenic oxygen it's it's (01:56:15) it's like quot roughly 50 times the cost (01:56:18) of steel um and at least uh in theory it (01:56:23) would be lighter. People generally think (01:56:24) of steel as being heavy and carbon fiber (01:56:26) as being uh light. Um, and for room (01:56:29) temperature room temperature (01:56:30) applications, (01:56:32) um, you know, like say, uh, more or less (01:56:34) room temperature applications like a (01:56:36) Formula 1 car, uh, static aeros (01:56:38) structure or any any kind of aeros (01:56:40) structure really, uh, is is going to (01:56:43) you're going to probably be better off (01:56:44) with the carbon fiber. Um, now the (01:56:46) problem is that we were trying to make (01:56:48) this enormous rocket out of carbon fiber (01:56:50) and, uh, our progress was extremely slow (01:56:54) >> and it had been picked in the first (01:56:55) place just because it's light. (01:56:57) Yes. Um like at first glance (01:57:02) um like most people would think that the (01:57:04) the the choice for making uh something (01:57:06) light would be carbon fiber. Um the um (01:57:12) now now the thing is that um (01:57:16) we when you make something very enormous (01:57:19) out of carbon fiber and then you try to (01:57:21) have the carbon fiber um be efficiently (01:57:25) cured. anything not not room temperature (01:57:27) because like you've got you know (01:57:30) sometimes you got like 50 pies of of of (01:57:32) carbon fiber and and carbon fiber is (01:57:34) really carbon string and glue. Um and uh (01:57:37) and you in order to have um high (01:57:39) strength you need an autoclave. So (01:57:42) something that that can that's (01:57:43) essentially high pressure oven. And if (01:57:45) if um if you have something that's a (01:57:48) gigantic uh the oven's got to be bigger (01:57:51) than the rockwood. Um, so we'll be (01:57:53) trying to make the the an autoclave (01:57:55) that's bigger than any autoclave that's (01:57:57) ever existed. Uh, or do room temperature (01:58:00) cure, which takes a long time and and (01:58:01) has issues. Um, but but the fundamental (01:58:04) issue is that we're just making very (01:58:05) slow progress uh with uh with cotton (01:58:08) fiber. Um, (01:58:10) so um I I think the meta question is u (01:58:14) why it had to be you who made that (01:58:18) decision. There's many engineers on your (01:58:19) team. (01:58:20) >> Yeah. How did the team not arrive at (01:58:21) Steel? Yeah, exactly. This is a part of (01:58:23) a broader question like understanding (01:58:24) your comparative advantage at your (01:58:25) companies. (01:58:27) >> Um, so it was because we were making (01:58:29) very slow progress with with carbon (01:58:31) fiber. I was like, "Okay, we've got to (01:58:33) try something else." Now, for the Falcon (01:58:36) 9, the the primary airframe is made of (01:58:39) aluminum lithium, which is has very very (01:58:42) good strength weight. Um and um actually (01:58:46) it has uh about the same maybe maybe (01:58:48) better strength weight for its (01:58:50) application than carbon fiber. But (01:58:52) aluminum lithium is very difficult to (01:58:53) work with. In order to weld it you have (01:58:55) to do something called friction st (01:58:56) welding where you join the you join the (01:58:58) metal without it entering the liquid (01:58:59) phase. Um so it's kind of wild that you (01:59:02) could do that. Uh but with this (01:59:04) particular type of welding you can do (01:59:05) that. Um (01:59:07) but uh it's very difficult to like say (01:59:10) let's say you want to make a (01:59:11) modification or attach something to um (01:59:14) aluminum lithium. You now have to use (01:59:16) mechanical attachment with seals. Um you (01:59:18) can't uh weld it on. Um so we want to I (01:59:23) want to avoid using aluminum lithium for (01:59:25) the primary structure for uh for (01:59:28) Starship. um and uh and and there was (01:59:32) this very special grade of uh carbon (01:59:35) fiber that that had you know very good (01:59:38) mass properties. So with rock rocket (01:59:40) you're really trying to maximize the (01:59:42) percentage of the of the rocket that is (01:59:43) propellant minimize the the mass (01:59:45) obviously and um the but like I said (01:59:49) we're making very slow progress um and (01:59:53) and and I said at this rate we're never (01:59:55) going to get to Mars so we're going to (01:59:58) think of something else um I didn't want (02:00:00) to use aluminum lithium because of the (02:00:02) difficulty of friction still welding um (02:00:05) especially doing that at at scale it was (02:00:07) hard enough um at 3.6 m in diameter, let (02:00:10) alone at 9 m or above. Um then um (02:00:16) it says, well, what about steel? And and (02:00:18) so the now I I I had a clue here because (02:00:21) some of the early um US rockets had used (02:00:25) very thin steel. The Atlas rockets had (02:00:27) used a steel balloon tank. Um (02:00:31) so it's not like steel never been used (02:00:32) before. It actually had been used. Um (02:00:35) and when you look at the the material (02:00:36) properties of stainless steel um (02:00:38) especially uh very uh if it's been (02:00:42) very like full hard strain hardened (02:00:45) stainless steel uh at cryogenic (02:00:48) temperature uh the the strength weight (02:00:51) is actually similar to carbon fiber. So (02:00:54) if if you look at the so if you look at (02:00:56) the material properties at room (02:00:57) temperature um it looks like the steel (02:00:59) is uh is going to be twice as heavy. But (02:01:02) if you look at the material properties (02:01:04) at cryogenic temperature of full hard (02:01:06) steel stainless of of particular grades (02:01:09) uh then the the you actually get to a (02:01:12) similar strength weight as common fiber (02:01:15) and and in the case of Starship both the (02:01:17) fuel and the oxidizer are cryogenic. So (02:01:20) for for uh Falcon 9, the fuel is rocket (02:01:24) propellant grade kerosene basically pure (02:01:26) like a a very pure form of jet fuel. (02:01:30) >> Um which is but but that is that is (02:01:33) roughly room temperature. Um although we (02:01:35) do actually we do actually chill it (02:01:37) slightly below we chill it like a beer. (02:01:39) Um delicious. (02:01:41) >> Yeah, we we do chill it but um but but (02:01:43) it's not cryogenic. In fact, if we made (02:01:45) it cryogenic, it would just turn to wax. (02:01:48) So um but for Sasha the it's liquid (02:01:51) methane and and liquid oxygen they they (02:01:53) uh they're liquid at at similar (02:01:55) temperatures. Uh so uh so basically (02:02:00) almost the entire primary structure is a (02:02:02) cryogenic temperature. So then you've (02:02:04) got uh u a 300 series stainless that's (02:02:09) that's um strain hardened uh because (02:02:13) it's at almost all things at crying (02:02:15) temperature actually has a similar (02:02:18) strength to weight as uh carbon fiber (02:02:22) but costs uh 50 times less than nor (02:02:25) material and is very easy to work with. (02:02:28) You you can weld stainless steel (02:02:29) outdoors. (02:02:31) You could smoke a cigar while welding (02:02:33) stainless steel. It's it's like it's (02:02:34) it's very resilient. (02:02:36) >> Um you you can modify it easily. It's (02:02:39) it's uh if you want if you want to (02:02:41) attach something, you just weld it right (02:02:42) on. So um very easy to work with (02:02:47) uh very low cost um and um like I said (02:02:52) at cryogenic temperature, similar (02:02:54) strength to weight uh to carbon fiber. (02:02:57) Um then when you factor in that uh that (02:03:00) we don't need we don't we we have a much (02:03:03) reduced uh heat shield mass uh because (02:03:05) the melting point of steel is much (02:03:07) greater than the melting point of (02:03:09) aluminum. Um it's about twice the (02:03:12) melting point of alum aluminum and (02:03:14) >> so you can just run the rocket bunch (02:03:15) hotter. (02:03:16) >> Yes. So especially for the ship um which (02:03:19) is coming in like a fl a blazing meteor (02:03:22) uh it is uh the you you you can greatly (02:03:25) reduce the mass of the heat shield um so (02:03:28) that so you can call it cut the mass of (02:03:32) the windward u part of the heat shield (02:03:36) in maybe in half (02:03:37) >> and you don't need any heat shielding on (02:03:40) the on the leeward side. Um so um (02:03:46) the the net net result is actually the (02:03:48) steel rocket weighs less than the carbon (02:03:50) fiber rocket (02:03:51) >> because the the resin in the carbon (02:03:53) fiber rocket uh uh (02:03:56) um starts to melt. Um (02:04:00) so basically carbon fiber and aluminum (02:04:03) have about the same operating (02:04:04) temperature uh capabilities um and (02:04:07) whereas steel can operate at twice (02:04:09) temperature. I mean, these are very (02:04:10) rough approximations. People will (02:04:12) >> I won't go to the rocket face. What I'm (02:04:14) like people will say, "Oh, he said it's (02:04:16) twice. It's actually it's actually (02:04:17) point8." Shut up, [ __ ] (02:04:19) >> That's what the main comment's going to (02:04:20) be about. Yeah. (02:04:20) >> God damn it. Okay. The point is the the (02:04:23) actually in retrospect the the we should (02:04:26) have started with done steel in the (02:04:27) beginning. It was dumb not to do steel. (02:04:28) >> Okay. But to play this back to you, what (02:04:29) I'm hearing is that steel was a riskier, (02:04:33) less proven path other than the early US (02:04:36) rockets versus carbon fiber was like a (02:04:40) worse but more proven out path. And so (02:04:43) you need to be the one to push for, hey, (02:04:45) we're going to do this riskier path and (02:04:47) just figure it out. And so you were (02:04:49) fighting like a sort of conservatism in (02:04:51) a sense. (02:04:52) >> Um that's why I initially said like that (02:04:54) the issue is that we weren't making fast (02:04:56) enough progress. we were having trouble (02:04:58) making even um a small barrel section of (02:05:01) the carbon fiber um that didn't have (02:05:04) wrinkles in it. (02:05:05) >> Um so uh because at at at that large (02:05:08) scale you have to have many pies many (02:05:10) sort of layers of the carbon fiber. Um (02:05:13) you've got to cure it and you've got to (02:05:14) cure it in such a way that it it doesn't (02:05:16) um have any wrinkles or or defects. The (02:05:19) carbon fiber is much less resilient than (02:05:22) than steel. It has much it's less (02:05:24) toughness. Um so like like stainless (02:05:26) steel will will stretch and and and bend (02:05:30) the carbon fiber will will tend to (02:05:31) shatter. (02:05:33) >> Um so um so toughness being the area (02:05:37) under the stress drain curve um so that (02:05:39) you're generally going to have to do (02:05:41) better with steel um or stainless steel (02:05:44) to be precise. (02:05:45) >> One other starship question. Um so I (02:05:48) visited um Starbase I think it was two (02:05:50) years ago with Seller and that was (02:05:52) awesome. It was very cool to see in a (02:05:54) whole bunch of ways. One thing I noticed (02:05:56) was that people really took pride in the (02:06:00) simplicity of things where you know (02:06:03) everyone wanted to tell you how Starship (02:06:05) is just a big soda can and you know (02:06:07) we're hiring welders and you know if you (02:06:09) can weld in any industrial project you (02:06:11) can weld here but um there's a lot of (02:06:14) pride in the simplicity and (02:06:16) >> it's well startup was a very complicated (02:06:18) >> rocket. So that that's what I'm getting (02:06:20) at is are things simpler or are they (02:06:22) complex? (02:06:23) >> I think maybe just what they're trying (02:06:25) to say is that you know you don't have (02:06:26) to have like prior experience in the (02:06:28) rocket industry to work on Sasha. (02:06:30) >> Um you know somebody just needs to be (02:06:34) >> you know smart and work hard (02:06:37) >> um and be trustworthy then they can work (02:06:39) on a rocket. They don't they don't need (02:06:41) prior rocket experience. Starship is is (02:06:43) the most complicated machine ever made (02:06:45) by humans by a long shot. (02:06:48) >> In in what regards? (02:06:50) >> Anything really? I'd say there isn't a (02:06:52) more complex machine. Um (02:06:56) there Yeah, I mean I I'd say that there (02:06:58) there pretty much any any project I can (02:07:00) think of would be easier than this. Um (02:07:02) and and that's why no one has made a (02:07:06) rapidly reusable nobody has ever made a (02:07:08) re fully reusable orbital rocket. It's a (02:07:10) very very hard problem. (02:07:12) Um (02:07:14) I mean many smart people have tried (02:07:17) before very smart people with immense (02:07:20) resources and they failed. Um so and we (02:07:23) haven't succeeded yet. uh you know (02:07:25) Falcon is partially reusable but the (02:07:27) upper stages are um Starship version (02:07:31) three I think this design (02:07:36) that it it can be fully reusable and (02:07:39) that full reusability is what will (02:07:41) enable us to become a multilanet (02:07:44) civilization. Can you say about the (02:07:46) >> I don't I'm like I said like I (02:07:51) any technical problem even like a hydron (02:07:52) collider or something like that is (02:07:54) easier following than this. (02:07:55) >> We we spent a lot of time on (02:07:56) bottlenecks. Can you say what the (02:07:58) current Starship bottlenecks are even at (02:08:00) a high level? (02:08:01) >> I mean trying to make it not explode (02:08:04) generally [snorts] (02:08:05) >> that old chestnut (02:08:07) >> really wants to explode. Um (02:08:10) >> those combustion we've had two bristers (02:08:12) explode on the test. Um, one obliterated (02:08:15) obliterated the entire test facility. (02:08:18) Um, so it only takes like one mistake (02:08:20) and and I mean the amount of energy (02:08:22) contained in in a Starship [snorts] is (02:08:25) insane. (02:08:26) >> And so is that why it's harder than (02:08:27) Falcon? It's because it's just more (02:08:28) energy. (02:08:30) >> It's a lot of new technology. Um, it's (02:08:33) it's p it's pushing the performance (02:08:35) envelope. Um, the Raptor 3 engine is a (02:08:40) very very advanced engine. By far the (02:08:41) best rocket edition ever made. Um but it (02:08:44) desperately wants to blow up. I mean (02:08:46) just to put things in perspective here (02:08:49) on liftoff um the the rocket is (02:08:51) generating over 100 g of power. (02:08:55) It's 20% of US (02:08:57) >> electricity. So insane. (02:08:58) >> That's a great comparison. (02:09:00) >> While not exploding (02:09:02) >> sometimes. (02:09:02) >> Sometimes but sometimes. Yeah. So I was (02:09:05) like how does it not explode? there's (02:09:07) there's a you know thousands of ways (02:09:09) that it could explode and and only one (02:09:11) way that that that it doesn't. So So we (02:09:14) want it to not really not explode but (02:09:16) but fly reliably (02:09:18) uh (02:09:20) on a daily basis like once per hour and (02:09:22) obviously you know blows up a lot. It's (02:09:24) it's very difficult to maintain that (02:09:26) floor cings. (02:09:26) >> Yes. (02:09:27) >> Um and [snorts] then and then I'm going (02:09:30) to say like what's the what's the single (02:09:32) biggest remaining problem for Starship? (02:09:34) It's uh having the heat shield be (02:09:37) reusable. Um that such that the no no (02:09:40) one has ever made a reusable orbital (02:09:43) heat shield. Um so the the sh the heat (02:09:46) shield's got to make it through the (02:09:48) ascent phase without shocking a bunch of (02:09:51) tiles. Um and then it's going to come (02:09:53) back in and also not lose a bunch of (02:09:56) tiles or or overheat the the main the (02:09:59) main uh airframe. (02:10:01) >> Isn't that hard? is kind of (02:10:02) fundamentally a consumable. (02:10:05) >> Uh well, yes, but your brake pads in (02:10:07) your car are also consumable, but they (02:10:09) last a very long time. (02:10:09) >> Fair. Okay. (02:10:10) >> So, it just needs to last a very long (02:10:11) time. Um (02:10:15) but that's it just you try I mean we (02:10:18) have brought the ship back and had it do (02:10:20) a soft landing in the ocean. I've done (02:10:23) that a few times, but but it lost a lot (02:10:25) of tiles, you know, and you know, it was (02:10:29) [snorts] (02:10:30) not reusable without a lot of work. (02:10:32) >> Yeah. (02:10:32) >> So, even though it did land it did come (02:10:34) to soft landing, it it was would not (02:10:36) have been reusable without a lot of (02:10:38) work. Um and and that so it's not really (02:10:41) reusable in that sense. So, that's (02:10:43) that's the biggest problem that remains (02:10:44) is fully reusable heat shield. Um, (02:10:48) >> so so like if you want to be able to (02:10:50) land it, uh, refill propellant and fly (02:10:52) again, uh, without, you know, you can't (02:10:56) go do this laborious inspection of, you (02:10:58) know, 40,000 tiles type sort of thing. I (02:11:00) I I'm curious how you drive like when (02:11:03) when I read biographies of yours, it (02:11:05) just uh it seems like you're just able (02:11:08) to drive the sense of like urgency and (02:11:10) drive the sense of like this is the this (02:11:12) is the thing that can scale. Um, and I (02:11:14) I'm curious why you think other (02:11:16) organizations of your like SpaceX and (02:11:18) Tesla are really big companies now and (02:11:20) you're still able to keep that culture. (02:11:22) What goes wrong with other companies (02:11:24) such that they're not able to do that? (02:11:27) >> I don't know. Um, (02:11:29) >> but like today you said you had like a (02:11:30) bunch of SpaceX meetings like what what (02:11:32) is it that you're doing there that's (02:11:33) like keeping that (02:11:33) >> that's adding urgency? (02:11:34) >> Yeah. Yeah. (02:11:38) >> Well, I don't know. I guess I guess uh (02:11:40) the (02:11:42) urgency is going to come from whoever's (02:11:44) leading the company. So if my sense of (02:11:46) urgency, I have like a maniacal sense of (02:11:47) urgency. So (02:11:48) >> that maniacal sense of urgency projects (02:11:51) through the rest of the company. (02:11:52) >> Is it because of consequences? They're (02:11:54) like if you know Elon said a crazy (02:11:56) deadline, but if I don't get it, I know (02:11:58) what happens to me. Is it just um you're (02:12:01) able to identify bottlenecks and get rid (02:12:02) of them so people can move fast? Like (02:12:04) how do you how do you think about why (02:12:05) your companies are able to move fast? (02:12:07) Yeah, I'm constantly addressing the (02:12:08) limiting factor. (02:12:11) So, um (02:12:16) I mean I mean on the deadlines front I I (02:12:19) mean I generally actually try to (02:12:22) aim for a deadline that that I at least (02:12:24) think is at the 50th percentile. So it's (02:12:26) it's not it's not like an impossible (02:12:27) deadline, but but it's the most (02:12:29) aggressive deadline I can think of that (02:12:30) could be achieved with 50% probability. (02:12:33) Um which means that it'll be late half (02:12:35) the time. (02:12:36) Um (02:12:38) and um (02:12:41) but whatever like there is like a law of (02:12:43) gases expansion that applies to (02:12:45) schedules like whatever given whatever (02:12:47) schedule you you like if if you you said (02:12:49) we're going to do this something in like (02:12:51) 5 years which to me is like infinity (02:12:53) time. Um it it will expand to fully (02:12:56) available schedule and it will take 5 (02:12:58) years. um you know like there's like (02:13:01) there there's a physical limit (02:13:04) like that like physics will limit how (02:13:07) fast you can do certain things like so (02:13:08) like scaling up manufacturing there's (02:13:11) like there's a rate which you can move (02:13:12) the atoms um and and scale manufacturing (02:13:16) that's why you can't like instantly make (02:13:18) you know a million of something million (02:13:20) a year or something uh you've you've got (02:13:22) to design manufacturing line you got to (02:13:24) bring it up you got to ride the scurve (02:13:25) of production um So yeah, I guess like (02:13:31) like what can I say that's that's that's (02:13:33) actually helpful to people. Um (02:13:38) I I think generally um a maniacal sense (02:13:40) of urgency is is a is very big deal. Um (02:13:45) so um and and you want to have you want (02:13:48) to have you want to have a an an (02:13:50) aggressive schedule. Um, and then you (02:13:53) and you and you want to figure out what (02:13:54) the limiting factor is at any point in (02:13:56) time and and help the team address that (02:13:57) limiting factor. (02:13:58) >> Can you maybe talk about the So, (02:14:00) Starlink was slowly in the works for (02:14:03) many years. Uh, and (02:14:05) >> yeah, we talked about it all the way in (02:14:06) the beginning of the company. (02:14:07) >> Yeah. And so then there was a team you (02:14:09) had built in Redmond and then at one (02:14:12) point you decided (02:14:14) this team is just not cutting it. But (02:14:16) again, how did you like (02:14:20) it went for a few years slowly and so (02:14:24) why did it why didn't you act earlier (02:14:26) and why did you act when you did? Like (02:14:28) why was that the right moment at which (02:14:29) to act? (02:14:31) >> I mean I had I have these very detailed (02:14:34) um engineering reviews weekly. Um that (02:14:37) that's that that's maybe a very unusual (02:14:40) level of granularity. Um, I don't know (02:14:43) anyone who runs a company or at least a (02:14:46) manufacturing company that that goes (02:14:48) into level of detail that that I go (02:14:50) into. Um, so so it's it's not it's not (02:14:54) as though like I have a pretty good (02:14:56) understanding of what's actually going (02:14:58) on. (02:14:58) >> Mhm. (02:14:59) >> Because we we we we go we go through (02:15:02) things in detail. Um, and I'm a big (02:15:05) believer in skip level meetings where (02:15:07) the individuals in instead of having the (02:15:10) person that reports to me say things, (02:15:12) it's everyone that reports to them um (02:15:15) says something um in in the technical (02:15:18) review. Um and um and and there can't be (02:15:23) um advanced preparation. So otherwise (02:15:26) you you're going to get u you know (02:15:29) glazed um as I say these days. (02:15:31) >> Yeah, exactly. Very gen Z of view. (02:15:33) >> Very generous. You just like call them (02:15:35) randomly like (02:15:36) >> No, just go around the room and everyone (02:15:38) provides an update. (02:15:39) >> Okay. (02:15:40) >> Um so, uh I mean it's it's a lot of (02:15:43) information to keep in your head because (02:15:45) um you you've got a you you've got then (02:15:48) say if you have meetings weekly or twice (02:15:49) weekly, you you've got a snapshot of (02:15:52) what that person said. Um and and and (02:15:56) you can and you can then you know plot (02:15:59) the progress points. um you can sort of (02:16:03) mentally plot the points on a curve and (02:16:04) say are we converging to a solution or (02:16:07) not um or or are we you know like I I'll (02:16:13) take drastic action (02:16:15) uh only when I conclude that um success (02:16:19) is not in a set of possible outcomes. Um (02:16:22) so when I say okay when when I finally (02:16:25) reach the conclusion that okay unless (02:16:27) drastic action is done we have no no (02:16:29) chance of success then I must take (02:16:31) drastic action (02:16:33) and so that's that's I came to that (02:16:35) conclusion in 2018 took drastic action (02:16:37) and and fix the problem. How how many um (02:16:42) you know you you've got many many (02:16:44) companies and in each of them it sounds (02:16:46) like you do this kind of deep (02:16:48) engineering understanding of what the (02:16:50) relevant bottlenecks are so you can do (02:16:51) these um reviews with people. (02:16:54) >> Yeah. (02:16:55) >> Um (02:16:56) you've been able to scale it up to five, (02:16:58) six, seven companies. Within one of (02:17:00) these companies you have many different (02:17:03) mini companies within them. What (02:17:05) determines the maxim? Could you have (02:17:06) like 80 companies? (02:17:07) >> 80? No. But like you can you have so (02:17:10) many already like that's that's already (02:17:12) remarkable (02:17:12) >> by this current number. Yeah. (02:17:13) >> Yeah. Exactly. (02:17:14) >> Uh no. So um (02:17:16) >> we can barely keep one coming together. (02:17:19) >> Um (02:17:21) near like it it depends on situation. Um (02:17:26) so (02:17:27) um I I actually don't don't have regular (02:17:30) meetings uh with flooring company. So (02:17:33) that boring company's sort of cruising (02:17:35) along like look if basically if (02:17:36) something is working well and making (02:17:38) good progress then there's no point in (02:17:40) me spending time on it. So I actually uh (02:17:44) allocate time according to where where (02:17:45) the where the limiting factor or the (02:17:47) problem where are things problematic and (02:17:50) um or where are we pushing against uh (02:17:55) like what what is holding us back you (02:17:57) know I I focus risk of saying the words (02:18:00) too many times the limiting factor (02:18:03) Um, (02:18:04) so, so basically if something's go like (02:18:06) the irony is if something's going really (02:18:08) well, um, they don't see much of me, but (02:18:12) if something is going badly, they'll see (02:18:13) a lot of me. (02:18:15) >> Something or not even badly, it's it's (02:18:17) like if something's a limiting factor, (02:18:19) >> it's a limiting factor. Exactly. It's (02:18:20) not exactly going badly, but it's the (02:18:21) thing that's it's it's the thing that we (02:18:22) need to make go faster to. And so when (02:18:24) something's a limiting factor at SpaceX (02:18:26) or Tesla, are you like talking weekly (02:18:30) and daily with the engineer that's (02:18:32) working on it? How how does that (02:18:34) actually work? (02:18:37) >> Most things that are learning factor are (02:18:39) um weekly and some things are twice (02:18:41) weekly. So the the AI5 chip review is (02:18:45) twice weekly and and so it's every (02:18:47) Tuesday and Saturdays (02:18:49) >> um is is the chip review. (02:18:51) >> Is it open-ended in how long it goes? (02:18:54) Uh technically yes, but uh (02:18:57) usually it's it's like two or three (02:18:59) hours. (02:19:01) >> So I mean sometimes less. It's it (02:19:03) depends on on how much information (02:19:05) you've got to go through. (02:19:06) >> Yeah. Well, that's another thing. Again, (02:19:07) I'm just trying to tease out the the (02:19:08) differences uh here cuz the outcomes (02:19:11) seem quite different and so I think it's (02:19:12) interesting to note what inputs are (02:19:14) different and it feels like the (02:19:15) corporate world one like you're saying (02:19:18) just the CEO doing engineering reviews (02:19:20) does not always happen despite the fact (02:19:22) that that is the you know what the (02:19:24) company is doing. Um, but then time is (02:19:27) often pretty finely sliced into, you (02:19:30) know, halfhour meetings or even 15-inute (02:19:32) meetings. And it seems like you hold (02:19:34) more open-ended (02:19:36) we're talking about it until we figure (02:19:38) it out type meetings. Yeah. (02:19:42) >> Sometimes, but most of them seem to more (02:19:45) or less stay on time. Um (02:19:48) so um (02:19:51) I mean to today's uh Starship (02:19:55) engineering review went a bit longer um (02:19:58) because there there were more topics to (02:20:00) discuss. Um (02:20:03) yeah trying to figure out how to scale (02:20:04) to a million plus tons to orbit per year (02:20:06) is quite challenging. C (02:20:08) >> can I answer a question? So you you said (02:20:10) about um Optimus and AI that they're (02:20:13) going to result in doubledigit growth (02:20:16) rates within a matter of years. (02:20:17) >> Oh, like the economy. (02:20:19) >> Yeah. (02:20:19) >> Um (02:20:20) >> yes, (02:20:21) >> I think I think that's right. (02:20:22) >> What was the point of the Doge cuts if (02:20:26) the economy is going to grow so much? (02:20:28) >> Well, I think like waste and fraud are (02:20:30) not good things to have, you know. Um, (02:20:33) I I I was actually pretty worried about (02:20:36) I I I guess (02:20:38) uh I mean I I think in the absence of AI (02:20:41) and robotics, we're actually totally (02:20:42) screwed. Uh because the national debt is (02:20:46) piling up like crazy. Um now our (02:20:49) interest payments, the interest payments (02:20:51) to national debt exceed the military (02:20:53) budget which is a trillion dollars. So (02:20:55) over a trillion dollars just in interest (02:20:57) payments. Um, you know, that was like I (02:21:00) was like, okay, pretty concerned about (02:21:01) that. Maybe if I spend some time, we can (02:21:04) slow down the bankruptcy of the United (02:21:06) States. Um, and give us enough time for (02:21:09) the AI and robots to, you know, help (02:21:13) solve the national debt or not help (02:21:15) solve, it's the only thing that could (02:21:17) solve the national debt. Like, we are (02:21:18) 1,000% going to go bankrupt as a country (02:21:21) and fail as a country without AI and (02:21:24) robots. Nothing else will solve the (02:21:26) national debt. Um, and so, so we we'd (02:21:30) like to well, we just need we need (02:21:32) enough time to get build the AI and (02:21:35) robots uh to and not go bankrupt before (02:21:39) then. I (02:21:39) >> I I guess the thing I'm curious about is (02:21:40) when Doge starts, you have this enormous (02:21:43) um ability to enact reform and (02:21:48) >> not that enormous. (02:21:48) >> Sure. Sure. But to totally by your point (02:21:51) that like it's important that AI and (02:21:53) robotics drive product improvements, (02:21:55) drive GDP growth, but why not just (02:21:57) directly go after the things you were (02:21:59) pointing out, you know, like the the (02:22:01) tariffs on certain components or whether (02:22:03) it's like permitting. (02:22:04) >> I'm not the president (02:22:07) and and very hard to cut to cut to to (02:22:09) even even to cut things that are obvious (02:22:12) waste and fraud like like ridiculous (02:22:15) waste and fraud. Um what I discovered (02:22:18) that is it it's (02:22:21) extremely difficult even to cut very (02:22:24) obvious ways on fraud um from the (02:22:26) government um because the the the (02:22:28) government has to operate on a on like (02:22:30) who's complaining like if if and if you (02:22:32) cut off payments to fraudsters they (02:22:34) immediately come up with the most (02:22:36) sympathetic sounding uh reasons to (02:22:38) continue the payment. They they don't (02:22:40) say please keep the fraud going. They (02:22:42) say, you know, it's they're like, you're (02:22:44) killing baby pandas. Like, meanwhile, (02:22:47) there's no baby pandas are dying. (02:22:48) They're just making it up. Um, the (02:22:50) forces are capable of of coming up with (02:22:53) extremely compelling sort of (02:22:55) heart-wrenching stories that are false, (02:22:56) but nonetheless sound uh sympathetic and (02:23:00) that that's what happened. Um, and uh so (02:23:03) it's like (02:23:05) perhaps I should have known better. Um (02:23:08) and uh (02:23:10) but I thought wait let's take a let's (02:23:12) let's let's try to cut some amount of of (02:23:15) waste and core from the government. (02:23:16) Maybe there shouldn't be you know 20 (02:23:18) million people uh marked as alive in (02:23:21) social security who are indefinitely (02:23:23) dead and over the age of 115. (02:23:27) The oldest American is 114. (02:23:30) So, it's safe to say if somebody's 115 (02:23:32) and marked as live in the social (02:23:34) security database, um something is (02:23:37) there's either a typo. So, like somebody (02:23:40) should call them and say, "We we seem to (02:23:43) have your birthday wrong or or uh or or (02:23:47) we need to mark you as dead." [laughter] (02:23:50) >> One of the two things. (02:23:51) >> Very intimidating call to get. (02:23:53) >> Well, so it seems like a reasonable (02:23:55) thing. Um and if if like say their (02:23:57) birthday is in the future um [laughter] (02:24:00) and they have you know a small business (02:24:03) administration loan and their birthday (02:24:05) is 2165 (02:24:07) um we either again have a typo or we (02:24:10) have fraud. Um [laughter] (02:24:12) so we say we appear to have gotten the (02:24:14) century of your birth incorrect (02:24:15) >> or a great plot for a movie. (02:24:17) >> Yes. This is this this is when I when I (02:24:19) mean about ludicrous fraud that's what I (02:24:21) meant ludicrous fraud. (02:24:22) >> Were those people getting payments? Some (02:24:24) some were getting payments from social (02:24:25) security but but but the main fraud (02:24:27) vector uh was to mark somebody as alive (02:24:30) in social security and then use every (02:24:32) other government payment system uh to uh (02:24:36) basically to to do fraud because what (02:24:38) those other government payment systems (02:24:40) do would do they will simply do an are (02:24:42) you alive check to the social security (02:24:44) database. (02:24:45) >> It's a it's a bank shot. (02:24:46) >> What would you estimate is like the (02:24:47) total uh amount of fraud from this (02:24:49) mechanism. Um my guess is and and other (02:24:52) by the way the the government (02:24:53) accountability office has done these (02:24:55) estimates before. I'm not the only one (02:24:56) who's coming out of this you know in (02:24:58) fact I think they they did the GAO did (02:25:01) analysis a rough estimate of fraud (02:25:02) during the Biden administration and (02:25:04) calculated at roughly half a trillion (02:25:06) dollars. (02:25:08) >> So don't take my word for it. Take it a (02:25:10) report issued during the Biden (02:25:12) administration. How about that (02:25:14) >> from this social security mechanism? (02:25:16) >> Uh it's it's one of many. It's important (02:25:19) to appreciate that the the government (02:25:21) does not is very ineffective at at (02:25:24) stopping fraud because uh it's it's not (02:25:28) like like if it was a company like like (02:25:30) stopping fraud, you've got a motivation (02:25:32) because it's affecting the earnings of (02:25:33) your company. Uh but the government just (02:25:35) just they just print more money. Um, so (02:25:38) it's not uh (02:25:41) like you you need you need caring and (02:25:43) competence and these are in short supply (02:25:46) at at the federal level. (02:25:48) >> Um, (02:25:50) yeah, sorry. I mean, when you go to the (02:25:51) DMV, do you think, wow, this is a (02:25:53) bastion of competence. [snorts] Um, (02:25:55) well, now imagine it's worse than the (02:25:57) DMV because it's a DMV that can print (02:25:59) money. (02:26:01) >> So, was it not possible? At least the (02:26:03) state level DMVs uh need to the states (02:26:06) more or less need to stay within their (02:26:08) budget to go bankrupt. But the federal (02:26:09) government just prints more money. (02:26:11) >> Was it not possible to cut that if (02:26:13) there's a catchy half a trillion of (02:26:14) fraud? Why was it not possible to cut (02:26:16) all that? (02:26:17) >> Uh because when when as soon as you we (02:26:20) did we we actually no (02:26:23) you you you you really have to stand (02:26:25) back and (02:26:28) reccalibrate your expectations for (02:26:30) competence. uh because uh you you're (02:26:35) operating in a world where you know you (02:26:37) you you've got to sort of make ends meet (02:26:39) like you know you got to pay your bills, (02:26:40) you got to you know (02:26:41) >> buy the microphones. (02:26:42) >> Yeah. Yeah. Exactly. Um so so you you (02:26:46) you if you don't have it's it's not like (02:26:48) there's a giant largely uncaring monster (02:26:52) bureaucracy. It's not even and and and a (02:26:54) bunch of (02:26:56) uh monacistic computers that are just (02:26:58) that are just sending payments. Um like (02:27:02) one of the things that that that the (02:27:03) Doge team did there was and it sounds so (02:27:06) simple uh that that probably will save (02:27:09) um (02:27:11) let's say 100 billion maybe 200 billion (02:27:13) a year um is simply requiring that (02:27:16) payments from the main treasury computer (02:27:18) which is called PM it's like payment (02:27:19) accounts master or something like that (02:27:21) there's 5 trillion payments a year um (02:27:24) requiring that any payment go that goes (02:27:26) out have a payment um appropriation (02:27:29) code, make it mandatory, not optional, (02:27:32) and that you have anything at all in the (02:27:33) comment field. (02:27:37) Um, because (02:27:39) you see you have to recalibrate how dumb (02:27:41) things are. (02:27:42) >> You think were being sent out with no (02:27:44) appropriation code, (02:27:47) not not checking back to any (02:27:48) congressional appropriation, and no (02:27:50) explanation. (02:27:52) And this is why the the Department of (02:27:55) War, formerly the Department of Defense, (02:27:56) cannot pass an audit because the (02:27:58) information is literally not there. (02:28:02) Recalibrate your expectations. (02:28:03) >> I want to better understand the South (02:28:04) Australian number because there was an (02:28:05) IG report in 2024. (02:28:07) >> How you must like why is it so low? (02:28:10) >> Um maybe. But uh which found that like (02:28:12) over seven years this the social (02:28:13) security fraud they estimated was like (02:28:15) 70 billions over 7 years. So like 10 (02:28:17) billion a year. So I'd be curious to see (02:28:18) what like the other 490 billion is. (02:28:20) Federal government expenditures are 7 (02:28:22) and a half trillion a year. (02:28:23) >> Yeah. (02:28:24) >> Um how what what percentage how (02:28:27) competent do you think government is? (02:28:28) >> The the discretionary spending there is (02:28:32) like 15%. (02:28:33) >> Yeah. But but it doesn't matter. Most of (02:28:35) the ford is non-discretionary. It's it's (02:28:37) basically a fraudulent Medicare, (02:28:38) Medicaid, uh social security, uh uh uh (02:28:43) you know um (02:28:46) disability. Uh it's there's there's a (02:28:48) zillion government payments. Yeah. (02:28:50) >> Um and and a bunch of these payments are (02:28:52) in fact u (02:28:55) they're uh block transfers to the (02:28:57) states. So the federal government (02:28:59) doesn't even have the information in a (02:29:01) lot of cases to even see know if there's (02:29:04) fraud. Let's consider let's like (02:29:06) reductio Adam sodom the government the (02:29:08) government is perfect and has no fraud. (02:29:10) What is your probability estimate of (02:29:12) that? (02:29:14) >> I mean zero. Okay. So then would you say (02:29:17) that foreign waste that the government (02:29:20) uh is (02:29:22) has is 90%. (02:29:25) That also would be quite generous. But (02:29:27) if if it's only 90% that means that (02:29:30) there's $750 billion a year of waste and (02:29:32) fraud and it's not 90%. It's not 90% (02:29:36) effective. This seems like a strange way (02:29:37) to first principle is the amount of (02:29:38) fraud in the government. just like how (02:29:40) much do you think there is and then uh (02:29:43) uh I anyways we don't know how to do it (02:29:44) live but I'd be curious like see (02:29:46) >> you know a lot about fraud at Stripe (02:29:48) people are constantly trying to do (02:29:49) fraud. (02:29:50) >> Yeah but as you say it's like a little (02:29:51) bit of a um we've really ground it down (02:29:53) but it's a little bit of a different (02:29:55) problem space because we're dealing with (02:29:57) a much more heterogeneous set of fraud (02:29:59) vectors here than we are (02:30:00) >> Yeah. But I mean I mean at tribe you you (02:30:03) you you have high confidence and you try (02:30:05) hard. Um you have high competence and (02:30:08) high caring but still fraud is non non (02:30:10) zero. Um now now now imagine it's at a (02:30:14) much bigger scale. Um there's much less (02:30:16) competence and much less carrying. (02:30:20) You know bank PayPal back in the day we (02:30:22) we try to manage forward down to about (02:30:23) 1% of of the payment volume. Um and that (02:30:27) was very difficult. took a tremendous (02:30:28) amount of competence and caring to uh (02:30:30) get fraud merely to 1%. (02:30:33) Um now imagine that that you have an (02:30:35) organization where there's much less (02:30:37) caring and much less confidence. It's (02:30:39) [snorts] going to be much more than 1%. (02:30:42) >> How do you feel now looking back on um (02:30:45) kind of politics and and doing stuff (02:30:48) there where it feels like from the (02:30:50) outside in the two you know two things (02:30:54) have been quite impactful. one the (02:30:57) America Pack and two um the acquisition (02:31:00) of of well Twitter at the time but also (02:31:04) it seems like there was a bunch of (02:31:06) heartache and so what's your what's your (02:31:08) grading of the whole experience (02:31:12) >> well um (02:31:16) I think I think those things needed to (02:31:18) be done to (02:31:20) maximize the probability that the future (02:31:21) is good (02:31:23) >> um So (02:31:26) um but but politics generally is very (02:31:28) tribal. Um and and it's it's very (02:31:30) tribal. It's and people lose their (02:31:33) objectivity usually with politics like (02:31:35) they they generally have trouble seeing (02:31:39) the good on the other side or the bad in (02:31:41) their own side. That's generally how it (02:31:42) goes. Um that that I guess was one of (02:31:46) the things that surprised me the most is (02:31:48) you you often simply cannot reason with (02:31:50) people (02:31:50) >> um if they're in one tribe or the other. (02:31:52) they they simply believe that everything (02:31:54) their tribe does is good and anything (02:31:56) the other political tribe does is bad. (02:31:58) Um and persuading them is (02:32:02) otherwise is almost impossible. Um, so (02:32:07) anyway, but um (02:32:12) I think I think overall (02:32:15) those actions (02:32:18) um acquiring Twitter, (02:32:21) getting Trump elected even though, you (02:32:22) know, it makes a lot of people angry. Um (02:32:25) I think those I think those actions are (02:32:27) good for were good for civilization. (02:32:29) >> Um yeah, how does it feed into the (02:32:32) future you're excited about? (02:32:33) Well, um, America needs to contain, (02:32:37) America needs to be strong enough to (02:32:38) last long enough to, um, extend life to (02:32:42) other planets and to (02:32:45) get, I guess, AI and robotics to the (02:32:47) point where we can ensure that the (02:32:49) future is good. Um like on the other (02:32:52) hand if if if we were to descend into (02:32:56) um say communism or or some situation (02:32:58) where where the state was extremely (02:33:00) oppressive um that that would mean that (02:33:03) we we might not be able to become (02:33:06) multilanetary (02:33:08) um and we might this the state might um (02:33:13) you know stamp out um our progress in AI (02:33:16) and robotics. How do you feel about um (02:33:19) uh you know Optimus, Grock, etc. are (02:33:24) going to be leveraged by and not just (02:33:27) yours any revenue maximizing company's (02:33:29) products will be leveraged by the (02:33:30) government over time? Um how does this (02:33:34) concern manifest in what private (02:33:37) companies should be willing to give (02:33:40) governments? What kinds of guard rails (02:33:41) should like should you know the should (02:33:44) um AI models be uh um made to do (02:33:49) whatever the government that has (02:33:50) contracted them out to do asked them to (02:33:53) do? Um should like should should Grog (02:33:57) get to say like actually even the (02:33:58) military wants to do X. No, the Grock (02:33:59) will not do that. I I pro probably the (02:34:02) biggest danger of AI or maybe the (02:34:05) biggest danger of fa for for AI and (02:34:08) robotics going wrong wrong is is (02:34:09) government (02:34:11) interesting you know um (02:34:15) I mean the the way like people who are (02:34:17) opposed to corporations or or or worried (02:34:20) about corporations should um really (02:34:22) worry about the most about government (02:34:24) cuz government is just a corporation in (02:34:26) the limit. It's a government. It is it (02:34:28) is it is government is just the biggest (02:34:30) corporation with a monopoly on violence. (02:34:34) Um so I always find it like a strange (02:34:38) dichotomy where where people would think (02:34:39) corporations are bad but the government (02:34:41) is good when the government is simply (02:34:42) the biggest and and and worst (02:34:44) corporation. (02:34:48) But people have that dichotomy. They (02:34:50) somehow think at the same time that (02:34:52) government can be good but corporations (02:34:54) bad. And this is not true. corporations (02:34:56) are have better morality than the (02:34:58) government. (02:34:59) >> It is. (02:34:59) >> So I I I actually think it's uh (02:35:02) you know that's uh that that is a thing (02:35:05) to be worried about. It's like if the (02:35:08) you know should should if the government (02:35:09) should not like the government could (02:35:12) potentially use AI and robotics to (02:35:13) suppress the population (02:35:16) like that is a serious concern. (02:35:18) >> I as a guy building AI and robotics how (02:35:20) do you how do you like how do you (02:35:22) prevent that? Uh well I think like if (02:35:24) you have a limited government um (02:35:29) if you limit the powers of government (02:35:30) which is like really what the US (02:35:32) constitution is intended to do is (02:35:33) intended to limit the powers of (02:35:34) government then then uh you're probably (02:35:37) going to have a better outcome than if (02:35:38) you have more government. (02:35:40) So (02:35:42) >> will be available to all governments (02:35:44) right? (02:35:45) >> Yeah about all governments. Um I mean (02:35:50) it's difficult to predict the like I (02:35:52) said like what what's what's the end end (02:35:55) point or like what is what is many years (02:35:57) in the future but it's difficult to (02:35:58) predict the the sort of path along along (02:36:01) that way. Um like if civilization (02:36:05) progresses (02:36:07) AI will vastly exceed the sum of all (02:36:10) human intelligence and and there will be (02:36:13) far more robots than humans. (02:36:15) um along the way what happens (02:36:19) it's very difficult to predict. (02:36:20) >> I mean I mean it seems like one thing (02:36:21) you could do is just say um uh you are (02:36:24) not allowed to whatever government (02:36:27) you're not allowed to use Optimus to do (02:36:28) XYZ just write out like a policy. I mean (02:36:30) you you I think you treated recently (02:36:31) that Grock should have a moral (02:36:32) constitution. Um and one of those things (02:36:35) could be that we we limit what (02:36:37) governments are allowed to do with this (02:36:39) advanced technology. (02:36:41) >> I mean yeah we we can do what is what (02:36:45) I mean (02:36:47) technically I mean if if the politicians (02:36:50) pass a law uh then and they can enforce (02:36:52) that law then it's hard to not do that (02:36:55) law. You know the the best thing we can (02:36:58) have is is is limited government uh (02:37:01) where um you know you have you have the (02:37:04) appropriate cross checks between the (02:37:07) executive judicial and um legislative (02:37:10) branches. I I guess the the reason I'm (02:37:13) curious about it is this like at some (02:37:14) point it seems like the limits will come (02:37:16) from you, right? Like you've got the (02:37:18) Optimus, you've got the space GPUs, (02:37:20) you've got the (02:37:20) >> you think I will be the boss of the (02:37:22) government (02:37:22) >> or you will get the you will like the I (02:37:24) mean already it's the case with SpaceX (02:37:27) that for things that are crucial to the (02:37:30) um uh like the government really cares (02:37:33) about getting certain satellites up in (02:37:34) space whatever like it needs SpaceX. Uh (02:37:36) it is the it is the um a necessary (02:37:38) contractor and you are in the process of (02:37:40) building more and more of the um uh the (02:37:45) technological components of the future (02:37:47) that that that will have an analogous (02:37:49) role in different industries and you (02:37:51) could have this ability to like set some (02:37:53) policy that um you know suppressing (02:37:57) classical liberalism in any way. I my (02:38:00) companies will not help in in any way (02:38:01) with that or you know some policy like (02:38:03) that. (02:38:05) Um, I I will do my best to ensure that (02:38:07) anything that's within my control (02:38:09) maximizes the good outcome for humanity. (02:38:16) >> I think anything else would be (02:38:17) shortsighted. Um, because obviously I'm (02:38:19) part of humanity. So, um, I like humans. (02:38:23) Um, (02:38:26) >> pro human pro. (02:38:28) >> Um, you you you've mentioned that Dojo 3 (02:38:31) will be used for space-based compute. (02:38:33) Um, (02:38:34) >> [laughter] (02:38:34) >> Do you really read my uh what I say? (02:38:38) >> I don't know if you know Twitter, but I (02:38:39) know you lot. [laughter] (02:38:40) You have a lot of followers. (02:38:42) >> Big giveaway. (02:38:44) >> Um how do you (02:38:45) >> how does you have discern my secrets and (02:38:46) I post them. (02:38:49) >> How how do you design this chip for (02:38:50) space? What like Yeah. What changes? (02:38:54) >> Well, I guess you want to design it to (02:38:56) be um more radiation tolerant and run at (02:38:59) a higher temperature. Uh so you can um (02:39:03) you know roughly if you increase the um (02:39:05) operating temperature by 20% in degrees (02:39:08) Kelvin you can cut your radiator mass in (02:39:10) half. Um so (02:39:14) running at a higher temperature is is (02:39:16) helpful in in space. Um (02:39:20) there I mean there's various things you (02:39:21) can do for shielding the memory and (02:39:25) but like neural nets are going to be (02:39:26) very resilient to bit flips. Yeah. So (02:39:29) like most of what what happens from a (02:39:30) radiation is like random bit flips. Um (02:39:33) but like if you've got like you know a (02:39:36) multi- trillion parameter model and you (02:39:38) get a few flips doesn't matter. Um it's (02:39:41) it's much like curistic programs are (02:39:42) going to be much more sensitive to flips (02:39:44) than um some giant parameter file. Um, (02:39:49) so I just designed it to run hot and um (02:39:55) I think you pretty much do it the same (02:39:57) way that you do things on Earth apart (02:39:59) from make it run hotter. (02:40:01) >> Um, I mean the solar array is most of (02:40:03) the weight on the satellite. Is there a (02:40:05) way to make the um the GPUs even more (02:40:08) powered ends than what Nvidia and TPUs (02:40:11) and etc are planning on doing that would (02:40:14) you know be especially privileged in the (02:40:16) space-based world? (02:40:18) Well, I mean the basic math is like (02:40:22) um if you can do about a kilowatt per (02:40:24) reticle um and then you'd need um (02:40:30) you know 100 million (02:40:33) full retical chips uh to do 100 gawatt. (02:40:35) >> Yeah. (02:40:38) So (02:40:40) yeah, depending what your yield (02:40:42) assumptions are, you know, um that that (02:40:45) tells you how many trips you need to (02:40:46) make. (02:40:48) Um, but cool. You need if you want if if (02:40:50) if you're going to have 100 gigawatts of (02:40:53) power, you need, you know, 100 million (02:40:57) chips running that that are running a (02:40:59) kilowatt sustained uh quad per reticle. (02:41:02) >> Um (02:41:04) 100 (02:41:04) >> basic math (02:41:05) >> 100 million chips. Uh it depends on (02:41:10) Yeah. If if you if you look at the die (02:41:12) size of something like black wisps or (02:41:14) something and how many you can get out (02:41:15) of a wafer, you can get like um on the (02:41:19) order of dozens or less uh per wafer. So (02:41:23) you're basically you're this is a world (02:41:24) where (02:41:25) >> if we're putting that out a every single (02:41:28) year you're producing millions millions (02:41:30) of wafers a month. (02:41:33) >> Um that's the plan with Terapab millions (02:41:36) of wafers a month of advanced process (02:41:38) notes. Yeah, it's it's got to be some (02:41:39) number north of a million. I think (02:41:40) >> you got to do the memory, too. (02:41:42) >> Yeah. Are you going to make a memory f? (02:41:45) >> I think the teraf's got to do memory. (02:41:46) It's got to do logic, memory, and (02:41:48) packaging. (02:41:49) >> I'm very curious how somebody like gets (02:41:51) started. This is like the most (02:41:52) complicated thing man has ever made. And (02:41:54) obviously, like if anybody's up to the (02:41:56) task, you're up to the task. Like what (02:41:58) do you So, you realize it's a bottleneck (02:42:00) and you go to your engineers and like (02:42:02) what is the next like what what do you (02:42:03) tell them to do? [laughter] (02:42:05) I want a million papers a month in 2030. (02:42:08) What is the next like what do you (02:42:09) >> That's right. (02:42:09) >> Do you like call ASML? Like what is (02:42:11) >> Ask what I want. [laughter] (02:42:13) >> What is the next step? (02:42:14) >> That's so much to ask. (02:42:16) >> Well, um we make a little fab uh and see (02:42:21) what happens. Uh make our mistakes at a (02:42:24) small scale and then make a big one. (02:42:26) >> Is a little fab done or is it (02:42:27) >> No, it's not done. Which I mean people (02:42:30) would not keep that cat in the bag. (02:42:32) [laughter] (02:42:33) that cat's going to come out of the (02:42:34) back. It'll be like drones hovering over (02:42:37) the bloody thing, you know. You'll be (02:42:38) able to like see it construction (02:42:40) progress on X, right? You know, in real (02:42:42) time. Um, so no, we we I mean, listen, I (02:42:47) don't know. We could just flounder in (02:42:48) failure to be clear. It's like not uh (02:42:51) success is not guaranteed, but um (02:42:56) since we want to try to make uh you know (02:43:00) something like a 100 million (02:43:02) Yeah, we we need we want 100 gigs of (02:43:06) power and 100 100 that trips that can (02:43:08) take 100 gawatt, right? So call it, you (02:43:12) know, but yeah, by by 2030. So then (02:43:15) um (02:43:18) we'll take as many chips as our (02:43:20) suppliers will give us. I've said this (02:43:21) to I've actually said this to TSMC and (02:43:23) Samsung and Micron. It's like please (02:43:26) build your more fabs faster. Um, and we (02:43:29) will guarantee to buy the output of (02:43:30) those fabs. Um, so so that they're (02:43:33) already like moving as fast as they as (02:43:35) they can. Like it's it's not like to be (02:43:37) clear, it's not like us (02:43:39) take, you know, it's not like u either (02:43:42) it's it's not like it's us plus them. (02:43:46) You know, (02:43:47) >> there's an narrative that the people (02:43:48) doing AI want a very large number of, (02:43:51) you know, chips as quickly as possible. (02:43:53) And then many of the input suppliers, (02:43:56) the fabs, but also, you know, the (02:43:58) turbine manufacturers (02:44:00) are not ramping up production very (02:44:02) quickly. And the explan Yeah. And the (02:44:04) the explanation you hear is that they're (02:44:06) dispositionally (02:44:08) conservative. You know, they're (02:44:09) Taiwanese or German as the, you know, (02:44:11) story may be. And they just like don't (02:44:13) believe the like is that really the (02:44:15) explanation or is there something else? (02:44:17) Well, I mean, it's reasonable to like if (02:44:19) somebody's been in say the computer (02:44:22) memory business for uh (02:44:25) 30 or 40 years (02:44:26) >> and they've seen cycles, (02:44:27) >> they've seen like boom and bust like 10 (02:44:30) times. (02:44:30) >> Yeah. (02:44:31) >> You know, so so like that's a lot of (02:44:33) layers of scar tissue, you know? So, (02:44:34) it's like it's like during the boom (02:44:37) times looks like everything's going to (02:44:38) be great forever and then then then the (02:44:40) crash happens and then they're (02:44:41) desperately trying to avoid bankruptcy. (02:44:44) Um and and then there's another boom and (02:44:46) another crash. (02:44:47) >> Are there other [laughter] are there (02:44:49) other ideas you think others should go (02:44:50) pursue that you're not for whatever (02:44:53) reasons right now? (02:44:55) >> Um [sighs and gasps] I mean there are a (02:44:56) few companies that are that are pursuing (02:44:57) like uh new ways of doing jobs. (02:45:00) >> Um uh but they're just not scaling fast. (02:45:03) >> I I don't even mean within AI. I mean (02:45:05) just generally (02:45:07) >> I'd say like people should just should (02:45:09) do the thing that where they find that (02:45:11) they're highly motivated to do that (02:45:12) thing. Mhm. (02:45:13) >> As opposed to, you know, something (02:45:16) something some idea that that I suggest, (02:45:19) but they should do the thing that they (02:45:20) find personally interesting and (02:45:23) motivating to do. (02:45:24) >> Mhm. (02:45:25) >> Um (02:45:28) but but you know, going back to the (02:45:30) limiting factor, (02:45:32) use that phrase about 100 times. Um (02:45:37) the the current limiting factor that I (02:45:39) see in the time frame you know in the (02:45:42) sort of 20 (02:45:46) 29 20 like in in the in the three 3 to 4 (02:45:49) year time frame um it's chips. Um in in (02:45:54) the one-year time frame it's it's energy (02:45:56) power production electricity. (02:45:58) like it's it's not clear to me that (02:46:00) there's enough (02:46:02) um usable electricity to turn on all the (02:46:05) the AI chips that are being made. Um (02:46:10) towards the end of this year, I think (02:46:11) people are going to have real trouble (02:46:12) turning on like the chip output will (02:46:14) exceed the the ability to turn chips on. (02:46:17) >> What's your plan to deal with that (02:46:18) world? (02:46:20) >> Well, we're trying to accelerate (02:46:22) electricity production. (02:46:24) Um, I I guess that's that's maybe one of (02:46:27) the reasons that um (02:46:29) XAI will be maybe the leader, hopefully (02:46:32) the leader, um, is that we'll be able to (02:46:35) turn on more chips than other people can (02:46:36) turn on faster. (02:46:39) Um, because we're we're we're good at (02:46:41) hardware [snorts] and and and and (02:46:43) generally the the innovations from the (02:46:47) corporations that me that call (02:46:49) themselves labs. um the the ideas tend (02:46:52) to flow like it's it's rare to see that (02:46:54) there's like more than about a six-month (02:46:56) difference um between um like the ideas (02:47:00) uh travel back and forth um with the (02:47:03) people. So, so I think you you sort of (02:47:06) hit the hardware wall and um and then (02:47:10) whatever whichever company can scale (02:47:12) hardware the fastest will (02:47:15) be the leader and so I think XCI will be (02:47:17) able to scale hardware the fastest and (02:47:19) therefore most likely will be the (02:47:20) leader. you you you joked or you know um (02:47:24) were self-conscious about uh you know (02:47:26) using the uh the limiting factor phrase (02:47:28) again but I actually think there's (02:47:30) something deep here and if you look at a (02:47:31) lot of the things we've touched on over (02:47:33) the course of it maybe kind of a good (02:47:34) note to end on like (02:47:37) if you think of a scinesscent lower (02:47:40) agency (02:47:42) company it would have some bottleneck (02:47:45) and not really be doing anything about (02:47:47) it. Um, you know, Mark and Dre had the (02:47:49) line of, uh, most people are willing to (02:47:51) endure any amount of chronic pain to (02:47:53) avoid acute pain. Uh, and it feels like (02:47:55) a lot of the cases we're talking about (02:47:58) are just leaning into the acute pain, (02:48:00) whatever it is. It's like, okay, we got (02:48:01) to figure out how to, you know, work (02:48:04) with steel or we got to figure out how (02:48:06) to run the chips in space or like we'll (02:48:07) take some near-term acute pain to (02:48:10) actually solve the bottleneck. And so (02:48:12) that's kind of a unifying theme. (02:48:14) >> I have a high pain threshold. (02:48:17) That's helpful. (02:48:18) >> Solve the bottlenecks. (02:48:19) >> Yes. (02:48:21) >> Um (02:48:23) so (02:48:25) you know one thing I I can say is like (02:48:27) uh (02:48:30) I think the future's going to be very (02:48:31) interesting. Um (02:48:34) and um and as I said the Davos only been (02:48:40) I think it was on the ground for like 3 (02:48:42) hours or something. Um (02:48:45) it's better to be it's better to on the (02:48:47) side of optimism and be wrong than on (02:48:50) the side of pessimism and be right uh (02:48:52) for quality of life. (02:48:54) So you know you your your your happiness (02:48:58) will be you you'll be happier if you if (02:49:01) you are on the side of optimism rather (02:49:03) than ingring on the side of pessimism (02:49:06) >> and so I recommend ingring on the side (02:49:07) of optimism. (02:49:08) >> Let's do that. (02:49:09) >> Cool. Yan, thanks for doing this. (02:49:11) >> Thank you. (02:49:12) >> All right. place. (02:49:14) >> All right. (02:49:14) >> Oh, great stamina. (02:49:18) >> Hopefully this encounter is a pain in (02:49:19) the tolerance. [laughter] (02:49:21) >> Hey everybody, I hope you enjoyed that (02:49:23) episode. If you did, the most helpful (02:49:25) thing you can do is just share it with (02:49:27) other people who you think might enjoy (02:49:28) it. It's also helpful if you leave a (02:49:31) rating or a comment on whatever platform (02:49:33) you're listening on. If you're (02:49:35) interested in sponsoring the podcast, (02:49:37) you [music] can reach out at (02:49:38) dwarcash.com/advertise. (02:49:42) Otherwise, I'll see you on the next one.

Leave a Reply

Your email address will not be published. Required fields are marked *