Good evening everyone. I am Ben Farahi. I'm assistant professor and director of the critical matter group here at MIT Media Lab. I also hold the inaugural Morningside Academy for Design professorship, which I'm really excited about. So I actually hold the best of the two worlds. It is my great pleasure to welcome you all on behalf of Morningside Academy for Design, MAD, as well as Media Lab, to this very exciting conversation. I have the pleasure of sharing the stage with both Tony and Paula back in December during Design Miami. Tony Fadell is the Morningside Academy for Design's inaugural designer in residence. Our first designer in residence.
So, MAD launched the designer in residence program to invite the leading designers and practitioners to campus for short-term residency to foster exchange between MIT community and the leading design voices. MAD's designer in residence is really about highlighting design as a mode of discovery and collaborations between disciplines. In his first visit, Tony met with many faculty and students in different labs, and he shared his experience, which I hope was inspiring and also inspired our community. And Tony will come back in January for a short visit to run a workshop during IAP period with our students. We're also extremely delighted to have Paola Antonelli in conversation with Tony. So I'm not giving the introduction to Tony. Paola will, but I'm going to give the introduction to Paola. Paola Antonelli is the senior curator of architecture and design and the founding director of research and development at the Museum of Modern Art, MoMA. An architect by training, her highly influential work investigates design in all forms, from architecture to game design, with a goal of promoting design's positive influence on the world and fostering restorative practices. Recognized by Time magazine as one of the 25 most incisive design visionaries, she is a recipient of numerous awards, including the Smithsonian National Design Awards and London Design Awards, and many more. Paola has a longstanding relationship with MIT, which we are very lucky about. She has formerly served as an advisory council member for MIT Media Lab, as well as participating in numerous events at MIT. With that, we are extremely excited about their conversation, and with that, please help me in welcoming both Paola and Tony onto the stage.
Good evening everybody. Thank you so much, and it's a delight to be back in this room because we ran symposia in here gloriously a few years ago, and it's fabulous to be here with you. And I want to thank Elise for this fabulous — it's a great slide, it's really beautiful, and actually it shows us together. And you know, we met — I was just now — I have this really bad trait: when I like people, I forget how I met them. It's very funny. It's like they're part of my life. I don't know when. I don't know how. So, I was asking Tony, 'How did we meet?' And he said that I reached out to him and I asked to meet him when he was still at Apple in 2008. Thank you for remembering that. But so, it's very telling that Tony is the first designer in residence for the Morningside Academy because even though he did not go to MIT, he really represents the multifaceted approach to technology, design, and even art that MIT has. So just a very brief introduction to let people know where you come from. So Tony is from Detroit, or Detroit, Motown. Motown, and that's — I like to think that that's very telling. But you know, he's from Detroit and he went to the University of Michigan where he studied computer engineering. Then out of computer engineering, he already had this sense of design being a fundamental part of engineering and of the world. I mean, it's what makes whatever engineers do into life for people. So he already had this sensation in his mind. And then he was part of the legendary General Magic company, which in a way was the actual founder of, you know, the inventors of really the smartphone. And so was our own MIT Megan Smith, our own star. She was also General Magic out there somewhere. Where's Megan?
Here are the other magicians. I mean, yeah, General Magicians. By the way, there's a great movie about General Magic if you want to see the two of them together when they were just like coming out of the egg. Anyway, so after General Magic, he went to Philips where he started the portable devices, the portable electronic devices division. After that, you went straight to Apple.
No, I went — I had another startup, my own, Fuse. Yeah, Fuse. So that was like a hard drive music startup, and then after that, Apple, where he is considered the father of the iPod because it started with the iPod. And actually, the iPod is at the moment — that's probably where we met, you know, the iPod. We also, when we show it, we also have like fake — to like make people realize what it felt like. And then also the first generation iPhone. And after that, he left and he founded Nest, the, you know, it's almost like a talking thermostat. It's not talking, but you know, the thermostat that I'm sure you either have or you have seen. And after that, he left Nest and he started what he's doing right now, which is to start many other companies. He started Build Collective — Build, I'm sorry, Build Collective, which is a company that advises startups and invests. So you see, all of these adventures make me really admire him, 'cause I am such a coward and I've been at MoMA for 31 years 'cause I'm scared of my own shadow. So this is the first thing that I want to connect with you being here at MIT. I'm starting from the end. You've been here, I think, 48 hours or not even, right? But already you're starting to feel how you can be used here, right?
So, what are you thinking? Even though it's early to know what you're going to do, but what are you thinking? What is boiling in your — in your stomach?
Well, first I want to thank you, and I think Hashim and Jonno and all the staff for such a warm welcome and adopting me in a way to come and be the inaugural designer here in residence. And I want to also thank all of you for the warm welcome and to show up and come today. So, thank you so much. But in 48 hours, besides the warm welcome and lots of great food, Lebanese food and all that stuff,
Lebanese and Polish. Yeah. Sorry.
I think the thing that I see, and you see this in most of the projects, everyone has kind of a passion project they're working on. Everything's project-based here. And they go through sometimes the technology they're working on and they want to create a product or create something out of that, or they see a product that needs to get fixed and so they work on that, but they really have this — what they want to do. And what happens — and I attended this thing called Sunday, it's a hackathon that happens every Sunday, all about AI and next-generation interfaces and applications, and everybody's talking about the what, and they're putting together all these Lego blocks, Lego block and Lego block, and 'isn't it cool if' and 'isn't it cool if'. And I think Megan will remember this. We did this kind of 'isn't it cool if' at General Magic, and we had the smartest people on the planet. This was the original team that created the Macintosh, and they were going to go off and create what was this iPhone, just 15 years too early. And we were putting all the pieces of what together, but we really didn't understand the why. Really understand what it was behind the product. Why? What problems were we really trying to solve, for whom? Did they really have those problems?
We were missing design. Yeah. It was just a bunch of engineers impressing the other engineer next to them. So, we were like, 'Isn't that cool?' 'Yeah, that's cool. Put that in. Put that in. Put that in.' And by the time we shipped, we didn't actually have a pulse on the market. And when we shipped, the internet had just shown up, and it took four years and it was a disaster. Well, we all learned from it, and there was so many — and you should watch the movie because I don't want to give it all away — but what came out of it and what we learned from that was not just about how to make better products, but to have better whys. And then you see the people at General Magic, the next generation, go off and do incredible things well beyond General Magic. And so when I look at the teams here and the people doing everything, I keep asking the why, the why, the why. Because even when we see they might get the right product why, they might understand the pain, and then they go over to the business school and they get the how to build a business, and they go over here to how to maybe scale up the manufacturing — they still don't understand the why for the customer. And what I mean by that is from the time they've never even heard about the product till the time they use the product or test it or whatever. And that whole journey that goes along with that, that whole why also needs to be discovered. And it was a lot of the magic of what I learned at Apple and then perfected over at Nest was that customer journey and that symphony that you create about how somebody learns about it through other people or whatever way, and the emotional experience they go through — both rational and emotional experience they go through — to try the product and then maybe make it part of their lives.
So this is what you want to implement here.
Yeah, that's — I really think that something around deep, deep customer understanding and the journey of the product, not just ethnographics, but really taking it —
And you know, besides the customer's understanding and the whole life cycle of the product, it's also about behaviors. I mean, what I find really powerful about design is that it can really change behaviors, especially when you have the wherewithal, the ambition — also the lack sometimes, but you know, the energy and vision to work on products like the iPod, like the iPhone, or like the thermostat that go everywhere. You know, that's what I'm always amazed about design, because it can really change things, behaviors. I don't want to say change the world because it's always so, you know, like exaggerated, but it can really do that. So when did you understand this potential, the importance of design? Sorry, I'm speaking about my own obsession, but when did you understand that design was the key?
Well, I had an inkling when I was young, and this was very young, being, you know, growing up sometime in Detroit and with my grandfather in the garage. He was a Depression-era kid, and we would save everything and we would repair everything. It was, you know, like the crazy labs here. We were making everything, and with my grandfather, we would repair all these old homes around Detroit, and we were repairing my parents' house. My grandfather and my brother were repairing my parents' house, fixing because they were old houses. And my grandfather would like put it all together, and let's say it was a screen door, and the screen door was working just fine, and then my mom would come through and go, 'Yeah, it works, but it's ugly. It's horrible. What is that? We can't have that in the house.' And my grandfather's like, 'What are you talking about? It works just fine. There's no problem here.' And she's like, 'No, we can't have that. We can't have that.' And so there was this huge fight. And my dad was also in fashion. So my dad worked for Levi's way back in the day for 33 years. So I was always seeing fashion. I was touching fabrics. My dad was teaching me about fabrics and sales and all this stuff. And then my mom would make sure the house was right, and she cared about all the design pieces. And my grandfather's over there in the basement fixing everything. And so I had this kind of weird, you know, sense of like, oh, there's more to this than just making something functional.
Yeah. Also, yeah, because aesthetic intention — it doesn't have to be prettiness. It can be punk, but aesthetic intention is a form of respect towards other human beings, towards your customer. Right. Exactly. And we should all demand better, right? And you know, I'm seeing right now Nest here was like — the thermostat was amazing. So, let's go back for a moment because Elise is commanding the slides. So let's talk about your process for a moment because I'm sure that you know the students want to know about your process. And now that we talked about your engineering background, your epiphany of aesthetics, and also the lessons that you learned with General Magic, we can talk a little bit about the process. So maybe we can start — we can go back to the first slide and talk about how it happens.
So first I should say that it has evolved, obviously, right? From General Magic, there's that first thing, because I'm like, I'm with all my heroes, and they must know design, and they made the Mac, they must understand all this stuff. And so I've had to go through a series of failures. So I had 10 years of failures, is all in the book of, you know, understanding product design, user interface, customer understanding, then sales and marketing, and all of the other pieces of the puzzle through many, many — 10 years' worth of failures and a lot of hard work. And so it has evolved. So let me tell you where it is now for me, and it really starts with pain. Where is the pain? Too many people go off and like think about, you know, 'oh, wouldn't it be cool if' — and I did that early on — but I really want to focus on the pain. Show me everyday pain that a large number of people have, and let's start there. And so then I look and I look at — so I say, okay, is there pain? And then I say, well, why hasn't anyone solved that yet? So then I look at the competition and I look at the products that are out there, and I say, 'Okay, why didn't they solve for this? What's the problem?' And sometimes it's just a big company. They just don't know any better and they can't get out of their own way, right? We know how many big companies — and a lot of students and faculty know — like you have incredible ideas and then it goes to die in some large company when they work with you, right? Because of the inertia of the whole big wheels turning there. And so I start with the pain, the competition, and then I say, wait a second, has technology changed since these products were initially conceived? And is it a deep enough technology that could unseat — it's a fundamental thing that changes the game so much that if you change and add the technology, it shakes all the stuff above.
And that's what we found with the iPod.
That's what we found with the iPhone.
We found it with Nest as well, which was literally — in the case of the iPod, it was storage. It was storage, and MP3 was the defining tech to solve the pain of carrying lots of CDs, 'cause you're a music lover, right? And you might not say that's a real important pain, but it is pain for some of us. I was a DJ and I carried 2,000 CDs with me, and it was pretty heavy.
And then the pain of iPhone. So what was iPhone all about? So the new tech there was multi-touch screens and all these other things. But what the real pain was, you were carrying a laptop for your productivity tools. You were carrying your mobile phone for communications and texting. And then you were carrying an iPod for entertainment. And we had games and videos and stuff at the time. And you would carry three things with all the different cables and everything else, and it was lugging. And so we just said, 'Okay, we're going to put this all in using multi-touch interface and next-generation interface and apps to put all of those things in your pocket.' So that was the pain we were solving, and we had to bring all of these different technologies together to solve that pain. At Nest, the pain was energy. We were just spending so much on energy. We didn't — you know, we'd leave it on and then we'd spend energy when we weren't home, or we'd turn it off and then we were cold or hot when we got home and we had to turn it on. We were always fiddling with it, and it was ugly as all hell, right? Absolutely ugly. And then what came about was not just beautiful — it wasn't just a beautiful thing. This was one of the very first AI-enabled products. 2011, we shipped an AI-enabled product. We called it the Nest Learning Thermostat because we couldn't call it the Nest AI Thermostat 14 years ago because people were like, 'What? I don't want AI in my home.' Today it's like if it doesn't have AI, you know, they won't even buy it. So that was the enabling technology there. So those are the kind of ways I think. So again: pain, incumbents, technology, and then after that it's understanding all the layers of customer behavior, understand the customer very well, the buying cycle. So in the case of a thermostat, you could say, 'Oh, someone buys that.' No, it's actually a considered purchase by two people. And the consumers are either environmentally conscious, or they're design-conscious because they want something that looks nice on the wall, or they just want a geeky, cool new product.
And you have to understand in a couple, you know, it's like, oh, one person — it could be the geek, the other person wants the energy savings or the money savings. And so you have to tear apart that dynamic and make sure you get it right in how the product is used and how it's communicating. So you sell it to two people to get the yes.
Yeah. But once the curiosity has ebbed,
It has to have staying power.
Oh, absolutely.
And because that's something that's really important. So the journey continues. So you have to keep on improving the interface, keep on improving the product, make it more familiar. So I'm sure that there's really a good and strong follow-up, right?
Oh, there's always the follow-up. Well, first is just getting it out of the box or getting whatever it is you're using and making sure you set expectations low and deliver high. And so the point with like the iPod, or really the iPhone, and then Nest was — you can solve a problem, a pain, with a painkiller. What I try to do, and I work with the teams on, is we try to turn it into a superpower. So you didn't just solve the problem, because if you solve the problem, it's too rational. It's just you're rationally solving it. People are like, 'Okay, that's great.' Well, and if you bring them that emotional superpower, they're like, 'Oh, yeah.' And then they want to show it to their friends. Like to me, you know, when people saw the iPhone, remember it was the Jesus phone, and like, 'Oh my god, look at all the stuff it's doing.' And then in Nest's case, they were giving them as gifts and putting them under the Christmas tree and saying, 'You have to have this. This is the best thing ever.' In some cases, we had — because we also made it self-installable, so you could install it. And I thought only 40% — we spent so much time on the installation and putting screwdrivers in the box and all the documentation, the walkthrough documentation and everything. And we thought it was only going to be 40% of people who would install it. It turned out to be 95% of people self-installed it because it was such a delightful experience. We were getting videos from grandmas who put it in and were like, 'I did it!' And they didn't even use the product yet, but they felt this like superpower. They did something they never thought they could. And that's the emotional experience tied with the rational thing to really get people to love the product and then hopefully love the brand for subsequent products.
And by doing that, saving energy. I mean, that's what's amazing, that you through that kind of delight and the efficiency and the fact that the piece works, you change behaviors, which is so important. So I wanted to ask you, what went wrong with Fuse? What did you not have with Fuse? Was it the wrong pain that you had?
So at Fuse, here's what basically happened, and this is another lesson kind of that I learned through time, not that I was necessarily cognizant about it. But at Fuse, we were — at Philips, I learned about MP3, and we were doing the very first audiobooks on handheld, so we were the very first Audible product that could play audiobooks. And then I was like, 'Oh, that could be music.' And so we tried to get Philips to do it, of course it goes to die at Philips. So I start my own company, and things are going well, but then I'm trying to get funding for it.
So the VCs were not really there yet, or they didn't understand, did they?
The VCs — it's kind of like what's happening right now, and we all know what happened — or some of us know what happened in 2000 — was everybody was pouring money into e-commerce and internet websites. They said there's no future in hardware, just do all this stuff. And so there was no money. And then what happened was 2000 happened, and the bottom folded out, fell out of the whole internet craze because all the companies didn't hit the numbers they were supposed to hit. And then it was even harder. I had to — I was near shutting down the company, and I had to go take a consulting job when Apple called because they said, 'Consult for us on what would be ultimately the iPod.' So I was staying in the hardware realm. So I was doing hardware products. So General Magic, then Philips, then Fuse. And all during that time, the VCs were like, 'What are you doing, Fadell? You're not hitting this internet wave. You're crazy. Why are you still doing this stuff? That was a whole decade ago. That's over.' Right. And then Apple calls, the iPod comes out, and six months into it, the VCs are calling, 'Hey, do you want to —'
So Steve Jobs was back — that was already back at — he knew, even though you might have failed at Fuse or whatever, he knew that you had it.
That you trusted hardware together with software. So —
Right. Exactly. Oh, there's the model that I made in my garage, and with my grandfather's fishing weights inside, and put it in Steve's hand. And that was the original iPod model. It's not like a beautiful thing, but it was enough to show the functionality and the size.
It's all there. It's in the hand. It has that kind of weight, and the kind — you put probably the fish bait inside because you wanted to also have the right weight. When that leads me to another extremely important part of the design of this kind of objects, which is the interface. You know, today we were having a conversation about interfaces, and you know, there's haptic, there's like voice, there's like tapping —
Now there's voice without voice.
What do you mean, voice without voice?
Oh, so there's a company actually here out of the Media Lab, I'm sure a lot of people know about it, and you can actually talk, you just —
Oh, and it knows what you're saying by watching the muscles.
It's always so complicated to talk when you cannot talk.
Yeah. So, there's a whole modality —
In Pattie Maes' organization, they invented that you can talk without — you can communicate in a voice interface without actually —
You know, actually speaking.
It's pretty interesting.
Let's go back to various interfaces. I want to go back to the idea of delight, because you know, in the design world, the b-word, beauty, has been banned for a long time. There was this fear of beauty, of being too pretty, but in truth, really, once again, there are many different types of beauty, and it is something that really plays a very important function. So in the case of the iPod, you know, it was just a marvel and a delight of interface, and the same with every single product that you have developed. So tell me about the process of developing an interface. Like how many people — let's say the iPod, that wonderful — tell me how it happened, how many people were with you, and how did you get to that haptic feedback that is just so inevitable?
Okay. Well, there's a few things, and I put it in the book, and it has been told before, but literally the way that that came about was great artists steal. Okay. And so what happened was that you saw the model that I made, and I had an idea for that, and we didn't really have — we had not even — it was just, could we physically make something that would seem compelling, and we'll work on all the other details yet. So we were doing that, and so at the end of the meeting, and Steve goes, 'We're going to do this thing.' And I was like, 'What?' It was one meeting, we green-lit — he green-lit it to the next phase. I was like, 'What?' And I was like, 'Oh, I wasn't even expecting that.' And then they go, 'Can we show?' And I was still a contractor at the time. They go, 'Can we show Tony?' And I'm like, 'Show me what?' And so they come out from his office and they bring a Bang & Olufsen phone.
And it had a wheel on it.
Oh, that's right. That it did.
It had a wheel on it. It was a decked phone only in Europe. And it was too heavy. And it was all that stuff. But it was like — and it was like that. And I was like — they're like, 'You see that? We think that's the interface.' And I was like, 'Yeah, that could be it.' And they're like, 'Do you think you can make that?' I'm like, 'Oh, absolutely. No problem.' So, I knew exactly what to do. And then from that, that was just the fundamental — the fundamental thing. But then there was the treatment of how we did the ID. There was then the subsequent versions, how we got the click wheel happening from the analog mechanical wheel. So there was lots of refinement along the way, but it was really that. And then it was — so that was the hardware interface, but then the software interface, we prototyped many times, and literally two weeks before we were going to ship the iPod, before we showed the world, it was four of us. It was Jeff Robbin, myself, Steve Jobs, and I think Sabi Khan, and we were all sitting there, and literally at the whiteboard talking about what the structure should be. We were literally all together like, 'No, not this. Put it in this hierarchical order that — that's how it happens.' And we were literally the four of us just finalizing the interface because we had the rough thing, but then we went and implemented it. And that was literally the start — from the time this was shown, this was March 2001. We shipped it October 2001.
Tomorrow is the 24th anniversary of the launch of the iPod. We did this in eight months.
How could it happen so fast? And how solid was the distribution infrastructure in October?
Was it like a Hail Mary, or was it —
No one believed — no one believed that we could pull this off. Steve — no, this wasn't Steve saying you need to. This wasn't anyone else saying it. I knew because I saw how many projects I had worked on that had died. I had 10 years of failure. Okay? So I know what happens along the route. Especially, you have to remember Apple was only — it had $200 million in the bank and $500 million in debt. It was barely breaking even and had less than 1% market share in the US and in Japan for Macs. It didn't have retail. It didn't have anything you knew except one laptop and a couple of desktop computers. That was it. And no one was buying them. So I was like — I was like, this may never get out if it takes too long. So I'm like, we got to just make it happen. And that's what we did. And everybody was like, 'Oh, it'll ship in the springtime of the following year.' And we got it done.
So, do you think that it's good to be in a situation of high pressure and with little or a lot to lose, like, you know, just this kind of like either we make it happen or we bust?
I think it's great to have a healthy pressure. And what sometimes happens — and this happens in big corporations and also small startups — is that there's an external pressure of fear, an external pressure of fear from investors saying you're going to run out of money, you got to do this, or the corporation going, 'We're going to cancel this project because you're not delivering on time' and whatever. And I saw that at Philips and other places. I see this in startups all the time. At Apple, Steve treated us like a little infant in terms of like, I have to guard this. I have to feed it. I have to care for it because it's surrounded by teenagers, you know, and like if you don't take care of it in a special way, and you take care of it like a teenager, it's never going to — it's never going to grow up. It's going to die, right? And so you have to think about that. So if you have the right kind of pressure and the right kind of environment, then those things can happen, and it's okay to have that pressure. But if it's the negative kind where it's like, if you don't, you're — it's not going to work.
So it was very much a — it was still a pressure cooker, but it was not — it was not this, you know, 'we're going to cut out your knees if you don't —'
So it was conducive for vision and creativity. It was conducive to that, which is very important.
And it's — and after — and I learned from my experience at General Magic that took four years to get out the door, like the markets can change, everything can change. So I wanted to make sure for us we had to get out by that holiday season because Sony owned all — was number one in every single audio category. And I was like, 'Steve, we can build this, but are we really going to be able to sell it? Sony's number one.' And that was another thing that was really pressuring me. So he was giving us the right environment, but I felt Sony — and Sony was like one of my, you know, design hero, you know, design hero companies, like from the Walkman and everything else. And so I was like, these guys, they could figure it out, and we have to go faster.
So, talk about the power of design. Sony and the Sony Walkman was the first time you could move around with this bubble of personal space. And then that bubble of personal space was also enabled by the iPod, but the iPod had more. It had more delight in a way, and also refinements, and it had the Chicago font, and it had all the haptic feedback. And — yeah, I know. Fantastic. And then, okay, let's move on to the — I'm a geek for these things, as you know. Let's move to the iPhone then. So there's a new technology that still has to be perfected, but you know, there's the touchscreen, and now you have to figure out an object which is an ingot. It doesn't have any more so much of the hardware qualities that you had worked with in the past. It's an ingot, and then it comes alive when you start it. So how did you move about in this kind of new environment?
It didn't start that way. So what it really started was it was an iPod. So it was supposed to be — so what was happening at the time was iPod was getting a lot — it was 50 to 60% of the revenue of the company. It was the thing taking off. We had 85, 90% market share worldwide for digital music players. And all the cell phone companies, smartphones, Nokias and everything, they didn't like it. They were like, 'Oh, we can do that on a mid-tier phone.' There was no smartphones really at the time. So they were starting to try to adopt music playing functionality in their phones. And so we had an existential crisis that if we knew that people only wanted to carry one thing in their pocket at the end of the day, and if it was a mobile phone and it played music, that was more likely than just an iPod alone. And so we had to figure out how to — we were saying, how are we going to compete with these mobile phones that were going to try to eat our lunch? There was already people — already like Nokia saying you could play MP3s. It was nowhere near as nice, but they were getting there. And so the first project was making an iPod plus phone. So literally it was the same iPod that you know with the click wheel, and then we put a phone inside of it, and we were all like, 'How is this going to work?' And Steve's like, 'Oh, you're going to just select the name from the wheel.' And they were like, 'Yeah, but sometimes you don't have the, you know, the name in your contact library. You're going to have to dial it.' And it turned into a rotary phone. And so you took this thing that was really, really cool, and it was like, 'That'll work. Yeah, we can make calls.' But then people are like, 'How do I dial a phone number?' And then, 'How do I do texting?' Right? How do I text? And there was not enough speech-to-text at the time. We didn't have any of that stuff. It was —
Yeah. Yeah. Forget it. And so he had us working on that for months, going, 'You're going to make it. We're going to figure out the right combination of buttons and everything and modalities to make this work.' And we were like banging our heads, and we're like, 'Steve, this doesn't work. This doesn't work.' 'Keep trying. Keep trying.' We're like, 'It doesn't work, Steve. It doesn't work.' And so there was this point — it was a point of resignation where he's like, 'Shit, it doesn't work.' But he goes, 'Come over here, Tony.' And I was like, 'What?' He's like, 'Secret room.' I didn't even know this was going on. It was a secret room making a touchscreen Macintosh. So it was a touchscreen Macintosh, and it was a new technology, capacitive touch instead of resistive like we used at General Magic and Philips and all those other things. And I hadn't seen capacitive touch because I built touchscreens before, and I was like, 'Oh, this is really cool.' The thing was the touchscreen — the Mac was projected from one of like these big projectors onto a ping-pong table.
And then the capacitive touch was all around the ping-pong table. It was this huge thing. And he's like, 'See, check it out.' And you could do multiple touches and all this stuff. And he goes, 'What if you had this on that?' Because we were also making a video iPod at the time, which was a really big iPod with a virtual wheel.
Because we wanted — because we were doing movies at the time. So how do we get maximum screen space? So we were doing a video iPod, an iPod plus phone, and then we had this touchscreen Mac, but it was huge. And he goes, 'You know that full-screen iPod you're making with virtual controls? Can you put this touchscreen on it instead of this other one I was doing?' And I was like, 'But Steve, it's the size of a ping-pong table.' And so over a course of two and a half, almost three years, we had to miniaturize all the technology, build a whole new software stack, a new processor, a whole new level of modality, all the different apps, and we threw away the design two times. So we threw away the iPod plus phone. We threw away the video large-screen iPod, and then we made two full versions of an iPod — or iPhone, threw those away, and then built the final one.
And at that point, there was not even a concept of a minimum viable product. It was not even an MVP. They were all like you went from model to prototype, and otherwise you would throw everything out. There was not the same process of iteration and test that exists right now.
Right. No, no. We would literally take it to a certain extent, and then we would test the radio, you know, the antennas, because we never really made portable antennas, or we didn't make the touchscreen, or was it fast enough. So we had to get it to a certain point, and we're like, 'Oh, we hit a wall again.' But we know what to do. So throw that away, start over again, and then we would continually modify. Because the first iPhone — the first model of an iPhone, it looked like an iPod mini, if anyone remembers that. It was an aluminum extrusion, more like a chocolate bar. It had a different proportion.
Exactly. So that was the first thing, but then the antennas didn't work in that —
You know, because we didn't know better. We didn't really know how to make those kinds of things. So we had to go through this process, but it was high speed. So three products in two and a half years, plus those other two that we threw away, plus all the software, all the other stuff. So — and it was a lot of people coming together. So I had a big team, but then we had a big operating system team. Then we had a big applications team as well, plus the whole user interface —
— plus the whole ecosystem outside of Apple, because then you had — I remember there was this little keyboard you could plug into, I think it was an Ericsson phone. So it was just the insanity of what everybody was testing around the world. It was like fervor.
It was crazy. And you know, we didn't even have an App Store. There were no apps, you know, third-party apps in the first iPhone. So again, iterate, iterate, iterate. Now we're on iPhone 17, and it's aluminum, and they figured how to make antennas work and all this stuff.
So, out of those 300 patents that you have, were they all 300 different pains, or were they ways to perfect solutions to different pains?
A little of both. A little of both. You know, I really got to charge — you know, Apple was really big on patents. Philips was as well. So I got to spend — and so was General — actually, General Magic too. So I got to do — I just learned that whole way of doing it and like keep pushing the edge. And so a lot of it was novel. In fact, so much so that when General Magic went bankrupt, a company came in and bought all the patents and all the technology from General Magic, and I wanted to try to buy my stuff back, but this company bought it all. And then I got a call.
What company was it? Is the company that bought it still alive or —
Yeah. Yeah. Yeah. Oh, okay. Yeah. It's Nathan Myhrvold's.
Nathan bought it all. So Nathan bought it all, and then he started going through all the patents, and he calls me up and he goes, 'Hey Tony, can I get your help with something?' He goes, 'Your patent,' because I did this special serial bus. He goes, 'Your patent is actually fundamental to USB.' The universal serial bus. That was what we were doing. So it was a fundamental patent. And he's like, 'I need your help because I'm going to sue everybody on USB.' I said, 'I'm out.' But yeah, it was literally we were doing fundamental —
Patent. It was a heroic company. It was like Xerox PARC, right? You know, Xerox PARC is where the graphical user interface — I'm saying it for the younger students here. So the interface of the Mac and the mouse, all of these amazing inventions were made. So it was a universal donor, General Magic.
Yeah. Yeah. General Magic positive.
All kinds — exactly. All kinds of different things. In fact, at General Magic, we created and invented — and this was really Bill Atkinson and Susan Kare — created emojis.
And we were working with NTT DoCoMo at the time, and they go, 'That's really cool.' And when General Magic died, they went and implemented emojis on the Japanese handsets. And that's how it all took off. And they're now in the collection of MoMA. And now they're with the iPod, with the original — well, not the original Macintosh icons because Steve didn't let me have them. He wanted to control every single exhibition that we did at MoMA. I said, 'Sorry, no.' So we don't have any like — yeah, we have Susan Kare, the icon designers. We have her notebooks. So —
And tomorrow, Susan and I are announcing our collaboration and a new product coming out tomorrow. I wanted to show it today, but it's under —