Brian Moynihan7:03
So a couple things. One which is instructive now is the quality of the AI models and stuff. Ten years ago or more, when we said we wanted to have a model that the customer could ask a question to and get an answer, we tried to use the then-existing search engines and we got answers that made no sense. 'What's my balance?' A picture of a scale, you know, things like that. So we said we had to build a model. So we went to Stanford and they built what we call today a small language model. Nobody would call it that. What was the key of that? The key was to sit there and say, as Erica opened up in 2018, there were 200 things you could ask it and it could get right. And I'll come back to that. Now there's 700 or 800, last quarter 200 million times it was used, and 20 million customers, you said. But what's the bridge? The lessons: the data has to be perfect because people won't tolerate a wrong answer when they're asking about their financial affairs. Other things you may tolerate a wrong answer — who's older, X or Y, Mike or me, may get it wrong, but life's not going to end because of that. But you won't tolerate a wrong answer about your financial affairs. So your data has to be perfect, the model rules then have to be perfect. They can't fantasize about what the answer is. And then you have to do it immediately with no latency. The person on the receiving end could be driving down the road with a cell phone with connectivity that's in this neighborhood, which I don't know is good, bad, or indifferent. Right? So people think this is so easy. All those things have to be in place. We spent $3 billion on our data to get it arrayed right for a whole set of reasons. That was a precursor to be able to entertain the idea you could use this stuff. Not to let you use it, just to entertain the idea. And so the growth of this will be unbelievable. We're seeing it. We have some use cases, 40 or so are active, and we put another one each week. It's across all the different aspects. We took the Erica model and put it into our tech break fix. So when you want to change your password or something, it's all done by that same technology. We put it into our cash management platform. Then we brought in agent force, we brought in stuff for the investment bankers and things. So there's a lot of stuff out there and we're pushing it ahead. But the lessons learned from the implementation area is: for the business we're in, you own the answer whether the model does or not. The data has to be perfect. The technology to manipulate the data in a set of deterministic rules have to be perfect, and they have to get an answer. There are other ways you can use it less deterministic, let it free form, but you have to have a human step in front and make sure the answer is right because it'll once in a while go off on a tangent. So we're trying to think, you work that hard. We use it in computer coding, 18,000 programmers are getting benefits out of it. We use it a lot of different ways in the company. But you had to start with this: data has to be right, the rules have to be right to either train the model on or put in a deterministic type model, and then you have to have the output available with a pace that the customer expects. That's actually harder than people think.