Host19:42
No, I know. But you can imagine you land there, you're like, "Okay, where is everyone? Let's meet. This is a big issue. Let's figure this out. This is important. National security is on the line." And they're like, "Where is everyone?" If you take safety seriously, cyber security seriously, bio security seriously, export control seriously, UFC could not be less aligned with the stakes there. There is this big gap between the administration and Anthropic. I think that every American should care about bridging this gap. Private enterprises should be able to flourish in the United States. Everyone agrees with that. And the government should be able to enact reasonable regulations to protect America's interests. Both of those need to find a way to play together, but there is a really broad gap between these two organizations. Everyone's hoping that things resolve quickly. It seems like the right wheels are in motion. The flights have been booked or already taken, and things are moving along. Just a recap on the play-by-play. March 4th, Anthropic received a Department of War supply chain risk letter that of course got rolled back eventually. April 7th was the Mythos preview announcement alongside Project Glass Wing. June 9th was the Fable 5 launch last Monday. Mythos with guardrails around cyber, bio, and AI research. On June 12th, just 5 days after the end of the week, Fable 5 gets suspended after the Commerce Department issues an export control directive. Anthropic explained in a blog post that the US government is restricting both Fable 5 and Mythos 5 from being used by any foreign national, whether inside or outside the US, including foreign national Anthropic employees. That's a huge compliance burden, very sudden. That led Anthropic to completely suspend the use of those models for all users, not just foreign national employees, because they need to comply with this, do all the KYC, understand how different organizations are using the model, who at those organizations has access, if something's being vended through an API and it's showing up in another product, does that product do all of the proper authorizations? It's a big wrench in the gears of the rollout of this model. Then the information reported that Andy Jassy at Amazon had raised concerns with senior administration officials about jailbreaking, the risk of jailbreaking Fable and getting access to all of Anthropic. Anthropic countered in their blog post saying, "We reviewed a demonstration of this specific technique being used to identify a small number of previously known minor vulnerabilities. These vulnerabilities all appear relatively simple, and we have found that other publicly available models are able to discover them as well without requiring a bypass." So they're saying this isn't that big of a jailbreak. This isn't that big of a deal. We can move forward safely. We've taken safety seriously. But that is the debate going on between the admin and Anthropic. As everyone knows, the rollout of Fable 5 has been a bit rocky. Incredible demos, incredible benchmarks, but offset by the odd decision to silently degrade the quality of answers related to frontier AI development. Instead of just refusing the request like cyber and bio prompts, which was the main thing that everyone was really confused about, the actual rationale behind AI development refusal is pretty sound. People are upset about that if they're working on machine learning systems, recommender systems, anything that requires instantiating an AI product, let alone if you're just doing open source AI research and you'd love to use the latest and greatest models to help you. Now it's not an option. But at the same time, just think about the logic. If a model doesn't let you hack a system, just have the model build you an unrestricted model that does let you hack that system. Clearly in that scenario, it makes sense to restrict. If you want to restrict hacking or bio, you also have to restrict the tool that makes the tool that hacks the system or develops the bioweapon in theory. But the choice to silently degrade responses was not well received. These are important issues, and there's another timeline where AI leaders are cut from the same cloth as America's elected officials. But we're in a world where Anthropic has to make their case for safety in an age of RSI during a UFC fight on the White House lawn. It's a very bizarre timeline, but here we are. Most of the big tech CEOs have figured out how to work with the administration effectively, showing up to large dinners, photo ops, the occasional movie screening to make their case about hot topics. Many of these CEOs also have business relationships with Anthropic, either on the customer side or on the investor side. That's what's really complicated about the Amazon relationship. Obviously Amazon uses Anthropic models, is also an investor in Anthropic, also provides compute to Anthropic. They have a very hairy, complex, circular relationship. That clouds the discussion over whether Anthropic is going to try and help Anthropic get through this, or if they're doing everything above board. At the same time, people were sort of putting out that, "Oh, did Amazon spike the ball on this?" If the government comes to you and asks, "Hey, you're a big tech company, you've been using this model a lot, your close partner, were you able to jailbreak it at all?" And your security team just issued a report like, "Yeah, we actually were able to jailbreak it a little bit." You're not going to withhold that from the government. You're going to turn that over. That's different than calling and saying, "Hey, I really think it's dangerous. You got to put pressure on them." There's a wide range of levels of interaction that can go both ways. A lab can be partnered with a big tech company. That big tech company can have a really established government regulations group that is actually helping you get through to the admin. On the flip side, you could have a big tech company that is competing with you or frustrated by your business and is actively trying to put their thumb on the scale the other way. I'm sure we'll learn more in the future. Many of these CEOs have business relationships with Anthropic. So we'll see how all of this develops. They're always renegotiating these contracts, too, which makes things more complex. And they're competing across multiple markets. So expect the 4D chess to be on full display all summer long in Washington. Anyway, UFC, Anthropic, what else is going on? Meta is doing a 180 according to a report over at The Information, trying to be the vanguard of token minimizing. I think the token maxing, token minimizing thing is so silly because do you know where maxing comes from really? It comes from gamer lingo usually.