Tom Brown on costs
From First Public Talk on GPT-3 by Tom Brown · · Tom Brown
“GPT-3 is incredibly expensive and inconvenient: you have to spend a lot of money to train it, you have to spend a lot of money to do inference on it, and you need a crazy distributed system to run it.”
On , Tom Brown, Cofounder at Anthropic, spoke about costs during First Public Talk on GPT-3 by Tom Brown on Tom Brown.
About Tom Brown
Tom Brown, cofounder of Anthropic, participated in a January 2025 conversation with other Anthropic co-founders about the company's history and approach to AI safety. During the discussion, Brown referenced the company's Responsible Scaling Policy (RSP), describing it as a framework that "creates healthy incentives" by aligning internal team incentives with safety and making safety-related decisions more legible externally. He noted that if the company cannot make a model safe at a certain capability level, the RSP provides a preexisting framework for that decision. In a 2020 talk on GPT-3, Brown described the model as "incredibly expensive and inconvenient" to train and run, requiring significant resources and distributed systems. He stated that "the stakes are becoming high" as more resources are directed toward AI, predicting that AI would "permeate every aspect of our lives within the next five to ten years." Brown called for public goods research on making models more interpretable and robust, a goal he said he was pursuing at Anthropic.