🔊 CEOInterviews
Start App
Try: AI strategy tariffs earnings guidance layoffs interest rates growth

Jonathan Ross

Chief Software Architect, Nvidia

Search every verified Jonathan Ross interview, podcast appearance, and on-the-record quote — each transcript cross-checked by AI and human review to confirm speaker identity. Jonathan Ross, founder of Groq and inventor of Google's TPU, has been discussing the company's near-collapse and subsequent partnership with Nvidia. He described a period when Groq was about three weeks from running out of money and considered layoffs, but instead implemented a salary-for-equity exchange called "Groq bonds," which he said 80% of employees participated in, with about half reducing their salaries to the statutory minimum. Ross stated that this move saved the company. He also discussed a $20 billion partnership with Nvidia, describing it as combining GPUs and LPUs for better performance, analogous to using both 18-wheelers and delivery vans in a logistics network. Ross has spoken about the future of AI compute, stating that "as long as there are unsolved problems in civilization, we will have a need for more compute" and that "there's no way to satiate the appetite for intelligence." He has advocated for revamping education to focus on asking questions rather than providing answers, saying "if you can come up with the right question, AI can go answer it for you." Ross also distinguished between intelligence and sentience, defining sentience as "your rate of improvement in your intelligence" and suggesting that AI is creating a feedback loop that accelerates societal intelligence.

Selected quotes

Recent appearances

  • Jonathan RossCEO & Founder at Groq | Revolutionizing AI Compute Architecture

    Jonathan Ross CEO & Founder at Groq | Revolutionizing AI Compute Architecture 👉#JonathanRoss: ​“We were going to run out of money. 💸 ​And the leadership team that I had at the time was starting to put together a list of layoffs of who we were going to lay off. ​When I started reviewing the list, it became very clear to me that if we did that layoff, we were dead. 💀 ​Why? 🤔 ​We were already struggling to keep up with what we needed to implement. This wasn't even pre-product market fit. This was pre-the product working. ​We had to write a very special compiler that had never been written…

    Watch on YouTube ↗

  • Leaving Google, Founding Groq & Building the Future of AI | Jonathan Ross

    Jonathan Ross is the founder of Groq and the inventor of the Google Tensor Processing Unit (TPU), now a senior executive at NVIDIA following the company's $20 billion partnership with Groq. Before Groq, Ross built something that didn't exist: a custom AI chip at Google called the TPU, which became the backbone of DeepMind's AlphaGo — the system that defeated world Go champion Lee Sedol in 2016. After watching the TPU push AlphaGo's ELO score up by hundreds of points overnight, Ross grasped a principle that would define his next decade: faster inference produces more capable models. He left Go…

    Watch on YouTube ↗

  • "An endless demand for compute" | Jonathan Ross, founder of Groq

    Jonathan Ross is the founder of Groq, a hardware chip specifically designed for LLM inference, which entered a $20 billion strategic agreement with NVIDIA. Topics covered: • The "success disaster" at Google that led to the TPU and eventually Groq • LPU vs. GPU: Pareto curves, cost-per-token, and when each wins • Static scheduling • Mixture-of-experts models • Auto-regressive vs. diffusion models • How Groq and NVIDIA's Vera Rubin work together at inference time • Jevons Paradox: why cheaper AI will increase total compute demand • Will AI replace CUDA kernel engineers? • What skills kids shoul…

    Watch on YouTube ↗

  • The Inference Revolution: Groq, Nvidia and the Future of AI

    At Sohn Investment Conference 2026, Jonathan Ross, Chief Software Architect, Nvidia, and John Yetimoglu, CIO, Infinitum, discuss the current landscape and future trajectory of AI.

    Watch on YouTube ↗

  • CUDA: New Features and Beyond | NVIDIA GTC

    The CUDA platform underpins GPU computing, providing the libraries, compilers, runtimes, and programming model used by ...

    Watch on YouTube ↗

  • Jonathan Ross on AI Chips | The NVIDIA Groq Deal Behind GTC 2026

    Fireside chat with NVIDIA Chief Software Architect (and LPU creator) Jonathan Ross, who joined David Senra (‪@founderspodcast1‬) at NVIDIA GTC for a conversation about the reality of modern inference. This is your opportunity to learn why Nvidia and Groq partnered together, and what it means for the future of inference. If you’re building for scale, you shouldn't be choosing between low latency and high throughput—you should be optimizing for both. Timestamps: 00:00 — How the Groq + NVIDIA partnership started 01:22 — How the LPU + GPU hybrid actually works 03:40 — Performance & cost charts 0…

    Watch on YouTube ↗

  • Jonathan Ross GPU ♥ LPU Everything You Wanted to Know Nvidia GTC 2026

    Explore how combining different processing architectures aims to optimize artificial intelligence performance. This discussion covers technical integration strategies and potential impacts on speed and cost-effectiveness in data centers.

    Watch on YouTube ↗

  • NVIDIA GTC 2026 Live

    Tune-in to hear live conversations between the hosts and industry leader panelists as they examine accelerated computing beyond AI, NVIDIA’s role as a full-stack infrastructure company, and the five-layer foundation behind one of the largest infrastructures build-outs in history — and the ecosystem required to deliver it worldwide.

    Watch on YouTube ↗

  • Why Groq CEO Jonathan Ross wants even HR teams to code with AI

    Groq Founder and CEO Jonathan Ross wants Indian startups to focus on AI applications rather than building foundational models.

    Watch on YouTube ↗

  • Saudi Arabia to Become AI Data Center Hub: Groq CEO Explains Why

    Saudi Arabia AI hub, Groq CEO Jonathan Ross, AI data centers, energy surplus, Vision 2030 Discover why Saudi Arabia is poised ...

    Watch on YouTube ↗

The summary and quote tags on this profile are produced with AI assistance from verified, first-person interview transcripts, then checked by our team to confirm the speaker's identity and the accuracy of every quote. See how we verify →