← All issues

AI Agents, Token Costs, and the New Internet Taste

Issue

AI Agents, Token Costs, and the New Internet Taste

Distilling Deep AI Insights from Leading Podcasts

3 episodes3 podcastsAugust 3, 2026
Cover art for Lenny's Podcast: Product | Growth | Career: This CPO regrets that product management exists | Tom Verrilli (CPO of Whatnot)

This CPO regrets that product management exists | Tom Verrilli (CPO of Whatnot)

Lenny's Podcast: Product | Growth | Career by Lenny Rachitsky · 84 min

Listen to episode →

This episode centers on Tom Verrilli’s unusually opinionated view of product management, especially at Whatnot, where the team is deliberately designed to avoid defaulting to PMs. He argues that engineers and designers should own more decisions directly, and that PM should be used selectively as a specialist function rather than a universal layer. The conversation also explores how AI is changing the role of product managers by making data analysis, code comprehension, and execution faster for senior operators. Tom shares how Whatnot structures product work around six-month planning cycles, problem ownership, and accountable DRIs instead of fixed team attachments. He also discusses what makes a great PM, why founder-led companies often benefit from leaders staying close to the details, and his “play the accordion” model of alternating between zooming out strategically and zooming in tactically.

Key Takeaways

  • 01

    Product management should not be the default operating model; it should be used only where it creates clear leverage.

    Tom’s core thesis is that engineers and designers can often make better decisions when they have the context and judgment to own the work directly. This challenges the common assumption that every product effort needs a PM, and it pushes organizations to be more intentional about when the PM role actually adds value. The underlying concept is a more distributed decision-making model, where product thinking is embedded across the team rather than centralized in a PM layer.

  • 02

    AI is accelerating the shift toward senior, hands-on IC-style product work.

    Tom believes AI reduces the cost of analyzing data, reading code, and iterating quickly, which makes experienced operators more effective without relying as much on coordination-heavy processes. This matters because it changes the leverage profile of the PM role: judgment, technical fluency, and speed become more important than process management. Technologies and concepts involved include AI-assisted analysis, code understanding, and faster decision loops.

  • 03

    The best PMs are judged by customer insight, business context, technical fluency, and decisive execution—not stakeholder theater.

    Tom is skeptical of candidates who are strongest at alignment and communication without demonstrating deep product judgment. His hiring philosophy suggests that successful PMs need to synthesize customer needs, business realities, and technical constraints into concrete decisions. This is significant because it reframes PM excellence as outcome-driven rather than coordination-driven, and it makes interview signals like case studies and decision quality more important than polished presentation.

  • 04

    Whatnot organizes product work around problems and planning cycles, not permanent team attachments.

    Instead of assigning PMs to fixed squads indefinitely, leadership defines what must be true every six months and then assigns owners to the highest-priority work. This structure supports flexibility, faster reallocation of talent, and clearer accountability for outcomes. The concept reflects an operating model centered on DRIs, planning horizons, and problem-first staffing.

  • 05

    In founder-led companies, being close to the work is a leadership advantage, not necessarily micromanagement.

    Tom argues that product leaders need ground truth from data, customers, and implementation details in order to make better decisions. That means staying engaged in the weeds can improve judgment and speed, especially when the founder’s intuition is a major driver of the business. The key concept here is calibration: leaders should debate with evidence, align where appropriate, and avoid treating autonomy as a universal good.

  • 06

    Great product leadership requires oscillating between strategy and execution.

    Tom’s “play the accordion” model describes repeatedly zooming out to understand the problem space and then zooming in to ship, learn, and revise. This is important because it prevents teams from getting stuck either in abstract strategy or in narrow execution without context. It’s a practical framework for balancing long-term thinking with rapid iteration and feedback.

Cover art for The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis: Everything You Need to Know About AI Tokens

Everything You Need to Know About AI Tokens

The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis by Nathaniel Whittemore · 50 min

Listen to episode →

This episode breaks down what AI tokens are and why they matter far beyond simple per-token pricing. The discussion focuses on how to measure AI usage by cost per successful task, especially in agentic workflows where loops, retries, and tool use can dramatically inflate spending. It also explores the idea that fear of token costs can suppress experimentation, causing organizations to miss valuable learning and innovation. A major theme is distinguishing productive token use from waste, including eliminating "tokens that spin" such as bloated context, unnecessary automations, and idle agent loops. The episode also notes that different models and tokenizers can produce very different bills for the same work, making model selection and workflow design critical to managing AI economics.

Key Takeaways

  • 01

    Measure AI spend by cost per successful task, not raw token volume or sticker price.

    The episode argues that token counts alone do not capture business value, because different models, tokenizers, and workflows can change the bill for the same outcome. Using cost per accepted task or completed job gives teams a more operationally meaningful metric for evaluating ROI, especially when comparing models like GPT-style systems or agent frameworks.

  • 02

    Fear of token costs can be more expensive than the tokens themselves.

    A key insight is that the most valuable users are often the ones most afraid to experiment, which reduces learning and slows adoption. This matters because innovation in AI often comes from trying workflows, testing prompts, and iterating on agents; if people self-censor due to cost anxiety, organizations may underuse the technology and lose competitive advantage.

  • 03

    Agentic workflows are inherently token-intensive because they loop, retry, and repeatedly exchange context with tools.

    Unlike simple chat interactions, agents may make many model calls, re-send long histories, and perform deep research or tool-based steps, causing costs to multiply quickly. The episode highlights widely cited estimates that agents can consume 5 to 30 times more tokens than a basic chat, which makes workflow design and control mechanisms essential.

  • 04

    Model choice and tokenizer differences can materially affect total cost, even when prices look similar on paper.

    Two models may have comparable per-token pricing but still generate very different bills depending on how they tokenize text, how many reasoning tokens they use, and how efficiently they complete the task. This is especially important for multilingual use cases, where tokenization can make non-English text more expensive, and for teams comparing reasoning-heavy models versus cheaper alternatives.

  • 05

    Organizations should actively eliminate 'tokens that spin'—work that creates activity without value.

    The episode recommends auditing agent loops, unused automations, overly frequent jobs, and oversized prompts or context windows that add cost without improving outcomes. This is significant because waste can accumulate invisibly in agent systems, so teams need dashboards and operational reviews to separate 'tokens that teach,' 'tokens that produce,' and 'tokens that spin.'

This episode explores how internet culture is evolving through fragmented online communities, shifting language, and algorithm-driven behavior. Ruby Thelot explains cyberethnography as a way to study digital groups by observing how people actually behave and assign meaning in online spaces. The conversation also examines how apparent trends can be amplified by feeds or media rather than reflecting broad cultural change. A major theme is the rise of a more "pluric" internet, where subcultures develop their own vernaculars, tastes, and norms, sometimes making communication between groups harder. The episode closes by looking at AI’s growing role in creativity, taste, and everyday utility, including why many people say they dislike AI while relying on AI-powered tools constantly.

Key Takeaways

  • 01

    Cyberethnography helps explain online culture by studying behavior in digital spaces, not just what people say they like.

    Ruby frames cyberethnography as an observational method for understanding communities like furries, Instagram users, and other online groups. This matters because platforms create new social signals—such as likes, Stories, and Close Friends memberships—that require a new vocabulary to interpret correctly.

  • 02

    Many viral 'trends' are not truly universal; they may be micro-behaviors amplified by algorithms, media coverage, or niche communities.

    Ruby emphasizes using both quantitative data and real-world observation to test whether a phenomenon is actually widespread. This is significant because it challenges the assumption that social media visibility equals cultural dominance, especially on platforms like TikTok.

  • 03

    The internet is becoming a collection of smaller, distinct subcultures rather than one shared mainstream, leading to a kind of 'pluric culture.'

    Ruby describes this fragmentation as 'BABBELIFICATION,' where the same word can mean different things across communities and platforms. The implication is that online language and norms are increasingly localized, which can make cross-community communication confusing and error-prone.

  • 04

    AI is changing what 'taste' means because creators now optimize for both humans and machines, not just human audiences.

    Ruby suggests that algorithms, bots, and AI systems increasingly shape what gets seen, liked, and rewarded. This makes taste less about personal aesthetic preference alone and more about navigating machine-mediated attention systems, including concepts like 'machine-against' taste and agent-to-agent interaction.

  • 05

    People often reject the label 'AI' even while relying on AI-powered tools every day, showing that public resistance is partly about language.

    Ruby points out that Americans may say they dislike AI because of job anxiety or abstract fears, but still use products like chat assistants and other AI-enabled tools for practical reasons. This is important because it suggests adoption is driven more by utility than by public enthusiasm for the term itself.

Questions answered in this issue

Why does Tom say Whatnot regrets that product management exists?

He means PMs should not be hired reflexively. The org should only use PMs where their specialization creates clear leverage; otherwise, engineers and designers should make decisions themselves.

How has AI changed the PM role at Whatnot?

AI lets PMs analyze data, understand the codebase, and move faster with less dependency on others. Tom says it makes senior, judgment-heavy IC work much more efficient.

What is a token in practical terms?

A token is a chunk of text that a model reads and writes; it is usually smaller than a word and larger than a character. The transcript also notes that tokenization varies by language and can make non-English text more expensive.

Why can agentic workflows become unexpectedly expensive?

Agents often run in loops, make many model calls, and repeatedly send history, instructions, and tool definitions back to the model. That means the real cost is often dominated by retries, refinement, and hidden reasoning tokens rather than the final answer.

What does a cyberethnographer do?

A cyberethnographer studies groups of people online, focusing on how they behave, communicate, and build meaning in digital spaces. Ruby describes research ranging from furries to Instagram and says the goal is often to build a vocabulary for new digital behaviors.

How do you tell whether a social-media trend is actually widespread?

Ruby says you have to combine quantitative analysis with interviews and real-world observation. He emphasizes asking whether something is truly prevalent or just amplified by an algorithm, journalists, or a small local community.

Explore

Related podcasts