AI without insight is just chaos: Why marketers need to rediscover research

Jun 17, 2025

Paramark News Desk

Source: subconscious.ai

Key Points

  • Avi Yashchin, CEO of Subconscious AI, says most AI marketing efforts fail because they lack a deep understanding of consumer decision-making, a gap traditionally filled by market research.

  • The "say-do gap"—the difference between what people claim and their actual behavior—is where effective marketing thrives.

  • Yashchin believes that true AI advancement in marketing requires a renewed focus on understanding the "why" behind consumer choices, not just scaling content generation.


If you let the language models by themselves create content or perform activities, it's like deploying interns into your company without any instructions.

Avi Yashchin

Founder and CEO
,
Subconscious AI

The siren song of AI in marketing has been loud, luring with tales of hyper-personalization and effortless efficiency. But for many, that glittering promise is souring, as a frustrated chorus at industry conferences echoes a common complaint: AI agents are "not working." The problem often isn't the technology itself, but its core deficit: a genuine understanding of human motivation.

Avi Yashchin is the Founder and CEO of Subconscious AI, a company leveraging generative AI for investment-grade behavioral science and research. With a background steeped in the market research world, including a role as Research Assistant Professor at New York University, he believes the marketing industry's rush to adopt AI has overlooked a foundational component: the deep, experimental research that uncovers consumer decision-making.

The intern problem: "There was this great quote at one of the earlier panels, 'agents aren't working.' And the crowd erupted," Yashchin recounts from the AIx Marketing conference. "The crowd was just clapping. Yeah, we agree, agents aren't working, but every single person here is deploying marketing agents. How are those two statements true?" For Yashchin, the disconnect stems from AI agents lacking a deep understanding of what causes humans to make decisions, something only rigorous market research can provide. "If you let the language models by themselves create content or perform activities, it's like deploying interns into your company without any instructions."

Rediscovering research: "I'm actually frankly shocked at how little market research is being discussed in this industry," Yashchin admits. "People are kind of trusting the language models to generate copy at scale, which is kind of scary." He argues that without this foundational research, AI operates in a vacuum, unable to truly connect with or persuade consumers. Subconscious AI was founded to make such capabilities widely accessible, prompting an internal debate about shifting from selling to market researchers to directly engaging CMOs and CPOs.

The "say-do gap": Yashchin explains the "say-do gap"—the well-documented phenomenon where what people report they want or will do often diverges wildly from their actual behavior. "If you ask most Americans what kind of coffee they like, they say, 'I love a dark robust blend.' But if you run a randomized controlled blind trial, they all like light and sweet," he explains. "What they say and what they do reliably doesn't match." The gap, he asserts, is where marketing truly lives and breathes. "If the say-do gap is large, marketing is effective. Marketing lives in the say-do gap."

Grounding the chaos: So how can marketers ground their AI? Subconscious AI’s DIY end-to-end platform runs large-scale quantitative research quickly and cost-effectively, exposing the say-do gap. "We'll design the research, we'll design the experiment, we'll recruit for the experiment, we'll run the experiment, we'll analyze the results," Yashchin outlines. This entire process, he explains, happens in minutes, not months, and at a fraction of the traditional cost. The goal isn't to be better than human agents, but to "get 95% of the right answer with 1% of the cost." Such grounding is fundamental. "If you ground every part of the experiment—the personas, the population, the products—then you can start to get a signal that matches humans. Now your interns could be junior marketing techs."

The goal isn't to be better than human agents, but to 'get 95% of the right answer with 1% of the cost.' Such grounding is fundamental. 'If you ground every part of the experiment—the personas, the population, the products—then you can start to get a signal that matches humans.

Avi Yashchin

Founder and CEO
,
Subconscious AI

Beyond marketing budgets: "When I was on Wall Street, I did a lot of backtesting and analysis of companies, and I noticed that companies with high marketing budgets underperform in general," Yashchin states, challenging conventional wisdom about marketing spend, though he acknowledges exceptions like Apple or Coca-Cola exist. He believes most of this expenditure isn't hitting the mark precisely because it relies on asking people what they want, rather than experimentally determining their true preferences. "If you spend marketing dollars intelligently, if you run well-designed experiments, if you explicitly expose the say-do gap and market within that gap, then yes, it can be effective."

Validating AI: Building trust in an AI-driven research model is paramount. Subconscious AI employs a three-pronged validation approach. "Number one, we back-test against published and non-published studies," Yashchin explains. "Number two, when you run an experiment, we can also take 1, 5, 10% of those responses and send it out to a real human so we can triangulate." The third method involves clients running their own experiments in parallel to compare results. "We really strongly suggest people always check with humans." He humorously adds that in early back-testing, their system sometimes "failed" experiments that turned out to be fraudulent benchmarks, leading them to inadvertently build a fraud detector.

New frontiers for understanding: What else can AI-powered market research unlock? The applications extend beyond typical marketing use cases like message testing or lead scoring. Yashchin sees potential in policy design and understanding societal values. "A lot of what people care about does not have a price: mental health, social connection, life, liberty, happiness," he muses. "You can use methods like this to understand what people care about in a non-marketing context. You could use this for policy design, for political campaign platform optimization." He cites examples in Northern Europe and Southeast Asia where similar methods inform public policy decisions, like choosing between a school or a solar farm.


AI without insight is just chaos: Why marketers need to rediscover research

Jun 17, 2025

Paramark News Desk

Source: subconscious.ai

Key Points

  • Avi Yashchin, CEO of Subconscious AI, says most AI marketing efforts fail because they lack a deep understanding of consumer decision-making, a gap traditionally filled by market research.

  • The "say-do gap"—the difference between what people claim and their actual behavior—is where effective marketing thrives.

  • Yashchin believes that true AI advancement in marketing requires a renewed focus on understanding the "why" behind consumer choices, not just scaling content generation.


If you let the language models by themselves create content or perform activities, it's like deploying interns into your company without any instructions.

Avi Yashchin

Founder and CEO
,
Subconscious AI

The siren song of AI in marketing has been loud, luring with tales of hyper-personalization and effortless efficiency. But for many, that glittering promise is souring, as a frustrated chorus at industry conferences echoes a common complaint: AI agents are "not working." The problem often isn't the technology itself, but its core deficit: a genuine understanding of human motivation.

Avi Yashchin is the Founder and CEO of Subconscious AI, a company leveraging generative AI for investment-grade behavioral science and research. With a background steeped in the market research world, including a role as Research Assistant Professor at New York University, he believes the marketing industry's rush to adopt AI has overlooked a foundational component: the deep, experimental research that uncovers consumer decision-making.

The intern problem: "There was this great quote at one of the earlier panels, 'agents aren't working.' And the crowd erupted," Yashchin recounts from the AIx Marketing conference. "The crowd was just clapping. Yeah, we agree, agents aren't working, but every single person here is deploying marketing agents. How are those two statements true?" For Yashchin, the disconnect stems from AI agents lacking a deep understanding of what causes humans to make decisions, something only rigorous market research can provide. "If you let the language models by themselves create content or perform activities, it's like deploying interns into your company without any instructions."

Rediscovering research: "I'm actually frankly shocked at how little market research is being discussed in this industry," Yashchin admits. "People are kind of trusting the language models to generate copy at scale, which is kind of scary." He argues that without this foundational research, AI operates in a vacuum, unable to truly connect with or persuade consumers. Subconscious AI was founded to make such capabilities widely accessible, prompting an internal debate about shifting from selling to market researchers to directly engaging CMOs and CPOs.

The "say-do gap": Yashchin explains the "say-do gap"—the well-documented phenomenon where what people report they want or will do often diverges wildly from their actual behavior. "If you ask most Americans what kind of coffee they like, they say, 'I love a dark robust blend.' But if you run a randomized controlled blind trial, they all like light and sweet," he explains. "What they say and what they do reliably doesn't match." The gap, he asserts, is where marketing truly lives and breathes. "If the say-do gap is large, marketing is effective. Marketing lives in the say-do gap."

Grounding the chaos: So how can marketers ground their AI? Subconscious AI’s DIY end-to-end platform runs large-scale quantitative research quickly and cost-effectively, exposing the say-do gap. "We'll design the research, we'll design the experiment, we'll recruit for the experiment, we'll run the experiment, we'll analyze the results," Yashchin outlines. This entire process, he explains, happens in minutes, not months, and at a fraction of the traditional cost. The goal isn't to be better than human agents, but to "get 95% of the right answer with 1% of the cost." Such grounding is fundamental. "If you ground every part of the experiment—the personas, the population, the products—then you can start to get a signal that matches humans. Now your interns could be junior marketing techs."

The goal isn't to be better than human agents, but to 'get 95% of the right answer with 1% of the cost.' Such grounding is fundamental. 'If you ground every part of the experiment—the personas, the population, the products—then you can start to get a signal that matches humans.

Avi Yashchin

Founder and CEO
,
Subconscious AI

Beyond marketing budgets: "When I was on Wall Street, I did a lot of backtesting and analysis of companies, and I noticed that companies with high marketing budgets underperform in general," Yashchin states, challenging conventional wisdom about marketing spend, though he acknowledges exceptions like Apple or Coca-Cola exist. He believes most of this expenditure isn't hitting the mark precisely because it relies on asking people what they want, rather than experimentally determining their true preferences. "If you spend marketing dollars intelligently, if you run well-designed experiments, if you explicitly expose the say-do gap and market within that gap, then yes, it can be effective."

Validating AI: Building trust in an AI-driven research model is paramount. Subconscious AI employs a three-pronged validation approach. "Number one, we back-test against published and non-published studies," Yashchin explains. "Number two, when you run an experiment, we can also take 1, 5, 10% of those responses and send it out to a real human so we can triangulate." The third method involves clients running their own experiments in parallel to compare results. "We really strongly suggest people always check with humans." He humorously adds that in early back-testing, their system sometimes "failed" experiments that turned out to be fraudulent benchmarks, leading them to inadvertently build a fraud detector.

New frontiers for understanding: What else can AI-powered market research unlock? The applications extend beyond typical marketing use cases like message testing or lead scoring. Yashchin sees potential in policy design and understanding societal values. "A lot of what people care about does not have a price: mental health, social connection, life, liberty, happiness," he muses. "You can use methods like this to understand what people care about in a non-marketing context. You could use this for policy design, for political campaign platform optimization." He cites examples in Northern Europe and Southeast Asia where similar methods inform public policy decisions, like choosing between a school or a solar farm.