The AI Automation Breakthrough: Key Insights from Our Latest Community Event

AI is opening up new possibilities for qualitative research. But for researchers, it’s not enough for an AI Interviewer to ask relevant questions. An effective AI Interviewer needs to create an experience where participants feel comfortable sharing their perspectives, have the space to explain their thinking and explore their answers in more depth.

‍

To find out more, we ran a study using Optimal’s AI Interviewer to look at general attitudes towards AI, better understand what participants valued about an AI Interviewer experience, and what worked well and where they saw room for improvement.

‍

One theme stood out: the value of AI interviews depends not just on the technology, but on the experience it creates for the people taking part.

‍

‍

What do people think about interacting with AI?

‍

As AI becomes more familiar in everyday life, the conversation is shifting from whether people will use it to when, why and under what circumstances they find it useful. In a survey of 1,005 US consumers led by Adobe Express, 61% said they were comfortable having conversations with AI-powered systems.

‍

Another survey of more than 1,000 participants across six countries found that people who knew they were interacting with AI reported satisfaction rates 34% higher than those who weren't informed.

‍

These findings suggest that interacting with AI isn't inherently uncomfortable for everyone. But comfort with AI doesn't automatically translate into a positive research experience. A quick customer-service interaction is different from a qualitative research interview, where people need to reflect on their experiences, explain their reasoning and sometimes share sensitive or complicated perspectives.

‍

For researchers, the more useful question is: what makes an AI-led conversation feel comfortable, natural and valuable for participants? 

‍

‍

What makes an AI-moderated research experience successful?

‍

In qualitative research, the quality of the conversation matters just as much as the number of responses collected.

‍

A good AI-moderated interview should give participants the freedom to express themselves in their own words, ask relevant follow-up questions and create opportunities to explore an answer beyond the initial response, and go beyond simply moving people through a series of questions.

‍

Here are considerations that stood out from participants interacting with Optimal’s AI Interviewer for the first time.

‍

‍

‍

1. Making AI interviews feel natural and conversational

‍

Qualitative research aims to uncover the reasoning behind people's choices, not just capture their first response. Relevant follow-up questions can encourage participants to elaborate, clarify an opinion or explore an experience in more depth. The ability to answer in their own words, rather than select from predefined options, is also central to gathering richer feedback.

‍

In our study, the majority of participants described their experience with Optimal’s AI Interviewer as “seamless,” “smooth”, “natural”, and even "fun". Several were pleasantly surprised by how the interaction felt, including participants who had reservations beforehand. One participant said, "I have no problems speaking freely."

‍

‍

Automated highlight reel: "The overall experience was widely rated as positive and enjoyable"

‍

On participant remarked, "It was pleasant and I enjoyed it. And you were great." Others described the AI interview format as something they had “come to expect,” framing it as routine rather than novel. 

‍

Automated highlight reel: "Overall satisfaction with the AI interview experience was high"

‍

These responses offer an encouraging perspective on what AI-moderated research can feel like for participants with the right cadence and context. Multiple participants also highlighted that the AI Interviewer’s replies were clearly based on what they had just said, rather than following a rigid script.

‍

One participant noted it felt like talking to a real person because responses were grounded in their own words: "I really felt like I was talking to a real person and that the responses were based off of what I what I said."

‍

Automated highlight reel: "Contextual follow-up questions made the conversation feel natural and responsive."

‍

Another participant highlighted how the AI concisely summarized their points before moving on, without asking the same question in different ways — something they’d found frustrating when using other AI interview tools.

‍

‍

2. Helping participants feel comfortable and confident

‍

People are more likely to engage when they understand what to expect and feel comfortable taking part. Several participants found the AI interview easier to talk to than a traditional interview. For some, the absence of a human interviewer reduced the pressure of the interaction, making it easier to share their thoughts. 

‍

Automated highlight reel: "Talking to an AI felt easier than a live human interview"

‍

The experience wasn't just about how the conversation sounded either. Participants also found the on-screen text helpful for following along with the spoken interaction. One participant who experiences auditory processing difficulties specifically highlighted this as a useful accessibility feature.

‍

These observations suggest that small details in the participant experience can make a meaningful difference. Clear instructions, the ability to follow a conversation in more than one way, and a format that feels comfortable can all help people engage with a study.

‍

One participant noted that they felt a person would more deeply grasp the feelings and emotions behind their answers, but overall rated their experience with the AI Interviewer positively.

‍

Comfort will vary by person and research context, so the goal isn't to assume AI moderation will suit everyone and every situation, but to provide another considered way for people to share their perspectives. 

‍

‍

‍

3. Giving participants control over their experience

‍

A positive AI interview experience doesn't mean every participant will prefer the same format.

With Optimal’s experience, participants appreciated the ability to choose a preferred conversational style that works best for them. One participant, who preferred greater control, initially chose the “submit response” mode. This allowed them to decide when to submit an answer and move on to the AI Interviewer's next question or follow-up.

‍

After a positive experience with the AI Interviewer, they said they would be willing to try the “free form” option. In this mode, the AI Interviewer responds naturally when the participant finishes speaking. This highlights the value of offering choice and helping participants gain familiarity and comfort.

‍

Clip: New comfort and willingness to try "free form"

‍

‍

A new way to engage with participants

‍

For UX research, design, and product teams, AI Interviews offer another option for gathering qualitative feedback, creating more flexibility in how conversations take place, and supporting gathering evidence at scale.

‍

The opportunity isn't to replace the human aspect of research. It's to give researchers more ways to listen, learn and make informed decisions.

‍

Ready to explore AI interviews? Get in touch for a demo or find out how to access Optimal’s AI Interviewer in Early Access.

‍Was human-centered design all wrong?

‍

No, but it fails to capture the whole picture.

‍

Don Norman introduced human-centered design (HCD), the approach of putting people and their needs at the center of the design process, in the 1980s and almost 50 years later at DDX San Diego 2026, he challenged the philosophy.

‍

Human-centered design gave the industry an important shift in perspective, paying close attention to the people who would actually live with what we create, but there’s tension. Design can create tremendous value for people while also creating unintended consequences for cultures, communities, organizations, and the world around them.

‍

If we optimize for the person in front of us, what happens to everyone and everything outside the frame?

‍

And as technology becomes increasingly agentic, that broader view becomes even more relevant. We're no longer designing only things that people interact with. We're increasingly designing systems that can act, make decisions, and influence what happens next.

‍

‍

‍

Summary

‍

‍

‍

‍

Emerging design philosophies

‍

‍

Life-Centered Design (LCD) expands the focus from the individual user to the larger living system that the product or service exists within. It seeks to align design decisions with global goals such as the United Nation’s Sustainable Development Goals.

‍

Intelligence-Centered Design (ICD) and Human-Agent Centered Design (H-ACD) are extensions of HCD where AI plays an active role in the design process alongside human intelligence, each learning from, making decisions, and mediating the process.

‍

Agent-Centered Design (ACD) puts AI agents at the center as the primary participant in the process, agents building for agents.

‍

‍

‍

Key elements of design and innovation in an agentic world

‍

‍

Start with the people, not the product

‍

‍

Good experiences have always started with deep understanding of the people who use the product, service, or system. Needs, expectations, and priorities are shaped by environment, so what works in one market, organization, or culture can't automatically be treated as a universal truth for all.

‍

That's why ethnography and other forms of contextual research remain so valuable. Before asking what we should build, we need to understand the world people are navigating.

‍

Questions to ask:

‍

• Who are we really designing for?
• What assumptions are we bringing from our own environment?
• What would happen if this design enters a different context?
• What are users' stated choices and how does that differ from their actual behavior?

‍

The discipline of understanding people hasn't gone anywhere. It's just being asked to stretch further, to the systems, risks, and impacts beyond individuals.

‍

‍

‍

Design for the system around the human

‍

‍

Behavior is shaped by systems, organizational structures, constraints, and the decisions made around you, so those factors are part of what we are designing for. Agentic AI makes this deep understanding of context even more important.

‍

When AI can act, make decisions, and influence what happens next, it becomes a key part of the system. Therefore, design has to account for the relationship between humans and their agents including how they work together, what artifacts are created along the way, how do they communicate, what decisions does AI make and what are its responsibilities.

‍

Questions to ask:

‍

• What happens outside the immediate experience?
• How might the system change over time?
• How do decisions get made? What's the logic behind them?

‍

One practical takeaway is to spend more time understanding what people actually do, not just what they say they do. Diary studies, observation, prototype testing, and live site testing can all help surface what people may not be able to articulate themselves. Rather than simply asking “why,” ask, “What drove you to make that decision?” This is an open question to prompt an honest explanation of what influenced their thinking and led them to take a certain action.

‍

‍

‍

Do more "design doing"

‍

‍

Design has no shortage of frameworks, methodologies, books, and white papers. While these give us useful ways to think, real change only happens when teams transform what they’ve learned into something tangible. In the end, impact isn't measured by the depth of your knowledge, but by what you actually create with it.

‍

Question to ask: What's the smallest thing I could do to build or test this idea this week?

‍

A simple prototype will reveal insights that hours of discussion never could. A real interaction exposes the hidden gaps between what people say and what they actually do. A quick experiment tells a team far more than another round of debate.

‍

At its best, good design thinking must always lead to good "design doing."

‍

‍

‍

Earn influence by translating value into the language of the business

‍

‍

Research and design often sits in the middle of an organization. Leadership sets direction, research gathers insight, design shapes the experience, then implementation follows. When each function speaks a different language, intent can get lost along the way.

‍

Designers and researchers are inherently connectors. We bring together different perspectives, make sense of complexity, and help people see how decisions affect one another. But we aren't often in the room when the decisions themselves are being made. Policy, process, business models, and organizational structures are all forms of design, yet designers are often brought in after those choices have already been made.

‍

There is an opportunity and a need for design thinking and "design doing" to move further upstream, and that starts with speaking the language of the people making those decisions: finances and margins.

‍

Questions to ask:

‍

• What does this insight or design mean for productivity, adoption, risk, growth, for the people working inside the system and for the people affected by it?
• What would this save, generate, or protect, in dollars, time, or risk?
• Can we connect the human story to a number?
• How can I socialize this upwards in my organization?

‍

Business decisions are design decisions.

‍

‍

‍

Designing for what comes next

‍

‍

The next era of design is expanding what we consider when we design.

‍

As systems become more autonomous, designers have an opportunity to shape not only experiences, but the policies, services, and the systems around them.

‍

The future of design is less about finding the right framework and more about what we choose to do with what we know.

‍

Our monthly newsletter, User Tested is for product, design, and research teams who want to make UX research a strategic accelerator.  Subscribe to User Tested.

‍

As AI takes on a bigger role in product decision-making and user experience design, ethical concerns are becoming more pressing for product teams. From privacy risks to unintended biases and manipulation, AI raises important questions: How do we balance automation with human responsibility? When should AI make decisions, and when should humans stay in control?

‍

These aren't just theoretical questions they have real consequences for users, businesses, and society. A chatbot that misunderstands cultural nuances, a recommendation engine that reinforces harmful stereotypes, or an AI assistant that collects too much personal data can all cause genuine harm while appearing to improve user experience.

‍

‍

‍

The Ethical Challenges of AI

‍

Privacy & Data Ethics

‍

AI needs personal data to work effectively, which raises serious concerns about transparency, consent, and data stewardship:

‍

• Data Collection Boundaries – What information is reasonable to collect? Just because we can gather certain data doesn't mean we should.
• Informed Consent – Do users really understand how their data powers AI experiences? Traditional privacy policies often don't do the job.
• Data Longevity – How long should AI systems keep user data, and what rights should users have to control or delete this information?
• Unexpected Insights – AI can draw sensitive conclusions about users that they never explicitly shared, creating privacy concerns beyond traditional data collection.

‍

A 2023 study by the Baymard Institute found that 78% of users were uncomfortable with how much personal data was used for personalized experiences once they understood the full extent of the data collection. Yet only 12% felt adequately informed about these practices through standard disclosures.

‍

‍

Bias & Fairness

‍

AI can amplify existing inequalities if it's not carefully designed and tested with diverse users:

‍

• Representation Gaps – AI trained on limited datasets often performs poorly for underrepresented groups.
• Algorithmic Discrimination – Systems might unintentionally discriminate based on protected characteristics like race, gender, or disability status.
• Performance Disparities – AI-powered interfaces may work well for some users while creating significant barriers for others.
• Reinforcement of Stereotypes – Recommendation systems can reinforce harmful stereotypes or create echo chambers.

‍

Recent research from Stanford's Human-Centered AI Institute revealed that AI-driven interfaces created 2.6 times more usability issues for older adults and 3.2 times more issues for users with disabilities compared to general populations, a gap that often goes undetected without specific testing for these groups.

‍

‍

User Autonomy & Agency

‍

Over-reliance on AI-driven suggestions may limit user freedom and sense of control:

‍

• Choice Architecture – AI systems can nudge users toward certain decisions, raising questions about manipulation versus assistance.
• Dependency Concerns – As users rely more on AI recommendations, they may lose skills or confidence in making independent judgments.
• Transparency of Influence – Users often don't recognize when their choices are being shaped by algorithms.
• Right to Human Interaction – In critical situations, users may prefer or need human support rather than AI assistance.

‍

A longitudinal study by the University of Amsterdam found that users of AI-powered decision-making tools showed decreased confidence in their own judgment over time, especially in areas where they had limited expertise.

‍

‍

Accessibility & Digital Divide

‍

AI-powered interfaces may create new barriers:

‍

• Technology Requirements – Advanced AI features often require newer devices or faster internet connections.
• Learning Curves – Novel AI interfaces may be particularly challenging for certain user groups to learn.
• Voice and Language Barriers – Voice-based AI often struggles with accents, dialects, and non-native speakers.
• Cognitive Load – AI that behaves unpredictably can increase cognitive burden for users.

‍

‍

Accountability & Transparency

‍

Who's responsible when AI makes mistakes or causes harm?

‍

• Explainability – Can users understand why an AI system made a particular recommendation or decision?
• Appeal Mechanisms – Do users have recourse when AI systems make errors?
• Responsibility Attribution – Is it the designer, developer, or organization that bears responsibility for AI outcomes?
• Audit Trails – How can we verify that AI systems are functioning as intended?

‍

‍

‍

How Product Owners Can Champion Ethical AI Through UX

‍

At Optimal, we advocate for research-driven AI development that puts human needs and ethical considerations at the center of the design process. Here's how UX research can help:

‍

‍

User-Centered Testing for AI Systems

‍

AI-powered experiences must be tested with real users to identify potential ethical issues:

‍

• Longitudinal Studies – Track how AI influences user behavior and autonomy over time.
• Diverse Testing Scenarios – Test AI under various conditions to identify edge cases where ethical issues might emerge.
• Multi-Method Approaches – Combine quantitative metrics with qualitative insights to understand the full impact of AI features.
• Ethical Impact Assessment – Develop frameworks specifically designed to evaluate the ethical dimensions of AI experiences.

‍

‍

Inclusive Research Practices

‍

Ensuring diverse user participation helps prevent bias and ensures AI works for everyone:

‍

• Representation in Research Panels – Include participants from various demographic groups, ability levels, and socioeconomic backgrounds.
• Contextual Research – Study how AI interfaces perform in real-world environments, not just controlled settings.
• Cultural Sensitivity – Test AI across different cultural contexts to identify potential misalignments.
• Intersectional Analysis – Consider how various aspects of identity might interact to create unique challenges for certain users.

‍

‍

Transparency in AI Decision-Making

‍

UX teams should investigate how users perceive AI-driven recommendations:

‍

• Mental Model Testing – Do users understand how and why AI is making certain recommendations?
• Disclosure Design – Develop and test effective ways to communicate how AI is using data and making decisions.
• Trust Research – Investigate what factors influence user trust in AI systems and how this affects experience.
• Control Mechanisms – Design and test interfaces that give users appropriate control over AI behavior.

‍

‍

‍

The Path Forward: Responsible Innovation

‍

As AI becomes more sophisticated and pervasive in UX design, the ethical stakes will only increase. However, this doesn't mean we should abandon AI-powered innovations. Instead, we need to embrace responsible innovation that considers ethical implications from the start rather than as an afterthought.

‍

AI should enhance human decision-making, not replace it. Through continuous UX research focused not just on usability but on broader human impact, we can ensure AI-driven experiences remain ethical, inclusive, user-friendly, and truly beneficial.

‍

The most successful AI implementations will be those that augment human capabilities while respecting human autonomy, providing assistance without creating dependency, offering personalization without compromising privacy, and enhancing experiences without reinforcing biases.

‍

‍

‍

A Product Owner's Responsibility: Leading the Charge for Ethical AI

‍

As UX professionals, we have both the opportunity and responsibility to shape how AI is integrated into the products people use daily. This requires us to:

‍

• Advocate for ethical considerations in product requirements and design processes
• Develop new research methods specifically designed to evaluate AI ethics
• Collaborate across disciplines with data scientists, ethicists, and domain experts
• Educate stakeholders about the importance of ethical AI design
• Amplify diverse perspectives in all stages of AI development

‍

By embracing these responsibilities, we can help ensure that AI serves as a force for positive change in user experience enhancing human capabilities while respecting human values, autonomy, and diversity.

‍

The future of AI in UX isn't just about what's technologically possible; it's about what's ethically responsible. Through thoughtful research, inclusive design practices, and a commitment to human-centered values, we can navigate this complex landscape and create AI experiences that truly benefit everyone.

‍