What Does Success Look Like? Catalyzing Meeting Intentionality with AI-Assisted Prospective Reflection

Authors: Ava Elizabeth Scott, Lev Tankelevitch, Payod Panda, Rishi Vanukuru, Xinyue Chen, Sean Rintel
Venue: CHIWORK 2025

AThe study

Technology probe study with 18 employees of a global technology company. In a session averaging 60 minutes, each talked through three real upcoming meetings with an AI assistant built on GPT-4 Turbo, then answered a survey after the meetings.

  1. 18 employeesA purposive sample from six work areas. Each brought a familiar meeting they organised, an unfamiliar one they organised and one they expected to be ineffective.
  2. Three conversationsEach participant had 10 minutes with the assistant per meeting, then 5 minutes of discussion, with a researcher guiding the session.
  3. Follow-up surveyAfter the meetings had happened, participants reported whether the reflection had made a difference.
  4. Thematic analysisSession transcripts were analysed for themes, and survey answers checked whether effects held after the meetings.

BThe tool

  1. Load real meetingsBefore each session, the researcher uploaded basic details of three of the participant's real upcoming meetings.titletimedescriptionattendees
  2. Ask about purposeThe assistant asks what the person hopes to achieve, what success would look like and what could get in the way.purposesuccesschallenges
  3. Probe the answersThe assistant follows up on vague replies, asks the person to prioritise among goals, or asks how to tackle a challenge.
  4. Hold back solutionsThe assistant does not volunteer its own solutions, though it gives suggestions when asked.
  5. SummariseA button turns the conversation into a Reflection Summary the person can reuse in invitations or chats.why we are meetingwhat success looks likewhat could prevent it

For organisers the questions focused on the meeting's purpose, and for attendees on each attendee's own purpose. There was no comparison group.

CWhat the study found

During the conversationswhat participants said about reflecting with the assistant

  • Participants said putting unstated goals into words helped them focus and arrive with a plan.Self-reported. Participants talked through three of their own real upcoming meetings with the assistant.
  • Several participants compared the assistant to a coach or therapist.Self-reported. The assistant made participants think for themselves, and some reported less stress about the meeting. Others found it too polite and passive and wanted to be challenged.

After the meetingswhat participants did and reported in the follow-up survey

  • Participants shared summaries or agendas and asked attendees to contribute.Self-reported. In follow-up surveys after their meetings, three participants said sharing had improved attendance and engagement.

Limits and fitwhere participants found reflection less useful, and where it fits

  • Some participants found the reflection too general to help.A recurring meeting rarely had specific goals for one instance, and the assistant lacked technical context. Some one-to-one topics felt too confidential to share.
  • Solution-minded participants wanted recommendations rather than questions.Attendees often felt unable to act on any solution in a meeting someone else organised.
  • Participants saw important and uncertain meetings as the best fit for this reflection.Examples were meetings with unfamiliar people or new projects. Reflecting on every instance of a familiar recurring meeting felt excessive.

DKey takeaway

AI asking why a meeting is needed, what success looks like and what could derail it can foster meeting intentionality. Such prospective reflection may suit important, uncertain meetings best, building a skill that instant AI answers could bypass.

Made for this site with AI assistance from the verified research brief. It is not the paper's own figure.

Abstract

Despite decades of HCI and Meeting Science research, complaints about ineffective meetings are still pervasive. We argue that meeting technologies lack support for prospective reflection, that is, thinking about why a meeting is needed and what might happen. To explore this, we designed a Meeting Purpose Assistant (MPA) technology probe to coach users to articulate their meeting’s purpose and challenges, and act accordingly. The MPA used Generative AI to support personalized and actionable prospective reflection across the diversity of meeting contexts. Using a participatory prompting methodology, 18 employees of a global technology company reflected with the MPA on upcoming meetings. Observed impacts were: clarifying meeting purposes, challenges, and success conditions; changing perspectives and flexibility; improving preparation and communication; and proposing changed plans. We also identify perceived social, temporal, and technological barriers to using the MPA. We present system and workflow design considerations for developing AI-assisted reflection support for meetings. KEYWORDS: videoconferencing, meetings, goals, purpose, intentionality, workplace, prospective reflection, generative AI, participatory prompting

Research brief

By Ava Elizabeth Scott, Lev Tankelevitch, Payod Panda, Rishi Vanukuru, Xinyue Chen, and Sean Rintel.

Takeaway: Before meetings, AI can build meeting intentionality by coaching prospective reflection (asking why a meeting is needed, what success looks like and what could derail it). People clarified goals, prepared, shared agendas and rethought recurring meetings. It suits important, uncertain meetings, building a skill instant AI answers would bypass.

Why this matters

What was known
Meeting tools support the 'how' of meetings, not the 'why'. Earlier workplace reflection tools used fixed questions, and we found no study of reflection on meeting goals, success conditions and challenges. (§1, p. 2)
What this paper adds
Earlier workplace reflection tools used fixed questions or looked back at meetings afterwards. We use generative AI to adapt the questions to each person's real upcoming meetings, and to turn the reflection into something they can share. (§1, p. 2)
Who it matters to
Designers of meeting, calendar and AI assistant tools, and researchers of reflection and intentionality at work. Our findings may inform the design of features for reflection across the meeting lifecycle, and potentially other areas of workplace intentionality (§1, p. 3)

Research questions

Method and data

Design
Exploratory, qualitative participatory prompting study using the Meeting Purpose Assistant as a technology probe. It had three parts: an onboarding survey, a moderated session with the MPA, and a follow-up survey after the meetings. The onboarding survey asked about three upcoming meetings (a familiar one they organised, an unfamiliar one they organised, and one they attended and expected to be ineffective).
Prototype
The Meeting Purpose Assistant, a chat interface much like ChatGPT, built as a Node.js web application on GPT-4 Turbo through OpenAI's Assistants API. Before each session the researcher uploaded basic details of three of the participant's real upcoming meetings (title, time, description, attendees). For each meeting the user opened the conversation, and the assistant asked what they hoped to achieve, what success would look like and what could get in the way. It then followed up on their answers by probing vague replies, asking them to prioritise among several goals, or asking how they would tackle a challenge. It did not volunteer its own solutions (though it gave suggestions when asked). Its questions focused on the meeting's overall purpose for organisers and on their own purpose for attendees. A 'summarize' button produced a Reflection Summary of bullet points under three headings: why we are meeting, what success looks like, and what could prevent it. It was explored on its own, not compared with another tool.
Screenshot of a chat about a mentoring session, beside a Reflection Summary listing its purpose, success criteria such as mentees sharing walking decks, and challenges such as encouragement being perceived as condescending.
Figure 2: The Meeting Purpose Assistant technology probe consisted of a chat interface (left), powered by GPT-4 Turbo, that participants interacted with, and a Reflection Summary (right) of their conversation that participants could obtain by clicking the 'summarize' button. The MPA had basic context about the meeting from information uploaded in advance by the researcher. From the paper, Fig. 2, p. 6.
Setting
A global technology company. Sessions held as video meetings with the participant sharing their screen.
Participants / data
A purposive sample of 19 participants from six work areas, including prior research participants who had indicated interest in future studies and four volunteers from adjacent research groups. One excluded, leaving 18 (10 women, 8 men).
Duration
One session per participant averaging 60 minutes (three sets of 10 minutes of conversation with the MPA, each followed by 5 minutes of discussion), then a follow-up survey.
Analysis
Reflexive thematic analysis of session transcripts in MAXQDA (initial themes from six transcripts by two authors. All 18 coded by the first author), with follow-up survey responses used to check whether impacts held after the meetings.

Findings

Questions this paper answers

Can an AI chatbot help me get clearer about why I'm having a meeting?
It can help. Prospective reflection (asking ahead why a meeting exists and what success looks like) appeared to support meeting intentionality. When 18 employees of a global technology company talked through real upcoming meetings with an AI assistant, they made implicit goals explicit and felt prepared. Some felt less stressed. (See §5.2.1, p. 9; §5.2.4, pp. 9–10.)
Does reflecting on a meeting beforehand actually change the meeting?
Sometimes. After reflecting with an AI assistant, some people shared summaries or agendas and asked attendees to contribute. In follow-up surveys, three said this had improved attendance and engagement. Attendees often felt they could not change meetings organised by others. (See §5.3.1, pp. 10–11; §5.4.3, p. 12.)
Why might people not want to use an AI meeting reflection tool?
Mainly effort and expectations. Explaining enough background to get useful questions takes typing, and some topics feel too confidential to share with a tool. Many people also expect AI to hand over answers, so questions alone can seem a poor use of time. (See §5.4.1, p. 12; §5.4.3, p. 12.)
Which meetings are most worth reflecting on beforehand?
People who tried AI-assisted reflection pointed to important and uncertain meetings, such as those with unfamiliar people or new projects. Reflecting on every instance of a familiar recurring meeting could feel excessive. (See §5.5.2, pp. 13–14.)

Contributions and implications

Limitations

›

Concepts

Prospective reflection
The kind of reflection studied, covering a meeting's purpose, success and challenges: prospective reflection, that is, thinking about why a meeting is needed and what might happen (Abstract, p. 1)
Reflection
Intentionality requires reflection, broadly defined in prior work as: consciously re-evaluating thoughts, ideas and experience(s) for the purpose of guiding future behavior (§1, p. 2)
Meeting Purpose Assistant (MPA)
Our technology probe: a chat interface powered by GPT-4 Turbo that asks about a meeting's purpose, success and challenges, plus a Reflection Summary. we built a technology probe [33, 68]-the Meeting Purpose Assistant (MPA)-that engaged participants in brief conversations to stimulate reflection on their meetings (§1, p. 2)
Reflection Summary
The MPA's structured record of the conversation, which participants could reuse in meeting invitations or chats. distilled the conversation into bullet points about the meeting's purpose, success criteria, and potential challenges (§5.1, pp. 8–9)
Participatory prompting
The study method: where the researcher guides the user's interaction with the GenAI system to clarify technical issues and elicit further reasoning (§1, p. 2)

Figures

Left: MPA chat and a summary pane headed 'Why are we meeting?', 'What does success look like for this meeting?', 'What could prevent this meeting's success?'. Right: onboarding survey, study session with MPA and researcher, follow-up survey.
Figure 1: Overview of this paper's exploration of how a generative AI Meeting Purpose Assistant (MPA) can support prospective meeting reflection. (a) The MPA technology probe included a chat interface where participants engaged with the AI (left) and a reflection summary pane (right) that included a summary of the conversation, triggered by participants' button-click. The summary included concise bullet points summarising key points from the conversation (not shown here), consistently organized under the three headings (shown here). (b) The study protocol included an onboarding survey where the participant provided details of three upcoming meetings; a study session in which the participant engaged with the MPA, moderated by a researcher via a participatory prompting methodology; and a follow-up survey in which the participant reported on their meetings after they occurred. From the paper, Fig. 1, p. 1.
Screenshot of a chat about a mentoring session, beside a Reflection Summary listing its purpose, success criteria such as mentees sharing walking decks, and challenges such as encouragement being perceived as condescending.
Figure 2: The Meeting Purpose Assistant technology probe consisted of a chat interface (left), powered by GPT-4 Turbo, that participants interacted with, and a Reflection Summary (right) of their conversation that participants could obtain by clicking the 'summarize' button. The MPA had basic context about the meeting from information uploaded in advance by the researcher. From the paper, Fig. 2, p. 6.

How to cite

Ava Elizabeth Scott, Lev Tankelevitch, Payod Panda, Rishi Vanukuru, Xinyue Chen, and Sean Rintel. 2025. What Does Success Look Like? Catalyzing Meeting Intentionality with AI-Assisted Prospective Reflection. CHIWORK 2025. https://doi.org/10.1145/3729176.3729204

This brief was prepared with AI assistance and published by Sean Rintel. It is not the authors' published text. Page numbers refer to this PDF.

BibTeX

@inproceedings{scott2025what,
author = {Scott, Ava Elizabeth and Tankelevitch, Lev and Panda, Payod and Vanukuru, Rishi and Chen,  Xinyue and Rintel, Sean},
title = {What Does Success Look Like? Catalyzing Meeting Intentionality with AI-Assisted Prospective Reflection},
booktitle = {CHIWORK 2025},
year = {2025},
month = {June},
publisher = {ACM},
url = {https://doi.org/10.1145/3729176.3729204},
doi = {10.1145/3729176.3729204},
}