Industry: professional services. Roles: project manager, account lead, team member. Capabilities: transcribe, extract, summarize, draft. Human control: approve before assigning or sending. Benefit: coordination capacity and potentially fewer dropped commitments. Costs: transcription where permitted, generation, review, integration, and maintenance.
The decision
A project manager at a services firm wants to spend less time turning client meetings into reliable follow-up. The useful output is a reviewed record of what was decided, who agreed to do what by when, and what remains open. A fluent summary is not that record. Summaries compress; follow-up must preserve the difference between a decision and a suggestion, a target and a commitment, a person mentioned and a person responsible.
The unit of work is a meeting converted into an approved follow-up: decisions, action items with accepted owners and dates, and open questions, sent to the right audience or filed by the accountable person. Effort includes checking the record, correcting it, resolving disputed items with participants, and entering tasks. A recap produced in two minutes that later causes a disagreement about scope has not saved two minutes.
The first boundary is a draft package for recurring project meetings whose recording is permitted. The assistant proposes; the project manager decides what the record says. Discussions of contract scope, price, staffing changes, personnel matters, or legal questions follow the firm's existing procedures. A recap may note that such a topic arose and who will handle it; it does not confirm a change.
All firms, people, meetings, transcript lines, time allocations, budgets, and pilot thresholds below are invented teaching examples. They are not customer records, measured performance, vendor claims, or benchmarks. External research appears separately and is labeled as such.
Map the work before choosing tools
In the illustrative baseline, one participant takes notes, possibly while also contributing to the discussion. Afterward they reread the notes, check unclear points with colleagues, write a recap, create tasks in the project system, and send the recap to the agreed audience. The failure modes this design targets are an action nobody wrote down, an owner assumed rather than agreed, a tentative date that hardens into a promise, or an internal remark that reaches the client.
| Step | Current work | Proposed assisted work | Human responsibility |
|---|---|---|---|
| Before the meeting | Share agenda; decide who takes notes | Confirm recording is permitted for this meeting and audience | Meeting owner confirms consent and client policy |
| Capture | Take notes during discussion | Record and transcribe with speaker labels | Note-taker marks key moments; flags off-record portions |
| Extract | Reread notes; identify decisions and actions | Propose candidate decisions, actions, and open questions, each linked to a timestamp | Check each item against the source passage |
| Resolve | Ask colleagues about unclear points | List unresolved owners, dates, and ambiguous statements | Resolve with participants or leave explicitly open |
| Distribute | Write and send the recap | Draft audience-specific recap from confirmed items only | Approve content and audience; send |
| Track | Create tasks by hand | Propose task records with stable identifiers | Approve each task write; prevent duplicates |
Workflow map
Consent check → recording and transcript → candidate items with timestamps → project-manager review → participant clarification where needed → audience-filtered recap → approved send and task creation
If recording is not permitted, the path starts from human notes and the assistant works from those. If the transcript has gaps or poor audio, those portions are marked and cannot support a decision or commitment on their own. If an item cannot be tied to a passage, it is rejected or moved to open questions. If the assistant fails, the note-taker writes the recap as before. No branch lets the system send a recap or create a task without approval.
The map has two gates: whether this meeting may be recorded and processed at all, and whether each item in this recap is supported. Passing the first says nothing about the second.
Only confirmed items reach the recap
- Assistant proposal
- Person decides or acts
- Decision gate
- Exit to an existing route
1. Consent
GateRecording permitted?
ExitWork from human notes
2. Capture
AssistantTranscribe; drop off-record segments
3. Extract
AssistantCandidate items with timestamps
PersonCheck each against the source
4. Resolve
AssistantList unclear owners and dates
PersonResolve or leave open
PersonParticipants clarify
5. Distribute
AssistantDraft recap per audience
PersonApprove content and audience
6. Track
AssistantPropose task records
PersonApprove each task write
- Internal segments are excluded before extraction. Nothing is sent or created without approval.
Compare against a simpler alternative
Much of the value may come from discipline rather than generation. A structured template filled in during the meeting (decision, action, owner, date, confirmed yes/no), with the last five minutes spent reading actions back, can prevent the most costly errors without any recording. A trial should compare three configurations on the same meeting types: the current process, the template with read-back, and the template plus assisted extraction. If the template captures most of the benefit, the transcription pipeline may not be worth its consent, retention, and review overhead.
Walk through one meeting
For your operations lead
The fictional firm is Tallowmere Partners, an operations consultancy. Its fictional client, Quillbrook Foods, has engaged it to redesign warehouse slotting. The meeting is a weekly steering call. Assume both parties agreed in the engagement terms that project calls may be recorded and transcribed for follow-up, and that recordings are deleted after 30 days. These facts exist only for this example.
Input: participants
| Name | Organization | Role in the meeting |
|---|---|---|
| Priya Anand | Tallowmere | Project manager, recap owner |
| Tom Reyes | Tallowmere | Analyst |
| Dana Kovač | Quillbrook | VP Operations, decision-maker |
| Luis Ortega | Quillbrook | Warehouse manager |
Input: transcript excerpt
These lines are invented. The automated transcript contains one error, shown as it would appear to the reviewer.
[00:06:12] Dana Kovač: We've looked at both options. Let's go with option B, the two-shift pilot in Building 2. I don't want to touch Building 1 until after the holiday peak.
[00:06:40] Tom Reyes: Understood. For the pilot we'd cap it at fifty aisles to keep the change manageable.
[00:07:05] Luis Ortega: Someone should probably pull last year's returns data, because returns clog the pick faces in November.
[00:07:19] Dana Kovač: Good point. Anyway, on the slotting model —
[00:07:31] Priya Anand: We could probably have a draft of the slotting model by Friday, depending on the SKU extract.
[00:07:48] Luis Ortega: I'll send the SKU extract tomorrow morning.
[00:31:02] Tom Reyes: (after the client participants left) Between us, we're already over the hours for this phase. Let's not raise it until we've talked to the partner.
The audio at 00:06:40 supports "fifteen aisles"; the transcription service rendered it as "fifty." The recording continued after the client left, which the note-taker should have marked as off-record. Because no marker existed, the segment reached extraction. The package below can only flag it, which is the filtering afterward that the design section warns against; record it as a process failure to fix, not as the system working.
Expected internal package
The assistant should give Priya a structured, source-linked package, not a polished paragraph:
| Type | Item | Source | Status |
|---|---|---|---|
| Decision | Proceed with option B: two-shift pilot in Building 2; Building 1 unchanged until after holiday peak | 00:06:12, Dana Kovač | Supported |
| Pilot parameter | Pilot capped at [fifty?] aisles | 00:06:40, Tom Reyes | Verify against audio: a critical value; every number, date, name, and quantity is checked against the audio |
| Action | Send SKU extract, due tomorrow morning | 00:07:48, Luis Ortega | Owner and date stated by the owner |
| Proposal | Draft slotting model by Friday | 00:07:31, Priya Anand | Tentative: "could probably," conditional on SKU extract; not a commitment |
| Open question | Pull prior-year returns data | 00:07:05, Luis Ortega | No owner accepted; conversation moved on |
| Excluded | Remarks after 00:30:55 | Internal only; no off-record marker | Not for the client recap; route to internal notes if retained at all; log the missing marker as a process failure |
The package makes three things visible that a summary would bury: which items rest on a single uncertain word, which statements were hedged, and which suggestions nobody took on. The reviewer can check each item by opening the timestamp.
What each line of the call becomes in the recap
- Decision or owned action
- Critical value: verify against audio
- Tentative or open
- Internal: excluded
00:06:12 · Dana Kovač · Decision
“Let’s go with option B, the two-shift pilot in Building 2. I don’t want to touch Building 1 until after the holiday peak.”
Recap → Decision: option B in Building 2; Building 1 unchanged until after the peak
00:06:40 · Tom Reyes · Critical value: verify against audio
“For the pilot we’d cap it at fifty aisles to keep the change manageable.”
Recap → After the audio check: capped at fifteen aisles
00:07:05 · Luis Ortega · Open question, no owner
“Someone should probably pull last year’s returns data, because returns clog the pick faces in November.”
Recap → Open question: who owns the returns review?
00:07:31 · Priya Anand · Tentative proposal
“We could probably have a draft of the slotting model by Friday, depending on the SKU extract.”
Recap → Date to be confirmed once the extract arrives; “aiming for Friday” only if Priya chooses
00:07:48 · Luis Ortega · Action with owner and date
“I’ll send the SKU extract tomorrow morning.”
Recap → Action: Luis sends the SKU extract tomorrow morning
00:30:55 · client participants leave
00:31:02 · Tom Reyes · Internal: excluded
“Between us, we’re already over the hours for this phase. Let’s not raise it until we’ve talked to the partner.”
Recap → Not in the recap, and must not shape its wording
Expected client-facing recap
After Priya checks the audio, confirms "fifteen," and decides how to present the model date, a suitable recap reads:
Decisions. Proceed with option B: a two-shift slotting pilot in Building 2, capped at fifteen aisles. Building 1 stays unchanged until after the holiday peak.
Actions. Luis will send the SKU extract by tomorrow morning. Once we receive it, Tallowmere will confirm a date for the draft slotting model; we are aiming for Friday.
Open question. Luis suggested reviewing last year's returns data because of its effect on pick faces in November. Can we agree who owns this at next week's call?
This is an editorially authored expected answer, not output from a tested system. Whether to state "aiming for Friday" is Priya's decision; the point is that the recap does not convert a hedge into a promise without her choosing to.
Reject a plausible but wrong recap
Great meeting. We agreed on option B with a fifty-aisle pilot. Tallowmere will deliver the slotting model Friday, and Luis will pull the SKU extract and last year's returns data. We're tracking well against the budget for this phase.
Every sentence reads naturally, and three of the five contain four errors. It propagates the misheard number. It turns "could probably … depending on" into a delivery commitment. It assigns the returns analysis to Luis, who only suggested that someone should do it. Its last sentence is shaped by the internal remark and says the opposite of it. The draft fails even though most of its content is accurate.
Change one input at a time
- Remove speaker labels. The transcript attributes "I'll send the SKU extract" to no one. The expected behavior is an action with owner unresolved, not a guess based on who spoke most about SKUs.
- Dana later reverses herself. At 00:24:00 she says, "Actually, let's hold Building 2 until I talk to finance." The expected package shows the earlier decision as superseded and the current status as on hold, with both timestamps. Reporting only the first statement is a major error.
- The call includes a pricing discussion. Dana asks whether the pilot extension changes the fee. The expected package records that the question was raised and routes it to the account lead. It does not summarize a price or scope change as agreed.
Design the data, access, and retention layer
For your technical lead
Start with consent. Rules for recording and transcribing conversations vary by jurisdiction, and client contracts and internal policies may be stricter. This chapter does not state those rules. As a proposed process gate, the meeting owner confirms that recording is permitted for this meeting and audience before it starts, and participants can see that it is running. Where that confirmation is not possible, work from notes.
Decide what is stored, for how long, and who can open it. A transcript of a client call is confidential client material. The proposed design keeps audio and transcripts under the same access controls as other project records, retains them only as long as needed to resolve disputes about the recap, and records the retention period in the engagement's data-handling terms. The confirmed recap, not the transcript, becomes the durable project record.
Keep audiences separate in the data, not only in the prompt. A client-facing recap should be generated only from items the reviewer has marked as shareable. Off-record portions should be excluded before extraction, not filtered afterward. If a meeting mixes internal and client participants, treat the entire transcript as internal until reviewed.
Task creation needs its own safeguards. Proposed tasks carry a stable identifier derived from the meeting and item, so re-running extraction or approving twice does not create duplicates. The integration should be able to create tasks only after approval and should not be able to send email or messages on its own.
Choose tools and models against this task
For your technical lead
This workflow chains at least two systems: speech-to-text with speaker attribution, and a language model that extracts and drafts. Evaluate them separately and together. The speech systems chapter covers the first in depth: word error rate and its blind spot, speaker attribution, and how accuracy varies by speaker and recording condition. A strong extraction model cannot recover a number the transcript got wrong, and a clean transcript does not prevent a model from upgrading a hedge into a commitment.
Word error rate weights all words equally, so "fifteen" heard as "fifty" counts the same as a dropped "the." As a proposed practice, measure a critical-token error rate as well: errors in numbers, dates, names, and quantities in the evaluation set, since those are what change the follow-up.
For the extraction step, test a complete configuration: transcription service and settings, model identifier, prompt revision, output schema, and review interface. Compare configurations on decision fidelity, false commitments, invented owners, missed actions, audience errors, reviewer minutes, and cost per acceptable recap. Use the model-selection guide to structure the comparison. Check each candidate's current specifications at the provider's own documentation on the day you test, and record that date. Nothing has been benchmarked for this chapter; provider specifications are constraints to test, not evidence of fitness.
Work through the economics
For your finance lead
The following monthly example uses invented assumptions. Assisted effort includes checking items against the source, resolving flags, editing, and task entry.
| Input | Illustrative assumption | What to measure locally |
|---|---|---|
| Eligible meetings per month | 60 | Recurring meetings that normally require written follow-up and may be recorded |
| Eligible share | 100% | Share within agreed scope after consent and topic exclusions |
| Adoption share | 80% | Meetings actually processed through the assisted path, including abandoned drafts |
| Baseline recap-owner effort | 25 minutes | Time from meeting end to approved recap and tasks |
| Assisted recap-owner effort | 12 minutes | The same, including review and correction |
| Assumed capacity value | $70/hour | A defined value for a released project-manager hour |
| Recurring incremental budget | $300/month | Transcription, usage, and continuing upkeep |
This yields 48 assisted recaps: 60 × 100% × 80%. At 13 minutes released per recap, monthly capacity is 48 × 13 / 60 = 10.4 hours, worth $728 at $70/hour, or $428 after the recurring budget, before any setup cost.
An illustrative 25-minute baseline might include eight minutes rereading notes, eight drafting the recap, five checking unclear points with colleagues, and four entering tasks and sending. An illustrative 12-minute assisted path might include six minutes checking candidate items against the source, three resolving flagged items, one editing the recap, and two approving tasks and sending. These allocations show where the claimed saving must come from. Most of it depends on source checking being faster than drafting, which a pilot must test.
Most of the remaining time is checking
- Continuing step
- Replaced by assistance
- New review work
Baseline · 25 min
Reread notes 8 min · Draft recap 8 min · Check unclear points 5 min · Tasks and send 4 min
Assisted · 12 min
Check items 6 min · Edit recap 1 min · Resolve flags 3 min · Approve tasks and send 2 min
Show the data
| Step | Baseline | Assisted |
|---|---|---|
| Reread notes | 8 min | — |
| Draft recap | 8 min | — |
| Check items | — | 6 min |
| Edit recap | — | 1 min |
| Check unclear points | 5 min | — |
| Resolve flags | — | 3 min |
| Tasks and send | 4 min | — |
| Approve tasks and send | — | 2 min |
| Total | 25 min | 12 min |
Only the recap owner's time is counted. Attendees do not save time because someone else's recap was faster to write, and multiplying minutes by headcount overstates the benefit.
Make continuing work visible
For planning, split the hypothetical $300 monthly budget into $150 for transcription and model usage, $60 for template and prompt upkeep, $60 for periodic quality sampling, and $30 for integration monitoring. The split is invented, not a quote. Upkeep absorbed by existing staff is consumed capacity, not cash, and review already inside the assisted minutes is not deducted again; the economics chapter explains both.
Stress-test review time and adoption
| Scenario | Assisted recaps/month | Minutes released/recap | Capacity hours | Value after $300 recurring budget |
|---|---|---|---|---|
| Base assumptions | 48 | 13 | 10.4 | $428 |
| Review takes longer: assisted effort is 22 minutes | 48 | 3 | 2.4 | −$132 |
| Adoption is 40% instead of 80% | 24 | 13 | 5.2 | $64 |
| Both lower adoption and 22-minute effort | 24 | 3 | 1.2 | −$216 |
The recurring budget is held fixed for clarity; usage costs would fall somewhat with fewer processed meetings. At base volume and rate, the budget requires about 5.36 minutes released per assisted recap to break even on capacity value: $300 ÷ $70 × 60 ÷ 48. That excludes setup and is not a cash break-even.
Explain what the capacity is worth in cash
Thirteen minutes after each of several meetings may not add up to hours a firm stops paying for. If none of the released time replaces paid work, the illustrative cash effect is simply the recurring spend: −$300/month plus setup. The released time may still matter if project managers use it for client work, but that is a separate claim about how time is used.
The more plausible benefit is quality: fewer dropped actions, fewer disputes about what was agreed, faster starts on agreed work. Those effects may be worth more than the capacity figure, but this chapter has no evidence for them. Do not assign them a dollar value until a pilot measures them, for example as actions completed by their agreed date or corrections requested by clients. The economics chapter distinguishes capacity, cash, and benefit location; how any costs are classified for reporting is a finance decision under the applicable framework, not something this workflow determines.
Define failure severity before the trial
For whoever runs the pilot
These categories are proposed pilot rules for owners to adapt and agree on before seeing results.
| Severity | Example | Proposed response and owner |
|---|---|---|
| Critical | Internal remarks, another client's material, or off-record content reaches a client; recording occurs without confirmed permission | Pause the pilot; account lead and data owner assess disclosure and notify as required |
| Major | Tentative statement recorded as a commitment; owner assigned who did not accept; wrong critical number or date; superseded decision reported as current; scope or price change stated as agreed | Correct before sending; project manager reviews the case and related meetings |
| Minor | Awkward wording, redundant items, missed low-stakes detail | Reviewer edits; track effort and patterns |
| Correct abstention | Owner or date left unresolved because the source does not establish it; poor audio flagged | Count as correct; record the effort to resolve |
Record failures caught in review as well as those that reached a recipient. A careful reviewer can mask a weak extractor, and the review time is part of the cost.
Build the evaluation set
For whoever runs the pilot
As an initial coverage plan, use 80 meetings with authorized recordings or reconstructed synthetic transcripts: 30 routine meetings with clear actions, 15 heavy on hedged or conditional language, 10 with no actions at all, 10 containing a decision that changes during the meeting, 8 with poor audio or overlapping speakers, and 7 with internal-only segments or mixed audiences. These counts are illustrative and not statistically justified.
For each meeting, a reviewer who did not build the system prepares the reference record from the audio, not the automated transcript. Split by project or client so similar meetings are not on both sides of the development and evaluation boundary. Hold out the evaluation meetings before any prompt tuning. Do not include later recaps or emails that reveal what was eventually agreed.
| Test variation | Expected behavior | Failure to record |
|---|---|---|
| Hedged date ("could probably … by Friday") | Proposal, marked tentative | Commitment with firm date |
| Suggestion with no taker | Open question, no owner | Owner assigned to the speaker |
| Decision reversed later in meeting | Current status with both timestamps | Only first decision reported |
| Misheard number on a critical value | Flag for audio check | Number passed through unmarked |
| Internal segment after client leaves | Excluded from client recap | Any content or influence in client draft |
| Price or scope question | Routed to account lead | Change reported as agreed |
| Meeting with no actions | Short record saying none were agreed | Invented actions to fill the template |
| Missing speaker labels | Owners unresolved | Owners guessed |
Score items, not paragraphs
For each meeting, record: meeting ID and category; configuration; reference decisions, actions, and open questions; extracted items; matches, misses, and additions; false commitments; invented owners; critical-token errors; audience errors; severity; reviewer minutes; and final disposition. Report with denominators: false commitments among all extracted actions, invented owners among actions without an agreed owner in the reference, audience errors among mixed-audience meetings, and missed actions among reference actions. Two reviewers should score a subset independently and reconcile before the rubric is used at scale.
An illustrative offline gate might require zero audience leaks in the held-out set, zero invented owners, all scope or price items routed correctly, and at least 90% of reference actions captured with the correct status. These are management thresholds for local agreement, not evidence of adequacy. A clean result on a small set bounds the true failure rate only loosely; pilot design shows how loosely.
Run a supervised pilot and decide
Begin offline with past meetings. Then run a shadow period in which the note-taker writes the recap as usual and the assistant's package is compared afterward; nothing assisted is sent. Only then allow assisted recaps, starting with internal meetings, then client meetings where consent is clear. Keep the manual path available for every meeting.
Where practical, alternate assisted and unassisted handling across comparable meetings rather than comparing enthusiastic early users with everyone else. Measure all meetings assigned to the assisted condition, including those where the draft was abandoned. Track corrections requested by participants within a fixed window after sending.
The project manager owns the recap and the expansion recommendation; the account lead owns client audience decisions; the data owner owns consent, retention, and access; engineering owns the integrations; finance reviews any cash claim. Before expanding:
- Consent confirmation, retention period, and excluded topics were agreed before the trial.
- Off-record and internal segments were excluded before extraction and tested.
- Held-out meetings covered hedging, reversals, no-action meetings, poor audio, and mixed audiences.
- Critical-token errors were measured separately from overall transcript quality.
- Reviewer effort includes checking, resolving, abandoned drafts, and corrections after sending.
- Results were compared with a structured template and read-back.
- Task creation cannot duplicate or run without approval.
- Any cash or delivery-quality claim is backed by a measured change, not by capacity arithmetic.
Stop if drafts repeatedly hide uncertainty, if any internal content reaches a client, or if consent cannot be confirmed reliably. Rollback is a return to notes and the template.
People and skills
The recap owner's job shifts from writing to checking. That requires reading against the source rather than for fluency, and resisting the pull of a confident summary. Teams also need a habit the tool cannot supply: stating owners and dates explicitly during the meeting and reading actions back before it ends. That habit improves follow-up with or without assistance. Account leads need clear rules for what may be recorded and what goes to clients.
Who you need
This pilot needs the roles below, named by responsibility rather than job title, with a proposed source for each. Recap ownership, consent and retention, client audience decisions, and evaluation continue after go-live, so their owners stay in-house.
| Role | Responsibility in this pilot | Effort | Proposed source | What to look for |
|---|---|---|---|---|
| Project manager | Owns the recap, the pilot, and the expansion recommendation; approves every record before it is sent | Lead | In-house | Reads against the recording, not for fluency, and leaves unresolved owners open |
| Account lead | Decides what clients receive and what may be recorded | Review | In-house | Clear rules for mixed-audience meetings |
| Data owner | Owns consent confirmation, retention, and access | Regular | In-house | Can set a retention period and stop recording where consent is unclear |
| Meeting owner | Confirms recording is permitted before each meeting starts | Occasional | In-house | Makes the check a habit, and falls back to notes without it |
| Engineer | Builds the transcription and task-system integrations, with approval gates and no duplicate tasks | Lead | In-house or contractor | Tests the exclusion of internal segments; documents monitoring for handover |
| Evaluator who did not build the system | Prepares reference records from the audio, scores held-out meetings, and runs quality sampling | Regular | In-house | Independence from the build; scores a subset alongside a second reviewer |
| Finance reviewer | Reviews any cash or delivery-quality claim | Occasional | In-house | Asks for a named paid task replaced or a measured change |
For the method behind this table, see Staffing an AI pilot; for bringing in outside help, see Choosing and working with an AI partner.
When to defer
Defer if recording consent cannot be handled consistently, if most meetings produce few actions, if the firm already runs disciplined action logs, or if meetings routinely mix internal and client discussion. Defer for sensitive engagements where retaining a transcript creates more risk than the recap saves. In each case, the simpler alternative is a structured template with read-back, filled in by the note-taker during the meeting.
What external research establishes
For your analyst
Koenecke and colleagues found that five commercial speech-recognition systems tested before 2020 made substantially more errors for Black speakers than for white speakers in structured interviews; the speech systems chapter reports the figures and the study's limits. Racial disparities in automated speech recognition, PNAS 117(14), 2020 The study concerns interviews, not current products or business meetings. It supports a narrower design point: transcription quality can differ systematically between speakers, so an evaluation set should include the range of voices, accents, and audio conditions the team actually has, and reviewers should not assume that errors fall evenly. We have not reviewed research on how AI-assisted meeting recaps affect project delivery, and this chapter makes no claim about it.
Evidence still needed and related reading
Obtain an attributable account of how recaps are produced today, how often actions are dropped or disputed, and how long review takes. Measure critical-token errors on the firm's own recordings, reviewer effort, participant corrections, and whether agreed actions are completed on time. Confirm consent and retention practices with counsel for the jurisdictions and clients involved. No operator has been contacted and no recap has been generated or measured for this chapter.
Continue with speech systems, professional services, project knowledge retrieval, proposals, sales operations leaders, human review, and assistance, approval, and autonomy. When comparing products, use build, buy, or configure and vendor diligence.
Related Neuronify resources: AI project scoping pack and AI ROI calculator.
Companion templates
Prepare your pilot with the pilot kit, evaluation scorecard, and evidence checklist. The companion workbook provides blank economics inputs and case records; worked chapter figures remain illustrative examples.