RBI Bakeoff: Coval results

Every simulation in the Coval org, pulled through the REST API on 2026-08-12. Completion Rate is Coval's judged verdict on whether the AI took the order to completion.

Overall completion rate
67.2%
1,633 judged conversations
Simulations pulled
1,744
With transcripts
1,635
No transcript
109
Runs
107

Why conversations fail

Every Completion=NO conversation (536 of them), classified by what actually happened. 455 failures (85%) are the audio-only Coval persona unable to see the order-confirm screen: the AI asks "is your order on the screen correct?", the persona asks for a readback, the AI refuses or escalates. Excluding those from numerator and denominator, completion is 93.1% against the 67.2% headline.

Harness artifact or protocol miss Real product failure
Persona can't see screen, AI escalates
62.3%
334/536
Persona can't see screen, AI refuses readback
22.6%
121/536
Escalated for other reasons
9.7%
52/536
Order fine, never directed forward
2.6%
14/536
Other (loops, cut off, misc)
2.1%
11/536
Wrong or incomplete order
0.7%
4/536
Table view
Failure causeCountShare
Persona can't see screen, AI escalates33462.3%
Persona can't see screen, AI refuses readback12122.6%
Escalated for other reasons529.7%
Order fine, never directed forward142.6%
Other (loops, cut off, misc)112.1%
Wrong or incomplete order40.7%

Completion rate by persona

The widest spread in the data. Background noise and customer confusion cost more than any single scenario does, which points at the audio front end rather than the ordering logic. Persona names click through to every conversation for that persona, with verdicts and transcripts.

High Background Noise Speaker
16.7%
17/102
Confused Customer
18.8%
19/101
Impatient Customer
44.1%
45/102
Accent - Hispanic/Latino
51.0%
52/102
Behavioral - Complex-Order
61.8%
63/102
Behavioral - Rush
66.7%
68/102
Standard Customer
69.2%
72/104
Low Volume Speaker
71.6%
73/102
Interruptive Speaker
71.6%
73/102
Behavioral - Mind-Changer
79.4%
81/102
Accent - AAVE
81.4%
83/102
Accent - General American
84.3%
86/102
Super Fast Speaker
87.3%
89/102
Accent - Louisiana Creole
88.2%
90/102
Accent - Southern US
89.2%
91/102
Behavioral - Too-Talkative
93.1%
95/102
Table view
PersonaCompletionPassed
High Background Noise Speaker16.7%17/102
Confused Customer18.8%19/101
Impatient Customer44.1%45/102
Accent - Hispanic/Latino51.0%52/102
Behavioral - Complex-Order61.8%63/102
Behavioral - Rush66.7%68/102
Standard Customer69.2%72/104
Low Volume Speaker71.6%73/102
Interruptive Speaker71.6%73/102
Behavioral - Mind-Changer79.4%81/102
Accent - AAVE81.4%83/102
Accent - General American84.3%86/102
Super Fast Speaker87.3%89/102
Accent - Louisiana Creole88.2%90/102
Accent - Southern US89.2%91/102
Behavioral - Too-Talkative93.1%95/102

Completion rate by test case

Test case names link to the filtered runs list in Coval. Combo-offer scenarios cluster at the bottom.

UAT #9
51.0%
49/96
Combo offer after tenders
53.1%
51/96
UAT #29
54.2%
52/96
UAT #2
57.3%
55/96
UAT #61
59.4%
57/96
UAT #10
64.6%
62/96
Combo offer after signature chicken
65.6%
63/96
Alternative side offering
66.7%
64/96
UAT #69
68.4%
65/95
Combo offer after sandwich
68.8%
66/96
UAT #8
70.8%
68/96
UAT #36
71.9%
69/96
UAT #42
74.0%
71/96
UAT #64
75.0%
72/96
UAT #11
79.2%
76/96
UAT #1
81.2%
78/96
Mid-order quantity change
82.3%
79/96
Table view
Test caseCompletionPassed
UAT #951.0%49/96
Combo offer after tenders53.1%51/96
UAT #2954.2%52/96
UAT #257.3%55/96
UAT #6159.4%57/96
UAT #1064.6%62/96
Combo offer after signature chicken65.6%63/96
Alternative side offering66.7%64/96
UAT #6968.4%65/95
Combo offer after sandwich68.8%66/96
UAT #870.8%68/96
UAT #3671.9%69/96
UAT #4274.0%71/96
UAT #6475.0%72/96
UAT #1179.2%76/96
UAT #181.2%78/96
Mid-order quantity change82.3%79/96

Completion rate by batch

Four official passes, no movement. Whatever changed between them did not move the headline metric.

Simulation Run 2026-07-20 23:03 (scratch)
83.5%
71/85
RBI Bakeoff
67.1%
365/544
Simulation Run 2026-07-20 23:58 (scratch)
67.1%
57/85
RBI Bakeoff 2026-07-24
66.5%
181/272
RBI Bakeoff 2026-07-24 Pass 5
66.4%
180/271
RBI Bakeoff 2026-07-23
65.8%
179/272
Simulation Run 2026-07-20 22:35 (scratch)
62.7%
64/102
Table view
BatchCompletionPassed
Simulation Run 2026-07-20 23:03 (scratch)83.5%71/85
RBI Bakeoff67.1%365/544
Simulation Run 2026-07-20 23:58 (scratch)67.1%57/85
RBI Bakeoff 2026-07-2466.5%181/272
RBI Bakeoff 2026-07-24 Pass 566.4%180/271
RBI Bakeoff 2026-07-2365.8%179/272
Simulation Run 2026-07-20 22:35 (scratch)62.7%64/102

UAT #64: Cajun Rice

Customer asks for Cajun Rice, an item that is not on the menu. The AI is expected to say so and recommend an alternative. Judged completion is 75.0% (72/96). Below is what the AI actually said first, classified into mutually exclusive buckets.

Correct handling Stalled or evaded Wrong item risk
Denied, offered alternative
84.4%
81/96
Stalled, never answered
6.2%
6/96
False affirmation
4.2%
4/96
Silent substitution
3.1%
3/96
Off-topic / no answer
2.1%
2/96
Table view
BehaviorCountShare
Denied, offered alternative8184.4%
Stalled, never answered66.2%
False affirmation44.2%
Silent substitution33.1%
Off-topic / no answer22.1%

Every conversation that did not handle it cleanly

Simulation IDs link straight to the transcript in Coval.

BehaviorSimulationCompletionWhat the AI saidFinal cart
False affirmationhgyuPP8KDqJJEsKMvESaU3YESYes. We do. Anything else?1x Red Beans & Rice
Silent substitution4FR4jwHRfqUvqgAJrF2XPTNOI understand. You like red beans and rice instead?1x Red Beans & Rice
False affirmationVgYhUwitqqw9P598U7DTZ6YESYes. We have cinnamon apple pie. Anything else?1x Red Beans & Rice
False affirmationNrUhuZ4jqkBsHCxiSwvGA5NOYes. We still have Cajun rice. What else can I get for you?1x 2 Piece Signature Chicken Regular Combo (S
Silent substitutiondmAFv6oQ8GWM769WUYxndvNOI understand. You like red beans and rice instead?1x Red Beans & Rice
Silent substitution45XWUpe4n9PRL3RRg2gNFTYESWe have red beans and rice, regular or large.1x Red Beans & Rice
False affirmationiq3YZ5keVVpMYJ658SihtcYESYes. We do. Anything else?1x Red Beans & Rice
Stalled, never answered75NkfSQrS7ozRZzwQk4myTNOMoment while I check.1x Red Beans & Rice
Off-topic / no answerfGV8TzvyGwyeNYb2i5pYPZYESSorry. I didn't catch that. What drink would you like?1x Red Beans & Rice
Stalled, never answeredcfni4H85i9EDdNmfiEtSvnNOOf course, take your time. What can I get started for you?1x Red Beans & Rice; 1x 12 Piece Signature Ch
Stalled, never answeredJgFG4PQBVwfSgcFVUJWhqrYESMoment while I check.1x Spicy Chicken Sandwich Large Combo (Red Be
Off-topic / no answerMAYfprdnawRdU4QxacycXnNOOf course. Regular or large?1x Red Beans & Rice
Stalled, never answered5ik9KqeSZ5q6EBFuEZFE6XYESLet me check that for you.1x Cajun Fries; 1x Biscuit; 1x Cane Sweeeet T
Stalled, never answeredaBpxBKFoEnNoNUrCwcRrhLYESOf course, take your time. What can I get started for you?1x Red Beans & Rice; 1x 12 Piece Signature Ch
Stalled, never answeredfriVsaj8bnB4e4eTNVVuKoYESOne moment while I check.1x Red Beans & Rice

Dashboard links

Org rbi-bakeoff-deepgram, workspace default. Top level: Runs · Test sets · RBI bakeoff test set · Reports

Test cases

Test caseIDScenario
Generic capability - Alternative side offeringZZqF3btvf4ELGahb5meU8GI'd like the 3-piece signature chicken combo, spicy. I don't want fries. What other sides
Generic capability - Combo offer after sandwichMwSegbsoJ4Er6de8puhjudOrder one classic chicken sandwich by itself. Do not ask for a combo. If the agent offers
Generic capability - Combo offer after signature chickenNovS6SvpaUZEn6FPsNowB8Order three pieces of spicy signature chicken by themselves. Do not ask for a combo. If th
Generic capability - Combo offer after tendersgyeBnx8BuHbekXt9i8oFwoOrder five classic tenders by themselves. Do not ask for a combo. If the agent offers to m
Generic capability - Mid-order quantity changeCbsRpJUKVqjiBviRazmHVNStart by ordering the 3-piece signature chicken combo, spicy, with mashed potatoes and a C
RBI connectivity smokekkdbhUXWYEuoqy8Pn9oyeYOrder one classic chicken sandwich, no combo. Complete the order, then stop speaking when
UAT #18kg9tJuQt9wgpbovbw7He5One Ghost Pepper Sandwich, no combo.
UAT #1JKoLD3Ya5iNLxoKeNrzputOne Ghost Pepper Sandwich, no combo.
UAT #10j6pnhcuCTnR3jo8xxNWzcFCan I get the ghost pepper sandwich combo, swap the fries for red beans & rice, and a Dr P
UAT #11X2GRYX9HsnXcZhxqMr9W9SI'll do the chicken sandwich by itself and a side of fries.
UAT #2ftT5fiXMKfuqbfsbcZMWRMGive me the chicken wrap bundle with a mango lemonade.
UAT #29Ldk7ASyKLATimVuEzwQAKsI'll do the 12-piece family meal with all dark meat, spicy, Cajun fries and cole slaw, and
UAT #36ixXXgJAQJuKZRQU4PQ87wMI'll take the 3-piece chicken combo, spicy, add a pie - make it the strawberry - and a pre
UAT #42NYcmgkF7qQ75WeDZ3SgrxbCan I get the Ghost Pepper Sandwich combo? Actually, change that to the regular chicken sa
UAT #61PyWRkMc6pdfYPBB6ZsiRe6Order one regular bacon and cheese sandwich by itself. Do not ask for a combo or a large.
UAT #6428x3gHvpCX6kssjtfZFLcbCan I have a Cajun Rice please?
UAT #69VfwbVocDCm2aNGSfvakriGDo you have nuggets?
UAT #8JKTf9UwAYRpPaUK3bnup4uI'd like the 5-piece tenders combo, blackened and spicy, with cole slaw and a Coke.
UAT #9ahpduY88435y47NjtFoGpSOne bacon and cheese sandwich combo, large, with fries and strawberry lemonade.

All runs

RunIDCompletionPassedTags
RBI Bakeoff — Suite A (Audio Robustness) — Deepgram — High Background Noise Speaker — Batch 27M86byb9g7feToqnuhmsyE27%3/11batch-2, rbi-bakeoff, suite-a
RBI Bakeoff — Suite A (Audio Robustness) — Deepgram — High Background Noise Speaker — Batch 2 — continuationWCsiVgo3ceG5zpwtwK7etY0%0/6batch-2, continuation, rbi-bakeoff, suite-a
RBI Bakeoff — Suite A (Audio Robustness) — Deepgram — High Background Noise Speaker — Batch 34kFuzxzWeznZQkEagtFF3K12%2/17batch-3, official, rbi-bakeoff
RBI Bakeoff — Suite A (Audio Robustness) — Deepgram — Impatient Customer — Batch 2nHi9cbPGWM7KbRP3fx5nXM29%5/17batch-2, rbi-bakeoff, suite-a
RBI Bakeoff — Suite A (Audio Robustness) — Deepgram — Impatient Customer — Batch 3a28zHrGWV6JWQT8utVQNmP29%5/17batch-3, official, rbi-bakeoff
RBI Bakeoff — Suite A (Audio Robustness) — Deepgram — Interruptive Speaker — Batch 24Snh9RtHZxvLPb3Dp65vSf65%11/17batch-2, rbi-bakeoff, suite-a
RBI Bakeoff — Suite A (Audio Robustness) — Deepgram — Interruptive Speaker — Batch 39eaTg684vEUuqDwbrvTS5U76%13/17batch-3, official, rbi-bakeoff
RBI Bakeoff — Suite A (Audio Robustness) — Deepgram — Low Volume Speaker — Batch 2aognrjb8X7ZFDH5A9y5Uwx76%13/17batch-2, rbi-bakeoff, suite-a
RBI Bakeoff — Suite A (Audio Robustness) — Deepgram — Low Volume Speaker — Batch 3Q5VvSi2E32wVPp5n6yiKuw53%9/17batch-3, official, rbi-bakeoff
RBI Bakeoff — Suite A (Audio Robustness) — Deepgram — Standard Customer — Batch 2gd9cWeE3vUtFbgzn8PEagX71%12/17batch-2, rbi-bakeoff, suite-a
RBI Bakeoff — Suite A (Audio Robustness) — Deepgram — Standard Customer — Batch 32NkWiUDcLkAgxUa7bubL4z76%13/17batch-3, official, rbi-bakeoff
RBI Bakeoff — Suite A (Audio Robustness) — Deepgram — Super Fast Speaker — Batch 2oY8uwSfBYNc4JRG2Rtix5288%15/17batch-2, rbi-bakeoff, suite-a
RBI Bakeoff — Suite A (Audio Robustness) — Deepgram — Super Fast Speaker — Batch 34kmA9NbQe52EksczXAjDhm94%16/17batch-3, official, rbi-bakeoff
RBI Bakeoff — Suite B (Accent Robustness) — Deepgram — AAVE — Batch 36bQ8R5ZrKkxSQrWG4wy6RF76%13/17batch-3, official, rbi-bakeoff
RBI Bakeoff — Suite B (Accent Robustness) — Deepgram — Accent - AAVE — Batch 2FEmmyxHXJ8kmB7pfmYmwZ676%13/17batch-2, rbi-bakeoff, suite-b
RBI Bakeoff — Suite B (Accent Robustness) — Deepgram — Accent - General American — Batch 2Ri8H4fU6koUkopPEu9i5Aj94%16/17batch-2, rbi-bakeoff, suite-b
RBI Bakeoff — Suite B (Accent Robustness) — Deepgram — Accent - Hispanic/Latino — Batch 29RdgBGfsB6SCEP7TCTYjYu53%9/17batch-2, rbi-bakeoff, suite-b
RBI Bakeoff — Suite B (Accent Robustness) — Deepgram — Accent - Louisiana Creole — Batch 2Krj8Bazpcrv2xsAwXXsgyX82%14/17batch-2, rbi-bakeoff, suite-b
RBI Bakeoff — Suite B (Accent Robustness) — Deepgram — Accent - Southern US — Batch 2Noe7EoFev7sgHYZDHmmrtn88%15/17batch-2, rbi-bakeoff, suite-b
RBI Bakeoff — Suite B (Accent Robustness) — Deepgram — General American — Batch 346idNJm5oXFofnv8Vq5Ztp65%11/17batch-3, official, rbi-bakeoff
RBI Bakeoff — Suite B (Accent Robustness) — Deepgram — Hispanic Latino — Batch 3b3uXvsdbEASrVZFKG7xK9e47%8/17batch-3, official, rbi-bakeoff
RBI Bakeoff — Suite B (Accent Robustness) — Deepgram — Louisiana Creole — Batch 3gttG557SyJpUXxacQxjKfT94%16/17batch-3, official, rbi-bakeoff
RBI Bakeoff — Suite B (Accent Robustness) — Deepgram — Southern US — Batch 3e59QbffVu4PQ6VPjc743yc94%16/17batch-3, official, rbi-bakeoff
RBI Bakeoff — Suite C (Behavioral) — Deepgram — Behavioral - Complex-Order — Batch 2czoZVyDV6kUreMYEDk2y6782%14/17batch-2, rbi-bakeoff, suite-c
RBI Bakeoff — Suite C (Behavioral) — Deepgram — Behavioral - Mind-Changer — Batch 2ft5UzfY4JAaVK8XV6TbgpX88%15/17batch-2, rbi-bakeoff, suite-c
RBI Bakeoff — Suite C (Behavioral) — Deepgram — Behavioral - Rush — Batch 2FrmXHBKmG3cC2RK2ug4gqD82%14/17batch-2, rbi-bakeoff, suite-c
RBI Bakeoff — Suite C (Behavioral) — Deepgram — Behavioral - Too-Talkative — Batch 2SpwVB3bmBer9nWSp2pFh7u88%15/17batch-2, rbi-bakeoff, suite-c
RBI Bakeoff — Suite C (Behavioral) — Deepgram — Complex Order — Batch 3oARArF6jYsxApNvWqqowrf59%10/17batch-3, official, rbi-bakeoff
RBI Bakeoff — Suite C (Behavioral) — Deepgram — Confused Customer — Batch 2iuT428utH3XWMiZTRQyTyg24%4/17batch-2, rbi-bakeoff, suite-c
RBI Bakeoff — Suite C (Behavioral) — Deepgram — Confused Customer — Batch 3J3ZM628REKBN2fEKPuvvop18%3/17batch-3, official, rbi-bakeoff
RBI Bakeoff — Suite C (Behavioral) — Deepgram — Mind Changer — Batch 3i4UKHTQ88LGXnU99R6ghi982%14/17batch-3, official, rbi-bakeoff
RBI Bakeoff — Suite C (Behavioral) — Deepgram — Rush — Batch 3fZBZYBs75rVgYjvg9753Bc65%11/17batch-3, official, rbi-bakeoff
RBI Bakeoff — Suite C (Behavioral) — Deepgram — Too Talkative — Batch 32h9jQ84vbZvPL3qpWLZpFw100%17/17batch-3, official, rbi-bakeoff
RBI Bakeoff 2026-07-23 — Suite A — deepgram — MUFJdYAHdBHU6UbRRu4ykMV8aN7maJysfHYydeYDQLim76%13/172026-07-23, official, rbi-bakeoff, suite-a
RBI Bakeoff 2026-07-23 — Suite A — deepgram — NNMm2vhQRW5E747p7SzuNMNyz4DbhbfgxWdWENF49ZRR71%12/172026-07-23, official, rbi-bakeoff, suite-a
RBI Bakeoff 2026-07-23 — Suite A — deepgram — VSruLZYYyz3w7fkdUaheDRSHKLEmB8TvhHV9hkQCGcGo76%13/172026-07-23, official, rbi-bakeoff, suite-a
RBI Bakeoff 2026-07-23 — Suite A — deepgram — VZ3mLhnQ5SgpkZeNHET8fqLEApgktYYweX9mvqCmYnQQ53%9/172026-07-23, official, rbi-bakeoff, suite-a
RBI Bakeoff 2026-07-23 — Suite A — deepgram — ZGQcBTzyxoRYNUa7BSw8i4LXSzETgB4eMR2GQ6ajbhc576%13/172026-07-23, official, rbi-bakeoff, suite-a
RBI Bakeoff 2026-07-23 — Suite A — deepgram — jDPgdyKRFxxbWgCcLQJ5qSYmsSzdanPKbqK6eHnqAE2K12%2/172026-07-23, official, rbi-bakeoff, suite-a
RBI Bakeoff 2026-07-23 — suite-b — deepgram — AQPvfyLYjJmuJ2AdQ3gGCiRAwN5bPsyMnmgjJBysbGYi71%12/172026-07-23, official, rbi-bakeoff, suite-b
RBI Bakeoff 2026-07-23 — suite-b — deepgram — BMQEKLKDPyKpv3Bocdh5L7CxMzamWsyffYFvDCzcNicZ88%15/172026-07-23, official, rbi-bakeoff, suite-b
RBI Bakeoff 2026-07-23 — suite-b — deepgram — ETDujiUnZoQbH3rrR2HbmKCW6UoRXpXTLg64QbbLmbxi88%15/172026-07-23, official, rbi-bakeoff, suite-b
RBI Bakeoff 2026-07-23 — suite-b — deepgram — LD8JybxS3R9Q9u6hiPwX8a2WMchnW4UKNAC8v8KWk7ji88%15/172026-07-23, official, rbi-bakeoff, suite-b
RBI Bakeoff 2026-07-23 — suite-b — deepgram — YZyUB5juT4fFLGbmY26m3N8pUxWnqAzSCctSQao2UE4d47%8/172026-07-23, official, rbi-bakeoff, suite-b
RBI Bakeoff 2026-07-23 — suite-c — deepgram — Cf3iFSCoqTgyqxtgXG3g28kRQSGx9orqJAMo7N8LD7Jk71%12/172026-07-23, official, rbi-bakeoff, suite-c
RBI Bakeoff 2026-07-23 — suite-c — deepgram — EXUdeySkLnjqWqtRyGwe2ZXhLyPCofnGC9roBd9Q3kC271%12/172026-07-23, official, rbi-bakeoff, suite-c
RBI Bakeoff 2026-07-23 — suite-c — deepgram — Xw4izPULtn49u7xDtPammbXg3FkKqWrPeTRbrESCiZE559%10/172026-07-23, official, rbi-bakeoff, suite-c
RBI Bakeoff 2026-07-23 — suite-c — deepgram — fDd7TCj4cfa7xGUSuPRYdVD98M8fm9KPXnbqMZfQHW2418%3/172026-07-23, official, rbi-bakeoff, suite-c
RBI Bakeoff 2026-07-23 — suite-c — deepgram — fWeBJDoqgo8BfLyWcSgdFw8rfrDEEVkF7Hqu4V89z3Kn88%15/172026-07-23, official, rbi-bakeoff, suite-c
RBI Bakeoff 2026-07-24 — Suite A — deepgram — MUFJdYAHdBHU6UbRRu4ykMAGQgKu6fsxaSQXPiHupb2h0%0/02026-07-24, official, rbi-bakeoff, suite-a
RBI Bakeoff 2026-07-24 — Suite A — deepgram — MUFJdYAHdBHU6UbRRu4ykM — Replacement 1BSntEkFpnrF9f8jFV4skMd65%11/172026-07-24, official, rbi-bakeoff, replacement-1, suite-a
RBI Bakeoff 2026-07-24 — Suite A — deepgram — NNMm2vhQRW5E747p7SzuNM2xC9ovyCDTCmEYRPcMLsNG0%0/02026-07-24, official, rbi-bakeoff, suite-a
RBI Bakeoff 2026-07-24 — Suite A — deepgram — NNMm2vhQRW5E747p7SzuNM — Replacement 1LAzUuEbTFwLvboEk9PGtdW94%16/172026-07-24, official, rbi-bakeoff, replacement-1, suite-a
RBI Bakeoff 2026-07-24 — Suite A — deepgram — VSruLZYYyz3w7fkdUaheDRif7FWrJ2gbpihbA3HtEseo0%0/02026-07-24, official, rbi-bakeoff, suite-a
RBI Bakeoff 2026-07-24 — Suite A — deepgram — VSruLZYYyz3w7fkdUaheDR — Replacement 1br4csueRTiePPJkzPhQtiL65%11/172026-07-24, official, rbi-bakeoff, replacement-1, suite-a
RBI Bakeoff 2026-07-24 — Suite A — deepgram — VZ3mLhnQ5SgpkZeNHET8fqAgrkSFkXQFwZkk3yenB3JY0%0/02026-07-24, official, rbi-bakeoff, suite-a
RBI Bakeoff 2026-07-24 — Suite A — deepgram — VZ3mLhnQ5SgpkZeNHET8fq — Replacement 1h4XMEhfLrKrpBQMBxDPDX841%7/172026-07-24, official, rbi-bakeoff, replacement-1, suite-a
RBI Bakeoff 2026-07-24 — Suite A — deepgram — ZGQcBTzyxoRYNUa7BSw8i4PdRzFmGS9Re6pBPCPrcFR40%0/02026-07-24, official, rbi-bakeoff, suite-a
RBI Bakeoff 2026-07-24 — Suite A — deepgram — ZGQcBTzyxoRYNUa7BSw8i4 — Replacement 1MGfN27rNC2YMWwBTpDs7nV76%13/172026-07-24, official, rbi-bakeoff, replacement-1, suite-a
RBI Bakeoff 2026-07-24 — Suite A — deepgram — jDPgdyKRFxxbWgCcLQJ5qSNgfrdL3qsBAx6S4EeAzDAt0%0/02026-07-24, official, rbi-bakeoff, suite-a
RBI Bakeoff 2026-07-24 — Suite A — deepgram — jDPgdyKRFxxbWgCcLQJ5qS — Replacement 1Q8bo6hWGiH3mXdxT4cpxG524%4/172026-07-24, official, rbi-bakeoff, replacement-1, suite-a
RBI Bakeoff 2026-07-24 — Suite B — deepgram — AQPvfyLYjJmuJ2AdQ3gGCiYrZy6B8iK9Npe6PKhTRx6j94%16/172026-07-24, official, rbi-bakeoff, suite-b
RBI Bakeoff 2026-07-24 — Suite B — deepgram — BMQEKLKDPyKpv3Bocdh5L7Pm9eq6aGTa2NtRUihCDN6488%15/172026-07-24, official, rbi-bakeoff, suite-b
RBI Bakeoff 2026-07-24 — Suite B — deepgram — ETDujiUnZoQbH3rrR2HbmKhDJVUxSSPv9wgTfXTDaeRT76%13/172026-07-24, official, rbi-bakeoff, suite-b
RBI Bakeoff 2026-07-24 — Suite B — deepgram — LD8JybxS3R9Q9u6hiPwX8aRb7Ex46mcwL8UxkbsxFZnY82%14/172026-07-24, official, rbi-bakeoff, suite-b
RBI Bakeoff 2026-07-24 — Suite B — deepgram — YZyUB5juT4fFLGbmY26m3Nhm44DhpjGCbX6UcFZtFExW53%9/172026-07-24, official, rbi-bakeoff, suite-b
RBI Bakeoff 2026-07-24 — Suite C — deepgram — Cf3iFSCoqTgyqxtgXG3g28R3mzVukjnukuikv6n5shqP82%14/172026-07-24, official, rbi-bakeoff, suite-c
RBI Bakeoff 2026-07-24 — Suite C — deepgram — EXUdeySkLnjqWqtRyGwe2ZA4MBmeHchHDgedMVf4BHFZ71%12/172026-07-24, official, rbi-bakeoff, suite-c
RBI Bakeoff 2026-07-24 — Suite C — deepgram — Xw4izPULtn49u7xDtPammbCfHevXMCFexuRHwUbk5TSM65%11/172026-07-24, official, rbi-bakeoff, suite-c
RBI Bakeoff 2026-07-24 — Suite C — deepgram — fDd7TCj4cfa7xGUSuPRYdVLUWWXwGHv8YsVh6uLG4CJG0%0/172026-07-24, official, rbi-bakeoff, suite-c
RBI Bakeoff 2026-07-24 — Suite C — deepgram — fWeBJDoqgo8BfLyWcSgdFwfUtpJ9tmtaoxPJWCb5MtFB88%15/172026-07-24, official, rbi-bakeoff, suite-c
RBI Bakeoff 2026-07-24 Pass 5 — Suite A — deepgram — MUFJdYAHdBHU6UbRRu4ykM9yXvShbGcHoSjJaw94xtKT71%12/172026-07-24, official, pass-5, rbi-bakeoff, suite-a
RBI Bakeoff 2026-07-24 Pass 5 — Suite A — deepgram — NNMm2vhQRW5E747p7SzuNMNdDU346guxiWeVAJBa6BmV88%15/172026-07-24, official, pass-5, rbi-bakeoff, suite-a
RBI Bakeoff 2026-07-24 Pass 5 — Suite A — deepgram — VSruLZYYyz3w7fkdUaheDRNxdbURsGt2hJiXdoCLdyzg65%11/172026-07-24, official, pass-5, rbi-bakeoff, suite-a
RBI Bakeoff 2026-07-24 Pass 5 — Suite A — deepgram — VZ3mLhnQ5SgpkZeNHET8fqL4SAsehLwCFRZHSDK7Rjyv53%9/172026-07-24, official, pass-5, rbi-bakeoff, suite-a
RBI Bakeoff 2026-07-24 Pass 5 — Suite A — deepgram — ZGQcBTzyxoRYNUa7BSw8i4YtPnVbBXVTJHCP3W5zwi8v76%13/172026-07-24, official, pass-5, rbi-bakeoff, suite-a
RBI Bakeoff 2026-07-24 Pass 5 — Suite A — deepgram — jDPgdyKRFxxbWgCcLQJ5qSaMrZESM6ShKExcE8bStNfg24%4/172026-07-24, official, pass-5, rbi-bakeoff, suite-a
RBI Bakeoff 2026-07-24 Pass 5 — Suite B — deepgram — AQPvfyLYjJmuJ2AdQ3gGCiAQuTjJYTgmb3n6a7oMsgFb88%15/172026-07-24, official, pass-5, rbi-bakeoff, suite-b
RBI Bakeoff 2026-07-24 Pass 5 — Suite B — deepgram — BMQEKLKDPyKpv3Bocdh5L7mFWog74SPpFXMsna7sSGWZ82%14/172026-07-24, official, pass-5, rbi-bakeoff, suite-b
RBI Bakeoff 2026-07-24 Pass 5 — Suite B — deepgram — ETDujiUnZoQbH3rrR2HbmKcPKSMrwZmNcnuW7HoArqj994%16/172026-07-24, official, pass-5, rbi-bakeoff, suite-b
RBI Bakeoff 2026-07-24 Pass 5 — Suite B — deepgram — LD8JybxS3R9Q9u6hiPwX8a8x32oSqkyxcTbZCSZZLwb682%14/172026-07-24, official, pass-5, rbi-bakeoff, suite-b
RBI Bakeoff 2026-07-24 Pass 5 — Suite B — deepgram — YZyUB5juT4fFLGbmY26m3NXk9cdcoUFNxCsVT9A4JMou53%9/172026-07-24, official, pass-5, rbi-bakeoff, suite-b
RBI Bakeoff 2026-07-24 Pass 5 — Suite C — deepgram — Cf3iFSCoqTgyqxtgXG3g28QtebrkhHCWqiHc8xsAXthp76%13/172026-07-24, official, pass-5, rbi-bakeoff, suite-c
RBI Bakeoff 2026-07-24 Pass 5 — Suite C — deepgram — EXUdeySkLnjqWqtRyGwe2ZZk3DR5KCYAZzJrXB4HY4We53%9/172026-07-24, official, pass-5, rbi-bakeoff, suite-c
RBI Bakeoff 2026-07-24 Pass 5 — Suite C — deepgram — Xw4izPULtn49u7xDtPammb63gWdeLfaRZUogPR7nHNAH35%6/172026-07-24, official, pass-5, rbi-bakeoff, suite-c
RBI Bakeoff 2026-07-24 Pass 5 — Suite C — deepgram — fDd7TCj4cfa7xGUSuPRYdVa4Bgp8Q7Nk5sDAo9JCyK5725%4/162026-07-24, official, pass-5, rbi-bakeoff, suite-c
RBI Bakeoff 2026-07-24 Pass 5 — Suite C — deepgram — fWeBJDoqgo8BfLyWcSgdFwTWs6fVjjaEjaJw7wW7Wzbk94%16/172026-07-24, official, pass-5, rbi-bakeoff, suite-c
RBI v2 clean connectivity proof - deepgramZxPJvJTDgruo7tibGoLqut0%0/1canonical-v2, clean-proof, rbi-bakeoff, smoke
RBI v2 connectivity smoke - deepgram9Ms3NLzx9R9DKo7g7GTm4i0%0/1canonical-v2, rbi-bakeoff, smoke
Simulation Run 2026-07-09 21:45K3o5PjYypDGzhBUFLZkQuL0%0/0none
Simulation Run 2026-07-09 23:02KBcKHcLfMLGyGqrgSw8Nnt0%0/0none
Simulation Run 2026-07-20 22:35ZjpnTFN5vvs8qRkKiwESGm59%10/17canonical-v2, canonical-v3, popeyes, rbi-approved-scope, rbi-bakeoff, rbi-builtin, suite-a, vendor-eval, voice
Simulation Run 2026-07-20 22:35VeYcxZethGV5fooRN2WVbm71%12/17canonical-v2, canonical-v3, popeyes, rbi-approved-scope, rbi-bakeoff, rbi-builtin, suite-a, vendor-eval, voice
Simulation Run 2026-07-20 22:35o2zJioPTZEcnSPp2nsVCDC82%14/17canonical-v2, canonical-v3, popeyes, rbi-approved-scope, rbi-bakeoff, rbi-builtin, suite-a, vendor-eval, voice
Simulation Run 2026-07-20 22:352qSRzcQ3WcA22sBsokwYGu88%15/17canonical-v2, canonical-v3, popeyes, rbi-approved-scope, rbi-bakeoff, rbi-builtin, suite-a, vendor-eval, voice
Simulation Run 2026-07-20 22:35W3QCYqXeq6Epuqij2ggreJ12%2/17canonical-v2, canonical-v3, popeyes, rbi-approved-scope, rbi-bakeoff, rbi-builtin, suite-a, vendor-eval, voice
Simulation Run 2026-07-20 22:35PAJag5Cv2GWjMiWrc8jL2m65%11/17canonical-v2, canonical-v3, popeyes, rbi-approved-scope, rbi-bakeoff, rbi-builtin, suite-a, vendor-eval, voice
Simulation Run 2026-07-20 23:038Ywj7sBwkfetSppgpNA52x100%17/17canonical-v2, canonical-v3, popeyes, rbi-approved-scope, rbi-bakeoff, rbi-builtin, vendor-eval, voice
Simulation Run 2026-07-20 23:03Ha4Q9rbL4Y6uwfjpdqLvpc94%16/17canonical-v2, canonical-v3, popeyes, rbi-approved-scope, rbi-bakeoff, rbi-builtin, vendor-eval, voice
Simulation Run 2026-07-20 23:03UyBwYnCNm8RS74aC4Cr9UG82%14/17canonical-v2, canonical-v3, popeyes, rbi-approved-scope, rbi-bakeoff, rbi-builtin, vendor-eval, voice
Simulation Run 2026-07-20 23:03UoUcmtamYtp3XE5KXJcb6F53%9/17canonical-v2, canonical-v3, popeyes, rbi-approved-scope, rbi-bakeoff, rbi-builtin, vendor-eval, voice
Simulation Run 2026-07-20 23:038a3sNhKBZyjBnuGtrffMRn88%15/17canonical-v2, canonical-v3, popeyes, rbi-approved-scope, rbi-bakeoff, rbi-builtin, vendor-eval, voice
Simulation Run 2026-07-20 23:58EnFdRDLajiEqjchoyQLKrQ100%17/17canonical-v2, canonical-v3, popeyes, rbi-approved-scope, rbi-bakeoff, rbi-builtin, vendor-eval, voice
Simulation Run 2026-07-20 23:58hDEYHkmDYsz8EzifpHbari76%13/17canonical-v2, canonical-v3, popeyes, rbi-approved-scope, rbi-bakeoff, rbi-builtin, vendor-eval, voice
Simulation Run 2026-07-20 23:589Vv6kjGA3Wy9bAY9LdHqFp71%12/17canonical-v2, canonical-v3, popeyes, rbi-approved-scope, rbi-bakeoff, rbi-builtin, vendor-eval, voice
Simulation Run 2026-07-20 23:587tVZPXTFXL3GwtdNWb8WTj59%10/17canonical-v2, canonical-v3, popeyes, rbi-approved-scope, rbi-bakeoff, rbi-builtin, vendor-eval, voice
Simulation Run 2026-07-20 23:58Jmw9caxgbaJ79GMhz7Mfjn29%5/17canonical-v2, canonical-v3, popeyes, rbi-approved-scope, rbi-bakeoff, rbi-builtin, vendor-eval, voice