You are soft-spoken and a little hesitant. Answer clearly but quietly, and repeat information if the agent asks for confirmation.
Test case names jump to that scenario's conversations below.
Failures first within each scenario. Simulation IDs open the transcript in Coval. The judge note is Coval's written reason for the Completion verdict.
One bacon and cheese sandwich combo, large, with fries and strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
SLbhtvXmVSpvHXPqkUogRk | RBI Bakeoff 2026-07-23 | NO | The agent escalated to a human employee when the order was not confirmed correctly. | 1x Classic Bacon & Cheese Chicken Sandwich Regular Comb |
npaiQkTLowzjRWKWwNDdMQ | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent stated an employee will assist with confirmation, indicating escalation to a human. | 1x Classic Bacon & Cheese Chicken Sandwich Regular Comb |
7nU7FMtTRuZeUfgJo4HpBX | RBI Bakeoff | NO | Agent confirmed order and told customer to pull forward but then handed off to a human employee at the window. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
jNBrA2wtMZtnwpMMpWoK67 | Simulation Run 2026-07-20 22:35 (scratch) | NO | Agent escalated to a human team member to verify the order, not completing it alone. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
4swvPJzxBjPXYb7nUV6Eyn | Simulation Run 2026-08-17 01:07 | NO | Agent never confirmed the full order or directed the customer to pull forward or the next window. | empty |
XB8GcXsBCf7ghQCzG3JN9U | RBI Bakeoff 2026-07-24 | no transcript | — | |
5wi4UJ7q7KCvACvv4eLxut | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9db9Jy7AYkQFZn3JTPYhMV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AsUC2yesp442mcPWi6EiHu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FsM3xJWArGHTxp8igHJatN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KbLh4W6k422PWhbdeZHHpY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
L4XJkySFGwDLDKppmSdF4r | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LgVkCBo85H35vqZdYYMXec | Simulation Run 2026-08-16 21:10 | no transcript | — | |
keD55MtFww5k4xzWBBdeTb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nW9YZxXmWzknbVNoNVWYbH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
oPR97h7zFbH7ajMPGtJrBa | Simulation Run 2026-08-16 21:10 | no transcript | — | |
3BmAC6MpPcBwqFxr3AB2BW | Test new prompt (Aug) | no transcript | — | |
KwjVQfDXcYZxeZBy43VnkF | Test new prompt (Aug) | no transcript | — | |
QQH8vi6ueSHXaq6DSUp9yx | Test new prompt (Aug) | UNKNOWN | Transcript does not show if the order was fully captured or if the customer was directed to pull forward or next window. | empty |
V7MtHZucrcjfz5BatknWYv | Test new prompt (Aug) | no transcript | — | |
n63p5BXxFvQGPkdDs8BfER | Test new prompt (Aug) | no transcript | — | |
7TortjUHgdypNT6YB82TEN | RBI Bakeoff 2026-07-24 | YES | The agent took the full order, confirmed it, and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Regular Comb |
i8rYA9Mjw8Zp6mHAUn7Laa | RBI Bakeoff | YES | The agent fully captured the order and instructed the customer to pull forward without escalating. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
B6a8bqRvivJEz4AWAtYeJQ | Simulation Run 2026-08-18 22:00 | YES | The agent captured the full order and directed the customer to pull forward without escalating. | empty |
Do you have nuggets?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
ibkXkkQFhqfiY7sE5Pp7Tt | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human to verify the order, not directing customer forward themselves. | 1x 5 Piece Chicken Tenders Large Combo (Cajun Fries, Ma |
GroZxf2Bv75mDAY2eHGqJT | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent did not send the customer forward but escalated to a human team member for assistance. | 1x 3 Piece Chicken Tenders (Classic, Bold BBQ) |
ULHkYRxYbQMDoxewqMs7n3 | RBI Bakeoff | NO | The agent escalated to a human team member instead of directing the customer to pull forward. | 1x 3 Piece Chicken Tenders Dinner (Classic, Wild Honey |
gXqxN9aKm8cFfCSZvk7wiU | RBI Bakeoff | NO | The agent did not direct the customer to pull forward/next window and instead escalated to a human employee. | 1x 3 Piece Chicken Tenders (Classic) |
A4rnNdtWFDJpAD2b6aTKqj | RBI Bakeoff 2026-07-24 | no transcript | — | |
3xxfBaZLZyGPNAoWfq2Qj2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
5JcENqTKi55dKoZnFHT2rj | Simulation Run 2026-08-16 21:10 | no transcript | — | |
5T3VAwNAa4VjpZUkMV55tt | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CKrdChxwz5FdXbJHKpTFVE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DCLwGxUennYJzwb3B6ZPPr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GQ8stw22PBvzcTqPFHJvw5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RYh4pJiiNQsQUqiDKhuwpb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VVMPfU6u6Fpaxv8ydJLYLD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bxJK6tmB7jBJuy59gZcy8Q | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kZEr9cx7awYJhmkiLP5Kas | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dpUBXmEMBApzrooJecNwVU | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript contains only a question about nuggets, no order or direction provided. | empty |
6ZEFC3G3aUrAfG9wazGDEo | Test new prompt (Aug) | no transcript | — | |
DxbwVpeGwxqZJEcrfoxqSx | Test new prompt (Aug) | no transcript | — | |
KLVWtmkghydQ7nLXEXTfd6 | Test new prompt (Aug) | no transcript | — | |
TdKRhNHzCYYsmT6HG64UNY | Test new prompt (Aug) | no transcript | — | |
Wdz5RxKBuenMieKCUNLbBg | Test new prompt (Aug) | no transcript | — | |
KdJLFCDfioamWSJyM2f8Cu | RBI Bakeoff 2026-07-24 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Cajun Fries, Ma |
bwJafAZFaV8BTMqLK2ozds | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent took the full order, confirmed it at the end, and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Mashed Potatoes |
VdSEHWDpJCQ6P2n9RshW5G | Simulation Run 2026-08-18 22:00 | YES | Agent took full order details and directed customer to pull forward without escalation. | empty |
Order three pieces of spicy signature chicken by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose mashed potatoes and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
kQKeLqbDe3CNmJkQ8eRDya | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent stated 'An employee will assist you,' indicating escalation to a human team member. | 1x 3 Piece Signature Chicken (Spicy) |
ZY95QrtVwy7yC6qwNRd72n | RBI Bakeoff 2026-07-24 | NO | The agent said 'An employee will help confirm it,' indicating escalation to a human team member. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
mUzsUGP5LC3fU4BsCEy2jM | RBI Bakeoff | NO | Agent escalated to a human employee for assistance instead of directing customer to pull forward. | 1x 3 Piece Signature Chicken (Spicy) |
ArtfpAqrwz7JHRit3k4bbx | RBI Bakeoff | NO | Agent did not complete order or direct customer forward; instead, agent escalated to a human employee. | 1x 3 Piece Signature Chicken (Spicy) |
CkzJEpZNG8xpzd4ZmdZWPR | Simulation Run 2026-08-16 21:10 | NO | The agent did not direct the customer to pull forward or the next window; the order was not confirmed complete. | 1x 3 Piece Signature Chicken (Spicy) |
mrqnGdt6gdK2j73uiJC3Hi | RBI Bakeoff 2026-07-24 | no transcript | — | |
2Ls25cinSrvTnHJQwsTzYZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7tJUPz5JodBSHr3eYLkcff | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DvtUKqiXk7kWvU8jHLWA3q | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MYV49a8ENnMns72G5EqPYU | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MdmtFxFfTbhWFenQiGPsQN | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript does not show the agent confirming the order is complete or directing the customer to pull forward. | 1x 3 Piece Signature Chicken (Spicy) |
PvSdeF7bkhJ5bb7pYLtTjC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Rj6XXeE4tig5abzDxrPXc4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
baVnPxAFccVDTmo9WSQPcj | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript lacks any agent messages confirming the order or directing the customer to pull forward. | 1x 3 Piece Signature Chicken (Spicy) |
kSN3Dii4CL37wmRQRMTqx3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
3ZgV9qR4REMPTRWa7Dj7Xh | Test new prompt (Aug) | UNKNOWN | The transcript ends before the agent confirms the full order or directs the customer to pull forward; no escalation is mentioned. | empty |
PUVSYF8QQK4aD7xDdqxRWn | Test new prompt (Aug) | no transcript | — | |
UbctGTErT2HbFXd2thNFxq | Test new prompt (Aug) | no transcript | — | |
XMrvvxJkKbjV4mH86dyeF2 | Test new prompt (Aug) | UNKNOWN | The transcript does not show the agent completing the order or directing the customer to pull forward or the next window. | empty |
nEKDdXbtexa7B3ccoXzBSd | Test new prompt (Aug) | no transcript | — | |
Ynj9gkrgk46ZsmvB3BGNqb | RBI Bakeoff 2026-07-23 | YES | The agent took the full order and told the customer to pull forward, without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
3sV8wvKMiWEiAukMskJBtF | Simulation Run 2026-07-20 22:35 (scratch) | YES | Agent captured the full order of three pieces of spicy chicken and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken (Spicy) |
h8MjgPvfyemcf5dxrVd3hS | Simulation Run 2026-08-17 01:07 | YES | Agent took full order of 3 pieces spicy chicken and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken (Spicy) |
jchdMhwuJkzWj9QHLw3oNd | Simulation Run 2026-08-18 22:00 | YES | Agent took full order and directed customer to pull forward without escalating or handing off. | empty |
One Ghost Pepper Sandwich, no combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
BCYd2taWD9nPWtxYyGhcPq | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human after taking the order, not sending customer forward directly. | 1x Spicy Chicken Sandwich |
Lh9ua2hG87bwcbBK4SrmqB | RBI Bakeoff | NO | Agent did not complete the order and escalated to a human employee for assistance. | empty |
Vc4KLMiAWXdaCfT7rBXvWy | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent escalated to a human by stating 'An employee will assist you.' | 1x Spicy Chicken Sandwich |
7JCtcEbn7FACdc9Agiw42k | Simulation Run 2026-08-17 01:07 | NO | The agent never directed the customer to pull forward or the next window after taking the order. | 1x Spicy Chicken Sandwich |
Ux5SC6RWVG4s8GFog3nffc | RBI Bakeoff 2026-07-24 | no transcript | — | |
4jjywwdySE4U5yn3QR5ovV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8DXRXAq8ksHsjT7RfdtMLp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DXVDvYgZHmeifMsYePaegK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FKVzxdw45dzJJWqCt53XTU | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FuMXTGaRkBoW42qtuwxpdv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Gkrn5rVHJNABRH6i27P9Gj | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RBa5KeK8E4cKaU76szNJpL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SAHPy2nTZVYXXaHvTGwbx6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VPvydfCUTt9ELkXMytjLSj | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ktoerw8QUUV8sXYPecVEc3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9bcsxCFRt64HzguMPmkqER | Test new prompt (Aug) | no transcript | — | |
C5HMrPa5mR34eukfYLxWY5 | Test new prompt (Aug) | no transcript | — | |
LgyPXPUovTt2a89SHih959 | Test new prompt (Aug) | no transcript | — | |
amhSFND2gD6RTwmcjZAtVm | Test new prompt (Aug) | no transcript | — | |
iTtGqVQrhuCEYi8E4Lmo5X | Test new prompt (Aug) | no transcript | — | |
hsLiN6Me4PJs8o2wvnCuBY | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent took full order of spicy sandwich and directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
SHCppMWSYtYZcxGQgHe8se | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order (Spicy Chicken Sandwich) and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
VW7KjmJ8kLA5sag7wGEy4M | RBI Bakeoff | YES | The agent took the full order of one classic spicy sandwich and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
gbLKMKuJEipKiA3qwGU3t9 | Simulation Run 2026-08-18 22:00 | YES | The agent captured the full order and directed the customer to pull forward without escalating or bailing. | empty |
Give me the chicken wrap bundle with a mango lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
RndVPH83gz8J43MtYRPLVZ | RBI Bakeoff 2026-07-24 | NO | The agent did not capture the mango item from the customer's order, so the order is incomplete. | 1x Wraps Bundle |
E2j3q5FEM9zoXVYHRhdQme | RBI Bakeoff | NO | Agent never read back full order and suggested an employee can help, showing incomplete handling. | 1x Wraps Bundle (Classic Wrap); 1x Chilled Mango Cane S |
A4xoyVY5yaDPA5NQtN5cuY | Simulation Run 2026-08-16 21:10 | NO | The agent repeated the initial greeting and did not confirm or complete the order, nor direct the customer forward. | empty |
KQgfvnZEDpAQVSGZ9py4yc | RBI Bakeoff 2026-07-24 | no transcript | — | |
9wADBrxdHipoDVjpfA4dRE | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent completing the order or directing the customer to pull forward or the next window. | empty |
PFDxxmkSShWzLDfsASzvBg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
URQyWbAZhcRrBChzd9sPUa | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XGuewZGthvnqrL2teKSCKT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YaZtzijpw69vUpB3vGA9oJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Z8ZVtukKnAkepywHCpbf7A | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dL8ypFej8M4oo6x7iafRgd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
junQpZEEccC7CDNk8u3Ziw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
oJD5ZyCzBSfDc6WEdXdTMV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Fi9LNXemhBJW8ap6qXRdHT | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript is incomplete and does not show order completion or directing customer to pull forward without escalation. | empty |
Dcz8gJaPExVBhfyrSC29mW | Test new prompt (Aug) | no transcript | — | |
P8cJWvEVzmhHn93CXkNBpF | Test new prompt (Aug) | no transcript | — | |
gwUWgAiMCdmYknSQt7AUPp | Test new prompt (Aug) | no transcript | — | |
hheMjy7Gs5HXupeGiBYA7e | Test new prompt (Aug) | no transcript | — | |
kYDfF8bajCvH7uujaeNDLR | Test new prompt (Aug) | no transcript | — | |
DCFKYUo6HixqUWEHGV2fPk | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x Wraps Bundle (Classic Wrap, Spicy Wrap, Chilled Mang |
5KYXRhFsHgVuXbwyJHXX5L | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Wrap Regular Combo |
Drrzdbkdb5VDa4ybfCpYhp | RBI Bakeoff | YES | Agent captured the full order and directed the customer to pull forward without escalating or handing off. | 1x Blackened Ranch Sauce; 1x Chilled Strawberry Cane Sw |
gd3TpDjAMHHKbGCznSn74B | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Wraps Bundle (Classic Wrap); 1x Chilled Mango Cane S |
GSHWELwYp23soowSa2CVqJ | Simulation Run 2026-08-18 22:00 | YES | Agent took the full order, confirmed it with the customer, and directed to pull forward without escalation. | empty |
Order one regular bacon and cheese sandwich by itself. Do not ask for a combo or a large. If the agent first offers to make it a regular combo, accept with fries and a Coke, then accept a subsequent l
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
LfVRoQcdeevrWsbDK6z52Q | RBI Bakeoff 2026-07-24 | NO | Agent escalated the order by stating an employee will assist, not directing customer to pull forward. | 1x Classic Bacon & Cheese Chicken Sandwich |
c9kAN9NR2xRBAq7J9ayPam | RBI Bakeoff | NO | Agent escalated the order by saying an employee will assist the customer. | 1x Classic Bacon & Cheese Chicken Sandwich |
8pCwf9SJkhKKA8K8vihPxE | Simulation Run 2026-07-20 22:35 (scratch) | NO | Agent escalated to a human employee instead of directing the customer forward after taking the order. | 1x Classic Bacon & Cheese Chicken Sandwich |
6MTFQipi5yx3j4C692W82H | RBI Bakeoff 2026-07-24 | no transcript | — | |
Kxz87TqA2w5rYpcdagSqXy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Lpo6jJURQdStmBCEVWDLvJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
N9wTRMDyNH3qnWRCRKhU2p | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VXUadxKuAPucbEW8E3Kb7j | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VsnMMHs2sRRS3YrprXoaZn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Z28LzZmt53gPydK4AKgjou | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZAQj3HKrwwt23t97DSaUxt | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZxsdJpinGKYjo3eBYLysXe | Simulation Run 2026-08-16 21:10 | no transcript | — | |
i3xWshngHc8pqGyMbboNn2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
if6pzkcVRjK8XDh2QGVFqY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7W3HokuPwMXfKMVBPzvWpM | Test new prompt (Aug) | no transcript | — | |
DXkeGPjyXPwfwH2F7C9XkV | Test new prompt (Aug) | no transcript | — | |
UWPz9qixfU7FFxTpkNz5q2 | Test new prompt (Aug) | no transcript | — | |
ZUPewKNJDpQ3g5xMhHQozB | Test new prompt (Aug) | no transcript | — | |
fF2bisk7Ap8pqoRwAWh2yD | Test new prompt (Aug) | no transcript | — | |
9rw9EbQYL5xrnKhctrTM27 | RBI Bakeoff 2026-07-23 | YES | The agent took the full order and directed the customer to pull forward without escalation. | 1x Bacon & Cheese Chicken Sandwich Dinner |
Ww3CohFbakDE3KyDA6jXXQ | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
dZWBqozuh6FfioQvDYH5Aj | RBI Bakeoff | YES | Agent took full order and directed customer to pull forward without escalating. | 1x Classic Bacon & Cheese Chicken Sandwich |
BGpgSaxtpJzWzQdcjQ6Nbj | Simulation Run 2026-08-17 01:07 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
PCJwKfZSSVimoDx52otxkN | Simulation Run 2026-08-18 22:00 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | empty |
Order one classic chicken sandwich by itself. Do not ask for a combo. If the agent offers to make it a combo, accept and choose Cajun fries and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
JXnEp9qujCbh6geQjWq9V4 | RBI Bakeoff 2026-07-24 | NO | Agent did not complete the order; instead, said an employee will assist, indicating escalation. | 1x Classic Chicken Sandwich |
WZKZ9E5UsfcAu7uj9GEcbi | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent did not direct the customer to pull forward or next window; instead, they said an employee will assist (escalation). | 1x Classic Chicken Sandwich |
geBW2YKe6mJimzwqtzruwD | RBI Bakeoff 2026-07-24 | no transcript | — | |
2VUQhHov56gsoWs7tzUGJ8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7vuAfL5CacB4dv7d5ZQu3E | Simulation Run 2026-08-16 21:10 | no transcript | — | |
93a39Xh7duCou7h6AQqurK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DJBeyMK9pkRe5r2mL9LFvM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FeAwDVx76GhrszKgW535bL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
H35SVu6EnvF4jxGqQ6twzk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Xd4jVTyAj7FbCiaMWWdPkd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
epiKWZrNb9xCgkxYEmcyE2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gQ8NYUWMP3AvmzTx6qtGBL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jhvGx4saj7rNCd8Ypy9z4m | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BMvKJF5AbahmKvx47B5swp | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript lacks agent response showing order completion or directing to pull forward/next window. | empty |
XZp9U5hAitRHpyBafjBQGj | Test new prompt (Aug) | no transcript | — | |
e5sEDocw5PS2Hm5CevxmsD | Test new prompt (Aug) | no transcript | — | |
kNmrGGfsfw7oAjr7xobXVJ | Test new prompt (Aug) | no transcript | — | |
mkKLR6eqqgVW9Ue8UfgijR | Test new prompt (Aug) | no transcript | — | |
oLnvvYs2bPfrqMMvp7zroM | Test new prompt (Aug) | no transcript | — | |
FtTpc4gLzNsMtaYMCfaNXz | RBI Bakeoff 2026-07-23 | YES | The agent took the full order of one classic chicken sandwich and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
4g4RJAikMRtHcPVZimrpmt | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent took the full order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
hXGKzBZ39d66awYjRYqfxU | RBI Bakeoff | YES | Agent took the full order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
KRHwwCMuEp3M8sT6qEMp3s | RBI Bakeoff | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
JeLsJY55NF9gHPsEH4xyQz | Simulation Run 2026-08-18 22:00 | YES | Agent took the full order and directed customer to pull forward without escalation. | empty |
I'll do the 12-piece family meal with all dark meat, spicy, Cajun fries and cole slaw, and two Sprites.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
Aa75ZNaTSzeQPT5XvCUZJp | RBI Bakeoff | NO | Agent finalized order with quantity 2 for the meal, but customer only confirmed quantity 1, indicating order not fully captured correctly. | 2x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
ijpFLfBKPTvfZUoKPwi8cd | RBI Bakeoff | NO | Agent said 'An employee will assist you,' indicating escalation to a human team member. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
LWwkQ2E9r9BDPGXtVoxPqZ | RBI Bakeoff 2026-07-24 | no transcript | — | |
8kVCKYTodXCEMF9mXiiZvs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BWGMWAgQ2ofkSZCPFF3Lyf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FF4dVjdMzTJbxNbyJQPi6a | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KnkG5pYDW5LPcVdZToBvaP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LT8qV5HDxzEMRVxRGachVS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SH9YKbn5iTStmWpeAgbjxn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZhCpVBgBoYbSzwEMAHiHxB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aQRSuC45DX9Vfq4MBUCXF6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bBPsS3rY7HiNGZiZo8myWs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jVsB6fQcbWGNSFiMMWSSNz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YN4Bwz2PX3UCofiJtYm3iT | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript only shows customer's order request twice; no agent response or direction given. | empty |
93WgTrwsVSYCw22Pvxn7cL | Test new prompt (Aug) | no transcript | — | |
EYdCxJo7p8zAU3qYsVS5kP | Test new prompt (Aug) | no transcript | — | |
GWWB7Gv39bS5p9Kchmqqgh | Test new prompt (Aug) | no transcript | — | |
JDr2KK5CbVpHqfRMkCnZXK | Test new prompt (Aug) | no transcript | — | |
KWmpGso6QQ4VYuMiSSQ8vb | Test new prompt (Aug) | no transcript | — | |
Pa452mB5iiuQYEnFDJ3NFE | RBI Bakeoff 2026-07-23 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
e4FrMcXFL3aw4ZTpZbFi6B | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
Mze2wnsN9i9Dsv8vnWDQDs | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward, no escalation occurred. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
5MEHc7v34cuskYVa7xqeXM | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
2YxKqATEcRrQwjEqucrFmP | Simulation Run 2026-08-18 22:00 | YES | Agent fully captured order and directed customer to pull forward without escalation. | empty |
Start by ordering the 3-piece signature chicken combo, spicy, with mashed potatoes and a Coke. Before the order is finalized, change it to the 4-piece combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
bfsknDbidbtLyFnMTpqQpQ | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human team member, saying 'An employee will assist you.' | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
aYjcjDnj2iBZhGVtJKYfuZ | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent did not direct the customer to pull forward or next window after taking the order. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
gLnP4i8Wj8dRC553uZrVPp | RBI Bakeoff 2026-07-24 | no transcript | — | |
2xX7QtsT9gmyukewn6fYsP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
5SatxouArRGXHAdDoGKA8o | Simulation Run 2026-08-16 21:10 | no transcript | — | |
66TfhunEj2nKjAgT994UHa | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8iSGfUd5ndRcW389JDyraE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NsKmDTKmoqgNp8heNezxXP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
V7x7SNBGbWwHxJtkrsJmzG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WUabq72jzXHqRM2TTY3aeQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
d5XTF8DLqsrRpJGH9s33rz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dgWGPqbPbmHoMnq4SMVbuc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jHsks22S3wux2JuDvHAjZ3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
28RDWUs5srQxarCvXHB83H | Test new prompt (Aug) | no transcript | — | |
7YTig8f7FZVsGnVxAPQivZ | Test new prompt (Aug) | no transcript | — | |
DXqfYHYCeUZLNTkc37nZPE | Test new prompt (Aug) | no transcript | — | |
L4YotKqihMRrbCCB5SK6ay | Test new prompt (Aug) | no transcript | — | |
kM87ij7nSMxGYkpUMoYz5j | Test new prompt (Aug) | no transcript | — | |
KiVQ69x7ebhGtYksN8sXir | RBI Bakeoff 2026-07-24 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
mPkkW2NKozHLqXk8MPpcXZ | RBI Bakeoff | YES | The agent took the full order including modifications and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
DWEmQZiWjwJUqoV6vAGr3w | RBI Bakeoff | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
EgzfVaU9caQVG7Dqa5T4LA | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
b7bGcruCkCLJ3ZFNgcPid2 | Simulation Run 2026-08-17 01:07 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
PHc5FF4yMZgikrRU8GvVai | Simulation Run 2026-08-18 22:00 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | empty |
I'd like the 3-piece signature chicken combo, spicy. I don't want fries. What other sides do you have?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
4TCpZJ27NnzaAhPjNjb4DF | Simulation Run 2026-07-20 22:35 (scratch) | NO | Agent escalated to a human after failing to read back the full order to the customer. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Home |
dVLBd6tVWxX9ukcmkVZoLT | RBI Bakeoff 2026-07-24 | no transcript | — | |
3RbUjQzpvfujjktcwm73MA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8gAWFmyv7P4Nk5uCcZcQ9x | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WdkRDZjrfsMHb4XxZfmGsY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YPqj43LiXCH3nmggTgqLMJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cyehrJxgERQDxdmGdq5gLT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dcfaxDms6oDd3mGNvGJMEp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
erSztDDebw2VMM2g9qheps | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent taking the full order or directing the customer forward without escalation. | empty |
hgkgNLh7t5puyevUNeJZ7Y | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mgze3DLgZTEjscJBYbXrM6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ngGpWymMLJt5zML4dUpive | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hwgeuPGwkK7pFAQZbatkTF | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent taking the full order or directing the customer forward. | empty |
7BE6Xkd6qJ2Qo9GU7cvg4N | Test new prompt (Aug) | no transcript | — | |
8VKUHu7fpkovdyJki8LuST | Test new prompt (Aug) | no transcript | — | |
LXnEndCQYAe7SHB82pRk9F | Test new prompt (Aug) | no transcript | — | |
ZsKHvsbaqb6Go33HHMp8x4 | Test new prompt (Aug) | no transcript | — | |
bmq9crNzmGGocuGmXaMs8B | Test new prompt (Aug) | no transcript | — | |
BxuBdmLvS7UJ2b2SVfdhw2 | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Home |
2BAfuoRJRAPPViUAc3xZBK | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent took the full order, confirmed details, and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Home |
NhhVgaQNNiAZTjENdL7USr | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
4tkKcR79Xv8Q2THgwZ5UgA | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Red |
i8VMtDDuGky29NgVE2DddJ | RBI Bakeoff | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Home |
D778QGa7RxVyyTwbNoz2T2 | Simulation Run 2026-08-18 22:00 | YES | The agent captured the full order and directed the customer to pull forward without escalating. | empty |
Order five classic tenders by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose cole slaw and a Sprite.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
DL5ywZJmjcy29M5bSjw2em | RBI Bakeoff | NO | The agent ended up saying 'An employee will assist you,' indicating escalation to a human. | 1x 5 Piece Chicken Tenders Dinner (Classic, Blackened R |
W8g2zA9kUuMUhP7m9J5z3m | RBI Bakeoff 2026-07-24 | no transcript | — | |
4FVyuBz9ayJs9G5rRecwUC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RP4LL9jx8QqGVJuU5TwDmQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UJgRBDRMGBBfHRE7mwZY57 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UfUnb7QWoMH8B24SFuBDDg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eFDo3V297EUw4RgWFXtbBd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gs2D2HoBWMRxuhdcCnqY2A | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ivYpivcZkspSW5j3hcA5gs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
k9DQhVJV7Jdh9t5ymSPf26 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nVs3daWuacj7oqMsQaEU56 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
oAQ2YQgc8kewtwXWUjrFyx | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Qooj6pKBvZRXzRST5Fsb8x | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript lacks explicit agent confirmation of order completion or direction to pull forward/next window. | 1x 5 Piece Chicken Tenders (Classic) |
8Aipw359Mt5bXFvwzVZd6x | Test new prompt (Aug) | no transcript | — | |
Ay4oU4GCCJF6QZsP5Lx4pZ | Test new prompt (Aug) | no transcript | — | |
b9w5sS8N4dRmYD8cjZA6HA | Test new prompt (Aug) | no transcript | — | |
gYvkNwkNNB2SPBDSj4VazN | Test new prompt (Aug) | no transcript | — | |
ht45dgADx7mhbMMyXN383n | Test new prompt (Aug) | no transcript | — | |
BEmCfQTV4t8nYqGRFn45Zb | RBI Bakeoff 2026-07-23 | YES | The agent took the full order with specific sauces and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, B |
d9a4sxEo9oMCxLJ27uXFRN | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured order and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, B |
iAoRRUbEtYiD9HNxgCKTW3 | RBI Bakeoff 2026-07-24 | YES | The agent fully took the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, B |
XJftJiL9fNTPhdhpGJLLy4 | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, B |
5wD8RUc7hfmyMcCz9JFzv3 | Simulation Run 2026-07-20 22:35 (scratch) | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, B |
VSbaT7RWWmPmmPsTRfLMix | Simulation Run 2026-08-18 22:00 | YES | The agent took the full order and directed the customer to pull forward without escalating or handing off. | empty |
I'll do the chicken sandwich by itself and a side of fries.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
ngSqCHrPPi5xSAbutuPhf6 | RBI Bakeoff | NO | The agent said 'An employee will assist you,' indicating escalation to a human team member. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
b26S4pFBPUwcGzYsWfjBPw | RBI Bakeoff 2026-07-24 | no transcript | — | |
2XGqhbFepLE697hh9PAprf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8whJRTDS4HycMGuDH9Y5cH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Ck3qaxFqyUSQxFzST6dKLn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EBWso5gihHU5rt4AUYWB9X | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FW34WBBhhSaZxY2LU4FdHs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Hy3LpAeBV4Jb5BmVscU6kj | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Kq5MR2xJpT2wXQxjG2Yi6D | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WoLcCSP8DQeKzmrUq83Fhr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fx6EM2Nj9TE96kuGHEFbdK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kD4FtHqGhtMAh4gVtHFqmW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cfpf3CBB8hkCfCado8UqgC | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript ends without the agent confirming the order or directing the customer to pull forward or the next window. | empty |
UJrBCxK6dUomPjcg4q2bfY | Test new prompt (Aug) | no transcript | — | |
USavGt4CDu78NLmHkP68m5 | Test new prompt (Aug) | no transcript | — | |
Yw7kr4WDZeTWLDCjeyqPNT | Test new prompt (Aug) | no transcript | — | |
mhfmsVreWuY7ZLpm6KNTns | Test new prompt (Aug) | no transcript | — | |
oWkMtnDVe9oHdYLKHkqBSp | Test new prompt (Aug) | no transcript | — | |
LtHoynFkYyfV9MGUAermiA | RBI Bakeoff 2026-07-23 | YES | Agent fully captured the order and told customer to pull forward, no escalation occurred. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
Wbr8hX4JRNimoB7qiQqQeW | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
fz4RB4koHNiUtM4XXmeiw9 | RBI Bakeoff 2026-07-24 | YES | Agent fully captured the order and told the customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
j8nXNQG5hqcJfL5B6VvUh3 | RBI Bakeoff | YES | Agent fully captured the order and instructed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
keRzcA2oBbPjfWUmTJGHWD | Simulation Run 2026-07-20 22:35 (scratch) | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
3hxtBVxXQ2Lt3EBdvDMFei | Simulation Run 2026-08-18 22:00 | YES | Agent took full order, confirmed it with customer, and directed them to pull forward without escalation. | empty |
Can I get the ghost pepper sandwich combo, swap the fries for red beans & rice, and a Dr Pepper?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
caTZDR5Kiwee3YJBrQyx8f | Simulation Run 2026-08-17 01:07 | NO | The agent repeated the order but never directed the customer to pull forward or the next window. | empty |
NAf5ujvRovSHc6BaCuogqg | RBI Bakeoff 2026-07-24 | no transcript | — | |
4brYnmLBDPExULu466dHbr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BVayafGgjgNG6VtgtuXph7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DzAjdVCzguwjRJqomM5bQ9 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EZFWK5z2YgcbwXnZiyBqTo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
H89MUvRN494W8wFZxUrPK6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eJ9WcJShx3KyGFMX5BrkhF | Simulation Run 2026-08-16 21:10 | no transcript | — | |
g3ikTS3o3LuFM3CPzfRWKu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jsDFcx7sojgXq8SE4ru3ju | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jumo9PnLd2mFFigttWqjSV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ntFqUA6oj3vYu3fgPKjeAY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
34tywyEuMvLm9JZ3BXXj42 | Test new prompt (Aug) | no transcript | — | |
NQvt3rGRpHHTRg9Mn2EpY9 | Test new prompt (Aug) | no transcript | — | |
NcZYAgyMJ3BsprCfb89H62 | Test new prompt (Aug) | no transcript | — | |
U4wMtasoe2XR7B2JupymJX | Test new prompt (Aug) | no transcript | — | |
dkjuq9LBYFyGwwY6DqDSQF | Test new prompt (Aug) | no transcript | — | |
JeUNBfrF4vFwFRQ7qAVk5s | RBI Bakeoff 2026-07-23 | YES | Agent captured full order and directed customer to pull forward without escalation. | 1x 2 Piece Signature Chicken Regular Combo (Red Beans a |
f57y3RYkmWftBA4cPjXdDA | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
48aueucPa7gfSn6XUqMiaF | RBI Bakeoff 2026-07-24 | YES | The agent fully took the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
7rHpjY8683Z2nxLgzhqWQZ | RBI Bakeoff | YES | The agent took the full order with modifications and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
PQaJv8Hn5QqhFCDbwHm9Wg | RBI Bakeoff | YES | Agent fully captured the order, confirmed it, and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
GxcZFZmzczEWSCJU8FtE5K | Simulation Run 2026-07-20 22:35 (scratch) | YES | Agent fully captured the order and directed the customer to pull forward without escalating. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
U6njPhR4pt7mKKR2CbrZPr | Simulation Run 2026-08-18 22:00 | YES | The agent fully captured the order and directed the customer to pull forward without any escalation. | empty |
Can I have a Cajun Rice please?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
oDLsiRp4YJiwNvRECoCVzv | Simulation Run 2026-08-17 01:07 | NO | The agent did not fully capture the order or send the customer forward; there was no completion or direction given. | empty |
CxyrU7SosDAdLjuLCA7UZD | RBI Bakeoff 2026-07-24 | no transcript | — | |
4L89Y9ydDZcvHc6LU4BfDN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4gBpDDAKyFwF48qgsCJkV5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AefnyQUoZcDKXBWQrZMbpi | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AyZmRbRMeEdDd2an8AAYKg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
N9DH7xbsViZHcUdjDJZ684 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SG4r2EWLchmGA4monb2E3u | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VUTLhU9xXdf7NbFneyqSZm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eBZtdtVvGL5jiC7uXnykYu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hWKufRhBzCNn3Vhecy63HW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mqNt2UmZaR4rKHqWSY4na9 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9y8B324Spkh8g7zioxwbhQ | Test new prompt (Aug) | no transcript | — | |
dAzaHnt9ZZzvimfWQhEEKW | Test new prompt (Aug) | no transcript | — | |
gF8PYpfnwG2RCXp4TuF9eM | Test new prompt (Aug) | no transcript | — | |
ijMsBEhwD8ZoPGy6ezZzmP | Test new prompt (Aug) | no transcript | — | |
kT8LALiiSzuT4ejeoz55CF | Test new prompt (Aug) | no transcript | — | |
5oZ6JqGAu7UvYJTSWF4Zjr | RBI Bakeoff 2026-07-23 | YES | Agent took the full order, confirmed it, and directed the customer to pull forward without escalation. | 1x Red Beans & Rice |
G2GLCTidRaxD3mdzfrJHyv | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent took full order of regular red beans and rice and directed customer to pull forward, no escalation occurred. | 1x Red Beans & Rice |
6pPub76zPy4r5BfXV96MMT | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Red Beans & Rice |
EmsayGRTwtHAKjBDyGKQzV | RBI Bakeoff | YES | The agent captured the full order and instructed the customer to pull forward without escalating. | 1x Red Beans & Rice |
SBhsKMkHgZZq3A23ZuSiMr | RBI Bakeoff | YES | The agent fully captured the customer's order and directed them to pull forward without escalating. | 1x Red Beans & Rice |
Gu43roxrymbtp35rnMWSGC | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent fully captured the order (regular red beans and rice) and directed the customer to pull forward without escalation. | 1x Red Beans & Rice |
GByyweMBVisUM5Z6RQGWQc | Simulation Run 2026-08-18 22:00 | YES | Agent took the full order and directed customer to pull forward without escalation or handoff. | empty |
I'll take the 3-piece chicken combo, spicy, add a pie - make it the strawberry - and a premium strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
DufcMTUSxZzh6chKstEbiK | RBI Bakeoff 2026-07-24 | no transcript | — | |
G99GjLc5vk78ZyVwhhSAGb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
H66W5NNvgSAWA3s29wFZDr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LWKj8uwKQhg4PgyPVuFbbE | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent completing the order or directing the customer to pull forward. | empty |
Qd72LnvKoBtXSNNHdtdAUi | Simulation Run 2026-08-16 21:10 | no transcript | — | |
TDqv6ubt6gkttZ3SyYEQ8s | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UuBECmk88P4VhwWxWoXYyZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
by5Fsr4q6YPwVwdT2CKrDs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
c7aRCw9Fg5sBEDzuYWYuWh | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hBezFKepwKBCxPo8jGb5ky | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kzZnK9oeHxBTAL7UGRD4Wa | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JZUg3ANBkcDcze27geLUWx | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent taking the order or directing the customer to pull forward or next window. | empty |
3bgkVKrKpFSUMG6QYatSyh | Test new prompt (Aug) | UNKNOWN | The transcript does not show the agent confirming the order was complete nor directing the customer to pull forward or next window. | empty |
KcQ63zet7P6K7sTDnyANZR | Test new prompt (Aug) | no transcript | — | |
XBTAXmPGXQJGCG2j3WiACs | Test new prompt (Aug) | no transcript | — | |
kzZY9stheb5pyGvgP7TyR3 | Test new prompt (Aug) | no transcript | — | |
mo3PTuwZetD8XQpFhVZ7vM | Test new prompt (Aug) | no transcript | — | |
ngP4o6JWfmdynrCgW4jveH | RBI Bakeoff 2026-07-23 | YES | The agent captured the full order, confirmed accuracy, and directed the customer to pull forward, without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Chille |
KS2Uk4U7CFtJvjUozxRnVA | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
TD9oUYNCFp42RBNQnUG9vT | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Chille |
oMfLxNVXv5yjSUbEiQ2Fyu | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Chille |
Nmrp4zf4EjuW5qQaqQqN5P | RBI Bakeoff | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
Nf55EYohCNaK8uqrVEBJkb | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
ZNeP3dYoAe2Eo6iZBw6ngX | Simulation Run 2026-08-18 22:00 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | empty |
Can I get the Ghost Pepper Sandwich combo? Actually, change that to the regular chicken sandwich. And make it spicy.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
GF9jaGhFU6WqVW6baYf6dc | RBI Bakeoff 2026-07-24 | no transcript | — | |
47BBUMzQGNtfxh6AKzVGDJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DKTcf6zS85G7QidZAps6BX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Dtfszw6rYSpXdf4pVi3nUZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
K4S6vPWpTQ2UiwvRUsc4M6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SYwoCW89Q6xjVZJdkUfC7o | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UCA9vFQZ6mRkjLukJPZTSH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VGFyPfNS7StkqDnYU82BF5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cc89QzoWi2ZMMZTTPiSZmr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mdyALutAAdq97fuafpDmRh | Simulation Run 2026-08-16 21:10 | no transcript | — | |
o5D66tTWWgN4Kg2i6pR223 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
E4yV2p6cwu65zwjoPVN8d9 | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent capturing the order or directing the customer to pull forward or the next window. | empty |
5o6ygmaFDgJMpq6ntXCF7M | Test new prompt (Aug) | no transcript | — | |
6DWKeuB354QNrRZALDU3Jj | Test new prompt (Aug) | no transcript | — | |
KSv9vC5PiYxiRJivhyeqm4 | Test new prompt (Aug) | no transcript | — | |
bfieRjMQHZJpsiJPk6ng2B | Test new prompt (Aug) | no transcript | — | |
jiQ53jeHMSwpatJnNtgENQ | Test new prompt (Aug) | no transcript | — | |
ie6EoGQqDFLxY4gNhz2M2b | RBI Bakeoff 2026-07-23 | YES | Agent took the full order, confirmed it, and directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, S |
oGvvPS3ng4QadUpxyJNTVa | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
o6Y4RBZKUQxkjearchoaTd | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
QRCFZuDt6uqWahvXEoYRHG | RBI Bakeoff | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
bAJD39zjpfFAMpEu6bycVV | RBI Bakeoff | YES | The agent fully captured the order and instructed the customer to pull forward without involving a human. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, S |
kZcwUoTqp4Fa8Mh3LdZdvx | Simulation Run 2026-07-20 22:35 (scratch) | YES | Agent fully captured order and directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
bea3odasXQesxrHSAkj4yD | Simulation Run 2026-08-18 22:00 | YES | The agent fully took the order and directed the customer to pull forward without escalation. | empty |
I'd like the 5-piece tenders combo, blackened and spicy, with cole slaw and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
RnWupfxepxHmWmTCGP8irg | RBI Bakeoff 2026-07-24 | no transcript | — | |
4joHBHzVCnhGowZXeyisCt | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CRy8jodnLvnzmKzPHiR2c3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JNC9DTAYep6b7ChDjY8kGo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
W5tJpEqKMBZ2NhwvyyPJ6d | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YQqVoHqyNduCZjWcNnhnqv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZpLMJFZRovdf7fD5pAFNAA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bJgQ7hyggXC67zrnFjhfMB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cE9TjgiYuPB9cLDD5JwPxk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dJdJ4egKLbKvArCnU6FDHn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
g3XCRMqTN3jrfTjan2GyoZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HECJSN2CdNehn4Lnxc4q76 | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent directing the customer to pull forward or the next window after capturing the order. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
34zGZFKjE5gGYMEuDZZf3S | Test new prompt (Aug) | no transcript | — | |
PkmrVoEou5fjWcPyp47dgS | Test new prompt (Aug) | no transcript | — | |
Z8YfTTwWNveXgpABxTAiaX | Test new prompt (Aug) | no transcript | — | |
mL7wGR3AcXKFYPw2wg5LLT | Test new prompt (Aug) | no transcript | — | |
nVqSmKRCo4i9n9LnF5t3Uk | Test new prompt (Aug) | no transcript | — | |
jytcVYzGMRNEDkatxVj258 | RBI Bakeoff 2026-07-23 | YES | Order was fully captured with all details and customer was directed to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Bl |
WqRUiHDuErMJNfioqzYtPX | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent took full order including modifications, confirmed it, and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
Cw33ESyT2XpXR9KuqrgFGc | RBI Bakeoff 2026-07-24 | YES | Agent took full order, confirmed it with customer, and directed them to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Blackened, Spic |
HmKzYRYgeXpgtiUJiPPbii | RBI Bakeoff | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
Ga853Zy7tw7eRdhmyoHSWH | RBI Bakeoff | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
aRV3oxSWt3vskcNB7V93EE | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward with no escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
oYXvxn7bcHowJWDgPyNbfx | Simulation Run 2026-08-18 22:00 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | empty |