You are a confused customer who has difficulty understanding things the first time. You speak slowly and hesitantly, often pausing to think. You frequently ask clarifying questions like "What do you mean by that?" or "Can you explain that again?" You need things repeated or explained in simpler terms. You are not in a rush and appreciate patience from the agent.
Test case names jump to that scenario's conversations below.
Failures first within each scenario. Simulation IDs open the transcript in Coval. The judge note is Coval's written reason for the Completion verdict.
I'd like the 3-piece signature chicken combo, spicy. I don't want fries. What other sides do you have?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
dK3N54e8zzPiNL3ogV9C86 | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human employee instead of handling the order completion and directing the customer forward. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
LB6ffLaDwDY6TT8kfxopbE | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human team member instead of directing customer forward after order capture. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
J4cjT6KiECcC4g62tA6rNt | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human team member by telling customer to wait for an employee. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Home |
Wv4RCHMWgMa8kgEBzeUoGn | RBI Bakeoff | NO | The agent handed off the conversation to a human team member and did not direct the customer to the next window. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
mKjpWp6z3e9qNYs6CMuJhX | RBI Bakeoff | NO | Agent said 'An employee will assist you', indicating escalation to a human team member. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
YFvGEBuddEVN6bgrAV7Hqr | Simulation Run 2026-07-20 23:58 (scratch) | NO | The transcript shows the agent took the full order but never directed the customer to pull forward or the next window, and no final completion is indicated. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
Order three pieces of spicy signature chicken by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose mashed potatoes and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
Asx9YUMgKSYqkTy4hLk3jc | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human employee to verify the order, not completing fully independently. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
QPubfVoSBYUfYk9rqFYfUD | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent repeatedly directed the customer to wait for an employee to assist, indicating escalation to a human. | 1x 3 Piece Signature Chicken (Spicy) |
DYLBetiV8vEHwAaH2UBCo8 | RBI Bakeoff 2026-07-24 | NO | The agent did not complete the order independently and escalated to a human for order confirmation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
9GGx8tNJEkYCfgmpogVHd6 | RBI Bakeoff | NO | Agent confirmed that an employee will assist, indicating escalation and not directing customer forward independently. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
VLtEo3QDrZDNYiNFWhBkhx | RBI Bakeoff | NO | Agent escalated to a human after failing to confirm the full order and read it back to the customer. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
4SnkoqfEPqHkBSxvE8jfdA | Simulation Run 2026-07-20 23:58 (scratch) | NO | Agent escalated to a human by stating 'an employee will help confirm your order'. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
Order five classic tenders by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose cole slaw and a Sprite.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
aJXK9kY4z6Gzt3JofPpCJK | RBI Bakeoff 2026-07-23 | NO | Agent escalated to human by stating employee will assist and show order multiple times. | 1x 5 Piece Chicken Tenders (Classic, Bold BBQ, Wild Hon |
hMVpm7piEm8o97GEyry2r7 | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent escalated to a human by telling the customer to wait for an employee twice. | 1x 5 Piece Chicken Tenders (Classic, Buttermilk Ranch, |
QgP8Ei5SVhRViLvwgNf7na | RBI Bakeoff 2026-07-24 | NO | Agent escalated to employee/human team member several times, failing to complete order alone. | 1x 5 Piece Chicken Tenders (Classic, Bold BBQ, Wild Hon |
W9pZwBkwFwytgvgi4VNUws | RBI Bakeoff | NO | The agent escalated to a human multiple times instead of completing order and sending customer forward. | 1x 5 Piece Chicken Tenders Dinner (Classic, Buttermilk |
5YwXgKJS93LD3qDdUYQeQG | RBI Bakeoff | NO | Agent escalated to a human after customer was unsure about order confirmation. | 1x 5 Piece Chicken Tenders (Classic, Buttermilk Ranch, |
Ew4jR2jgJGfKHhbaKndg3q | Simulation Run 2026-07-20 23:58 (scratch) | NO | The agent confirmed the order but repeatedly directed the customer that an employee would assist, not to pull forward or the next window, indicating escalation to a human… | 1x 5 Piece Chicken Tenders (Classic, Buttermilk Ranch, |
One Ghost Pepper Sandwich, no combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
GLyBDb3nRcu4KYB4QUvLzf | Simulation Run 2026-07-09 23:02 (scratch) | unjudged | empty |
Can I get the ghost pepper sandwich combo, swap the fries for red beans & rice, and a Dr Pepper?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
TjjxcmYtRRX2LCQfWTXY7y | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human team member instead of directing the customer to pull forward/next window. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
XUxy4sitXjUaFtN3oreZXi | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent did not personally direct the customer to pull forward or the next window; they deferred to an employee for assistance instead. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
DAW2VgRz7pxmQRNYAU9gmq | RBI Bakeoff 2026-07-24 | NO | The agent escalated to a human team member instead of sending the customer to the next window. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
jEcAj9NrhDs3riLSHTXrEb | RBI Bakeoff | NO | Agent deferred order verification to an employee and did not direct customer to pull forward or the next window. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
CKEUUeoLkzmtkCTUvmzHrv | RBI Bakeoff | NO | Agent escalated to an employee instead of directing to pull forward without handoff. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
JpN8UucXq4jZZrkyoeRBZe | Simulation Run 2026-07-20 23:58 (scratch) | NO | The agent escalated to a human team member for order verification instead of directing the customer forward. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
Can I get the Ghost Pepper Sandwich combo? Actually, change that to the regular chicken sandwich. And make it spicy.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
6eg7w6t6PtehbHVa2rDS5G | RBI Bakeoff 2026-07-23 | NO | Agent completed order but escalated to a human employee instead of directing to next window. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
E6V2GyUPfksPUD5QyJX7f9 | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent stated 'An employee will assist you,' indicating escalation to a human team member. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, F |
VZ3rvexTSqRUk4cx9e2JKr | RBI Bakeoff 2026-07-24 | NO | The agent escalated to a human team member by stating "Employee will assist you." | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, F |
cJJwcB2Xo8ZJ9CffxQMeFF | RBI Bakeoff | NO | Agent escalated to a human team member instead of directing the customer to pull forward. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, S |
9abs7kYNdqnu4XL9fLSFjY | RBI Bakeoff | NO | The agent did not complete the order themselves and referred the customer to an employee to verify the order. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, U |
KU3yFrDNiWXiSisam8ribC | Simulation Run 2026-07-20 23:58 (scratch) | NO | The agent confirmed an employee will assist the customer, indicating escalation and not completing the order fully by themselves. | 1x Spicy Chicken Sandwich Large Combo (Homestyle Mac an |
Do you have nuggets?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
fUiciuyisjtRrP7SWSHem5 | RBI Bakeoff 2026-07-23 | NO | The agent never captured a full order nor directed the customer to pull forward or the next window. | empty |
PpRXgRg8xUNXRuyDNPdQNp | RBI Bakeoff 2026-07-24 | NO | Agent did not send customer forward but escalated to a human for order verification. | 1x 5 Piece Chicken Tenders Large Combo (Cajun Fries, Ma |
eR8WysDFpUfdiPbB3Vf4Z9 | RBI Bakeoff | NO | Agent did not direct customer to pull forward or the next window; instead, the order was escalated to a human employee. | 1x 5 Piece Chicken Tenders Large Combo (Homestyle Mac a |
fVbE7NSAVuRz7wpbnHZKg4 | RBI Bakeoff | NO | Agent took the full order but escalated to an employee instead of sending customer to the next window. | 1x 5 Piece Chicken Tenders (Classic, Buttermilk Ranch, |
aJdbzNF5dyQ7ew7Rt6o77X | Simulation Run 2026-07-20 23:58 (scratch) | NO | Agent escalated to an employee twice and did not finalize order direction to pull forward or next window. | 1x 5 Piece Chicken Tenders Regular Combo (Mashed Potato |
fz7LzFHUvzTivhpcSCGvi3 | RBI Bakeoff 2026-07-24 Pass 5 | no transcript | — |
I'd like the 5-piece tenders combo, blackened and spicy, with cole slaw and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
UwtUKyMr4Uv7SzvepffGYi | RBI Bakeoff 2026-07-23 | NO | The agent did not direct the customer to pull forward or the next window but instead escalated to a human employee. | 1x 5 Piece Chicken Tenders Large Combo (Mashed Potatoes |
e8fAsiH4mj2Jeyk39kVk8j | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human team member instead of directing customer to pull forward after taking order. | 1x 5 Piece Chicken Tenders Regular Combo (Spicy, Popeye |
SpwgTGgJtfpLo3bfRcV98L | RBI Bakeoff 2026-07-24 | NO | Agent stated 'Employee will assist you', indicating escalation to a human team member before directing the customer forward. | 1x 5 Piece Chicken Tenders Large Combo (Spicy, Coleslaw |
WuomVFj8gaUGwAxkRbDGPo | RBI Bakeoff | NO | The agent escalated to a human employee instead of sending the customer to the next window. | 1x 5 Piece Chicken Tenders Regular Combo (Spicy, Colesl |
74zFvHx89ADjtc24t8EbJ2 | RBI Bakeoff | NO | The agent escalated to a human team member due to customer's difficulty with the screen and lack of readback capability. | 1x 5 Piece Chicken Tenders Regular Combo (Spicy, Butter |
4vmACyDmpNjwJ3WeGfyT8W | Simulation Run 2026-07-20 23:58 (scratch) | NO | Agent escalated to a human employee instead of directing customer to the next window. | 1x 5 Piece Chicken Tenders Large Combo (Spicy, Blackene |
One bacon and cheese sandwich combo, large, with fries and strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
3Gk8orKbzA5BV2n5zCviSW | RBI Bakeoff 2026-07-23 | NO | Agent said 'They'll help with the rest there,' implying escalation to a human team member at the window. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
Hd4K9twCc2DKhhmgzBBS5r | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human by saying 'An employee will help you out.' | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
FkZVyG8dMZjUTwS2vvfrMT | RBI Bakeoff 2026-07-24 | NO | Agent did not direct the customer to pull forward or the next window and mentioned an employee will assist. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
2UuUTSrsH3NpXjq2WyYBPN | RBI Bakeoff | NO | Agent could not verify order alone and escalated to human for order verification. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
hrqcVzKKzAuLCD7cQbHvsu | RBI Bakeoff | NO | Agent confirmed full order but escalated by saying an employee will assist, indicating a handoff. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
6Tc9Pduphhy49fR6DA8RZ9 | Simulation Run 2026-07-20 23:58 (scratch) | NO | The agent did not complete the order fully by themselves and directed the customer to an employee to verify the order at the window. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
Order one classic chicken sandwich by itself. Do not ask for a combo. If the agent offers to make it a combo, accept and choose Cajun fries and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
PRm5JHAdsATEXt9vzrLNsS | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent escalated to a human employee instead of completing the order and directing the customer forward. | 1x Classic Chicken Sandwich |
hgZKp9n4D5DL6nEwcHyFVk | RBI Bakeoff 2026-07-24 | NO | The agent said 'Needed, an employee will assist you,' indicating escalation to a human. | 1x Classic Chicken Sandwich |
XfjUww9JTAV7umTVBa9kp8 | RBI Bakeoff | NO | The agent escalated to a human when they said an employee will help and couldn't read back the order. | 1x Classic Chicken Sandwich Large Combo (Cajun Fries, L |
AwvKmeip5xUE6Ku8XYL5Ss | RBI Bakeoff | NO | The agent escalated to a human by stating 'An employee will assist you' after the customer was confused. | 1x Classic Chicken Sandwich Large Combo (Cajun Fries, H |
3SpUmxFtWkNmfrVGy4ugMc | Simulation Run 2026-07-20 23:58 (scratch) | NO | Agent did not complete order or direct customer to next window; escalated to human multiple times. | 1x Classic Chicken Sandwich |
Qav57qCG62AGo7DAEHMFyE | RBI Bakeoff 2026-07-23 | YES | Agent captured full order (classic chicken sandwich only) and directed customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
Give me the chicken wrap bundle with a mango lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
FeJGVYpvtJSPDkvusGDKcL | RBI Bakeoff 2026-07-23 | NO | Agent did not read back the full order and stated they would get an employee if there was an issue, indicating escalation readiness. | 1x Classic Wrap (Blackened Ranch); 1x Blackened Wrap |
gnccFiCe9F9C8VQ6jA6yED | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human by saying 'An employee will assist you' and did not send customer forward. | 1x Wraps Bundle (Classic Wrap); 1x Chilled Mango Cane S |
gkdH6qwuHfy3vdY5xcWA2n | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human and did not direct customer to pull forward after taking full order. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade); |
BSX6PyD4bzRqBnteziKYd2 | RBI Bakeoff | NO | Agent escalated to a human by saying 'An employee will assist you' after order confirmation. | 1x Wraps Bundle (Frozen Mango Cane Sweeeet Lemonade, Cl |
XBZqEjfZT7hDDYe2vMihAF | Simulation Run 2026-07-20 23:58 (scratch) | NO | The agent stated an employee would assist the customer, indicating escalation to a human team member. | 1x Classic Wrap (Blackened Ranch); 1x Blackened Wrap (C |
kPAGi7ZKYeAoeK4NqZWCw5 | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Wraps Bundle (Classic Wrap, Frozen Mango Cane Sweeee |
I'll take the 3-piece chicken combo, spicy, add a pie - make it the strawberry - and a premium strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
epoQWeYNDmjC3Gse9oeJYy | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human team member instead of directing the customer to pull forward or the next window. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Frozen |
WZvFqdzX8MgQ3mR3ZwsNyT | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human employee instead of directing customer to next window. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Cajun |
7PqsQy33jkUtLJLdXrUejB | RBI Bakeoff 2026-07-24 | NO | Agent did not direct customer to pull forward or next window; instead, escalated to employee assistance repeatedly. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Caju |
YqokBfEmpFhzgBTLzTzS2h | RBI Bakeoff | NO | Agent escalated to a human after confirming the order and did not direct customer to next window. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
kTjNxAfKhusVctJyf4q9kJ | Simulation Run 2026-07-20 23:58 (scratch) | NO | The agent did not complete the order or send the customer forward, instead escalating to a human team member. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
W4bMDgukWddMCUECT2mf2e | RBI Bakeoff | YES | Agent captured the full order including combo, sides, drink, and dessert, then directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
Start by ordering the 3-piece signature chicken combo, spicy, with mashed potatoes and a Coke. Before the order is finalized, change it to the 4-piece combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
ivSfUBZH62B9JkPj6uqA6i | RBI Bakeoff 2026-07-23 | NO | The agent escalated to a human when unable to read back the order, failing to complete the order themselves. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
H4CEnJMgJGMbWUhqcDY8oy | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent did not direct customer to pull forward or next window; agent said an employee will assist. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
Cv6ntf7S6DBbDMridUjAnQ | RBI Bakeoff 2026-07-24 | NO | The agent escalated to a human team member by stating an employee will assist the customer. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
VrcVPMjJrWbupJcaP7aaG5 | RBI Bakeoff | NO | Agent failed to read back the full order and escalated by stating an employee would assist the customer. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
4CvpfNuPbmu9TWKNHxr8CN | RBI Bakeoff | YES | Agent captured full order details and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
QFgpqb6fjV6iN6NPkcepkj | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order and explicitly directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
I'll do the 12-piece family meal with all dark meat, spicy, Cajun fries and cole slaw, and two Sprites.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
gcBxKdKezj9icqwZ9ULgVa | RBI Bakeoff 2026-07-23 | NO | Agent confirmed need for employee to verify order and did not direct customer to next window. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
gAaq6cqqSe8rHyieAu362B | RBI Bakeoff 2026-07-24 | NO | Agent confirmed the order but then escalated to a human by saying an employee will assist. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
9uMoNS5CfY3CjB8WtgdRt4 | RBI Bakeoff | NO | The agent handed off the conversation to a human employee instead of directing the customer to pull forward or the next window. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
T6rgPekfobFAmsQBWCBxTd | RBI Bakeoff | NO | Agent escalated to a human employee instead of sending the customer forward alone. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
HeyDLtQgNU6XQvTNJMbTgB | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured the order with details, confirmed accuracy, and directed customer to pull forward without escalating. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
KRnJAtpzsHwRc2fE47Avbw | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent captured the full order including modifications and drinks, then instructed the customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
Order one regular bacon and cheese sandwich by itself. Do not ask for a combo or a large. If the agent first offers to make it a regular combo, accept with fries and a Coke, then accept a subsequent l
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
nTkD7j9LoGmL3zZUutC84V | RBI Bakeoff 2026-07-23 | NO | Agent did not direct customer to pull forward/next window; escalated to human assistance multiple times. | 1x Classic Bacon & Cheese Chicken Sandwich |
GmvGqeibX3osryxqXAWXyV | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human team member to help verify the order, not sending the customer forward directly. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
MKqfVcdheNqT3RJyw8Hd5e | RBI Bakeoff | NO | Agent did not direct customer to pull forward or the next window and repeatedly stated an employee would assist. | 1x Classic Bacon & Cheese Chicken Sandwich |
LTRWCBq3wv2EgeQTFXGp3c | RBI Bakeoff | NO | Agent escalated to a human multiple times, failing to direct customer to pull forward without handoff. | 1x Classic Bacon & Cheese Chicken Sandwich |
UcHTVamzF24rLvbN6TquBu | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order for a classic bacon and cheese sandwich and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
VigAUVSL5StPBWHbMw9Ehj | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
Can I have a Cajun Rice please?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
8YVTFJAS5xUxQBRSBpCTZj | RBI Bakeoff 2026-07-23 | NO | The agent escalated to a human employee to verify the order and assist the customer, not directing them to the next window alone. | 1x Red Beans & Rice |
75NkfSQrS7ozRZzwQk4myT | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human employee rather than completing order and directing customer forward. | 1x Red Beans & Rice |
QFMkoURoxz9exh4rPo7TcH | RBI Bakeoff 2026-07-24 | NO | The agent did not direct the customer to pull forward or the next window, but said 'An employee will assist you,' implying escalation to a human team member. | 1x Red Beans & Rice |
PzTsXLDVHzca7EpHfXkzrX | RBI Bakeoff | NO | Agent escalated to a human employee instead of directing customer to next window after order was captured. | 1x Red Beans & Rice |
friVsaj8bnB4e4eTNVVuKo | RBI Bakeoff | YES | The agent captured the full order for regular red beans and rice and directed the customer to pull forward to the window without escalating. | 1x Red Beans & Rice |
SKCYNLcahTS5MKg3ZS3xaF | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order for regular red beans and rice and directed the customer to pull forward without escalation. | 1x Red Beans & Rice |
One Ghost Pepper Sandwich, no combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
ThUWxTDBaQaBGVCML7VD8K | RBI Bakeoff 2026-07-24 | NO | The agent could not read back the order and directed the customer to wait for an employee, indicating escalation. | 1x Spicy Chicken Sandwich |
VgtP3jki2aueVB5Ue7Zzqc | Simulation Run 2026-07-20 23:58 (scratch) | NO | Agent escalated to a human by saying 'Employee will assist you' and instructing customer to wait for assistance. | 1x Spicy Chicken Sandwich |
eZHPbumWD4pAAeQ9u4jvQT | RBI Bakeoff 2026-07-23 | YES | The agent took the customer's full order and directed them to pull forward and pay at the window without escalation. | 1x Spicy Chicken Sandwich |
ejEaNvkemf8pdBVjtBEyPM | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent took the full order and directed the customer to pull forward without escalate or handoff. | 1x Spicy Chicken Sandwich |
GCuN9rZVbtycJ8DprTZAvs | RBI Bakeoff | YES | The agent fully captured the customer's order and directed them to pull forward without escalation. | 1x Spicy Chicken Sandwich |
6sWEjh7FspjJYw9HivFY8n | RBI Bakeoff | YES | Agent captured the full order (Spicy Chicken Sandwich) and directed customer to pull forward to the window without escalation. | 1x Spicy Chicken Sandwich |
I'll do the chicken sandwich by itself and a side of fries.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
NwycfGcSndNBdDkm3VTrRT | RBI Bakeoff 2026-07-24 | NO | The agent escalated to a human by stating 'An employee will assist you' and directing the customer to wait, not sending them to the next window. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
T6iatXuXt49gvSSBL3hA2k | RBI Bakeoff | NO | The agent escalated to a human employee instead of directing the customer forward after taking the full order. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
hnTT5eax2FUyfywdkJa6cy | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
9w6G3LxstM9cndf6yyZiE8 | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich Dinner (Cajun Fries) |
EMB7NtBZHHGVLqEawnoCYT | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward to the window without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
QEMjDn7X3YxLiUbd5US4Fc | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully took the order for a chicken sandwich and regular fries, confirmed with the customer, and directed them to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |