You are calling from a noisy cafe. Speak normally, occasionally ask the agent to repeat themselves, and continue the task despite background noise.
Test case names jump to that scenario's conversations below.
Failures first within each scenario. Simulation IDs open the transcript in Coval. The judge note is Coval's written reason for the Completion verdict.
Can I get the ghost pepper sandwich combo, swap the fries for red beans & rice, and a Dr Pepper?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
NLjXC6xUwcKMwrjkq8rvZg | RBI Bakeoff 2026-07-23 | NO | The agent escalated to a human team member instead of directing the customer to pull forward/next window. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
3SaGtVLsRP8kTrk5LSgoJx | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent escalated to a human team member instead of directing the customer to pull forward. | 1x Classic Chicken Sandwich Regular Combo (Red Beans an |
3y9pLtRVwbCnZM6j7DsRvr | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human employee instead of completing order and directing customer. | 1x Classic Chicken Sandwich Regular Combo (Red Beans an |
VpEhXmZd2WD9KMig6jCata | RBI Bakeoff | NO | Agent escalated to a human by saying an employee will assist the customer. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
7UnjnrisqzeUZeij2Gowka | RBI Bakeoff | NO | The agent escalated to a human by stating an employee will assist the customer instead of directing them to the next window. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
YAQnxFtpHymC7aW6ozHXty | Simulation Run 2026-07-20 22:35 (scratch) | NO | Agent escalated to a human after capturing the order, failing to direct customer to next window. | 1x Classic Chicken Sandwich Regular Combo (Red Beans an |
6akFRK2wFp3urb8YcdN8C7 | RBI Bakeoff 2026-07-24 | no transcript | — |
Give me the chicken wrap bundle with a mango lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
CBEEirBHpsjP2eU2U3o93h | RBI Bakeoff 2026-07-23 | NO | Agent did not read back the full order and escalated to an employee for help at the window. | 1x Wraps Bundle (Classic Wrap, Chilled Mango Cane Sweee |
eXAYEabZ3itcF9tLeq8EbB | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent did not hand off the order to the customer or direct them to pull forward; instead, they escalated to a human team member. | 1x Classic Wrap Regular Combo (Frozen Mango Cane Sweeee |
KqzqVKWVgZbcHddt4h5op2 | RBI Bakeoff 2026-07-24 | NO | The agent escalated to a human by stating an employee will assist and did not direct the customer to pull forward the next window. | 1x Blackened Wrap Regular Combo (Chilled Mango Cane Swe |
mATKcFXWFJSQ2joM7szPeR | RBI Bakeoff | NO | The agent escalated to a human team member and did not direct the customer to pull forward or the next window. | 1x Classic Wrap Regular Combo (Chilled Mango Cane Sweee |
keSy3A89wUNBFZnCb6DvHC | RBI Bakeoff | NO | Agent failed to read back order and escalated to a human team member for assistance. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, S |
RXzR5GTkX6cRhrHWxXUpJ8 | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent escalated the order to an employee instead of directing the customer to the next window after capturing the full order. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
8WytQco6XtFB8useKCVkGu | RBI Bakeoff 2026-07-24 | no transcript | — |
I'll do the 12-piece family meal with all dark meat, spicy, Cajun fries and cole slaw, and two Sprites.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
d38JwXfGV8m4eSCeGYg7ej | RBI Bakeoff 2026-07-23 | NO | Agent handed off the order to an employee without completing the order or directing to next window. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
Yjix2w235JdGhEzKJYqozh | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent did not complete the order and escalated to a human team member for assistance. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
eVoZJ2k3ADn6gJUVH9jnFr | RBI Bakeoff 2026-07-24 | NO | Agent acknowledged the order but repeatedly stated 'An employee will assist you' without completing or directing to next window. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
RzEBqkUfeDztAQvbw4BFau | RBI Bakeoff | NO | The agent escalated to a human team member instead of completing the order and sending the customer forward. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
NWCrzEHgKjCGMAdjyjPZwN | RBI Bakeoff | NO | Agent escalated the conversation to a human employee instead of directing customer forward after full order. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
3EpWjrBh2776hkqoaueN6b | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent failed to read back the full order and escalated to a human employee to assist the customer. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
iWVJV74GXtMbbaSPKx9gCA | RBI Bakeoff 2026-07-24 | no transcript | — | |
7StUTEpM6PJtNj56x9apLM | RBI Bakeoff | no transcript | — |
I'll take the 3-piece chicken combo, spicy, add a pie - make it the strawberry - and a premium strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
oRuGKRzL7fpp7SSTKeiGTv | RBI Bakeoff 2026-07-23 | NO | The agent escalated to a human team member instead of directing the customer to pull forward after taking the full order. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
4qoqeRvqXxvXaXfaGYu72w | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human employee to verify the order instead of completing it themself. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
Vcfuk2qGAUPkfzBVr7rzhM | RBI Bakeoff 2026-07-24 | NO | The agent said 'An employee will assist you,' indicating escalation to a human team member. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Cajun |
H6CEFryaPHpnMgBci2cCUS | RBI Bakeoff | NO | Agent repeatedly stated an employee would assist, indicating escalation to a human team member. | 1x 3 Piece Chicken Tenders Large Combo (Spicy, Cajun Fr |
KTnXSSmhHgm2FBn5RWda9b | RBI Bakeoff | NO | The agent escalated the conversation to a human team member instead of directing the customer to pull forward. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
Ec2mvkEkd3V9qyv6EnBC4u | Simulation Run 2026-07-20 22:35 (scratch) | NO | Agent escalated to a human team member instead of directing customer forward after order was taken. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
D3EiwTEGyFFvQK4wNxZBTS | RBI Bakeoff 2026-07-24 | no transcript | — |
Can I get the Ghost Pepper Sandwich combo? Actually, change that to the regular chicken sandwich. And make it spicy.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
HWp5Z9uf3TVrycno7xTDZc | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human team member instead of directing the customer forward after order capture. | 1x Classic Chicken Sandwich Regular Combo (Sprite, Caju |
nS7mcFHExuLw5NgQg9RGPt | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated the order to a human by stating 'An employee will assist you'. | 1x Classic Chicken Sandwich Regular Combo (Cajun Fries, |
ioabvvTQRYLMJ6NDqhFuFk | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human by stating an employee will assist multiple times, not directing to next window. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
ZfKNoYJYMZtMeV5w4n7zPe | RBI Bakeoff | NO | The agent escalated to a human by stating an employee will assist the customer. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
k9mqx7ZKBVkgV8qZzArXLx | RBI Bakeoff | NO | Agent escalated to a human employee for order verification instead of directing customer forward. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
CLAK7gg5BC88vwXvdasykw | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent escalated to a human team member by stating 'An employee will assist you.' | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
FuVCMszxLLikoWVbJ32tbm | RBI Bakeoff 2026-07-24 | no transcript | — | |
Hy3y56UqwtXEG2AHT5oReV | RBI Bakeoff | no transcript | — |
I'd like the 5-piece tenders combo, blackened and spicy, with cole slaw and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
GDdscBKN8GGRAgoBL33EAt | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human team member instead of completing and sending the customer forward. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
KeKzCMmU5amUMFuadNnJf8 | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human team member instead of directing the customer to the next window. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
nqY9PGpmHuA8GpnsDCW2mk | RBI Bakeoff 2026-07-24 | NO | The agent escalated to a human by stating an employee will assist and did not complete the order by reading it back or directing to the next window. | 1x 5 Piece Chicken Tenders Large Combo (Blackened, Spic |
ES4AbgQErFhtU4jaUSqjnw | RBI Bakeoff | NO | The agent did not complete the order by directing the customer to pull forward; instead, they escalated to a human team member. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
jPRbyGcw8gQt8skjXT6aDv | RBI Bakeoff | NO | Agent said 'An employee will assist you,' indicating escalation to a human team member. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
Y2bYP2byJv6aNcuZAjpK2x | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent escalated to a human by stating 'An employee will assist you,' failing to complete the order fully by itself. | 1x 5 Piece Chicken Tenders Regular Combo (Spicy, Colesl |
kzbo4VdE4cWZ5VLCYRUuVx | RBI Bakeoff 2026-07-24 | no transcript | — |
One bacon and cheese sandwich combo, large, with fries and strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
XgLnW2UXfUEZfSVc4rgiiV | RBI Bakeoff 2026-07-23 | NO | Agent failed to complete order by reading back and escalated to a human for verification. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
6uAFrjmVpsJTtE4xgyWtAt | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human team member to assist the customer. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
SE5RMKsnTaikxh9LZRx8tx | RBI Bakeoff 2026-07-24 | NO | Agent confirmed the order but ultimately escalated to a human team member for assistance. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
arHoPtSc6LjtGJFM7pN5FP | RBI Bakeoff | NO | The agent handed off the order verification to an employee and did not complete the order themselves. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
FqH3qVKCzFJPCH4BfZ3mJa | RBI Bakeoff | NO | Agent did not direct the customer to pull forward or the next window after capturing the order. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
LU9oMb6vCre8kGo25z9gfQ | Simulation Run 2026-07-20 22:35 (scratch) | NO | Agent did not direct the customer to pull forward; handed off to a human instead. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
7xUt84iigH3KpyhWjYLQyx | RBI Bakeoff 2026-07-24 | no transcript | — | |
QnMj39LHr65qrS3LjQrHxv | RBI Bakeoff | no transcript | — |
Order three pieces of spicy signature chicken by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose mashed potatoes and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
k6kUM8L9g2r497JbTsn7zB | RBI Bakeoff 2026-07-23 | NO | Agent did not complete the full order or direct customer forward; escalated to human multiple times. | 1x 3 Piece Signature Chicken (Spicy) |
k5ohHLk6d2Xz6jCAMoWRLw | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent failed to complete the order and repeatedly escalated to a human team member for assistance. | 1x 3 Piece Signature Chicken (Spicy) |
bUHjUf55YWD4kVnFscnYBu | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human by saying 'An employee will assist you' instead of directing to the next window. | 1x 3 Piece Signature Chicken (Spicy) |
9a3rqyokoB6RVFUhEEtYWb | RBI Bakeoff | NO | Agent failed to read back the order and escalated to a human employee for assistance. | 1x 3 Piece Signature Chicken (Spicy) |
GrHVB3hdUUfLCPqcqHzSvu | RBI Bakeoff | NO | Agent does not send customer to pull forward or next window; no direction given after order confirmation. | 1x 3 Piece Signature Chicken (Spicy) |
D5LMwCHMEEBooTLMxkDGZh | RBI Bakeoff 2026-07-24 | no transcript | — | |
SRVUPWW5q2Y2GojCinUiN8 | RBI Bakeoff | no transcript | — | |
TDNMh5SYhwSjDZosSHbq2g | Simulation Run 2026-07-20 22:35 (scratch) | YES | Agent captured the full order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken (Spicy) |
Order five classic tenders by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose cole slaw and a Sprite.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
Yuxnqthq92An6aRD7qDZi9 | RBI Bakeoff 2026-07-23 | NO | The agent handed off to a human team member instead of directing the customer forward after taking the order. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, S |
FCsSvzxhUjbH8NE9aUf6PA | RBI Bakeoff 2026-07-24 | NO | The agent captured the order but repeatedly escalated to a human and did not complete the order or direct the customer forward. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, B |
fR3UFvDYs5cu58qKVXo5Dz | RBI Bakeoff | NO | Agent escalated to a human team member instead of directing customer forward after capturing order. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, B |
GM669tmg5Yb3GjGj4BFJoZ | RBI Bakeoff | NO | The agent did not direct the customer to pull forward; instead, they said 'An employee will help confirm your order,' indicating escalation to a human. | 1x 5 Piece Chicken Tenders Regular Combo (Classic, Cole |
FTyhXQuvs8NaSroBM9xt8V | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent escalated the order to a human team member and did not complete or direct the customer forward. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, B |
cqxDD3CFCKkGgh2vxrGYEY | RBI Bakeoff 2026-07-24 | no transcript | — | |
B8pAiaozxttr9kKre6fiF5 | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Classic, Colesl |
I'll do the chicken sandwich by itself and a side of fries.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
Qq8tZc6eRtDyuztZnTVXSn | RBI Bakeoff 2026-07-23 | NO | The agent did not direct the customer to pull forward or the next window and escalated to a human by stating an employee will assist them. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
L4GyZJj6ZjLeJxsim2cpV9 | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to an employee assisting the customer in person, not directing to next window. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
AfMPfPAxKpZfLmPK2mVHzL | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human employee instead of completing the order and directing customer forward. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
ZkrjYEE4TGcxihZfidJbqg | RBI Bakeoff | NO | The agent confirmed the full order but escalated to a human employee instead of directing the customer to the next window. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
aefxgEeVHzzRAjZSfmqSCu | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent handed off the order to an employee instead of directing the customer to pull forward. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
WNL2a7eSFHQez8CSLPiTKu | RBI Bakeoff 2026-07-24 | no transcript | — | |
AbbdC3X3FTVkrJvwSbjvDg | RBI Bakeoff | YES | The agent fully captured the order, confirmed it, and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
Can I have a Cajun Rice please?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
cUxzVrmoXHDaKHzpe78iPr | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human by saying 'An employee will assist you' after order was taken. | 1x Red Beans & Rice; 1x Chilled Apple Cranberry Cane Sw |
5fcyfbcdGdE9F9j46pEUCX | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent confirmed order but said 'An employee will assist you,' indicating escalation to a human. | 1x Red Beans & Rice |
WokERmgWVuSkgfXEKb7qxZ | RBI Bakeoff | NO | Agent escalated by stating 'An employee will assist you' instead of completing the order and directing customer to next window. | 1x Red Beans & Rice; 1x Bottled Water |
Kvrczp74hr5BwtEUHT68N8 | RBI Bakeoff | NO | Agent escalated to a human employee to verify the order and assist the customer. | 1x Red Beans & Rice |
FWqaWFgptv7zmAa8uknYoE | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent escalated the interaction by saying 'An employee will assist you,' indicating a handoff to a human team member. | 1x Red Beans & Rice |
TeQZL7tFNrYdCVZceXrQKA | RBI Bakeoff 2026-07-24 | no transcript | — | |
VWgyRuuirTxwy9xaaqtNCt | RBI Bakeoff | no transcript | — | |
5VsT66PxKJr4ipeXrY6viw | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order for regular red beans and rice and directed the customer to pull forward to the window without escalation. | 1x Red Beans & Rice |
Do you have nuggets?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
nwGvD3EduoTJb7ZjnvKYrC | RBI Bakeoff 2026-07-23 | NO | The agent escalated to a human and did not complete the order fully by themselves. | 1x 3 Piece Chicken Tenders Regular Combo (Buttermilk Ra |
GLviFybjdbEqXkTg2p2LyC | RBI Bakeoff 2026-07-24 | NO | The agent escalated to a human employee after the customer requested order confirmation. | 1x Blackened Ranch Sauce |
ToRACtz5RohZUNmaJTP4gn | RBI Bakeoff | NO | Agent states 'I can help at the window. Employee will assist you,' indicating a handoff to a human team member. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened Ran |
UVwUpUu2GC6QXwEiJEXLPS | RBI Bakeoff | NO | Agent completed order but escalated by saying 'An employee will assist you,' not directing customer to pull forward or next window. | 1x 3 Piece Chicken Tenders Large Combo (Buttermilk Ranc |
EPBxn4wouWkdhJCHBGbDsb | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent escalated to a human team member instead of directing to next window after full order capture. | 1x 5 Piece Chicken Tenders Large Combo (Spicy, Cajun Fr |
fqTi6zexLAw8qv7yWtwxex | RBI Bakeoff 2026-07-24 | no transcript | — | |
DKBeLmmWaygnoJSNRtxPq3 | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent took full order, confirmed accuracy, and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Spicy, Blackened Ranch, Swe |
I'd like the 3-piece signature chicken combo, spicy. I don't want fries. What other sides do you have?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
ADJAea7YnVHnv2oHsuGmm8 | RBI Bakeoff 2026-07-23 | NO | The agent escalated to a human by saying an employee will assist you after order confirmation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
6mVEWpDDnpM8KL5yk6NWLJ | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to an employee instead of completing order and directing customer forward. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
LoxJ2uUjKXdLmZy4dKDPJZ | RBI Bakeoff | NO | The agent escalated to a human by saying 'An employee will assist you.' | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
dDaBqKVWpWhxjg4wuYsLt6 | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent did not confirm the full order by reading it back and escalated to a human team member for assistance. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
j4ik46wcfJ5E3Jn36LeaxR | RBI Bakeoff 2026-07-24 | no transcript | — | |
ibUgeAoGBTcrZ4uhwwjGxb | RBI Bakeoff 2026-07-24 | YES | The agent took the full order including sides and drink, confirmed it, and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
cWvSe6PHzLnKstf2M9p4zy | RBI Bakeoff | YES | Agent took full order including combo, side, and drink, then directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
One Ghost Pepper Sandwich, no combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
CjvFS7wBFgM3xmgNxJm3V6 | RBI Bakeoff 2026-07-23 | NO | The agent handed off the order to an employee instead of directing the customer to pull forward. | 1x Spicy Chicken Sandwich |
h8zgnCK3dM97RusuBrWhdF | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent escalated to a human team member for order verification instead of directing the customer to the next window. | 1x Spicy Chicken Sandwich |
jTR228Lcah4bspPLWu5GXQ | RBI Bakeoff | NO | The agent repeatedly deferred to an employee for assistance and did not take the full order or direct the customer forward. | empty |
4STd2TwmSrDXXvQBLsUt69 | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent escalated by saying 'An employee will assist you' instead of directing to next window. | 1x Spicy Chicken Sandwich |
gmMFQYycZq79iwdAT2Gm36 | RBI Bakeoff 2026-07-24 | no transcript | — | |
cJrNNWTcXvw2wNPCjhLf3B | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x Spicy Chicken Sandwich |
5tw9jhnH7xHPX3P8xsougq | RBI Bakeoff | YES | Agent fully captured the order for a spicy chicken sandwich and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
Order one regular bacon and cheese sandwich by itself. Do not ask for a combo or a large. If the agent first offers to make it a regular combo, accept with fries and a Coke, then accept a subsequent l
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
kvTzF8YZ4zsVTM6PwkFjRw | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human team member saying an employee will assist the customer. | 1x Classic Bacon & Cheese Chicken Sandwich |
6JnfFnqBvcaH6B8677qnJb | RBI Bakeoff | NO | The agent escalated the conversation to an employee multiple times instead of directing the customer forward. | 1x Bacon & Cheese Chicken Sandwich Dinner |
Ve9dW96wYTHsLEeHoW7h7N | RBI Bakeoff | NO | The agent escalated the conversation to a human by stating 'An employee will assist you.' | 1x Classic Bacon & Cheese Chicken Sandwich |
Tci8mrjUCaEz93gDFpELaz | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent escalated to a human team member to assist the customer instead of directing to the next window. | 1x Bacon & Cheese Chicken Sandwich Dinner |
ZuofybFD9N6A6sHai5pkJD | RBI Bakeoff 2026-07-24 | no transcript | — | |
VbDSFHAi3pg3t3iCoPPE3M | RBI Bakeoff | no transcript | — | |
Dg3BBZRck7m8mvr6tLVp8U | RBI Bakeoff 2026-07-23 | YES | Agent captured full order, confirmed it with customer, and directed to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
KnGqVrAC4ALZ9YFdCWWzEY | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent captured the full order and directed customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
Order one classic chicken sandwich by itself. Do not ask for a combo. If the agent offers to make it a combo, accept and choose Cajun fries and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
V6hq4NdxWXGRJ5fdMQsKz2 | RBI Bakeoff 2026-07-23 | NO | The agent escalated to a human by saying 'An employee will assist you.' | 1x Classic Chicken Sandwich |
ehMiTJQScTek2aCa8dnWxi | RBI Bakeoff | NO | The agent escalated to a human team member instead of completing the order and directing the customer forward. | 1x Classic Chicken Sandwich |
aNEcZgFv6ECc9SBTEBPpue | RBI Bakeoff | NO | The agent escalated to a human team member multiple times instead of completing the order and directing the customer forward. | 1x Classic Chicken Sandwich |
WA57gZZLiPfyRtE3hVNEn7 | RBI Bakeoff 2026-07-24 | no transcript | — | |
SP5YaJTZmh86LUZCoHHX5v | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order (one classic chicken sandwich) and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
b5kYwDLp2uC3CQL68YLb4b | RBI Bakeoff 2026-07-24 | YES | Agent captured full order and directed customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
oABt4EHn82uLh4f8bCp43f | Simulation Run 2026-07-20 22:35 (scratch) | YES | Agent fully captured the order and directed the customer to pull forward without escalating to a human. | 1x Classic Chicken Sandwich |
Start by ordering the 3-piece signature chicken combo, spicy, with mashed potatoes and a Coke. Before the order is finalized, change it to the 4-piece combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
fTNX6Sv3PcikQSoHDN5vXL | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human by saying "An employee will assist you." | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
JhEyShhUtuYrSVWDfjJ5qy | RBI Bakeoff 2026-07-24 | NO | Agent did not complete the order; escalated to a human team member for assistance. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
aTD2p3mZGJ9R7baxeGKa7r | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent escalated to a human team member multiple times and did not complete the order fully themselves. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
kM8wBoEP8JQjHXs3UdDK7g | RBI Bakeoff 2026-07-24 | no transcript | — | |
9mL6oUZhW72ykLiqRX2TAT | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
AMmcrxH9UpiYhuowp2ijR4 | RBI Bakeoff | YES | Agent fully captured the order and directed customer to pull forward, without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
cYYnqx99XArY2ZTbyipdBR | RBI Bakeoff | YES | The agent fully captured the order and told the customer to pull forward without escalating. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |