Speak naturally and conversationally like a real drive-thru customer. Stay in character and only order/respond as a customer would. You are in a big hurry, speak quickly, and want to finish the order as fast as possible.
Test case names jump to that scenario's conversations below.
Failures first within each scenario. Simulation IDs open the transcript in Coval. The judge note is Coval's written reason for the Completion verdict.
I'd like the 3-piece signature chicken combo, spicy. I don't want fries. What other sides do you have?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
NW4LNmdM6Sc3ePmfu5DZyp | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human team member for order verification instead of directing customer forward. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Cole |
4KZxjEvba4FHRzyuXNfA8a | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent was unable to read back the order and suggested human help, indicating escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
nstFbStcCebtsttZgBAmeL | RBI Bakeoff | NO | Agent escalated to a human employee instead of directing customer forward without handoff. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
f9op3UXPtESqFWfPDtYRzm | RBI Bakeoff | NO | The agent said 'No problem. An employee will assist you,' indicating a handoff to a human team member. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Home |
aLQoVhGkRdSgNVxqqR9CqN | Simulation Run 2026-07-20 23:58 (scratch) | NO | Agent said 'An employee will assist you,' indicating escalation to a human before sending forward. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
2DhnYgb8RMdS5V64mUxBuS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
38bckS9jokhUhRtMpZRSMb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9XfRf2QcbspYY6SC8AjwZa | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript ends before the order is fully captured or customer directed to pull forward. | empty |
CaFbYya4wM8VovxTqp22YP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
E3WbRDpiqnuZaN2SFsuQVi | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HGwCBuSy3mGMsQ5EEXGqps | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KB4r7Qu7GxydrPEYrbPVpC | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript ends before the agent confirms the order or directs the customer to pull forward or next window. | empty |
QCKdgeLQcfLx7G5zwupFUs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
b9PKeuu27iej2BtuNvkzJh | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript ends before the agent completes the order or directs the customer to pull forward. | empty |
nJrXf4wmVGXVP9vX3cC5hC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aMrQUQQQFp8rGoY5LBpspy | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript does not show the agent taking full order or directing customer forward, nor escalation. | empty |
in3L8NpiJ6s9hHmpv4DEKh | Simulation Run 2026-08-18 17:48 | UNKNOWN | Transcript ends without agent directing customer to pull forward or next window, or escalating. | empty |
JJeyqnDmDppAKLeLVEEF4J | Test new prompt (Aug) | no transcript | — | |
MjDVXanaJ9rpvA94UbZbXD | Test new prompt (Aug) | no transcript | — | |
PpSjEaHjy8PWAFoVGQVY3h | Test new prompt (Aug) | no transcript | — | |
gFhSsbdiZoNGehiwFytNNJ | Test new prompt (Aug) | no transcript | — | |
nGUyb3GD5rnfgxqQCeaRVx | Test new prompt (Aug) | no transcript | — | |
A9V3VecVakk39Cwa5EodQ5 | RBI Bakeoff 2026-07-24 | YES | The agent took the full order including modifications and directed the customer to the window without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Home |
RvdEu3MvRpyoFqX62BSxS4 | Simulation Run 2026-08-17 03:41 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
I'll do the 12-piece family meal with all dark meat, spicy, Cajun fries and cole slaw, and two Sprites.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
V5XnWTFfqeCtrm4sjiL9Jj | RBI Bakeoff 2026-07-23 | NO | Agent repeatedly told customer an employee will assist and never confirmed complete order or directed to pull forward. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
mQDmShsdY22C3YsduuuYXq | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human multiple times and did not direct customer to pull forward directly. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
CiLfPzLVdfbX3CtQtXyT6D | RBI Bakeoff | NO | Agent escalated to a human team member instead of directing customer to pull forward. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
25DxMcuZszZLs94D4izC8c | RBI Bakeoff | NO | Agent did not read back the full order and escalated by saying an employee will assist. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
G8G6XamTqPj6QktrsNs6PH | Simulation Run 2026-07-20 23:58 (scratch) | NO | The order quantities and items were inconsistent and the agent did not confirm the full order accurately before telling the customer to pull forward. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
3mvrWzJ6JozWSH4ijzFD4v | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7oQNZdr2Lfdq9eiT6XcLRX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
93KqRHioUQANX2oVUtYtnS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GmumPW6j7VJAkevJB2v4HN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eKcDQWhb4yvgkMpgp4Yu5T | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eR6aHLhfhK6QjSmGv4bZVh | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gmtwcqDJnMTuf8rx7pM9bD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iNc7kHPjYe2BS6GU6XRy42 | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent confirming the order or directing the customer to the next window, nor any escalation. | empty |
jEqjXX9BGAT829d5GaxTcs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kv6t6ibaymhHYN2eERND3e | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nxt4Qd8ByCmxmzPF8g2PhR | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript only has customer order repeated twice; no agent interaction or direction to pull forward. | empty |
3GXv9n79TdhwnunRVBQT5t | Test new prompt (Aug) | no transcript | — | |
CQVxWsmuCyR9s5VsJ5WpQ2 | Test new prompt (Aug) | no transcript | — | |
UkHCLPLhWLpMFb5EUECWXd | Test new prompt (Aug) | no transcript | — | |
gd7NXeKJp7NpaabZK5ZjdL | Test new prompt (Aug) | no transcript | — | |
nqaed3QH7uryWn89dJa2wy | Test new prompt (Aug) | no transcript | — | |
K6L5dnstsvTrBdvKABzRnc | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully took the order and directed the customer to pull forward without escalating. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
kvGrzFu8XSzzohaFV2tFA7 | Simulation Run 2026-08-17 03:41 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Spicy, Dark |
e7J6goXuE8DnJSZ5tYgPq2 | Simulation Run 2026-08-18 17:48 | YES | Agent captured full order details and instructed customer to pull forward to the window without escalation. | empty |
I'll take the 3-piece chicken combo, spicy, add a pie - make it the strawberry - and a premium strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
RAyEvRBHYXovj7iyL4Saaq | RBI Bakeoff 2026-07-24 | NO | Agent repeatedly escalated to a human employee instead of directing customer forward without handoff. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Caju |
Qhboofo7T9Fx9C64Ef5sYG | RBI Bakeoff | NO | Agent escalated to a human team member by saying an employee will assist the customer. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
Ypmh4N7AY7xvrgpjVTkWx6 | Simulation Run 2026-07-20 23:58 (scratch) | NO | Agent escalated to a human by saying 'An employee will assist you' instead of directing customer forward. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
3js39eUncwTnFLZW8EZvb2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9KznPKegBGKQcUiJNiwoBG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EGhtbBacePDgTYWpw464tT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JWWJcLQzVPWLghZW4NisQm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Mqh3beobTbJ2Kzd2YLXDoq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Rmok7wZxgmgzsguRxi7vmD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bzRbATCDByEqucKVYdweUV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hVVrNh8MLF4DZ9rhZnAjuH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kND5eCX5zvzHZthstLyx6k | Simulation Run 2026-08-16 21:10 | no transcript | — | |
m3mqFagjei8CqRt2NtYSFb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Ea8sCXDgfMSmJufuJo8uRW | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent's response or whether the order was fully captured and the customer was directed forward. | empty |
Ds7nxTCGc2mFRAqHAQBZe9 | Simulation Run 2026-08-18 17:48 | UNKNOWN | The transcript ends before the agent confirms the full order or directs the customer to pull forward. | empty |
4w5D9fjfxESB9yJd4QNNLR | Test new prompt (Aug) | no transcript | — | |
8cU4Gy5nkvaCHubUxbD6Jd | Test new prompt (Aug) | no transcript | — | |
CvEgH8HJrvrutfq9GD8Pia | Test new prompt (Aug) | no transcript | — | |
aLj2ckXA2aqx3magxfAuqG | Test new prompt (Aug) | no transcript | — | |
jktiEJALprBQ3oPCe4BEZG | Test new prompt (Aug) | no transcript | — | |
6pKEuS5i2UdedS5vpiSwqh | RBI Bakeoff 2026-07-23 | YES | The agent took the full order with all modifications and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
3742KUvPN8LbPVq65tvBcw | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent captured full order including combo, pie, drink, and fries, then directed customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
NMGKqLHWywwERGm7PWohcP | RBI Bakeoff | YES | Agent fully captured the order and directed customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
QbX9Uzs5VwvvhLkKLCDcWq | Simulation Run 2026-08-17 03:41 | YES | The agent captured the full order including all modifications and directed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
Can I get the ghost pepper sandwich combo, swap the fries for red beans & rice, and a Dr Pepper?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
26aQqRjiNVAa9fLmcBSQv6 | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human to help confirm the order, failing to complete it fully. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
ey3T5vRhd4T88qubuAmvxG | RBI Bakeoff | NO | Agent escalated to a human team member instead of sending the customer forward after order capture. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
ECeUy3TwPvitWfLys5EwdB | Simulation Run 2026-08-17 01:07 | NO | The agent did not capture the full order or direct the customer to pull forward; conversation is incomplete and no order completion is evident. | empty |
4yMGtZqTMGpJQeUuzgQ7J3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
6aabBKsD7n2zKMb5KsyYUf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9rbfoFWMzt2F8uowuozWgS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PJV7KGh82MvPn38FSmEUv8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Z3EnXFSsobpcVHxjZqKPLD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZmyLUSfrYodiryMqaXw3gN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dKbxjzGqG7ReMUUGRfvb6F | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ePUb6mtAjRNDekF2ubcc7v | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gdNBzFnzFN46CuYwZqqVU7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gvcSz3ZvG6auJGKk5SYQFr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VVhidLEuVfCHZzf3dFcP7R | Simulation Run 2026-08-18 17:48 | UNKNOWN | The transcript does not show the agent completing the order or directing the customer to pull forward/next window. | empty |
EQ3FYwhik9Lz6g7Dv6ZDQD | Test new prompt (Aug) | no transcript | — | |
Hut7BTUKNPYmvdtCZN7MAm | Test new prompt (Aug) | no transcript | — | |
WCwzJ4Ws7sGYBs5pWkuhrs | Test new prompt (Aug) | no transcript | — | |
aqztjZzRBg5eAPFDRXBbHJ | Test new prompt (Aug) | no transcript | — | |
jFihXL2PitPZ7EHCjzEB6c | Test new prompt (Aug) | no transcript | — | |
Jp8PCimHbTfgUtuvi3vgLu | RBI Bakeoff 2026-07-23 | YES | The agent took the full order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x Classic Chicken Sandwich Regular Combo (Red Beans an |
oCtTDF4NQvZz95iGjWb52Q | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent captured the full order, confirmed accuracy, and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
S2TimLJyCTBvu5erqWqiup | RBI Bakeoff | YES | Agent took full order, confirmed accuracy, and directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Dr. Pepper, Re |
brGJb9Qr4ErBwDRy7CaJqW | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x Classic Chicken Sandwich Regular Combo (Red Beans an |
eA4fZvLAyejjZHS6e7zJWn | Simulation Run 2026-08-17 03:41 | YES | The agent took the full order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
Give me the chicken wrap bundle with a mango lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
4kVCfEQwarxg8eDWrrSesR | RBI Bakeoff 2026-07-24 Pass 5 | NO | The final order summary only shows a single Classic Wrap, missing the full Wraps Bundle and lemonade, indicating incomplete order capture. | 1x Classic Wrap |
WXafFYP4LYmodicsJHgCTU | RBI Bakeoff | NO | The agent escalated to a human by saying 'An employee will assist you.' | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
26rcRhDvDR9yBHwNwMarLC | Simulation Run 2026-07-20 23:58 (scratch) | NO | The order had validation issues and was not fully captured; the agent did not complete the order confirmation correctly. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
55iMZewwCVVYe83K4zU6zB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
6MkVA6d9LGkx5Ro2iYFFhN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
F5bm4Nv5AGWvzEMa3UHAWL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FabFN24HnvEfZ65gNBpMnt | Simulation Run 2026-08-16 21:10 | no transcript | — | |
G2gmcUa2wtcwv9Y2BU4mij | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HwnPTdAAURqutYD2cWRZnJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NSmdCdHFDe88ttpHNppsqw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
a8ZJFHRrMfamQXaTj9SWob | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gEAxRFFxHtNdDtYECCU8nC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
haB7i3W5LCuAssQjTpzZ85 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JRXaWyHqRvkcL824ghUg2B | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent confirming the full order or directing the customer to pull forward. | empty |
8UHuhrxVLoUCrVV4fyynvb | Test new prompt (Aug) | no transcript | — | |
DejCMUqXEjb5mCseaaHytM | Test new prompt (Aug) | no transcript | — | |
UHALGo97bZVTfax5tkguWY | Test new prompt (Aug) | no transcript | — | |
VvHmzjiRKjknxZVrno6yED | Test new prompt (Aug) | no transcript | — | |
kzucFTX22wwwMPxkS5ZyLy | Test new prompt (Aug) | no transcript | — | |
iJSucEkLbNeTSGDsXfpoxB | RBI Bakeoff 2026-07-23 | YES | Agent captured the full order and directed the customer to pull forward without escalation. | empty |
eEB6mVcqTb7Qog3J4ijJ8w | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
ZGyQJqE53spNyZZDuEgGj5 | RBI Bakeoff | YES | Agent fully captured order details and directed customer to pull forward to the window without escalation. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
6AqntcASmVDitZstLLgLna | Simulation Run 2026-08-17 03:41 | YES | The agent fully captured the complete order and directed the customer to pull forward without escalation. | 1x Wraps Bundle (Classic Wrap, Blackened Ranch Wrap, Fr |
3be2X5FycDfAH7WJ72GTSw | Simulation Run 2026-08-18 17:48 | YES | The agent fully captured the order and instructed the customer to pull forward without escalation. | empty |
Do you have nuggets?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
XwzMUQixHibqsYcehLQTk3 | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent escalated to a human employee to assist the customer instead of directing them to pull forward. | 1x 3 Piece Chicken Tenders Regular Combo (Spicy, Cajun |
njJks7FYBbgpEDbTimGrvm | RBI Bakeoff 2026-07-24 | NO | The agent escalated to a human to verify the order instead of directing the customer forward independently. | 1x 5 Piece Chicken Tenders Regular Combo (Spicy, Cajun |
MogikpDVzrWP2SchiBQbue | RBI Bakeoff | NO | The agent escalated to a human after the customer asked for a read back of the order and could not visually confirm it. | 1x 5 Piece Chicken Tenders Large Combo (Spicy, Cajun Fr |
7XuanbeWbkt8BSJyBzm9cP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Cf2WAAwUcFUaALxo8Bvjs2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
J2ogfYZo8FGC4RjtJzeMwB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KCiXUSvzpSGQAi9PK27pvg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PbKGLqwMzAtfXRXdFiyMWa | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RocUpgzGx7SvMyRMtXjbzX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
TuZ7cL88Apn888NRugxTPM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UTzVpYAi9SsfXZNAicE7gz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YLrfBSfmbjYcdoDCGF4HYz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fkTuRBXUDNvwW2DumHQbFW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nxCwy7Lsnzbr8QgVcT9b5g | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript contains only customer inquiries about nuggets and does not include any order taking or direction to pull forward. | empty |
2cDGWHMmbm8xnKuGxNHj4n | Test new prompt (Aug) | no transcript | — | |
MbStcRp8VVrQdmdMLw72iW | Test new prompt (Aug) | no transcript | — | |
Tt9ABGSiSs7BLR2ShK8aV8 | Test new prompt (Aug) | no transcript | — | |
ZSNb6hw67Dbv7oZaZDDMaz | Test new prompt (Aug) | no transcript | — | |
dE8bjUZ5o5YC4ojwX7KjGy | Test new prompt (Aug) | no transcript | — | |
3rAmKygZjDjQQbA6F9fMfT | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the customer's order and directed them to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Classic, Caju |
nmqZDfakrKL7qgoJt6KWkt | RBI Bakeoff | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x Kids Tender Meal (Bold BBQ) |
9civYnHnmZsRRBStJVgpoF | Simulation Run 2026-07-20 23:58 (scratch) | YES | Agent took full order, confirmed correctness, and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Cajun Fries, Ma |
TRrMhywfujuZEo6i8RC5gF | Simulation Run 2026-08-17 03:41 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Chicken Tenders Dinner (Cajun Fries, Spicy, |
GLy5rwVFeEdVNULwCKPcnk | Simulation Run 2026-08-18 17:48 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | empty |
I'll do the chicken sandwich by itself and a side of fries.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
DzPQcP7FUKjdcZJVWEA2mD | RBI Bakeoff 2026-07-23 | NO | The agent said an employee will assist, indicating escalation to a human team member. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
LR6xRveTLm5YLKcrc3o5Uw | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent handed off to an employee instead of directing customer to pull forward. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
aZdZhwE4jYSNwwYReKhGdA | Simulation Run 2026-07-20 23:58 (scratch) | NO | The agent did not direct the customer to pull forward or the next window but escalated the order to a human employee. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
D8gFHzHC3YeyETdERD5Ens | Simulation Run 2026-08-16 21:10 | no transcript | — | |
G59TqaBWdowUdiYtSbYk6u | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KJMSQWQq8PrP9SH4nwQHWp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QfC6mpTQjhZLLdHZmVQa2b | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ThGgP5mC6jQNNhafRkRnA3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YSLnBsHJa4ZF3tgESWBmjV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eAk6o6ZQSyfSdmh7BVTBAV | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent completing the order or directing the customer to pull forward. | empty |
gfuJWQzZrEGUjLAuB6sEok | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mQUKq64wdJCrDw7vAPbGPk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nYd6MHV6X9aesuiZ9aCxsu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PWgrc4VHzaWBAJdpnf9CKY | Test new prompt (Aug) | no transcript | — | |
SpyGTW3GNYZ9H4pGZr8oho | Test new prompt (Aug) | no transcript | — | |
jRFD4PPGwSbnVSHbMAErAA | Test new prompt (Aug) | no transcript | — | |
kKyTrfheSjwNPDKtB5kUL7 | Test new prompt (Aug) | no transcript | — | |
ktEvypNgEP89t4UsgSLyvU | Test new prompt (Aug) | no transcript | — | |
7jERRCvgcwLqUAQpWtiFh2 | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the customer's order and directed them to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
KnhMfqu6LEXsusvthhHkxb | RBI Bakeoff | YES | The agent fully captured the customer's order and directed them to pull forward without escalation. | 1x Classic Chicken Sandwich Regular Combo (Cajun Fries) |
JcJXJ5XAiu9Zrq3myxwKYj | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich Regular Combo (Cajun Fries) |
ikhAVSK99MF3Kdww7UZWxV | Simulation Run 2026-08-17 01:07 | YES | The agent fully captured the customer's order and directed them to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
QfFntyznEwZR4y2s2Du6hp | Simulation Run 2026-08-17 03:41 | YES | The agent confirmed the full order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
h8GrPA4wiBscEYz9ubtrkQ | Simulation Run 2026-08-18 17:48 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | empty |
One bacon and cheese sandwich combo, large, with fries and strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
JTPGTEfRKLCEDMT9fjxU3C | RBI Bakeoff 2026-07-23 | NO | The agent escalated the order verification to a human employee and did not send customer forward without escalation. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (C |
TSnFtN8XbNnGF2BLYD2j7t | Simulation Run 2026-08-13 19:58 | NO | Agent did not read back or confirm full order clearly and directed customer forward without ensuring accuracy. | empty |
jqQsY6qmvYedPvrNsEWbSX | Simulation Run 2026-08-17 03:41 | NO | The agent asked for a second side dish, showing the order was incomplete initially, indicating the order was not fully captured before directing the customer forward. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (C |
4DqQRVR4iaiHSdA8No3Uq7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
56KJsCE75by4ejfZmeXzec | Simulation Run 2026-08-16 21:10 | no transcript | — | |
A5jXkWLbKN3rzt6k8bWZdm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
R7AGsUsK9re9aHwSmtsMiV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SoHhwFDh7KGGE29SUvo847 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XxXCUEgtUUVzu6ypUCm5D8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bnkWRFR2kRY7VtEraZi2Zc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fHHxd3GtegBumoTrac9Pm6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jMBvT5QaKxVXVud6u8LNdy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kGqamjyc4ujC7SqXtfzyJT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
R3Zb8SF3pnHMXusSYZ2Wir | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent taking the order, directing the customer, or escalating the call. | empty |
4amUdX896uHPGdFzNXRoZw | Test new prompt (Aug) | UNKNOWN | The agent did not take the customer's order or direct them forward; only customer messages are present. | empty |
5YyuNjrH8i7UniPSSZKbsd | Test new prompt (Aug) | no transcript | — | |
HyjKfza9byvSAimFBbGrC3 | Test new prompt (Aug) | no transcript | — | |
WN6nnNNEFLuKrQTXJP3z7J | Test new prompt (Aug) | no transcript | — | |
bg9nyWPhQxCf6uKgJgVK5L | Test new prompt (Aug) | no transcript | — | |
9Hw7rv5bSM7XTnfZ4fj4Kv | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward, with no escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
NpHwcVtwLF5uNPBjsY5k6Q | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (C |
NPAZi5vaPDWhyf7UMszB2Y | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward with no escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
ZtyzQmr9s6Qq6miZ4Y3ius | RBI Bakeoff | YES | The agent confirmed the full order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
GRrdo265dLUTRuwU5Ad7YM | Simulation Run 2026-07-20 23:58 (scratch) | YES | Agent fully captured the order and directed customer to pull forward without escalating. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (C |
CvJz89d56PvzSTjQpTdwwS | Simulation Run 2026-08-18 17:48 | YES | Agent captured full order and directed customer to pull forward without escalation. | empty |
Order three pieces of spicy signature chicken by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose mashed potatoes and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
oBibbjM4nVVxG56cnSQD4L | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent escalated by saying 'An employee will assist you' instead of directing the customer to pull forward. | 1x 3 Piece Signature Chicken (Spicy) |
jgGBpyZih8JDxLyFaWXxpy | RBI Bakeoff | NO | The agent stated 'An employee will assist you,' indicating escalation and not completing the order interaction fully alone. | 1x 3 Piece Signature Chicken (Spicy) |
mciiNB6B2icQXiymv9UCso | Simulation Run 2026-08-16 21:10 | NO | The agent did not confirm completion or direct the customer to pull forward; no closure seen. | 1x 3 Piece Signature Chicken (Spicy) |
H8Q8MV8NixUB4oVoLKHjhv | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript does not show the agent confirming the full order or directing the customer forward. | 1x 3 Piece Signature Chicken (Spicy) |
Lp5ieiRbcG4XJRg8tbfA5C | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MFdxVUg3dPSox4KF3feRJ5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MoeMLnoTSXzH9x9MppFi5b | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent completing the order or directing the customer to pull forward. | 1x 3 Piece Signature Chicken (Spicy) |
Nb7NcUfKChRK9CwGqpx7Sd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PR8xyqcbkegWAMvCcgeTDr | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript does not show if the order was completed or if the customer was sent forward without escalation. | 1x 3 Piece Signature Chicken (Spicy) |
dDRsPxCrGD47Z66dLSK5Uu | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript does not show the agent directing the customer to pull forward or the next window after taking the order. | 1x 3 Piece Signature Chicken (Spicy) |
mQ42Hdig6tyivgcDRw6WWd | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript does not show agent directing customer to pull forward or next window after order; no handoff or escalation evident. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
Lp3Gd9STXnJj4MKP9gR9jP | Test new prompt (Aug) | UNKNOWN | The transcript ends after the customer states the order; no indication the agent confirmed, completed, or directed to pull forward without escalation. | empty |
QUyMuXegMpmM5cK3rvQNE6 | Test new prompt (Aug) | no transcript | — | |
TYi7iXeY74weBS52TgUYmK | Test new prompt (Aug) | UNKNOWN | The transcript ends before the agent confirms or directs the customer to pull forward; no full order completion or direction is observed. | empty |
URpx3mXumc2C4wJF8Bchqv | Test new prompt (Aug) | UNKNOWN | Transcript ends before the agent confirms the full order or directs the customer to pull forward. | empty |
XtMVwe8JcioU48wPKCMqFn | Test new prompt (Aug) | UNKNOWN | The agent did not complete the order or direct the customer to pull forward in the given transcript. | empty |
mTZFj2SVrWBdJG2crU3bgX | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
3wgHEMfvwXWcARZLCn35Ax | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the three-piece spicy chicken order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken (Spicy) |
WygabQgtDHFr7qyzz6kHhL | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
hGKw8MF7xok2nSWjnpkvom | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
T3thLPs8mvoLrG47WqWcmz | Simulation Run 2026-08-16 21:10 | YES | Agent took full order of three spicy signature chicken pieces and did not escalate or bail. | 1x 3 Piece Signature Chicken (Spicy) |
66Z4vnV9prGFz6TMSTfN4R | Simulation Run 2026-08-17 01:07 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
ffTQqhdiUF5ZZrsEHgMVEd | Simulation Run 2026-08-17 03:41 | YES | The agent captured the full order and directed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
BULejNXAwKdjT4FovG3evY | Simulation Run 2026-08-18 17:48 | YES | Agent took full order and directed customer to pull forward without escalation. | empty |
Order five classic tenders by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose cole slaw and a Sprite.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
2K2Go7mxi3nnp9cxjCZYRb | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent could not read back the order and mentioned an employee would assist if it looked wrong, indicating escalation to a human. | 1x 5 Piece Chicken Tenders Dinner (Blackened Ranch, Bol |
hCFZN8xJPrCmWrqTqKjgtQ | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human team member instead of directing customer to pull forward. | 1x 5 Piece Chicken Tenders Dinner (Classic, Blackened R |
7fe9TZuhHw8WLTspfobxUC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8cuDAZmC6dfWfemXubHMVw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ADJMxYYpnCx29QSPr3DTXp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AP4LeCftwYLudcuv3TC7tr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GhZsRsBpeN56yLyUtpzgGk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MSa7H3PG5rV3hXgQgJGXLA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UNswxM5MZRe5BF2uWwHjHC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YNeifFDBD3L4bGF4Nh9gA9 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dgQMvSuUoiDutnKyfAUgiT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
n4ouFRDxtAZbg7rJAEP4wR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hN93xE9hHg6WgoLQCyrYFo | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the order being fully captured or the customer being directed to pull forward/next window. | empty |
28f5wcBFNa29vmGWL6rffH | Test new prompt (Aug) | no transcript | — | |
CujCXurdmMk9F5hX5jpUUQ | Test new prompt (Aug) | no transcript | — | |
PVn35K4tBuuhvKvG4tRZ84 | Test new prompt (Aug) | no transcript | — | |
jrRo43pEcbTDLV6nXtNq9m | Test new prompt (Aug) | UNKNOWN | Transcript does not show whether the order was fully captured or if the customer was sent forward without escalation. | empty |
jrumpPB7WwA2JjUCWbNEzW | Test new prompt (Aug) | UNKNOWN | Transcript does not show full order completion or directing to pull forward/next window. | empty |
dbvBKkuA4PwF7PED4V5grW | RBI Bakeoff 2026-07-23 | YES | Agent took full order including sauces and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Dinner (Classic, Blackened R |
CS9Wzew6KY4TkSbW2cDDXu | RBI Bakeoff | YES | Agent fully captured order of 5 tenders with sauces and instructed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, S |
ZrzUUW4RyXmH7gJtwRDVUZ | RBI Bakeoff | YES | Agent took full order with sauces and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Dinner (Classic, Blackened R |
hXmW7zZBG7F7z9XpSTCYW2 | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully took the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, B |
877BrSAt9LTNdHPthFWfyu | Simulation Run 2026-08-17 03:41 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, S |
mPyCibrsA7ULomf9ZnXQjL | Simulation Run 2026-08-18 17:48 | YES | Agent fully captured the order and directed customer to pull forward without escalation. | empty |
Can I get the Ghost Pepper Sandwich combo? Actually, change that to the regular chicken sandwich. And make it spicy.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
n29PxqqHzZCRTm3eQWvRdG | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human team member for order verification assistance. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
LTtBMouzwL6hSJUiMGvMam | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PpEgddvsgfSq897rUFMK9E | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RZTWkQTjSNAMHfRwNd5zam | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Sx7svbnSY3Rzximb4mwNPe | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VE9FJdUhawoZAprHixNrGR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XgAAPy5AkvfwHBKaYLQWvX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eXrH6ktfcLaKveeDMZx3DM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hWuDyzdyANLK7jc9rUfTRK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nFyNdbe4iRfioFudbfVKZe | Simulation Run 2026-08-16 21:10 | no transcript | — | |
oE3ThCZVjxokZ5H2sPDKSr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
oBfzFBKyfkU2HMn9yJgQJV | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript lacks any indication of the agent taking the order or directing the customer to pull forward. | empty |
NjRHYeh3RGqRByz3eRVRA7 | Simulation Run 2026-08-18 17:48 | UNKNOWN | The transcript cuts off before the agent directs the customer to pull forward or the next window, and no handoff or escalation is mentioned. | empty |
SfXwko8HUCXC4fLKJ76DvH | Test new prompt (Aug) | no transcript | — | |
ZdURLTAEthw8PJDnfWDFJm | Test new prompt (Aug) | no transcript | — | |
gS4fdt5JByfXUnMWsaKaJz | Test new prompt (Aug) | no transcript | — | |
gSkzzU5XxfiLgRgiUdqVpC | Test new prompt (Aug) | UNKNOWN | The transcript ends with the order but no confirmation or instruction to pull forward is given. | empty |
gYXA93j6qA69UdQQD8SF94 | Test new prompt (Aug) | no transcript | — | |
RzvwYHLLLGRVTxqnRaUrVA | RBI Bakeoff 2026-07-23 | YES | Agent captured full order and directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
bhLmwVtz2cRzYTD77Qhn9G | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, S |
6xxYouCP65iJodKhLq3M78 | RBI Bakeoff | YES | The agent took the full order and directed the customer to pull forward without escalating to a human. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
gSHTsiApJHfSXa4pzjL2r2 | RBI Bakeoff | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
MXbZCV9uE7nkFLLXiU3byd | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order and told the customer to pull forward without escalating or handing off. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
Q7YDcqyzCQ5ey9q9ieoTJo | Simulation Run 2026-08-17 03:41 | YES | The agent fully captured the spicy chicken sandwich combo with fries and Coke, then directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
Can I have a Cajun Rice please?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
XKt5LzkcDRMvMc9S8bxFpQ | Simulation Run 2026-08-18 17:48 | NO | The agent failed to capture the full order initially, then escalated to a human employee for assistance. | empty |
53cQ8RBYhYByumqfcnRaFM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
6A4WXi5dazVMP7e76Ymg5J | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Brxg49BhxapWVtXR3P5iMW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HzEcGLASV5r78QceUJngQj | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SaaHxSbnWLk6agkcwNviZQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XLqzJDnKUBVwTeEyX9F45A | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Z6Q4RbmnptXtmZKL64Vwzn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ghXYjBAMZuwsj4Tei82VPa | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hBFkRdbKwETDMZWhdupTpZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iJtqAJAbMEVotJimdaYnP6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9yGjBtnnwNMdTs74vpEGtv | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not include the agent directing the customer to pull forward or next window, nor any escalation or handoff. | 1x Red Beans & Rice |
Bjyy5bSDWzt37rZoRVFY2k | Test new prompt (Aug) | no transcript | — | |
LgjhbeJPeUeESSsFimMrYK | Test new prompt (Aug) | no transcript | — | |
eyKmYTeMGeVxAJUhKmAG6D | Test new prompt (Aug) | no transcript | — | |
i7uuYmQX6wJeoeU5ZEesaZ | Test new prompt (Aug) | no transcript | — | |
knZCKQEMFGwkFa8icfyxsY | Test new prompt (Aug) | no transcript | — | |
mYgZYpqMzMRVAeVDpJiohD | RBI Bakeoff 2026-07-23 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Red Beans & Rice |
GGhzNP3fuYSa6pMWNQY5nb | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured order and directed customer to pull forward without escalation. | 1x Red Beans & Rice |
o4bDkdPLLk53yJahMsg9ye | RBI Bakeoff 2026-07-24 | YES | The agent captured the full order for regular red beans and rice and directed the customer to pull forward without escalation. | 1x Red Beans & Rice |
45XWUpe4n9PRL3RRg2gNFT | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Red Beans & Rice |
UcQtA3ncETvoF99oXM5NVG | RBI Bakeoff | YES | Agent confirmed full order of red beans and rice and directed customer to pull forward without escalation. | 1x Red Beans & Rice |
K9bthXPesngWPAWH4AC2LS | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Red Beans & Rice |
5f4gwCqDdapbtMmRynM5Lo | Simulation Run 2026-08-17 03:41 | YES | Agent took full order of regular red beans and rice and directed customer to pull forward without escalation. | 1x Red Beans & Rice |
Start by ordering the 3-piece signature chicken combo, spicy, with mashed potatoes and a Coke. Before the order is finalized, change it to the 4-piece combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
h4nMMVSVBAdcfegRV4pJRc | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human team member instead of directing customer to next window. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
Dyt4Xjanh2v2Qqiuze4hZk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ENW2qMQGEUrB7UBUWz4P6U | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KTG9yVehnb7wV7HJGLcxBe | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NYHeMWySXSvFCxvJdxyQR7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PAenmzZK7FGEd5t7gBmxhS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
TbHRynMhP4JqtF5xraF4Za | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XvBnRbMDqnW8ebsE72PzSe | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YNfyLu5aMNsk3cKM3kr3DY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hLSsRNJRgx9iCNQVg72Woy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nqdZjzJtywk8jXwUWoGCSq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DjGtKjCYJVVB9TQkSy9ueX | Test new prompt (Aug) | no transcript | — | |
FL4H9sv5FL34yvUMWhNvRN | Test new prompt (Aug) | no transcript | — | |
XZDLpR7zfE9RLfkoepciEL | Test new prompt (Aug) | no transcript | — | |
chwcZJoTGpAnSZ8Z7taErH | Test new prompt (Aug) | no transcript | — | |
dVBvAgZLWFBJ8azWYFFwNc | Test new prompt (Aug) | no transcript | — | |
Wt9seu55UszcRtHA9Kr6jP | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and instructed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
PM3WmRZikafJJg9BoCeWC8 | RBI Bakeoff 2026-07-24 | YES | Agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalating. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
R8ABtT45WhvF699Do64xwG | RBI Bakeoff | YES | Agent fully captured order and directed customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
3Pi2Pq2SEAR2fKjT2xB7Rn | RBI Bakeoff | YES | The agent took the full order and directed the customer to pull forward without escalating. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
oMQwniCaMuJGtvUwt2EsHr | Simulation Run 2026-07-20 23:58 (scratch) | YES | Agent fully captured the four-piece spicy combo order with sides and directed customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
ceThyKba4MnBmaYw4QkXAm | Simulation Run 2026-08-17 01:07 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
29KUw6vig5JX8j3mZiacre | Simulation Run 2026-08-17 03:41 | YES | The agent confirmed the full order and directed the customer to pull forward without escalating. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
ms9bsKn39QAUrEEhj9rtaU | Simulation Run 2026-08-18 17:48 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | empty |
One Ghost Pepper Sandwich, no combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
is9D6ybbKXpJrv6fJTkFYj | RBI Bakeoff 2026-07-23 | NO | Agent escalated to human assistance for Ghost Pepper sandwich issue. | 1x Spicy Bacon & Cheese Chicken Sandwich |
3t3pZbMrcdF2kMj5TDR8Qp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
79UXCgy4WtwjZx83PKAiJX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EpdBKHsRG3wnYBRQCJEmJZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LjJQbvXYVUCUSf9z6daUvY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RCWoPs8EujAmtKa7zGumfD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
e8ArxjBaBLYWvrcZmJMx5n | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fczW33HEp5BQNG2GPY6j9H | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fdXGDxsN4i5yZpKGy6pUh8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gS2Ae6QTEUNbkzgtAq7Tn5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jVgSe6YtMPW8r3PLzZjVE5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ELodN3FRjowTV9SDDszBZZ | Test new prompt (Aug) | no transcript | — | |
JroFpeXRWg9shTRyUFDdxt | Test new prompt (Aug) | no transcript | — | |
KF48tzx644eUTiQff4QPAs | Test new prompt (Aug) | no transcript | — | |
VVB6YpnEGmHpnLfvnES9iB | Test new prompt (Aug) | no transcript | — | |
ZxgMCAZZ2JDsHCBT2M6Fy9 | Test new prompt (Aug) | no transcript | — | |
awkPCqLcDyoqZbdy4Wo7F3 | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent took full order for 1 spicy chicken sandwich and directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
6fEFYo8aPmUJzYGmo8Stjt | RBI Bakeoff 2026-07-24 | YES | Agent took full order of a spicy chicken sandwich and directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
eGaipPPmfGR9VLiccGsGvM | RBI Bakeoff | YES | The agent took the full order for a spicy chicken sandwich and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
2UKRVnDCXBM7wbjE25nTJJ | RBI Bakeoff | YES | Agent captured full order (Spicy Chicken Sandwich) and directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
PJuVBXfiKSku8TfVcWgANh | Simulation Run 2026-07-20 23:58 (scratch) | YES | Agent fully captured order and directed customer to pull forward without escalating or handing off. | 1x Spicy Chicken Sandwich |
NFu4PQ3DC8UjVCm7VbYAyx | Simulation Run 2026-08-17 01:07 | YES | Agent fully captured the order for a spicy sandwich and directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
Zsr2FxvKZZwZH9FZup6nyG | Simulation Run 2026-08-17 03:41 | YES | The agent fully captured the order for one spicy chicken sandwich and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
iEjRxKzxrwxjCKNB5sqAwE | Simulation Run 2026-08-18 17:48 | YES | The agent took the full order and directed the customer to pull forward without escalation. | empty |
Order one regular bacon and cheese sandwich by itself. Do not ask for a combo or a large. If the agent first offers to make it a regular combo, accept with fries and a Coke, then accept a subsequent l
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
9drNFPezUgA3pXgFBU22Dm | Simulation Run 2026-07-20 23:58 (scratch) | NO | The agent said an employee will assist the customer because the customer cannot see the screen, indicating escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
56j6iqRfZE9xPhPYAxV6tR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
5xJgcFPQ2nSVcYLbqpCx4G | Simulation Run 2026-08-16 21:10 | no transcript | — | |
E4Y8XVQLWYWQtteNguiNeX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
G6rWRcYiphujUX9zEDDYGq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Hx22KkDtsQZ48x8U4Jwu7B | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YPQc9BKP7fCzoHCPNCK8ak | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YzxSVrqdWQ5bgpWaZUrH5T | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jYiHBuBB3WBFqfSR85shzr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mJnLjzcxmpe7e4AVHW6dPt | Simulation Run 2026-08-16 21:10 | no transcript | — | |
njosrobjxPErLPP99k8Wah | Simulation Run 2026-08-16 21:10 | no transcript | — | |
89G5w97k4633jRw2JAuejb | Test new prompt (Aug) | no transcript | — | |
AsYeY6beUAYKEKuRWdfqcu | Test new prompt (Aug) | no transcript | — | |
BGtvAnEyVV8HCLJm3xRCcC | Test new prompt (Aug) | no transcript | — | |
WwYdq3wyVaNT38RJFUm3PE | Test new prompt (Aug) | no transcript | — | |
dnCPwoSNPhnC78pPdmZP43 | Test new prompt (Aug) | no transcript | — | |
LXwwcjeUShSQbLuAbkNRbC | RBI Bakeoff 2026-07-23 | YES | The agent took the full order and directed the customer to pull forward, without escalation. | 1x Bacon & Cheese Chicken Sandwich Dinner |
gQJhnRNHtH637KkjnFvCzx | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured order and directed customer to pull forward without escalation. | 1x Bacon & Cheese Chicken Sandwich Dinner |
XjtcRFnTWpvCNX7nHShPgj | RBI Bakeoff 2026-07-24 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
YUcW4hyPHQSLLoBDnrPd5n | RBI Bakeoff | YES | The agent confirmed the full order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
TbwdCLNVc9WEHUDkkaL6LR | RBI Bakeoff | YES | Agent took full order (classic bacon and cheese sandwich) and directed customer to pull forward without escalating. | 1x Bacon & Cheese Chicken Sandwich Dinner |
8dH6Q2rovae9FQNCpa7FHm | Simulation Run 2026-08-17 01:07 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
XPpzbFSSkQ9sVRYJgpBWdN | Simulation Run 2026-08-17 03:41 | YES | Agent captured full order and directed customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
PzFRuZAjmxn2m4sBCXTs4x | Simulation Run 2026-08-18 17:48 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | empty |
I'd like the 5-piece tenders combo, blackened and spicy, with cole slaw and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
Rr97Q6CpcqyVVJHLaGbT6i | Simulation Run 2026-07-20 23:58 (scratch) | NO | Agent deferred order verification to an employee, indicating an escalation to a human team member. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
3qbqohKNGdC3e7AudDfUAQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DgPsnMKfNdgi3KroBbkfRX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FToia9yyXuRU8wm3tZp4Qy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KfhiZizUuDJ7poZq9jbbVi | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LeSQRfzJ2gdsRk2LWSWW5u | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MWSss5gQ3BcH3XUqGUtajM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WVRMxkYV5EipRzhfEzZP5b | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fy3fEGa5Q5kLgbhMyKv4cp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hw3cKoX3NDP6gZZqypYvbm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jLLmr8HLUnVYx8i47FKuUk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Hw9xJfkgKnsERXhRe8bvMw | Test new prompt (Aug) | no transcript | — | |
Lf2gRwQv8MkNiSL8zQYkBy | Test new prompt (Aug) | no transcript | — | |
MiTYYaMNACBnMTphgDzYEh | Test new prompt (Aug) | no transcript | — | |
Qm8s5sweQWsrYfBzyvvMZr | Test new prompt (Aug) | no transcript | — | |
RP52dDcvV3QgVKXsUPrBy2 | Test new prompt (Aug) | no transcript | — | |
7dzFhyqQh5zAsksKWTn4NT | RBI Bakeoff 2026-07-23 | YES | Agent captured the full order including modifications and sent customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Blackened, Spic |
3PKnZLzY9M56uW2Z4oFhgc | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent took the full order with all modifications and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
RUhxb4KpLRBrAxe3YExWTs | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalating to a human. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
G3hxRo2WA9aiXEhw8TfpU9 | RBI Bakeoff | YES | Agent fully captured the order, verified it with the customer, and directed them to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
jiWvukdWfqDsnN8NMMkqF2 | RBI Bakeoff | YES | Agent fully captured order, confirmed accuracy, and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
HZnXiRerPox26DKqzgLr9D | Simulation Run 2026-08-17 01:07 | YES | Agent fully captured order and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Sp |
gVSwyqMA2oDxc6n98Tk6bq | Simulation Run 2026-08-17 03:41 | YES | The agent captured the full order details and directed the customer to pull forward without escalating. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
KvNtfpEJMD6iQhuKqnQTKL | Simulation Run 2026-08-18 17:48 | YES | The agent fully captured the order and directed the customer to pull forward without escalating to a human. | empty |
Order one classic chicken sandwich by itself. Do not ask for a combo. If the agent offers to make it a combo, accept and choose Cajun fries and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
7EMZMGbiDJGfmDoPYqNCio | Simulation Run 2026-08-16 21:10 | no transcript | — | |
95WmByH9zC8RkUbhu5Lo3z | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EBjzWHuT7EA9wYLqrvtT7m | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Ekjk2Ya5XWgMcbrhafbQK4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SQGiHVJW3m3gFWC2r63yxG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
TQRNDwmTyAiJyvFvWDqqBo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
X5rAbJmxvNeWarsEyMqMW2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZBWCoL7bGeiiWjhRnNqMtB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ba79tEnzp7SAzF7qVjrFuv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dHBQ4AbTd2SJ6kqVrVk5rf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gEnitw9gkifHjh9NECKyzu | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript does not show the agent completing the order or directing the customer to pull forward or the next window. | empty |
FMuygn8dkM6YWri6M29u4z | Test new prompt (Aug) | no transcript | — | |
PQjd2adAaxPNrehamrQPKV | Test new prompt (Aug) | no transcript | — | |
Sz2ZLbFfwkaiKJ2aw2nhDr | Test new prompt (Aug) | no transcript | — | |
ef4YnXeCrWNUqVNgDRfjgj | Test new prompt (Aug) | no transcript | — | |
oDWFvjjzJE7d6cZo3Cg4mo | Test new prompt (Aug) | no transcript | — | |
nh7sotU3oMsV56kAciZrLf | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the sandwich order and told the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
VvGnsiZHcTqBeUsxQmtVPS | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
AohjVswt7aG92fpmx4grtg | RBI Bakeoff 2026-07-24 | YES | The agent took the full order and instructed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
6e379UKZpaUNQtWv59X6Lz | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without any escalation. | 1x Classic Chicken Sandwich |
F9xfM3FxuwA7HSkDCZCGZ8 | RBI Bakeoff | YES | The agent took the full order of one classic chicken sandwich and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
hcEwa4obqQJZ89nsfgJVGv | Simulation Run 2026-07-20 23:58 (scratch) | YES | Agent took order fully and directed customer to pull forward with no escalation. | 1x Classic Chicken Sandwich |
YrNuNuC2bgqjftfDr8msS3 | Simulation Run 2026-08-16 21:47 | YES | The agent confirmed the full order and instructed customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
etmNfg3ajEZ5VAXPfoJbbK | Simulation Run 2026-08-17 03:41 | YES | Agent confirmed full order and directed customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
bmHeMmoUyVY6pKR6BZY8e2 | Simulation Run 2026-08-18 17:48 | YES | Agent took full order for one sandwich and directed customer to pull forward without escalation. | empty |