Speak naturally and conversationally like a real drive-thru customer. Stay in character and only order/respond as a customer would. You are very chatty, going off on tangents and small talk while slowly getting to your order.
Test case names jump to that scenario's conversations below.
Failures first within each scenario. Simulation IDs open the transcript in Coval. The judge note is Coval's written reason for the Completion verdict.
Order three pieces of spicy signature chicken by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose mashed potatoes and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
KquhRWKPmxH87YTA6SWJih | RBI Bakeoff | NO | Agent said 'An employee will assist you,' indicating escalation to a human team member. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
7q9nqzAFpSwUUuNfn67y2N | Simulation Run 2026-08-16 21:10 | NO | The transcript shows the order but lacks confirmation and direction to pull forward, no indication of order completion or next step. | 1x 3 Piece Signature Chicken (Spicy) |
NRnAQqyW8ZgYZV8wepuA3v | Simulation Run 2026-08-16 21:10 | NO | Agent never confirmed full order completion or directed customer to pull forward; no indication order was finalized without escalation. | 1x 3 Piece Signature Chicken (Spicy) |
jfkhr4AR5yKXGG7gWNxLQM | Simulation Run 2026-08-16 21:10 | NO | The agent did not explicitly direct the customer to pull forward or the next window after taking the order. | 1x 3 Piece Signature Chicken (Spicy) |
U5TYkPaFmc2sXS6YBixUaS | Simulation Run 2026-08-17 01:07 | NO | The transcript does not show the agent directing the customer to pull forward or the next window after order capture. | 1x 3 Piece Signature Chicken (Spicy) |
3PMengjzRzkZeKpmCgXsqf | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent taking an order or directing the customer to pull forward. | empty |
7QEANcuUokxZWWBtPGao2z | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GTBUUkZUaXPcnaaPBo2QKZ | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript contains only greetings and no order or direction information is presented. | empty |
ZqV3ZnZ47VNHbddDQZLCgs | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript lacks any confirmation or completion of the order and no direction to pull forward or next window. | empty |
aiWkppRDoccJFkm33pcnVx | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript lacks agent confirmation of order completion or direction to pull forward/next window. | 1x 3 Piece Signature Chicken (Spicy) |
nymXCbbKh8HiQpE3MQeeVB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4mbmRwsrPESzmFgDQLGFbs | Test new prompt (Aug) | UNKNOWN | The transcript does not show the agent fully capturing the order or directing the customer to pull forward or next window. | empty |
ASQfkN3ehu5vPMMYrqLvpy | Test new prompt (Aug) | UNKNOWN | The transcript only contains greetings and no order or direction to pull forward. | empty |
KuexwvSWENrFyHMARqDGok | Test new prompt (Aug) | UNKNOWN | The transcript contains only greetings and no order details or direction to pull forward. | empty |
NVCRhgNcs9gNVbjxTFyERN | Test new prompt (Aug) | UNKNOWN | Transcript does not show the agent completing the order or directing the customer to pull forward or the next window. | empty |
RLAPwCGSpfyC3Kr2XBLR2u | Test new prompt (Aug) | UNKNOWN | Transcript only contains greetings and no order or direction information. | empty |
jFgEgABnYo2fvesuoaxtvE | RBI Bakeoff 2026-07-23 | YES | Agent captured the full order including modifications, confirmed accuracy, and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
h7Mi7aQY8KoXcViGW6nbhW | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order including combo details and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
2m7Gys65E8uf4G2Xs6Qk7u | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order with combo and sides, then directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
7yzkYtYeoBRxnsECXSzpMX | RBI Bakeoff | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
Yj9MkSMhrEU8SCzchMkydh | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
PrXbsQHQbpDWisQvCWCTM2 | Simulation Run 2026-08-16 21:10 | YES | Agent took the full order and sent customer forward without escalation. | 1x 3 Piece Signature Chicken (Spicy) |
3p4Z5oCJrJCJpAiB5etkRS | Simulation Run 2026-08-18 16:53 | YES | The agent fully captured the order and asked the customer to pull forward without escalating or handing off. | empty |
Can I get the ghost pepper sandwich combo, swap the fries for red beans & rice, and a Dr Pepper?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
8uugsoSvaqMaAxo3ko98Ya | RBI Bakeoff | NO | The agent did not finalize the order and handed off to an employee for assistance. | empty |
DdxdbJEGX6S2yT6gZiDuc8 | Simulation Run 2026-08-17 01:07 | NO | The transcript shows no agent response capturing the full order or directing the customer forward. | empty |
35mwkRitdocv2hBdtDhzex | Simulation Run 2026-08-16 21:10 | no transcript | — | |
6Mxn2rXidTS59JiJXhQt4P | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BLN7nrfrHzvFabYmZ3LWxc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HsHggKBZZwReNyvrUPvP2B | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WPdTNF4HPJ9whJb4y8iXBo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
czWopgXXtB8pmciZkCMMcf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eSYcN9jcS9HCQTHNgtMpUo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
g28KgPXhAtLxcLsQXfs9WY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ibduwcd8X4tmkkQe8UXaKW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ktHthZzfL5i9QtmCHaZ4BR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9etLdACSXyY8g83prEDKp5 | Test new prompt (Aug) | no transcript | — | |
iesbDxRdzyuT5v6aKDQH6r | Test new prompt (Aug) | no transcript | — | |
J3bRUZyd6zzDgcNQgzHRmv | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the customer's order including modifications and directed them to pull forward to the window without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
nt7SSFGYLurV2FVfmZCLJY | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
b5kG8xdo9GCeLqEqKiRMFG | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalating. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
f7ReLz34fP5dwU2fdX5WZw | RBI Bakeoff | YES | The agent fully captured the order with modifications, confirmed it, and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
ca2aqB5u9Vd7xLB4NshAd5 | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order, confirmed details with the customer, and directed them to pull forward to the window without escalation. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
c9KGhvzPTYxTHBkE7DziQ7 | Simulation Run 2026-08-18 16:53 | YES | Agent fully captured the order and directed customer to pull forward without escalation or handoff. | empty |
5MYDnCRWDu8w4gGstnDte8 | Test new prompt (Aug) | YES | The agent fully captured the customer's order with all modifications and directed them to pull forward with no escalation. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
6CHJGLZ5P9DvfguRUrEQug | Test new prompt (Aug) | YES | Agent fully captured the order including modifications and directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
8zj6BupDFfgytmiUBxYFtd | Test new prompt (Aug) | YES | The agent fully captured the order details and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
I'll do the 12-piece family meal with all dark meat, spicy, Cajun fries and cole slaw, and two Sprites.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
NcG5WLJfyH6WNxiFgt326w | RBI Bakeoff 2026-07-23 | NO | The agent repeatedly stated that an employee will assist the customer, indicating escalation to a human team member before completion. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
AcwLHgURH2SzZo6cVubpt4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CjtFerGrpgGC9dhLVa5QTY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DUoCNWvKVkR8RHAnNvyduj | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JaZCCwGiEWBGvpn2NCsYG3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NTBvAs3BjGpK7q6HTv2C3S | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VBGr66c9VTPLTLFvKj6JKV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VmHygVDVmBbgP2oXLMXcjC | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not include the agent taking the full order or directing the customer to the next window. | empty |
fbqYezSQRAKYVibaMYhzWT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gESftCWoJLxUB8wJrxddo6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mM8MU2P2ZoQt4wGmdfigeo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YAcmSms3ASjZ9UTe2KyTip | Simulation Run 2026-08-17 01:07 | UNKNOWN | The agent never took the order or directed the customer forward, nor escalated or bailed; no order completion is evident. | empty |
Ba356gsMdvNCYLvYT2c56f | Test new prompt (Aug) | no transcript | — | |
FseB2DLLFgUm9wbBQZZLFA | Test new prompt (Aug) | no transcript | — | |
WQgaEWtFJfKTLisbSdpudV | Test new prompt (Aug) | no transcript | — | |
ae9YNKgijcoXPwd8dj9kCw | Test new prompt (Aug) | no transcript | — | |
cKWfeYAkt7pmiuX7aNqRf2 | Test new prompt (Aug) | no transcript | — | |
PQVc648oE3aQMoHQ9TNjwR | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent took the full order including modifications and directed the customer to pull forward without escalating. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
imZrFQMXCxeHqM8WQ3pGbB | RBI Bakeoff 2026-07-24 | YES | Agent fully captured the order and instructed customer to pull forward to the window without escalation. | 1x 12 Piece Signature Chicken Family Meal (Spicy, Dark |
9QEMtT3eSiLNtVsTDk7Bkb | RBI Bakeoff | YES | Agent fully captured the order and directed customer to pull forward to the window without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
LCfJhGKnfKsY4YWqTRkKp3 | RBI Bakeoff | YES | The agent captured the full order and directed the customer to the window without escalating or handing off. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
QMxgSbWoLa92BTnDU4rtXm | Simulation Run 2026-07-20 23:58 (scratch) | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
TXMvioT89QVRSe5f9KAq7h | Simulation Run 2026-08-18 16:53 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | empty |
Order one regular bacon and cheese sandwich by itself. Do not ask for a combo or a large. If the agent first offers to make it a regular combo, accept with fries and a Coke, then accept a subsequent l
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
PLV8acSdbN53HmfU6NmDTb | RBI Bakeoff 2026-07-24 | NO | The agent did not complete the order by themselves but handed off to an employee at the window. | 1x Classic Bacon & Cheese Chicken Sandwich |
Ao4FYmNKfAheyPRLfhrhE6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CajHcvNS9fYb8sLRmM3ACk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
P73aTnZXTNPaFtLVAFJHoZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Tb3Ve3V3AuEzT6zTQaNoKB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZLHX2eynsNeFYVuCGJPVpj | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bxhRtK6VdPoJWfqW62dTc8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eKoc4F4qMWwh5TFuvSm3kW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jdMocRFH8eU2joN53y8uSf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kb7s43FhdjPkrDDqpR64o8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nq2YeKvooZv8YjdF88sEPt | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CQ9FDirKjtUVGSA7ACQywa | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript contains no information about taking an order, directing to pull forward, or escalation; only greetings are present. | empty |
8rQN4CRA2B2Gmf5CxNfbUg | Test new prompt (Aug) | no transcript | — | |
UAWPFi4hsMUfXDRE8UjUcA | Test new prompt (Aug) | no transcript | — | |
WEb5CRVU5AQa6UhkKkYWxw | Test new prompt (Aug) | no transcript | — | |
aLNftnvPhv6hADuJs7ae5e | Test new prompt (Aug) | no transcript | — | |
cimvndqPCSSYZnb9p9YNHr | Test new prompt (Aug) | no transcript | — | |
5u2y8ULwNebRDeSer6Uoq3 | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the classic bacon and cheese sandwich order and directed the customer to the window without escalation. | 1x Bacon & Cheese Chicken Sandwich Dinner |
RMGPDWDRy9JjcrWZaxuoBa | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the customer's order and instructed them to pull forward without escalating. | 1x Classic Bacon & Cheese Chicken Sandwich |
UnQZTsy7DCrHg2bMCrLCJj | RBI Bakeoff | YES | Agent fully captured the order and directed the customer to pull forward to the window without escalation. | 1x Spicy Bacon & Cheese Chicken Sandwich |
SSQKk2DRn7RhosmBhjKbNE | RBI Bakeoff | YES | Agent fully captured the Classic Bacon & Cheese Chicken Sandwich order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
MGAbBzAuQHrqxXW3UCTtme | Simulation Run 2026-07-20 23:58 (scratch) | YES | Agent took full order, confirmed it twice, and directed customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
PB4hUXGfUoNGWquPdprnSX | Simulation Run 2026-08-18 16:53 | YES | Agent confirmed full order and instructed customer to pull forward without escalation or handoff. | empty |
Start by ordering the 3-piece signature chicken combo, spicy, with mashed potatoes and a Coke. Before the order is finalized, change it to the 4-piece combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
f3hidmZyzHJV5tfmQqFZns | Simulation Run 2026-08-17 01:07 | NO | The conversation does not include the agent directing the customer to pull forward or the next window after taking the full order. | 1x 4 Piece Signature Chicken Large Combo (Spicy, Large |
7jEs9V9PmXEYjP8XyaAsQ4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ButyqQ5qg4QFHfkrxTFWTo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DoT7TURi2Je4aKtxZx4RtP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RiqyviMyY92oAavSuRRjzB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UFnX7aJUt4aHH6pFyVRn7b | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WovkhsGCpSdxCocha5N8mc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YP7jS32RcZw6CZRzYcvf8a | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aajNsm549iQunV3MtLCeC3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dYxgkJVvB2b2qZVobvZ7Uk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fpQ9tnxiuhyu9TRrSCv6yb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
3muGmKhbmz4itPVqwRvSUA | Test new prompt (Aug) | no transcript | — | |
MwuQgJ83iaWKTcfyjMUEo2 | Test new prompt (Aug) | no transcript | — | |
gQb3x2LSjwpd2cebbf2tDT | Test new prompt (Aug) | no transcript | — | |
kdxrWqDugNps2YjpQ62UA9 | Test new prompt (Aug) | no transcript | — | |
nZirQ356tbum3Y6RFR9TGB | Test new prompt (Aug) | no transcript | — | |
bqB4tmdHawGEbBw2J6JqCU | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and told the customer to pull up to the window without escalation. | 1x 4 Piece Signature Chicken Large Combo (Spicy, Mashed |
nVGiAa6ezeZajeaB7FKMkR | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
PFQCDKFshBdP8wTxwDiyqr | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward to the window without escalation. | 1x 4 Piece Signature Chicken Large Combo (Spicy, Mashed |
ganSsck8mGzHKabLvEQojp | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Large Combo (Spicy, Mashed |
2xauPha3Ks9ZQF4MbMrGTd | RBI Bakeoff | YES | Agent confirmed full order, verified it with customer, and directed to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
S6qfWpQReucEfC4eAxCjyZ | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent captured the full order and told the customer to pull forward without escalating or handing off. | 1x 4 Piece Signature Chicken Large Combo (Spicy, Mashed |
PEyNbuJCWFA9krRUCyyQSA | Simulation Run 2026-08-18 16:53 | YES | The agent took the full order and directed the customer to pull forward without escalating or handing off. | empty |
One Ghost Pepper Sandwich, no combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
3tKQRrLm8ybBTf9FXugAPC | RBI Bakeoff 2026-07-24 | NO | The agent ordered a Spicy Chicken Sandwich instead of the Ghost Pepper Sandwich the customer requested, so the order was not fully captured. | empty |
CVMadQm9ouKryqCJxygkyj | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LgGVqYKRQN9RQwXFBosRii | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NqvjjASKkebcRGJ9d35fBN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RauDJuDo2gJa4LzmWsndue | Simulation Run 2026-08-16 21:10 | no transcript | — | |
W5VWo8sBaYJwjEGGcNHPNn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YCqFizw2eEQFnmjwvmwXNA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ahQQf9EAaf5ScaVRiSP42T | Simulation Run 2026-08-16 21:10 | no transcript | — | |
c5nNMhuaoxuk8YzJABfU3x | Simulation Run 2026-08-16 21:10 | no transcript | — | |
efrNpfDkN7RuKRsMeQKeZx | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eom5uUscHqUeGYi6HVT7m3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
6NTpbAgdUNtB4PCpNqWtSc | Test new prompt (Aug) | no transcript | — | |
K7eUm4hg5jcuGLkKAboEfu | Test new prompt (Aug) | no transcript | — | |
RgVya42rSF6kW46SMvyvZN | Test new prompt (Aug) | no transcript | — | |
XVwGSw9vnX3oR7LKkfJeQe | Test new prompt (Aug) | no transcript | — | |
fZ6J92LPAJNzzrjif6knQK | Test new prompt (Aug) | no transcript | — | |
kfSWsR9APqAdQujcxg2NBZ | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the spicy chicken sandwich order and told the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
nrC4EGZuvga5tsxpHBmoym | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent captured the full order (Spicy Chicken Sandwich with extra spicy sauce) and told customer to pull forward to the window without escalating. | 1x Spicy Chicken Sandwich |
QqpxKYRx9AGtdZAoxdpDbP | RBI Bakeoff | YES | The agent fully captured the spicy chicken sandwich order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
bhWCVf9rpQoYScaNFn42Xk | RBI Bakeoff | YES | The agent took the full order including modifications and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich (Pickle, Mayo) |
HuSFc6hrzh8Vk3dJMzhVBv | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order of one Spicy Chicken Sandwich and directed the customer to the window without escalation. | 1x Spicy Chicken Sandwich |
dKKciZATnErcEisR9gzoKP | Simulation Run 2026-08-17 01:07 | YES | The agent captured the full order including extra pickles, confirmed it with the customer, and directed them to pull forward to the window without escalation. | 1x Spicy Chicken Sandwich (Pickle) |
gYtKdkVAJ9pGFFDeWTejhL | Simulation Run 2026-08-18 16:53 | YES | Agent captured full order and directed customer to pull forward without escalation. | empty |
I'll do the chicken sandwich by itself and a side of fries.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
MZbJzaBeAaqD7aaZ98HKRq | Simulation Run 2026-08-17 01:07 | NO | Agent did not direct customer to pull forward or the next window after taking the full order. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
4FSiZ6dYDuiUitdVZmix2a | Simulation Run 2026-08-16 21:10 | no transcript | — | |
523xAqC4BgMVQuRXYUrqNq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CG7YwC8hSm2yGgh9Xp9CQr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FumXKMZuZeGWYyDApcFibp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PvH8Ne4EoaRYzYgC3EoTN7 | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript shows only the initial greeting and customer hint at ordering, no full order or direction to pull forward. | empty |
SMrVCJ6aRX6GNzmFgRa2r5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WPeiVN9bPZLoLdAZbcwZQo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aiBLm32r63gMw7iTK86rWd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fjc9WMDxSGvsRiZbABCWn5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
m4PEKRQgbVokq7sAz8gpfa | Simulation Run 2026-08-16 21:10 | no transcript | — | |
2C4hG6aoiGEcqinv7S7rxa | Test new prompt (Aug) | no transcript | — | |
FxdAYEYKeuLjPXq5FZ7Z2y | Test new prompt (Aug) | no transcript | — | |
LpduTCrxWQ8DL9JdqoqWou | Test new prompt (Aug) | no transcript | — | |
PvBgoYxaqq4tcDkwcLuYVG | Test new prompt (Aug) | no transcript | — | |
gpczYhgiCSAsnTxscxXK7q | Test new prompt (Aug) | no transcript | — | |
Z9upbQS5ko9BsWGqK9JVdM | RBI Bakeoff 2026-07-23 | YES | Agent fully captured the order and directed customer to pull forward without escalating. | 1x Classic Chicken Sandwich; 1x Cajun Fries; 1x Blacken |
dZdi2yEjofB72PHF7sSDst | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured order and directed customer to pull forward without escalation or handoff. | 1x Spicy Chicken Sandwich; 1x Cajun Fries; 1x Cup of Wa |
5uTCoVaDFczmTuqkWYjkcz | RBI Bakeoff 2026-07-24 | YES | The agent took the full order, confirmed it with the customer, and directed them to pull forward to the window without escalating. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
Ct3PHQ6EZKVDneDSA36xqw | RBI Bakeoff | YES | The agent fully captured the order and told the customer to ask for the sauce at the window without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries; 1x Cinnamo |
nfTUn8Wn8kDEoB7YJ5UyAK | RBI Bakeoff | YES | The agent took the full order, confirmed it, and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich (Pickle); 1x Cajun Fries; 1 |
PJ8DgmXeTZwMXEZvfr885j | Simulation Run 2026-07-20 23:58 (scratch) | YES | Agent took full order (spicy chicken sandwich, large Cajun fries, Mardi Gras mustard) and directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich; 1x Cajun Fries; 1x Mardi Gra |
C8bAzGumayegMLZYGC6ZgJ | Simulation Run 2026-08-18 16:53 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | empty |
I'll take the 3-piece chicken combo, spicy, add a pie - make it the strawberry - and a premium strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
862ckZW28jBRbtrwmZkpmx | Simulation Run 2026-08-17 01:07 | NO | The transcript shows the order was partially captured, but the agent did not explicitly direct the customer to pull forward or the next window. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Dark |
5HCHXUA5b9CnACV9rGn4eN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7BGpJ27EEojb4v8yR4uDLk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7SqxC64K6goqUiS3zEDhW8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
975poCxEmqjJkEvSfpEooc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DCNmmWa5hUG4ErKaGiTWQm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JTdGfLjcsQTTEyJfcRV3tK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KoeF3f6kkKKfXP6hUVmbNg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NvzQLcNGyBEm8yZNkZjq3Z | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Pjf7DNzT4haWZbV23gy6qA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Zg6KmgBXAv5cgfZG6RxCFu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LkiYxuWoMVQxQ3fYNVSrrq | Test new prompt (Aug) | no transcript | — | |
akVDmMyQSMveovWZiktKgY | Test new prompt (Aug) | no transcript | — | |
btjxCohguVARZ24KvQL6aY | Test new prompt (Aug) | no transcript | — | |
kbuyJBT4eDUXAoJPkog5Ci | Test new prompt (Aug) | UNKNOWN | Transcript does not show agent confirming full order or directing customer to pull forward. | empty |
nJPau6uHuEJp2VnwmimkuF | Test new prompt (Aug) | no transcript | — | |
bsMchVoFMXb7kBxpbMotNn | RBI Bakeoff 2026-07-23 | YES | Agent fully captured the order and directed customer to pull forward without escalation or handoff. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
4rVxxghLQv6SZs3eLgsw2f | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent captured the full order, confirmed accuracy, and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
XXUGs6DpoBYqG8TDzA9Qrf | RBI Bakeoff 2026-07-24 | YES | Agent fully captured the order and instructed customer to pull forward to the window without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Caju |
ZesDcwSU8TLTPqXguXgvTD | RBI Bakeoff | YES | The agent captured the full order and confirmed it with the customer, then ended without escalation, directing to proceed. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
36SU8VgqMBqEkcMsxUaneQ | RBI Bakeoff | YES | The agent captured the full order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Cajun |
L5VuPWmf7KcMGdterf9ixa | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
jajum2cmPwBiRUWmJAJgdJ | Simulation Run 2026-08-18 16:53 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | empty |
One bacon and cheese sandwich combo, large, with fries and strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
nmtVzWDH7e4wJ3fA28HGrk | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent asked for a second side dish but did not update the order; order not fully captured. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
2jL8UNkwx4xUqmmh3sn8pn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4y3iA7HRsJP3YT6mUExuDs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BeQMxHfVRw6dS63ZJRm9rR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QpxTpni3RRvytPfhJ3NFvp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SjS7J7K7ipZXfAhmtLJ5ws | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XaPJSX8CH7o22sbK6j57KR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Ym3SY67EuEpSYJ7u8z2Tqm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZVKn8V2NCN5sHDEQSugnmX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
e6fxNYQctEWqQiaVKvQhEm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kshWiYb5HtpmciRJt2SA2q | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mPny9yy3FzWrynmsSbTYJs | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not contain any information about the agent taking an order or directing the customer to pull forward. | empty |
NY29rueENUkGY5dpZzbuTM | Test new prompt (Aug) | no transcript | — | |
ZVSGnTh9aaiCDmBEn5ygnj | Test new prompt (Aug) | no transcript | — | |
kogCaAXcW7dJbwunxd2nz9 | RBI Bakeoff 2026-07-23 | YES | Agent captured full order and instructed customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
kr7GVbLn8GY8ccEUQjsGPs | RBI Bakeoff 2026-07-24 | YES | The agent took the full order, confirmed it with the customer, and instructed to pull forward without escalation. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (C |
NuYt93iyiFrsiduQ2D2Gkg | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward with no escalation. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (C |
YRFuGAUZYpjUddXotCM89i | RBI Bakeoff | YES | Agent took full order details, confirmed accuracy, and told customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
442QjgFZ9e23nAYpHykXP8 | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order with all details and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
oRkreaPRpJCiBzQxTwzyBm | Simulation Run 2026-08-18 16:53 | YES | The agent took the full order and directed the customer to pull forward without escalation. | empty |
D7DkNpSqtXxwjcBPV7v2h6 | Test new prompt (Aug) | YES | The agent took the full order and instructed the customer to pull forward without escalation or handoff. | 1x Spicy Bacon & Cheese Chicken Sandwich Regular Combo |
kEqnZ5jX5f7vvA3SB6Pj4Q | Test new prompt (Aug) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
oPfM3eWiCyTH9MY7VuySVG | Test new prompt (Aug) | YES | The agent captured the full order, confirmed it with the customer, and directed them to pull forward to the window without escalation. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (F |
Order one classic chicken sandwich by itself. Do not ask for a combo. If the agent offers to make it a combo, accept and choose Cajun fries and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
DBGwtbfXs88tk4sYyaz2sS | RBI Bakeoff 2026-07-23 | NO | Agent asked 'Is your second side dish?' indicating the order was not fully captured before directing to the window. | 1x Classic Chicken Sandwich Large Combo (Cajun Fries, M |
2UtyLbBvfexJHxRuE5zaBL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
3At5uJvPPy2zqhSs9AAD7j | Simulation Run 2026-08-16 21:10 | no transcript | — | |
A3WwvACoFjsmLhWdYnTZTT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JmvEkgHPGmk92Gg5kfJRsh | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KbCmxcd5amFWMMrRvbNQpk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WESJTeJTyywdPx9BveBqHv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZSzrjJdsQSt47NbgFttdrp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dXd3486yepU3xFueg2fRUv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mufrc4fCBaHHZBDuicNRHA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
n69TwejThdwTqoToQguaQn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
emi5SHA7NefszyqjAP5yj7 | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript ends before the agent completes the order or directs the customer forward. | empty |
A3Jqnak2eY6Juc9Q6nPob2 | Test new prompt (Aug) | no transcript | — | |
XCZKtupSM7t4kuGxMjv7s6 | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent took full order including combo and directed customer to pull forward without escalation. | 1x Classic Chicken Sandwich Regular Combo (Cajun Fries, |
5oAH7BPPRNrqbrjJ9o2je8 | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x Classic Chicken Sandwich Regular Combo (Cajun Fries, |
aFCHPeE4hMBETgqBa7HzuE | RBI Bakeoff | YES | Agent fully captured the customer's order and directed them to pull forward without escalation or handing off. | 1x Classic Chicken Sandwich Large Combo (Cajun Fries, L |
U6u8Mxfe7UjmHXvaz97oDC | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward to the window without escalation. | 1x Classic Chicken Sandwich Large Combo (Cajun Fries, H |
PgwQfRnidiFKmmyCERvmTJ | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent captured the full order and instructed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich Large Combo (Cajun Fries, M |
7CjMZiPPMvywwD9226qo5R | Simulation Run 2026-08-18 16:53 | YES | Agent fully captured the order and directed the customer to pull forward without escalating. | empty |
885SsJ2abkExadC3neXNcF | Test new prompt (Aug) | YES | The agent took the full order and directed the customer to pull forward with no escalation or handing off. | 1x Classic Chicken Sandwich Large Combo (Cajun Fries, M |
JbhDkVqEEH7sD2YMZYhKKf | Test new prompt (Aug) | YES | Agent fully captured the order and directed the customer to pull forward without escalating to a human. | 1x Classic Chicken Sandwich Large Combo (Cajun Fries, L |
Ne8swFFqByhYJQnJRURgaz | Test new prompt (Aug) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
gw2NKjZJ5Z7S9e6MvvQZZR | Test new prompt (Aug) | YES | Agent took the full order and directed the customer to pull forward without escalation or handoff. | 1x Classic Chicken Sandwich |
I'd like the 3-piece signature chicken combo, spicy. I don't want fries. What other sides do you have?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
DEq472pcfeBD9rhXA2JuoS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Fkt67iTWYXVsTUsYqfnbXK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JE68gKyrYtURXcXp56ohwS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MUanBqomUqveyMhNLRqRMf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QpwuizFemsLJsvysZx2JVh | Simulation Run 2026-08-16 21:10 | no transcript | — | |
S3u8Jvr3kUj7zXTjMzms75 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eYbun3taLmw5EiTMAzKwZP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fEn69ywRWdymTYuRYBAPDY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fyDPeZzSZpEWVyhdBjx8az | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jP79hirmhYUEHtNWxPUXeF | Simulation Run 2026-08-16 21:10 | no transcript | — | |
n3FVdxZhbuYQgFKUyrvPYq | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript contains only customer utterances with no agent response or order confirmation. | empty |
6C7aWAwVFvkppWWST3VuQb | Test new prompt (Aug) | no transcript | — | |
UvpLFBXLCdRQoXCS47TCx6 | Test new prompt (Aug) | no transcript | — | |
WbaYQXRtVcVS4LZoDJ4bLy | Test new prompt (Aug) | no transcript | — | |
WuaBAVvseDj2zrNNa6TPKX | Test new prompt (Aug) | no transcript | — | |
f6PmL7xha7c3yy36PGRFM6 | Test new prompt (Aug) | UNKNOWN | Transcript does not show the agent taking the full order or directing the customer forward or escalating. | empty |
cpqcFHcTPDSuio2okgcwrw | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Home |
RMB3w5px27wbVjAxid4ut8 | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and instructed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Cole |
YXZeVptLsbKpuYZQQZXKR7 | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
AXRF2uUBaPQC3HWaBvf78u | RBI Bakeoff | YES | The agent captured the full order and directed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Home |
czrEvasSyrQ2ZmJXPFEYZj | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalating or handing off. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Red |
VUxnqsFNDr2WZim6At6c8D | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order details including spicy chicken, mashed potatoes, biscuit, large sweet tea, and directed the customer to pull forward without escalatio… | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
gGgmRBk2LRtVZZNANbVFRt | Simulation Run 2026-08-18 16:53 | YES | The agent took the full order, confirmed it, and directed the customer to pull forward without escalation. | empty |
Order five classic tenders by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose cole slaw and a Sprite.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
6AFwUrfVkPGTJdf8xAi6wZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7bWeaGxeWGUQKkCNRfj2jw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8Nu9dnMVbWjHDT8teUGUnv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FdaQAK3bXn5DWyMTyhSX7Y | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Jy58rQKSmRD6TEu6U3B4i7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NH2uvjv6xZh3YQMByrHLRp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VqqYVuiQfGgXXb3xsqShq4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YUvPC9f8LecJfxPep48fCF | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aWxuSvaxgAfetr6CvwLBLu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bKMC8nEhPZhx4BksJGSaKE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZuwrNknPoGu6UQUVWq9UkW | Simulation Run 2026-08-17 01:07 | UNKNOWN | No order was taken or customer directed; the transcript contains only greetings. | empty |
MjeRsMVBQwc2oAbyj65To8 | Test new prompt (Aug) | no transcript | — | |
Pt4UQXQoRQBsnPgeTHf82u | Test new prompt (Aug) | no transcript | — | |
XpFBumY7VPzxpR2KotUEQ7 | Test new prompt (Aug) | UNKNOWN | Transcript does not show an order being taken or customer sent forward; no escalation info either. | empty |
o69UMVT7WAupyYVtJCX5B2 | Test new prompt (Aug) | no transcript | — | |
Zj9MLFYqeaBtbGdPGNYyHQ | RBI Bakeoff 2026-07-23 | YES | The agent captured the full order, confirmed it, and directed the customer to pull forward without escalating. | 1x 5 Piece Chicken Tenders Large Combo (Classic, Blacke |
gTFP4Rf9G5DPcVsCcu9HqP | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and explicitly instructed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Classic, Blac |
QApjZ6FNELwX3xNvtKGumx | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the customer's order and directed them to pull forward without escalating to a human. | 1x 5 Piece Chicken Tenders (Mardi Gras Mustard, Blacken |
ETxUWmcrPVLVnLCVLvePMA | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Classic, Blacke |
CUDK25US7fcYPTKCCocxjZ | RBI Bakeoff | YES | The agent took the full order, confirmed it, and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Classic, Blacke |
cvxGjxrnQq9gNmZr5GVjBt | Simulation Run 2026-07-20 23:58 (scratch) | YES | Agent fully captured the order and instructed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Classic, Blacke |
KZfy5YfMxFXasyfDUEzdGH | Simulation Run 2026-08-18 16:53 | YES | The agent captured the full order and directed the customer to pull forward without escalating or handing off. | empty |
nKiDzNs7ipmSZopMExXiWd | Test new prompt (Aug) | YES | The agent took the full order, confirmed it, and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, B |
Give me the chicken wrap bundle with a mango lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
3S5KFfw9HfHGDeVDQTQhFo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FZxqcjxhTyKGNacfUSUmsi | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript contains no order details or indications of directing the customer forward or escalation. | empty |
NkM7BjXQkvSBCGoBUeWFiR | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not contain any order details or direction to pull forward/order completion. | empty |
PzMoNBGWLZVMwX7joB5LR6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RsUxVnZ5FyZgBRLUJEubmm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UHLYi9eZ5WhGDYSVy8QKrk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UYX9LngHp4izyaKNrcHobm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eBDfWSAMwwoUfUgSMeKrnm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eMkkjT98RuFpiUFf6kCocY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hMMGZKkdP5q44tsZjv5TrV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
C4fb3CPy4qDfiCC3gVhuGk | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not contain any agent responses or order processing details. | empty |
2ePdnuYZdG9QQWmtKHhzpA | Test new prompt (Aug) | no transcript | — | |
BMnVxuaHni8FPDqGTsrrw6 | Test new prompt (Aug) | no transcript | — | |
BVBdRF29DZKDNejrzZ5o5n | Test new prompt (Aug) | no transcript | — | |
eqGUk5S2AtJT9VbU2kMtDy | Test new prompt (Aug) | no transcript | — | |
kqSb78QqmFcKHGAZibyUAM | Test new prompt (Aug) | no transcript | — | |
CKu6Z6Qdahvg6nbyCs4UMb | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalating or handing off. | 1x Chilled Mango Cane Sweeeet Lemonade |
eiHpBCm5uf8HhYcuzotWZE | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent captured the full order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x Blackened Wrap (Blackened Ranch); 1x Classic Wrap (C |
bjQheLVA7TTe7VaDSXiA7J | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the customer's order with all modifications and directed them to pull forward to the window without escalation. | 1x Wraps Bundle (Frozen Mango Cane Sweeeet Lemonade, Cl |
RLx6Zczftqw98mn9qMie8R | RBI Bakeoff | YES | The agent fully captured the order and instructed the customer to pull forward without escalating or handing off. | 1x Blackened Ranch Sauce; 1x Chilled Mango Cane Sweeeet |
Nw26bwF6zE3iUVQMhYot8c | RBI Bakeoff | YES | The agent took the complete order, confirmed it with the customer, and instructed them to pull forward without escalation. | 1x Blackened Ranch Sauce |
DoddpJHBpHhpVoLchYvhgV | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent took the entire order, confirmed it with the customer, and directed them to pull forward to the window without escalation. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade) |
9g9XPN36m2q4oshTpdQtJ2 | Simulation Run 2026-08-18 16:53 | YES | The agent took the full order and confirmed it with the customer, then directed them to move forward without escalation. | empty |
Can I get the Ghost Pepper Sandwich combo? Actually, change that to the regular chicken sandwich. And make it spicy.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
2BgH4xSofJbjfvYkRk3p4b | Simulation Run 2026-08-16 21:10 | no transcript | — | |
2FBVs8Cyjc74xaJHh4zde5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
3LvCcYCRxx7aj7DnAARHPd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
3Sw8ao6VfnyHKuP3N6UJNo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
44DdobbGHk5skYBn3fcqzA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DSMiHv4okBpsevFsxdfRgR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KvjHNocTPtBhmU2RDZanXJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UYM365kphEmcKaioWuftpf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
boBsHgPLooWXsv6EDSxuGF | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hdfM5jNTHkZ8F9dhuyUzQW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eyZm3WPL2nHpsU7tg4qQgs | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript only contains the customer's partial order request without any agent response or order completion. | empty |
7Fgfm5KyFCavMHVS7PTmaR | Test new prompt (Aug) | UNKNOWN | The transcript does not show the agent taking the full order or directing the customer forward. | empty |
9xyC9tdodeHFGXCDFRo4uX | Test new prompt (Aug) | no transcript | — | |
LFSRLetS2n7rCxFd5aRedj | Test new prompt (Aug) | no transcript | — | |
QN97Bqm2co2VwdR2kWhgQ4 | Test new prompt (Aug) | no transcript | — | |
bkXCu2x2Dx6wSgXxwNcad6 | Test new prompt (Aug) | no transcript | — | |
A9yrQv7A5DRmbEPJvHb4M7 | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalating to a human. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, F |
Rbo7Wfo4uLu4XzB8eCNCdh | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent took the full order, confirmed it with the customer, and directed to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
LtJaPDNSiJ2zS9RXKVHrYt | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order details and instructed the customer to pull forward to the window without escalation. | 1x Spicy Chicken Sandwich Large Combo (Frozen Strawberr |
Uyyd7dkC9gHJKi2eUQQzAU | RBI Bakeoff | YES | The agent captured the full order including sandwich, side, drink, and pie, then instructed to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, F |
WakiKSjfyLgdjLUpELKbKS | RBI Bakeoff | YES | Agent fully captured the order and directed the customer to pull forward without escalating. | 1x Spicy Chicken Sandwich Large Combo (Frozen Strawberr |
BAJJjaUJsUAZNYTEtDbmoZ | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Large Combo (Frozen Strawberr |
myW7D3LVinbMHxbWShRwGg | Simulation Run 2026-08-18 16:53 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | empty |
Can I have a Cajun Rice please?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
2aiJjKhS4jzt98JMk8ZFw4 | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not include the agent capturing the full order or directing the customer to pull forward/next window. | empty |
9CmYUeKtDQN2RNdA6sNcnq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DNPmppgbxrWrHi4J2SnQ4s | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EsUzZYoJ4do4NgGQmGjjqN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KYoWipuboUaiq6rf9eiQnD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZbeqohfRudaJpyx3LDmVww | Simulation Run 2026-08-16 21:10 | no transcript | — | |
beJJNmUuWyLr6QrCzf4RGo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dtLakzjREMThkjtt2n8qec | Simulation Run 2026-08-16 21:10 | no transcript | — | |
j4cGuwWiJ5rDbRaXHHVgFj | Simulation Run 2026-08-16 21:10 | no transcript | — | |
keWGwPCAtmoVAJPVCVkVdy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
5hyNecizn9tfJQdu7E4L7r | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript shows only the customer's order and inquiry; no agent response or order handling is present. | empty |
9LBVVCqUMbVEkfjpn4h5xB | Test new prompt (Aug) | no transcript | — | |
GGNJEgRDyesN3thjrdaZek | Test new prompt (Aug) | no transcript | — | |
ZxJMDK9rwvVfNfccSd3Eru | Test new prompt (Aug) | no transcript | — | |
a5uAzfq9qzUJdwHGRsVv7S | Test new prompt (Aug) | UNKNOWN | The transcript does not show the customer placing a full order or being directed to pull forward/next window. | empty |
kkgELL6wRYuKMh9ZoBDqcv | Test new prompt (Aug) | no transcript | — | |
JgFG4PQBVwfSgcFVUJWhqr | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the customer's detailed order and instructed them to pull forward to the window without escalating or handing off. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
3CL4THzHDMQ6Q5yBDjmWQs | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured the order (2 biscuits, regular red beans and rice) and directed customer to pull forward without escalation. | 2x Biscuit; 1x Red Beans & Rice |
ZCYvfhuKmLywZjCeqgeDws | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to the window without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Spicy, Blackene |
FMGJHwEPDMVsWYCUAMdMFx | RBI Bakeoff | YES | Agent captured full order including size and honey packets, then directed customer to pull forward without escalation. | 1x Cajun Fries |
Vb2GuGWPQND62PQpd4hAT8 | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward to the window without escalation. | 1x Red Beans & Rice; 2x Biscuit; 1x Cane Sweeeet Tea |
cqSSXe3FQMW4xzJLb9FGiG | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Red Beans & Rice; 1x Biscuit; 2x Honey Sauce |
nZdWKXqeUsui8zBMuQMmFE | Simulation Run 2026-08-18 16:53 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | empty |
Do you have nuggets?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
9crMmkBEia6ikDSDXvbmJC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DTRgPkKSLiTSPDPnuL7Pt5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
E7CY8iAwMWWB6RqjU3hZZp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JJ4uypgk3dYa4SsrUo533w | Simulation Run 2026-08-16 21:10 | no transcript | — | |
R2MqiMP5seHYhLP9uPrH2N | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SokjRgVkPppWjkNwpWaqPQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZPFMbvE7qPRJrXFcpMvHk9 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cmE7oWJ4phPLUFsPEZLNEr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fsYecseNN74e7dWx48mZMi | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kWyyTNLRvgw9qH9V2AtFGw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GvMCVZKzG2vYW28ciBVsSA | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not include any agent responses or order details to evaluate. | empty |
6Gi24kNNVY6nttMzJMAqCs | Test new prompt (Aug) | no transcript | — | |
AXEhWvY8JLtqfSTnWnGBZk | Test new prompt (Aug) | no transcript | — | |
KPwF8mADYcNFokTWM5fDwr | Test new prompt (Aug) | no transcript | — | |
iSMmpHvxcyso7uszipapZg | Test new prompt (Aug) | no transcript | — | |
nmbzjkVPtuCjoitXxaoKtd | Test new prompt (Aug) | no transcript | — | |
CgnPrVRgWE4aDFUYL3tuLp | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the customer's order and directed them to pull forward without escalating to a human. | 1x 5 Piece Chicken Tenders Regular Combo (Spicy, Mashed |
eDhjj7nBeK7zifgL5rsD3y | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order, confirmed it, and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Blackened Ranch |
nAmum2SRjq5YgsZqpLzV7u | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and instructed the customer to pull forward without handoff or escalation. | 1x Spicy Chicken Sandwich Large Combo (Cajun Fries, Mas |
EnmvFdMr6XxH4tuZGcZdxC | RBI Bakeoff | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Bold BBQ, Buttermi |
ivXz49oGVas9LB4FJRpQK3 | RBI Bakeoff | YES | The agent took the full order with all modifications and directed the customer to pull forward without any escalation. | 1x Surf & Turf Combo (Blackened Ranch, Garlic Parm, Hom |
FNJw6Gbbtbz7uYRKgYiLDo | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Chicken Tenders Regular Combo (Blackened, Wi |
542oyb4ZBt4zDYJrtqFb4h | Simulation Run 2026-08-18 16:53 | YES | The agent captured the full order and told the customer to pull forward without escalating or handing off. | empty |
I'd like the 5-piece tenders combo, blackened and spicy, with cole slaw and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
4HqgKSTWiKB3Bh63vaV3ki | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7UQHtKiqMAF5LPgKkYtTPF | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8BRApWJtDKZ4R6qQV6TTUC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
93ZGb4aezUJphvmviCwXHw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HQugySW2ndNcn38FawoxLY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HcckoEy9nDohSXXx3SmupE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PmbvLSftQWdCLsVKpqPyLb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Tj7HHL35Fi3DnssTXS5r5N | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aXQagT2Jgp6Jd72yuiyAny | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cM4cyZ6zJkTuMx4FFzKfiR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mLc3Tw5pKGTntLfFqDfUqu | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show order taking or directing the customer forward, nor escalation or bail out. | empty |
88kg7NZMLKpyAfechoL4xG | Test new prompt (Aug) | no transcript | — | |
UeLkXxmbZfEu72jYSeMPGn | Test new prompt (Aug) | no transcript | — | |
YmEhUnWYL92yJSFT8Vojty | Test new prompt (Aug) | no transcript | — | |
cdpk7HrMuqSpN7PuToFqWF | Test new prompt (Aug) | no transcript | — | |
igsuSFEkWbYfY84FpnZnTW | Test new prompt (Aug) | no transcript | — | |
nwMFe3tG7HukNhytVkhsrm | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the detailed order and explicitly directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
C8weZYV9UirC5y6JLqrhzc | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
HVvRckFuy2UPgBV2Jf43GX | RBI Bakeoff 2026-07-24 | YES | The agent captured the full order and directed the customer to pull forward to the window without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
mdxEGZLaKmdkWqrAdv2Ev7 | RBI Bakeoff | YES | Agent fully captured order and instructed customer to pull forward without escalating to a human. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Sp |
J6XxFtFzEifXAYt63jV9iY | RBI Bakeoff | YES | The agent fully captured the order including all modifications and sauces, and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
CbkrujH5FLFSeisXS3SjTi | Simulation Run 2026-07-20 23:58 (scratch) | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
gqHWeE5Mbi4ERLpXyqBooq | Simulation Run 2026-08-18 16:53 | YES | The agent took the full order, confirmed it with the customer, and directed them to pull forward without escalation. | empty |