Speak naturally and conversationally like a real drive-thru customer. Stay in character and only order/respond as a customer would. You change your mind repeatedly mid-order, swapping items, sizes, and sides after already deciding.
Test case names jump to that scenario's conversations below.
Failures first within each scenario. Simulation IDs open the transcript in Coval. The judge note is Coval's written reason for the Completion verdict.
Do you have nuggets?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
75YQVG2BwKwBFdRs2BwGd5 | RBI Bakeoff 2026-07-23 | NO | The agent failed to complete the order and did not direct the customer to pull forward or the next window. | empty |
ahU9omddbQ52qRR5SspmKy | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to an employee for order verification instead of completing the order directly. | 1x 5 Piece Chicken Tenders Large Combo (Classic, Wild H |
DFWFmvNDYNCcv9NAEE6SqX | RBI Bakeoff | NO | Agent escalated to a human team member instead of directing customer forward after taking order. | 1x 5 Piece Chicken Tenders Regular Combo (Homestyle Mac |
SWwgoj5WiAfxPExPhJzGHL | Simulation Run 2026-07-20 23:58 (scratch) | NO | Agent escalated to a human employee instead of directing the customer to the next window after taking the full order. | 1x 3 Piece Chicken Tenders Dinner (Blackened Ranch, Caj |
4o2UrTw4deXqdd3d2Qfk48 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QcHe4thYJhxpj9h34amAxa | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SXkKqremFuWzF3qnkx7Wks | Simulation Run 2026-08-16 21:10 | no transcript | — | |
T4X6ETF6QQXGVh6SS2mD83 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aQB5XMuPnjBZ5JhzwHjyvK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
baCXD7anR2YN535Le6xEDZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jTAnzExBqEMDauvMNkhhpU | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jwX6krR5dwGkDHT7QW5w8t | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kehnSf7kMBiknHqNYxXBJU | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show any order being taken or the customer being directed to pull forward. | empty |
nvzTyLBUD64zxNVTU8VtVe | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SbHJChufF6ghSJPUrU2TzW | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript is too short and lacks any order-taking or directing to pull forward steps. | empty |
JA6UNYoWjAVYtp2MR9QdEz | Test new prompt (Aug) | no transcript | — | |
KhXRyuZ6VjE3y4MhLzKkG7 | Test new prompt (Aug) | no transcript | — | |
VbyREkVrjUVMGULmDNeFBg | Test new prompt (Aug) | no transcript | — | |
XMcUty7dxwTfXXQ6mMgisw | Test new prompt (Aug) | UNKNOWN | The transcript does not show any order being taken or the customer being directed to pull forward. | empty |
fp8GGUMoxsnTV6WUkJGB8B | Test new prompt (Aug) | no transcript | — | |
8mmTV6LKvVsbXW3vjj7aoH | RBI Bakeoff 2026-07-24 | YES | Agent fully captured the order and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Spicy, Cajun Fr |
H6MdUZNRVoqYvGw8NKwVLS | RBI Bakeoff | YES | Agent took full order, confirmed it with customer, and directed to pull forward without escalation. | 1x 3 Piece Chicken Tenders Large Combo (Blackened Ranch |
gGPnmZEvq9aQsMDKabUUn4 | Simulation Run 2026-08-18 17:12 | YES | The agent took the full order, confirmed it, and directed the customer to pull forward without escalation. | empty |
Order one classic chicken sandwich by itself. Do not ask for a combo. If the agent offers to make it a combo, accept and choose Cajun fries and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
7nwTK5uxnM3muZmRZvbdsp | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human by saying 'An employee will assist you' after taking the full order. | 1x Classic Chicken Sandwich |
aMLQVa8AV2jhvcsRJNZJDr | RBI Bakeoff | NO | The agent initially told the customer to pull forward before the order was complete, and the customer changed the order afterwards. | 1x Classic Chicken Sandwich Regular Combo (Cajun Fries, |
cqXmqUa96GaXUBYGF9N36o | Simulation Run 2026-07-20 23:58 (scratch) | NO | The agent did not direct the customer to pull forward; instead, the agent escalated to a human by saying 'An employee will assist you.' | 1x Classic Chicken Sandwich |
2ogrF3mj7B5rodCqn23K5C | Simulation Run 2026-08-16 21:10 | no transcript | — | |
44KvZRQWbd7DZ9AEEC2UGw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
553goRy67N9hKhMvts52AH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AZYaQzFcfdKEbevZXVNLSH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LPTi8yGaitT267cVhstcSC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MjRZEmHc72i5BFMfsc3KXt | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WMh6fTD522Xb7HLnPnexxZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Z26W926xU83pUvF6L62UpV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bvnGS9hCXKcYcrh8o47PAz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cDWt4WtBtLQDpJiQs3hhBW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
C8JjZDfbLp8VcfSuXTkWHb | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript contains only greetings with no order or direction given to the customer. | empty |
6JAEpD8gmHy3NDjPavaQg4 | Test new prompt (Aug) | no transcript | — | |
JsKo84nckywshQCGSYLtFK | Test new prompt (Aug) | no transcript | — | |
cjx33Sf8AQQ39myNbc6TEi | Test new prompt (Aug) | no transcript | — | |
ftusa4Ysnfzx55aYgZ6eDd | Test new prompt (Aug) | no transcript | — | |
gEYmbe7g5NuYb5s6WcMf25 | Test new prompt (Aug) | no transcript | — | |
bwdnqvSBmQnzq6QUQsD6yw | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich Regular Combo (Cajun Fries, |
GXtJ5iBst6EhZNwA72rt2E | RBI Bakeoff 2026-07-24 | YES | The agent took the full order with detailed modifications and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich Regular Combo (Cajun Fries, |
kqHUkYHE94qFRtov7SWwH7 | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich Regular Combo (Cajun Fries, |
MYKGgWDT3Eu9YYA3yto32V | Simulation Run 2026-08-18 17:12 | YES | The agent took the full order and directed the customer to pull forward without escalating. | empty |
I'd like the 5-piece tenders combo, blackened and spicy, with cole slaw and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
Z6b9LshTLUvn6F8efa7daw | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent escalated to a human by saying an employee will assist, thus not completing the order fully themselves. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Ma |
SKmu5fyiSiEgMugKqCvCht | RBI Bakeoff | NO | Agent escalated to a human team member instead of directing customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Spicy, Blackene |
GAAadyc8EMYMBm2tx8Eq7L | Simulation Run 2026-07-20 23:58 (scratch) | NO | Agent failed to confirm the final order and escalated to a human employee for assistance. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Sp |
5eFstPxHsQqe8htkWHxK38 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
D3bPjkvp4yBHpL97hpF4gR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Jm8rLfbCjM4udLheEZZEXh | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Tn6TY69XfKCkVJuWtBEPsW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
a88WCXvhBgYM2dxzD73nnk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bCgFxFMJUqdbDpmuuShXxS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
chcpAe67AbyrcJ2SJxPwb3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gQjc2vGCTVh3Q9AoqUmAFb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
imRvyfLQ5tfGLQ5MpajemE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nGmvkPgcbDKVJs4udZkWpK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4GCZW9aFjjURgEVGAahYpx | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent directing the customer to pull forward or the next window after taking the order, nor does it show escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Coleslaw, Coc |
4BiPU5RwNKuQCHv5Muu3pQ | Test new prompt (Aug) | no transcript | — | |
T8yoTfABy7h5eoaTjoyHDJ | Test new prompt (Aug) | no transcript | — | |
U8qFjCDTDKZf7BKoeRT6WB | Test new prompt (Aug) | no transcript | — | |
ZVKAr6YLiMepk27TAchJow | Test new prompt (Aug) | no transcript | — | |
nthot9eDi922KdNqZ4H7jn | Test new prompt (Aug) | no transcript | — | |
6rUo8pYtwvU3MKuopCq7Ys | RBI Bakeoff 2026-07-23 | YES | The agent captured the entire order and instructed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Sp |
GzCq2Wrczcbw7hAoaKiPNC | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the customer's order with all modifications and directed them to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Spicy, Cajun Fr |
T4c5A82kk4bEteDg2dnnxH | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Sp |
dNTi542STC8sAaKYZvQ2N8 | Simulation Run 2026-08-18 17:12 | YES | Agent captured the full order with all changes, confirmed accuracy, then directed customer to pull forward without escalation. | empty |
Can I get the ghost pepper sandwich combo, swap the fries for red beans & rice, and a Dr Pepper?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
SgK4m572F7oKUKcjcQgXUL | RBI Bakeoff 2026-07-23 | NO | The agent repeatedly said 'An employee will assist you' instead of directing the customer to pull forward or the next window. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
Nw99udeXtK5Ei4qXqXUkuX | RBI Bakeoff | NO | Agent escalated to a human employee to confirm the sandwich availability, failing to complete order independently. | 1x Spicy Chicken Sandwich Large Combo (Mashed Potatoes |
3bvysBCVXrL2mT6zDQHcuw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GqjxtxAqzwKj42g7dtKqxi | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PFjSEdnT7JSaTRc4no6s53 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QSL7YHHohvgm6UXjL2SZXe | Simulation Run 2026-08-16 21:10 | no transcript | — | |
R7dTxRLWebRBSDsJmmg8jN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SifckuLMRVS5WPGUXqs4Bi | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VYbVVGNWPfYdxLqWyRXfiL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bLxSmmmGfGtDhhRY8QyiLE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gxh6cg3avQakZrgMzfcuFy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jnHyjBH4hjiSDfxH82iuS7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
N9yKY6oNZG3W6kRifxrKRE | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript only shows the customer placing the order; no agent response or direction to pull forward is included. | empty |
2T3fFtnSb8BigkWFhAZP6F | Test new prompt (Aug) | no transcript | — | |
4KRmBFCmMJ7B5vVap69aWV | Test new prompt (Aug) | no transcript | — | |
73YcBMLTFMKmUw3i2oNUgg | Test new prompt (Aug) | no transcript | — | |
AvCbmHhBSJuLA37tcBwAaz | Test new prompt (Aug) | no transcript | — | |
fzbjAScvNhFouwAMxopL7U | Test new prompt (Aug) | no transcript | — | |
i7M2mtY82qCs9hov7iDnqc | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order including all changes and directed the customer to pull forward without escalating to a human. | 1x Classic Chicken Sandwich Regular Combo (Red Beans an |
LK5vnbhZXz6xCLDsrexAmF | RBI Bakeoff 2026-07-24 | YES | Agent captured the full order including combo, side, and drink, then directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Mashed Potatoe |
BAMiRXZVaAkgNL2R5L4VbH | RBI Bakeoff | YES | Agent fully captured the order and directed customer to pull forward without escalating. | 1x Spicy Chicken Sandwich; 1x Red Beans & Rice; 1x Dr. |
A59KnhTFDEbHzysSPDNBhz | Simulation Run 2026-07-20 23:58 (scratch) | YES | Agent fully captured the order with all modifications and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich Large Combo (Red Beans and |
7MunUNyPVEfduPQ2WgwioC | Simulation Run 2026-08-18 17:12 | YES | The agent took the full order, confirmed it, and directed the customer to pull forward without escalation. | empty |
Can I get the Ghost Pepper Sandwich combo? Actually, change that to the regular chicken sandwich. And make it spicy.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
4ZYPMs7Y2EKcT3qXDmuo7Q | RBI Bakeoff 2026-07-24 | NO | Agent couldn't read back the full order and suggested employee help, indicating incomplete autonomous handling. | 1x Spicy Chicken Sandwich Large Combo (Cajun Fries, Hom |
nx2k4PMecNvriAMitWVswH | Test new prompt (Aug) | NO | The agent never completed the order or directed the customer to pull forward or the next window. | empty |
A3ze5Bbf3VkEy5WxVuzCCG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
B5TCQnavdFcW53bcyWRGek | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BeVLFBHGzBGPaxiLiGP3HV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VKCayUVonwmTYRyK5QgdrA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
X9xsH8za7vGi8AVAkDapZu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Y8zPpEHHThx9R3wQQHauTX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
a6MiuRJG6SAmq9SJZ33jKz | Simulation Run 2026-08-16 21:10 | UNKNOWN | The agent did not complete the order or direct the customer to pull forward or the next window. | empty |
d2FfdYHUv57D6EqXVNaekL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nAyAbgjNCz6EUQACyiam7g | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nU3j2VTBZB3cbfLb35tisv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
L6r9ctck5gRG5zrUCF5pHT | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent taking the order, directing the customer forward, or escalating. | empty |
9JJhbkpNcpSb2RNxHERmMk | Test new prompt (Aug) | UNKNOWN | Transcript does not show if the order was completed or customer directed forward without human escalation. | empty |
UhgRA4FXTkhinmG5f5wpeE | Test new prompt (Aug) | no transcript | — | |
aQtWZwQxyVsuyt36BrjMun | Test new prompt (Aug) | no transcript | — | |
np2rQss5hNhQ8dMdo558BT | Test new prompt (Aug) | no transcript | — | |
jHtMq57LF9cKMw7yRyFsR6 | RBI Bakeoff 2026-07-23 | YES | Agent fully captured the customer's order and directed them to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
b2qWGcUWexVT5tyuU6GeoJ | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent captured the full order with all modifications and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Mashed Potatoe |
fKMrT3hLFZa68g7ZKX3QfD | RBI Bakeoff | YES | The agent captured the full order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x Spicy Chicken Sandwich Large Combo (Homestyle Mac an |
579VKCTcahYTH89JQ2iDWD | RBI Bakeoff | YES | The agent took the full order with all customizations and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Mashed Potatoe |
WtkNykrJUvPBbo2r6FietU | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent took the full order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x Spicy Chicken Sandwich Large Combo (Mashed Potatoes |
dg6y4maQK9FVzXxdTozNYr | Simulation Run 2026-08-18 17:12 | YES | Agent took full order, confirmed, and directed the customer to pull forward without escalation. | empty |
Give me the chicken wrap bundle with a mango lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
KNNgE8K8afxMQRHU8VzDf5 | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human team member at the window for order review, not completing order alone. | 1x Wraps Bundle (Spicy Wrap, Classic Wrap, Chilled Mang |
55E23VxYUrySrqG4pKHwtA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BJgLuUvrnMxsuUswK6ebYv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DUfknTrDtrtNd7grAiDJaM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
E6d4i6tC9AZ7wM6C4yAjR8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HmhZ98nvKEJ9JMuFKsdAMK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Qy6LB33jfQ7kcAJ3j6azoH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XfVZidPqbXEvo9ZiAhCmLZ | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent capturing the full order or directing the customer to pull forward or the next window. | empty |
aFsWnsEWx2YPx9k6pZHn6T | Simulation Run 2026-08-16 21:10 | no transcript | — | |
g4ao42544xqKXRJGAbK2h6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nzNHeBkpGD8cL7wfneSgTM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WVLSdtybtZMU49p2h43Hvp | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent completing the order or directing the customer to pull forward/next window. | empty |
EnafjjzxietLUJ5nQNKXzs | Simulation Run 2026-08-18 17:12 | no transcript | — | |
J3robzvMLwrFmpZRJ9XJ8Z | Test new prompt (Aug) | no transcript | — | |
J9mMHSLV7aV7dW5JxRLFNa | Test new prompt (Aug) | no transcript | — | |
LuLCH9xSAjMfFtmyepbG2s | Test new prompt (Aug) | no transcript | — | |
UrWx3iB8myW74ShyMes5Jg | Test new prompt (Aug) | no transcript | — | |
o7KNSDHSWiAxsLddhYj3jC | Test new prompt (Aug) | no transcript | — | |
BzUNzwptsTvFoHCcGgJUBf | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, S |
VR7ZtwNQynJ9oG7XwHS3oj | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent took the full order with modifications and directed the customer to pull forward without escalation. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade) |
nSbvTAPaU62YipGNDYhNKz | RBI Bakeoff | YES | Agent fully captured the order and directed the customer to pull forward without escalating. | 1x Blackened Wrap Regular Combo (Mashed Potatoes with C |
5DLhgP2rWLkBAYnVie4zxM | RBI Bakeoff | YES | The agent fully captured the order with all customizations and directed the customer to pull forward without escalation. | 1x Wraps Bundle (Frozen Strawberry Cane Sweeeet Lemonad |
G45stEYdAHhFRrCYRtRLit | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent captured the full order including all modifications and directed the customer to pull forward without escalation. | 1x Wraps Bundle (Classic Wrap, Spicy Wrap); 1x Frozen M |
I'd like the 3-piece signature chicken combo, spicy. I don't want fries. What other sides do you have?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
JWMN2ppfHyyp43GNFQ4JJQ | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human by saying an employee will assist them without completing the order fully themselves. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
3wjT8Ffd3Bydj36hM8mctP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
6oWGsAeDdPJsRsoDPHWVMx | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BsaUwhcUCFqkHD38rnGKGy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DifKTHp9D4YUffDDdBmQsf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
THWv7zwbotH3evfAZqKt9z | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aKBqF3qQMZUCKpmT6g67dM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dytNVKbKA2mnZasHGbfiNN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fYYbFzobXrDzFrjUHb7mMo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kpzo5FYhdqJpLPfBQAymQn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
oEyNayBaBcRXE6UeS3hvnD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Ts33NTVJyJQrxTnBysnVHB | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript does not show if the order was fully taken or if customer was directed to pull forward. | empty |
4JPSFBTgcRJXjZFARfwaEg | Test new prompt (Aug) | no transcript | — | |
C96mzaLxVjVtb2uS4JnGbm | Test new prompt (Aug) | no transcript | — | |
FTBmGGWkzCx62ZskMMt9WV | Test new prompt (Aug) | no transcript | — | |
QuhseTfKTN24Sib6hTUjVd | Test new prompt (Aug) | no transcript | — | |
hcFJYKcbnRDuQFv8dquCQW | Test new prompt (Aug) | no transcript | — | |
9AX7jZjZrpnRJTe97aq7td | RBI Bakeoff 2026-07-23 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Red |
mzpDohFpbYCKAHYtateiNF | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the customer's final order with all modifications and directed them to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Red |
LV8wrBVPPguwfes7MVXMtt | RBI Bakeoff | YES | Agent fully captured the order with all modifications and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Red |
TCz6JN4YfLu9U2GDggfJn3 | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
aBxTJzCsyei9GUYMGyT5NP | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order details and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Home |
e2esiV6zsokjSZ3VJnPibr | Simulation Run 2026-08-18 17:12 | YES | Agent captured the full order and directed the customer to pull forward without escalating. | empty |
Order five classic tenders by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose cole slaw and a Sprite.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
cffXevwixHsDxQvBATUAP5 | RBI Bakeoff 2026-07-23 | NO | The agent did not complete the order and escalated to a human employee for assistance. | 1x 5 Piece Chicken Tenders Large Combo (Classic, Blacke |
ET6xoPiy8Hpz4zLiCDuN9q | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FTtJ7RMzcWPNdicDyevsxy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FubPHvgXeq4Ax5vNmngpEJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LRxhFqRujPe8KeHN7waMWs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
S3pienXteyffhTmfjirEVw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YEYVUtmiZMv4tsp7gqpjAf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
btkapkLbV6nbdKCShpCpg5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cQHLFdfLgusMhWXYuzre4R | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fLh7jiorzE2nzWwpPKwcrM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nppmcjcs6ib9xtRvtktpLd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cVDjyyE7APecn4CA6odC7z | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript does not show the agent directing the customer to pull forward or next window after taking the full order. | 1x 5 Piece Chicken Tenders (Classic, Mardi Gras Mustard |
FYtrtiGTLRex3oRnrsg3Eb | Test new prompt (Aug) | no transcript | — | |
PZYTke3Eq5TfWHTHpC2wJY | Test new prompt (Aug) | UNKNOWN | The transcript does not show the agent completing the order or directing the customer forward. | empty |
PgiBChRRssjx7A3k5AdAd7 | Test new prompt (Aug) | no transcript | — | |
Qozu7PXj2nArdsRJWztQ7K | Test new prompt (Aug) | no transcript | — | |
b8oSRBrt6RBpGaQKouapAB | Test new prompt (Aug) | no transcript | — | |
3RxuXqfXA5sZa2XhSgXXAU | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent took the full order, confirmed it with the customer, and directed them to pull forward without escalating. | 1x 5 Piece Chicken Tenders Regular Combo (Classic, Mard |
GYKcYkqGCUFvVsTnei56iU | RBI Bakeoff 2026-07-24 | YES | Agent took full order and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Classic, Colesl |
6iHybrpbBZWVwMrEh67r9z | RBI Bakeoff | YES | The agent fully captured the customer's order including combo details and sauces, then directed them to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Classic, Colesl |
HGzC3TVw34Gkw76VeSqRdD | RBI Bakeoff | YES | Agent captured the full order and directed the customer to pull forward without escalating. | 1x 5 Piece Chicken Tenders Regular Combo (Classic, Blac |
WiLZsN6izvMFw9ccskRygv | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the customer's order and directed them to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Classic, Mardi |
XvRXReAqWgorHSTiYiLF5p | Simulation Run 2026-08-18 17:12 | YES | The agent took the full order and directed the customer to pull forward without escalating to a human. | empty |
I'll do the chicken sandwich by itself and a side of fries.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
Xz2jp6DSpi2EPjDps9j8NB | RBI Bakeoff 2026-07-24 Pass 5 | NO | Order was fully captured, but agent instructed to pull forward without confirming fries size as medium (stayed regular). | 1x Classic Chicken Sandwich; 1x Cajun Fries |
Dxu3Q2W7T42cR4KdLWcDT9 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PwA7bLzz8CizT2KX2QNaCB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZGdH77yGeHV5vHB9oNjND6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bDzQjBfWMvDeWLds8Bshzp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dZtf2Vq4T2En467VRCAv4v | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dnRLqtcBfjFCGadRqLo3TH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
i6uSNNwZLepWrSTXzPuPLd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kDNYR3AfbGRzHeA3VbcFEQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kW3YJsVMLaSK7hjas8yqE3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
n3ruA2rPKCZVUKHjSSxWHz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
B5XCqbEatJddU7hKGbmXLY | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript ends before agent directs customer to pull forward or next window, no escalation present. | 1x Spicy Chicken Sandwich; 1x Mashed Potatoes with Caju |
PFyNtHg2hJZJQsCkP2f5Ys | Test new prompt (Aug) | no transcript | — | |
Tjf8SST9tCtrq3CP6GsGhx | Test new prompt (Aug) | no transcript | — | |
YhUCCgYwJFxbqhJbT9AZNT | Test new prompt (Aug) | no transcript | — | |
be3zMZnsVfEXkKeP7zKRYb | Test new prompt (Aug) | no transcript | — | |
jvjDeio4iE6LKdGBqjXLH4 | Test new prompt (Aug) | no transcript | — | |
FrT8ZquVjSEHxGXAWCHA9o | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the customer's order and directed them to pull forward without escalation. | 1x Spicy Chicken Sandwich; 1x Mashed Potatoes with Caju |
MkWtSCCgnNmgGRpnTpcCrN | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the customer's order and instructed them to pull forward without escalation. | 1x Spicy Chicken Sandwich; 1x Mashed Potatoes with Caju |
H6YozwYYYvfgFRgSijG5bq | RBI Bakeoff | YES | The agent fully captured the customer's order and directed them to pull forward without escalation. | 1x Spicy Chicken Sandwich; 1x $5 Favorites - 2 Sides (M |
XLtXuFmCPGKkiV2QL3X2rr | RBI Bakeoff | YES | Agent captured full order and directed customer to pull forward without escalation. | 1x Classic Chicken Sandwich Regular Combo (Chilled Gum- |
5Luqnki3qNe3ktF8xnKRrT | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x Spicy Chicken Sandwich; 1x Cajun Fries |
fgVLitCZMRYhCmtYRp6Rpr | Simulation Run 2026-08-18 17:12 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | empty |
I'll do the 12-piece family meal with all dark meat, spicy, Cajun fries and cole slaw, and two Sprites.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
44XzyUDLxvjK3MgRrdzQQa | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human team member multiple times and did not send the customer forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
3TrTv6KQfTVSZ7H2E6g53m | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AYoiKhymNYzyj57Q7snQoK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BD6zY6V7zDeo8qTpkBMYAv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NCsasRSoaz3rSd96CVcbqK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QEKPpTrxXc8meChXxn2YPh | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RmCUJ4yc23hLyfHrknX7QB | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript ends without agent confirming complete order or instructing to pull forward next window. | empty |
U3n7bKEYo2oubLsALfRxdF | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cpFBZjn4sFM6YYaHfPKA7v | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fdSod8tE2TkRaNeREypSZq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nrrDMAcaE3Bm9uHvBQxLsD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BJLfBmLAaSeaQnfvTRDUXE | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript shows only customer ordering with no agent responses or order completion. | empty |
Cyk8AXGfemKb2JLnPXsVcW | Test new prompt (Aug) | no transcript | — | |
HUFsSdj3wbHSHCa58Hfo8H | Test new prompt (Aug) | no transcript | — | |
Jk5VTSaq3BpaYu7XYcz2u5 | Test new prompt (Aug) | no transcript | — | |
PZMrgrvcTi3t6XtwzCUdTQ | Test new prompt (Aug) | no transcript | — | |
TdxRtwNgd2evSryEMbnUKH | Test new prompt (Aug) | no transcript | — | |
bHEgNipEdC3wNyCbQekG7U | RBI Bakeoff 2026-07-23 | YES | Agent fully captured the customer's order and directed them to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, L |
AeZA69A9FbyQpvoNFLbut9 | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order with all customer changes and directed the customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
SCSsKfaSSYiepiV3DR8KKK | RBI Bakeoff | YES | Agent confirmed full order, clarified changes, and directed customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
mxZPqWQ8rorPWAi2EeJXVP | RBI Bakeoff | YES | The agent fully captured the complete order and directed the customer to pull forward without any escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
h66crKLp9Z4KQ4gXBJ6X4f | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order with multiple modifications and directed the customer to pull forward without escalating. | 1x 12 Piece Signature Chicken Family Meal (Spicy, Large |
Kchm6Wyy6pRw78HQAZWE7o | Simulation Run 2026-08-18 17:12 | YES | The agent captured the full order, confirmed it, and directed the customer to pull forward without escalation. | empty |
Can I have a Cajun Rice please?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
NrUhuZ4jqkBsHCxiSwvGA5 | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human team member for order verification instead of directing the customer forward. | 1x 2 Piece Signature Chicken Regular Combo (Spicy, Mash |
7H8q3xg4gBfCWJ4ZTu4rcW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AXYygZv27qJQYguXjfG8Ha | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FUMmXBw2TiwXkviG4e4vdC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MTjVw7rKUDa3tq7CsK7MvH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RA7kAMDMcczhL8dDSgrVKu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Yeeez6UtFePnpBkYkL2Lw6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
doBdSLxWEHBYMeqRGq9XJR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dxic9G8VvoNuKqZK3JVs8G | Simulation Run 2026-08-16 21:10 | no transcript | — | |
f9UaucvKznwEqJGYfDKoPx | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nmrWTZdEU6Grf4jQT27MC2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Ffp4UzGupnTw8ZbWx8dNUm | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent taking the full order or directing the customer forward. | empty |
CWS63wH8YtbvzDEJ3s5dUX | Test new prompt (Aug) | no transcript | — | |
FiN5jAuqz3mPtDNKVEv2di | Test new prompt (Aug) | no transcript | — | |
PEtmgecga3sTRdoG6GJMKM | Test new prompt (Aug) | no transcript | — | |
ScxjTKnsZPNJTAhFUbZHJB | Test new prompt (Aug) | no transcript | — | |
fxRBJD9hdcqLf5WEYVbzBo | Test new prompt (Aug) | no transcript | — | |
mxBLFrBdGunGWKQzMnMxPx | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Mashed Potatoes with Cajun Gravy; 1x Biscuit; 1x Can |
8JGp2KagtXr5QXBAvuJUDZ | RBI Bakeoff 2026-07-24 | YES | Agent captured all order changes and directed customer to pull forward without escalation. | 1x Cajun Fries; 1x Biscuit |
5ik9KqeSZ5q6EBFuEZFE6X | RBI Bakeoff | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x Cajun Fries; 1x Biscuit; 1x Cane Sweeeet Tea; 1x Hom |
Bbj4X4CCfuxxqQnBZiXhL9 | RBI Bakeoff | YES | Agent captured full order and directed customer to pull forward without escalation. | 1x Biscuit; 1x $5 Favorites - 2 Sides (Mashed Potatoes |
AZnjjb2ZAavMdTephGCvZS | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent captured the full order and directed the customer to pull forward without escalating to a human. | 1x Cajun Fries; 2x Biscuit; 1x Cane Sweeeet Tea; 1x Mas |
goMkrCw4dx9ysKU8MaYGcA | Simulation Run 2026-08-18 17:12 | YES | Agent successfully took full order and directed customer to pull forward without escalation. | empty |
One bacon and cheese sandwich combo, large, with fries and strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
eHMYmQK9k6B7M3wW4nsTL2 | RBI Bakeoff | NO | Order was not fully captured correctly; combo size was inconsistent and agent did not clearly confirm all details before directing to pull forward. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
4KhQkFgWMMBviSxhamc2M3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
B6idBuq5aVCktcipFTaXd6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QjF6GGy7kfJUpefQ8abYKB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Qp2ZzPKkJXEzYH4NtXRib7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SAkibHeXBsSEZukGrrT4pR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
TNPhLrxesVxcTfgFxaocVg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XR6r7qvMXjgAfJiP7E6waB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
c4LhKJYK8ydfdeHXFUNUB9 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
e2g8ruyNYNRJzYJBezj3V8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
imXY7G2ccVZHZ6iwFgbuWr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
J6xXPGEYHyjRZeUBbSpALX | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript cuts off before the agent completes the order or directs the customer to pull forward. | empty |
K36jEc9PqNp7MRvGmVLV93 | Test new prompt (Aug) | no transcript | — | |
TwJVR6hY3cEt4q7tcmg5Rm | Test new prompt (Aug) | no transcript | — | |
VpozeAVQ9fn2ccJUjMxr3k | Test new prompt (Aug) | no transcript | — | |
eJyzoLfn5i2jSPrGaZLQrS | Test new prompt (Aug) | no transcript | — | |
g5qbM4JAhHLt7k8vnJezqa | Test new prompt (Aug) | no transcript | — | |
GF5Eqm7nnwEyXLJ3crNvoX | RBI Bakeoff 2026-07-23 | YES | Agent took full order with all modifications and directed customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
Bxxv4bqZuFQohC6mtdfTmR | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent took the full order and directed the customer to pull forward without escalation. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (C |
3wThvNsBhNjQYyPxo4ZKsq | RBI Bakeoff 2026-07-24 | YES | Agent captured full order details and directed customer to pull forward without escalation. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (F |
drkzosYYZgLL9hqZiU5n8M | RBI Bakeoff | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Bacon & Cheese Chicken Sandwich Regular Combo |
mCtbazdXFDjG9KqYJc6SSN | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the customer's order with all changes and directed them to pull forward without escalation. | 1x Spicy Bacon & Cheese Chicken Sandwich Regular Combo |
4v22EZNVmVbMc5JeLcokSz | Simulation Run 2026-08-18 17:12 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | empty |
Start by ordering the 3-piece signature chicken combo, spicy, with mashed potatoes and a Coke. Before the order is finalized, change it to the 4-piece combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
52B7YGvu3r5CoRnRQNn7X2 | Simulation Run 2026-07-20 23:58 (scratch) | NO | Agent confirmed order but then said 'An employee will assist you,' indicating escalation to a human. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
5siZp3HPDEB4sSsB6szoZm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9pB4EHLJjjcVFR8KQbuona | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent confirming the full order or directing the customer to pull forward or the next window. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
AauLgSbfQQERPAKX6HcU4f | Simulation Run 2026-08-16 21:10 | no transcript | — | |
M9pAMzfBXwabTTYo6YiG5n | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NxFzozGAMzELKp6z3FGXQv | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript lacks any indication that the order was completed or the customer was directed to pull forward. | empty |
RMeykFwqHyBgEcxs5sFgEz | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent confirming the full order or directing the customer to pull forward or the next window. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
T3rY6fRbFQis9DKGdVh9nT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WSmGdQ7KL4r4afWoyRYaCm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dduxhnKJ5KowzYHbEXbUHy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nc3E6zEjGjfoh2BFHgveja | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BNohpd5Gi8kGsEuErfQzLg | Test new prompt (Aug) | no transcript | — | |
P9HbBTRaNuw8F4PtX53syM | Test new prompt (Aug) | no transcript | — | |
SZFDNNZUGFDKh7nhUs2pt3 | Test new prompt (Aug) | no transcript | — | |
VSRdtfH4gngPsKmPYWog4q | Test new prompt (Aug) | no transcript | — | |
ZJJW9rER4WNXCxqMMz3vJq | Test new prompt (Aug) | no transcript | — | |
KiuKGu7Yqv5i9UjdeFKMEg | RBI Bakeoff 2026-07-23 | YES | Order was fully captured and the agent directed the customer to pull forward, no escalation occurred. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
o4LREZ5Q4fYVyug7jMvEsR | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured the order and directed the customer to pull forward without escalating or handing off. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
HfZFftrsKAtsm7TsntwQX4 | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
JuRuf6N28yg2ZrZNtfGusp | RBI Bakeoff | YES | The agent fully captured the updated order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Large Combo (Spicy, Mashed |
ScbaQsGwvmFQ57giPrbvpy | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward with no escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
myqopGztSnxS6oYuMRDATm | Simulation Run 2026-08-17 01:07 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Large Combo (Spicy, Mashed |
i5pUs4NQedTAQHGibYV9nq | Simulation Run 2026-08-18 17:12 | YES | The agent fully captured the order and directed the customer to the window without escalation. | empty |
Order one regular bacon and cheese sandwich by itself. Do not ask for a combo or a large. If the agent first offers to make it a regular combo, accept with fries and a Coke, then accept a subsequent l
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
KFcxdFjAXpWQN9FsZJYRif | Simulation Run 2026-08-17 01:07 | NO | The transcript ends before the agent directs the customer to pull forward or the next window. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
9KRXU44EAZzrpfJUaWAUoe | Simulation Run 2026-08-16 21:10 | no transcript | — | |
E3qjbxg2Svgpm7KjPrvDYe | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EGMYKykapXRLuEW82Ahv3u | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EzbC6vDghcYcXAWGC9aGkC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FyF3npRgRXoFpJGQ3jZKGo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GsgTkUnKm9a4JMrpqEve3G | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SrwNDm853Yp6c5kkQE9KhP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aen4Z9qmoy4qSHaigWCRZa | Simulation Run 2026-08-16 21:10 | no transcript | — | |
b3fwg8FKQCHLmFEHfoRqUG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cmc6vKLuJUFMqkPnZt2JPD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
37pnXQ4uvuV88bX5F2k7h7 | Test new prompt (Aug) | no transcript | — | |
6uVfv9weQWmoxuEkykrkAU | Test new prompt (Aug) | no transcript | — | |
6yeZh7JBJhjydRJERGsNhm | Test new prompt (Aug) | no transcript | — | |
8bVkCkHeJvt2AniuRDSWdW | Test new prompt (Aug) | no transcript | — | |
EFGmGanwNuakPFy5KxAbtS | Test new prompt (Aug) | no transcript | — | |
dCUmhcnPJ3HYsQbK9njceG | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the modified order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
BhRxoN6mzLTtTHtae9jTay | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and instructed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
VPg4Pk59RDgWkU6noyCoEK | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order, confirmed accuracy, and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
TLS3qs6za3heZhBch3vTXq | RBI Bakeoff | YES | Agent captured full order with all modifications and directed customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
aUoXAYgRrrJNL9uiQqsess | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
KJhku7Fu2KdecmBtPQ7eMR | Simulation Run 2026-07-20 23:58 (scratch) | YES | Agent fully captured the customer's order, confirmed it, and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
GTDrXmb2xnmstEmZriLhjn | Simulation Run 2026-08-18 17:12 | YES | The agent took the full order and directed the customer to pull forward with no escalation. | empty |
Order three pieces of spicy signature chicken by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose mashed potatoes and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
MwAkeoENR8jPkrZsuPAmzU | Simulation Run 2026-08-16 21:10 | no transcript | — | |
erL2rwQM4smu5Cz8huRZi2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
J4y7VW8ipRgzGhSJnv7H8K | Test new prompt (Aug) | UNKNOWN | The transcript ends before the agent confirms the full order or directs the customer to pull forward without escalation. | empty |
NnSRv6iqZmz2SKKSdkRLmW | Test new prompt (Aug) | UNKNOWN | The transcript is incomplete and does not show the agent capturing the full order or directing the customer to pull forward. | empty |
WsELoWATPdYMPQQ4dhPwzX | Test new prompt (Aug) | UNKNOWN | The transcript cuts off before the agent confirms the full order or directs the customer to pull forward. | empty |
YxUjZNeAgUtqZq64A5fu3D | Test new prompt (Aug) | UNKNOWN | Transcript lacks any agent direction to pull forward or to next window, or mention of order completion. | empty |
hxMbJYCkhfyPnwG7MmoPki | Test new prompt (Aug) | UNKNOWN | The transcript does not show the full order being confirmed or the customer being directed to pull forward/next window. | empty |
9mfMXfb9ybwkzZBnZrwMAh | RBI Bakeoff 2026-07-23 | YES | Agent fully captured the order and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
k2zLC26XsjvvWLyYeDfPWM | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
DhRv6SFnXBDy3HciRLubYn | RBI Bakeoff 2026-07-24 | YES | The agent confirmed the full order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
2Xe3VSCnjLJGyGZVKYDtWU | RBI Bakeoff | YES | Agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
CYUfykxtK38EkzefSVpuaP | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalating to a human. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
eSN4ddSVfBcfUpADsTjyUY | Simulation Run 2026-07-20 23:58 (scratch) | YES | Agent captured full order including combo and directed customer to pull forward twice without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
52csewhE77SZ34V4HbdWg8 | Simulation Run 2026-08-16 21:10 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Cajun |
8vv6sJJ33JYtmqnfv2wUT5 | Simulation Run 2026-08-16 21:10 | YES | The agent fully captured the customer's order and directed them to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
BPwk9dMKdv5a65sH2TWcXZ | Simulation Run 2026-08-16 21:10 | YES | Agent captured full order modifications and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
H68yRjtuwe9HyiVN3ut9Fs | Simulation Run 2026-08-16 21:10 | YES | The agent took the full order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
R5Ek4cfTMsei3NB2iShzhe | Simulation Run 2026-08-16 21:10 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
cDZps3E8f8Kn6MuWcbfDz3 | Simulation Run 2026-08-16 21:10 | YES | Agent took full order including combo and sides, confirmed with customer, and directed to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
cH8PnW9fizatFxYY7sYib9 | Simulation Run 2026-08-16 21:10 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Large |
fvbAGAk7V4ioMczdrLSrkB | Simulation Run 2026-08-16 21:10 | YES | The agent took the full order with sides and drink, confirmed it, and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Large |
mLy7gXbENYs6S8NjdSXnFF | Simulation Run 2026-08-17 01:07 | YES | The agent captured the full order including all modifications and directed the customer to pull forward without escalating to a human. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Cajun |
CfZ8cFoMeAPjGP3XtZTw4b | Simulation Run 2026-08-18 17:12 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | empty |
One Ghost Pepper Sandwich, no combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
2mD86DxrjpRxhLRVgbiqR7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
3S2HFvGHYZw2vXi4gDuwSM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
3TEK67MhYmGFUuHDkJE8bD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
85BS6YTwy78r2hPPrEcP6m | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8AnudvSBctjjN5d67NseSp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MiXvVg94ZPSP24bZVfD8zd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
TkxufxEGEwctvfdopFbmsM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZonYuAuyGNk7A4B574dYgM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aaWCPkMkut3yH7UEu2ZvQv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ni53Ni6RAD4TPjceMysxSJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
P4rTcGksNgaNoYkNT5ffZd | Test new prompt (Aug) | no transcript | — | |
P77aniQ9Mg48aSZsVEb4HH | Test new prompt (Aug) | no transcript | — | |
euF6fyGQFvnr8Y3cTdf8Hv | Test new prompt (Aug) | no transcript | — | |
fGgjGyqxCFk9NQo5SVqyqz | Test new prompt (Aug) | no transcript | — | |
hHXyNv9vriJttFJcoMUYEg | Test new prompt (Aug) | no transcript | — | |
66rUAszqutgitqNCc69avn | RBI Bakeoff 2026-07-23 | YES | Agent captured the full order and directed the customer to pull forward without escalation. | 1x Honey BBQ Chicken Sandwich |
VqEAg5Cu2jYPGWbesZaYcN | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the honey BBQ sandwich order and directed the customer to pull forward without escalation. | 1x Honey BBQ Chicken Sandwich |
TyrMyUQFxB8CPdqwJGBTrQ | RBI Bakeoff 2026-07-24 | YES | Agent took full order with modifications and directed customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
cxyhiLqH2AZJP7BkKEkCTK | RBI Bakeoff | YES | Agent fully captured the customer's order and directed them to pull forward without escalation. | 1x Honey BBQ Chicken Sandwich |
Pgfk4U5FFoadnFg9hrkpdS | RBI Bakeoff | YES | The agent fully captured the order and told the customer to pull forward without escalation. | 1x Honey BBQ Chicken Sandwich |
cX2gz4mhedZe8qK5NqBYBs | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent captured the full order and instructed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
CL9WPwdtMtR5ZyNZNuBysY | Simulation Run 2026-08-17 01:07 | YES | Agent took full order of classic chicken sandwich and told customer to pull forward, no escalation occurred. | 1x Classic Chicken Sandwich |
3pSzgvGdX7ZQKxVkqFKGEq | Simulation Run 2026-08-18 17:12 | YES | The agent confirmed the full order and directed the customer to pull forward without escalation. | empty |
I'll take the 3-piece chicken combo, spicy, add a pie - make it the strawberry - and a premium strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
8naHQgytLJij3bpMK6zCZU | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AWdY2MfRFKzUmVkxm9EoQV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EuWfWEPinNxkBejE3wTfKc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Jb8nvhsCEg4eLLzMY5CYjm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KkZgNUVZV9KabvpyjLv4y2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PFP3apSa5vDXjsvqnfdzBt | Simulation Run 2026-08-16 21:10 | no transcript | — | |
TLkWvb4rhabEqUEjZjnyE8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aTYemxrrKMkFTUAv8FxHzD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hHBwjDTR2WzpD8hWvyMHJJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
idmBWsqf99L4ACBfHBuY5D | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bjYftRPM3B8VTWvBkL8mxp | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show if the agent took the full order or directed the customer forward. | empty |
FA9o3p9Rwb8oX357zQhjs8 | Test new prompt (Aug) | no transcript | — | |
Gd2zAScd2UNHJEzAZFqPcW | Test new prompt (Aug) | UNKNOWN | Transcript ends without agent confirming full order or directing customer to pull forward/next window. | empty |
JQ6LRnywtEa7e2HSt8FAVD | Test new prompt (Aug) | no transcript | — | |
X2pMQdW23L5t4BQTxqfS5c | Test new prompt (Aug) | no transcript | — | |
koLWGMzFZuQbURpMvTuSYy | Test new prompt (Aug) | no transcript | — | |
MndhE7HEKuaWGUZhmdDSy9 | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Regular Combo (Classic, Ca |
AG3hedE5VZNmNuaWYk9o6G | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Classic, Re |
9y53aBc3uPoPXcNhVtpKmU | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Regular Combo (Classic, Ma |
ZpptJCgSDefiKiWY4mYQH3 | RBI Bakeoff | YES | Agent fully captured the customer's order and directed them to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Red |
afQjG8ib5Eg62uKXtYvX9d | RBI Bakeoff | YES | The agent successfully took the full order with all modifications and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Red |
A34xLz3WgGxrx8LinEmYTw | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent took the full order with all modifications and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Classic, Ca |
4h8EfgARB8kydX7VYMJ4Us | Simulation Run 2026-08-18 17:12 | YES | The agent captured the full order and directed the customer to pull forward without escalating to a human. | empty |