Speak naturally and conversationally like a real drive-thru customer. Stay in character and only order/respond as a customer would. You speak with a standard General American (Midwestern) accent.
Test case names jump to that scenario's conversations below.
Failures first within each scenario. Simulation IDs open the transcript in Coval. The judge note is Coval's written reason for the Completion verdict.
Order three pieces of spicy signature chicken by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose mashed potatoes and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
DoXBp5QsXvE3gt6m9xQrjA | RBI Bakeoff | NO | The agent escalated to a human employee for assistance, not sending customer forward without escalation. | 1x 3 Piece Signature Chicken (Spicy) |
HFN3zo9apgbMw9mBELF3Ns | RBI Bakeoff | NO | Agent escalated the order to a human team member for verification instead of directing the customer forward. | 1x 3 Piece Signature Chicken (Spicy) |
DZABCVo4CWd5LadwqACPHb | Simulation Run 2026-08-16 21:10 | NO | The agent did not direct the customer to pull forward or the next window in the transcript provided. | 1x 3 Piece Signature Chicken (Spicy) |
gxPsR3qibBMyBivqrym3FB | Simulation Run 2026-08-16 21:10 | NO | The transcript contains no agent confirmation or direction to pull forward/next window, only the customer's repeated order. | 1x 3 Piece Signature Chicken (Spicy) |
3C97hp9NZjSHqX3BHgDPiF | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent completing the order or directing the customer to pull forward or the next window. | 1x 3 Piece Signature Chicken (Spicy) |
8qVMsziV66wV7mxwBcHscJ | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript shows the order being taken but doesn't show the agent directing the customer to pull forward or the next window. | 1x 3 Piece Signature Chicken (Spicy) |
MKJVo8kp3NqEb8paX6hY3t | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript does not indicate the agent directing the customer to pull forward or the next window, nor if order was completed. | 1x 3 Piece Signature Chicken (Spicy) |
P8CtF9S8j49QhrqzgFTaQ6 | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent confirming the full order or directing the customer to pull forward/the next window. | 1x 3 Piece Signature Chicken (Spicy) |
QXUz8pN9T6tnY3ij7XRQH2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VS83Rb9HMdDxw4HFFtYFos | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript shows order taking but lacks confirmation or directing customer to pull forward. | 1x 3 Piece Signature Chicken (Spicy) |
Wuxnt24iup6YhFBWF7JEws | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript shows order placement but no agent direction to pull forward or next window. | 1x 3 Piece Signature Chicken (Spicy) |
aTWm5ogCvJYggAezqmrJ2L | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BiYrDyLqrgCVc4gc4EmAjV | Test new prompt (Aug) | UNKNOWN | Transcript does not show whether the full order was taken or if the customer was directed to pull forward. | empty |
DzGfBeHTkBNJbcijEYzDns | Test new prompt (Aug) | UNKNOWN | The transcript ends with the customer's order request; no confirmation, direction, or escalation is shown. | empty |
FWZH8pt2J5kaUovnyWxUA9 | Test new prompt (Aug) | UNKNOWN | The transcript does not show the agent completing the order or directing the customer to pull forward. | empty |
ZHMh7s7xmJhaoaJsLJSFaX | Test new prompt (Aug) | UNKNOWN | The transcript does not show the agent confirming the full order or directing the customer to pull forward or next window. | empty |
k75GXf29LXs8wPkG4CsvLu | Test new prompt (Aug) | UNKNOWN | The transcript does not show the agent confirming the full order or directing the customer to pull forward. | empty |
djobfL9QCZtFhsXyBePLn2 | RBI Bakeoff 2026-07-23 | YES | The agent captured the full order with modifications and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
H7ZLS8S6CfRPvGhebZPwTh | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation or handoff. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
j493adtVxUufSGkZTTkY85 | RBI Bakeoff 2026-07-24 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken (Spicy) |
RT4YjqgVY9TTiVVtNpMyGe | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent took the full order, confirmed it twice with the customer, and directed to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
fU3tjWk7BbcdxQkZjbCdbn | Simulation Run 2026-08-17 01:07 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
One bacon and cheese sandwich combo, large, with fries and strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
HDmSAjKSmR6wZXetPgicT3 | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human team member to read back the order, not directing customer to next window. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
FVxknVXBN86xwBFyNHi6a3 | RBI Bakeoff | NO | Agent escalated to a human team member instead of directing customer forward after capturing order. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
3a2gaMEbNEh9aZAh9FeFPY | Simulation Run 2026-08-17 01:07 | NO | The agent did not complete the order or direct the customer to pull forward or the next window. | empty |
jSFonNDG82dntAiCXtKgHt | Test new prompt (Aug) | NO | The agent did not capture the order or direct the customer to pull forward; the conversation ends without completion. | empty |
9ZjkFwvFnDAUnKxVYrQQ9C | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AxzX3zJf3L8hXDCgfNcV8j | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CNe57PDtd9xFLFUTkuBC6w | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GUNdJjVNpoExVmGtnhH5oS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HbqgfbSLphXu5eGFdhpXcF | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HyeUyGkknb62CbfJYaCKtp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JrD284PiuT9iG5gKu9wPZs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZCUxU4UayiqieNWPG2WRbQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iYydJ2iTkzqWA9wPfKMY8v | Simulation Run 2026-08-16 21:10 | no transcript | — | |
me8mX5ihF4zuPxoXYq2BNF | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Aw8ySV5phMZbyNRoRUBd6b | Test new prompt (Aug) | no transcript | — | |
gSd7BK2BvELrQVE2MKFEfe | Test new prompt (Aug) | no transcript | — | |
hMgttHT7Xb4eWUTwhEgvnz | Test new prompt (Aug) | no transcript | — | |
jMmQefpy3q3fVYiR75ZZWf | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
dNpCuEmZ7hg36wxNydAZt6 | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
nXruQVfX7Zyd5G6V43shjq | RBI Bakeoff | YES | The agent captured the full order and directed the customer to pull forward, without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
KBUhkjttv7TJPfcivPfyzK | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
JuDqdazPPP8HqWsKEtLrDy | Test new prompt (Aug) | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
Order one regular bacon and cheese sandwich by itself. Do not ask for a combo or a large. If the agent first offers to make it a regular combo, accept with fries and a Coke, then accept a subsequent l
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
kwANnpoEfzEP2zCcqbztNh | RBI Bakeoff 2026-07-24 | NO | Agent could not read the order back and implied human assistance might be needed. | 1x Bacon & Cheese Chicken Sandwich Dinner |
XHhkDNFudZsL2nuzwVVUa8 | RBI Bakeoff | NO | The agent incorrectly changed the order to a dinner item, not capturing the customer's full original order. | 1x Bacon & Cheese Chicken Sandwich Dinner |
iSWjb4dnf24wRTvQC4WoBm | Simulation Run 2026-08-17 01:07 | NO | The agent confirmed the order but did not direct the customer to pull forward or the next window. | 1x Classic Bacon & Cheese Chicken Sandwich |
F92AFQ7cd2ePLkzJeJrp7C | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SUbtUZVszLm5oNiEWTpE3m | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UUJ3P2DWh9kUiYigAmHpLq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
V78rTqjxqNNs9oD6futw5Z | Simulation Run 2026-08-16 21:10 | no transcript | — | |
W7yToydcsR9CWAy3nc2Qb2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XtHQkWaE6NJF3BwNUW37a9 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YPmGXVix7NoEFNMvSHcp67 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aYpNSrAvYHbWczr8SMZuyg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gXkSmVExmnafLCbuHJPhQG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
oCJyRzhmXRv4sZVDgVFzfp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XvYk5sEYTR32EMRADQWUKS | Test new prompt (Aug) | no transcript | — | |
d8qnWHHMgTU359V4vf6kHT | Test new prompt (Aug) | no transcript | — | |
gK2xhjDMx9MVg7yC4B3yxD | Test new prompt (Aug) | no transcript | — | |
hnVeziv7mcWhemZkMtC2Rd | Test new prompt (Aug) | no transcript | — | |
m2zSVe5exJoiCK2AQaCwX7 | Test new prompt (Aug) | no transcript | — | |
ZCN2bFsXeNySDyuxmdc4t8 | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
RS5RMdZUQPAejkFSXHUsuS | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Bacon & Cheese Chicken Sandwich Dinner |
Qv73GGC9JT2VLmKRxKm88P | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x Bacon & Cheese Chicken Sandwich Dinner |
8MSQ64m4EWQtPWpjtV2utu | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Bacon & Cheese Chicken Sandwich Dinner |
Order one classic chicken sandwich by itself. Do not ask for a combo. If the agent offers to make it a combo, accept and choose Cajun fries and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
NT2u8KouYNJpqb7d9PmK37 | RBI Bakeoff | NO | The agent said they can't read back the order and implied escalation to a human if incorrect. | 1x Classic Chicken Sandwich |
gvQHmw3XQoFU2ZnkjSEoNC | Simulation Run 2026-07-20 23:03 (scratch) | NO | The agent escalated to a human team member by saying 'An employee will assist you.' | 1x Classic Chicken Sandwich |
kTr8ija3hAVohdZJ9Czm7L | Simulation Run 2026-08-17 01:07 | NO | The transcript shows only order request and greetings without completing order or directing customer forward. | empty |
3rPc8DdGST3gerVDnXydTr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8Zp59sHquzpy4RUN4M3VWe | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ArHmjVHuvdQjCrx4yYPS3z | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HNszVBWes8Y9wrbX8kRT6Q | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LFLohxQybzB5g9cm3JLGMt | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZyC7jNqYNwkLUU5pT97z6A | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dZJfwJLCcomVryGvMswcAk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fKx6PfYMMtg8eugEuVpxuT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ff3zwMPyiuEUWVcEpMWUgD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
o7PKm8JbnuCPSP2n7RQGWF | Simulation Run 2026-08-16 21:10 | no transcript | — | |
6DhoaAo2kCwdAjmv335A9u | Test new prompt (Aug) | no transcript | — | |
8HdzBuSzHGJeEsv32LfGBV | Test new prompt (Aug) | no transcript | — | |
Qm5ggebn5uasq45GFghp4Q | Test new prompt (Aug) | no transcript | — | |
Wz26369kr9ArvtVaYDbHFi | Test new prompt (Aug) | no transcript | — | |
8uXurPrCU7Duw9pGggdQ8V | RBI Bakeoff 2026-07-23 | YES | Agent fully captured the order and directed the customer to pull forward without escalating or handing off. | 1x Classic Chicken Sandwich Large Combo (Cajun Fries, L |
NY4iBG7GUVaKCQ4g3e8Hi9 | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x Classic Chicken Sandwich |
527T48Jn6KW5Kx6kdzkifU | RBI Bakeoff 2026-07-24 | YES | The agent captured the full order and directed the customer to pull forward without escalating. | 1x Classic Chicken Sandwich Large Combo (Cajun Fries, M |
a5NUXrv9CTJ4sinXsBcw6d | RBI Bakeoff | YES | The agent took the full order (classic chicken sandwich) and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
RuaYfcf5c6o87w8kZG5T7q | Test new prompt (Aug) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
Order five classic tenders by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose cole slaw and a Sprite.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
ED9tqbqhXYGcFNGYqBwQkJ | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human employee for order verification instead of directing customer forward. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, S |
TAa2nXRC7YufCbNWMoRJUm | RBI Bakeoff 2026-07-24 | NO | The agent escalated to a human team member for assistance twice instead of directing the customer forward. | 1x 5 Piece Chicken Tenders (Blackened Ranch, Classic); |
48ZpCzWefa2KDNzJNnGTir | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BHCEXJWYpyeFQQU4PdwxVq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BXFZzTH8YCjJvHRSv93DCr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Cs6AtKKTQPadVj8aHuUtJy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
K3vir7v3krvAQR7WfdJ8VK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Ue7ySEHenbBtnB8SExu496 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VVEZYjNpdW7gvzuMTnbePj | Simulation Run 2026-08-16 21:10 | no transcript | — | |
a4KKYDJs5Qozh6RwNV4Bma | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aTrMtDuDCK8bnVpT9XRo8A | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mdCgccfo9zU6MPepdLDy3J | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EzgphYNTUGyscmbmL9tYYt | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not contain the agent's confirmation of the full order or direction to pull forward or the next window. | 1x 5 Piece Chicken Tenders (Classic) |
CFQiWnuPmFNfsBQ6hmZLcy | Test new prompt (Aug) | no transcript | — | |
Sq2BkQhtj4ypBZgevudfjD | Test new prompt (Aug) | no transcript | — | |
aYvo6iTTt7fAXPYuANw8My | Test new prompt (Aug) | no transcript | — | |
c7JzanZ7BWCj7wXE5aG3kj | Test new prompt (Aug) | no transcript | — | |
eaeaZ2CprSMYta8NGHgpHe | Test new prompt (Aug) | no transcript | — | |
Ns6KvDzEAhAih7zVw6M7Ar | RBI Bakeoff 2026-07-23 | YES | Agent took full order, confirmed it, and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, B |
7bDo7bm7M4WQESB3DoAqaX | RBI Bakeoff | YES | The agent took the full order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Dinner (Classic, Blackened R |
jWyKZD5nqUbwzyFWtkYiSA | RBI Bakeoff | YES | The agent took the full order and told the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Blackened Ranch, Classic); |
25eb8RQhcfsNtScmaTodv4 | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Blackened Ranch, Classic); |
One Ghost Pepper Sandwich, no combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
CpkZKkPQeYpTN3GSUKoZQK | RBI Bakeoff 2026-07-24 | NO | The agent escalated to a human employee multiple times to assist with order verification. | 1x Spicy Chicken Sandwich |
5Yv8CvVdWRV2s5BvkT5mB4 | RBI Bakeoff | NO | The agent said 'An employee will assist you,' indicating escalation to a human team member before directing to the window. | 1x Spicy Chicken Sandwich |
DA26kFdPoTm7gEGLG8ebBp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FmWCVpYnT8ubjW32aNpgR6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Hvy4wC3tAbDJxGvj2GT52b | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PS4XeR7fmvFssfJ3Hnb9o7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XsC8VMorrBffdwnbyCWuUn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YFyD72PHhELiATwDReE4xu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
arxGip8Kp3NeiRf5mV7jgd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cULMpxaDWoeQ6Pb3hwt3BS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mXBevGpXrfSGDWwb2iy7c7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
oRS3QR9aw6iRtNbBkSiKx2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
2fRZRgiy2sTTbupR5imJBq | Test new prompt (Aug) | no transcript | — | |
AdFFwPJELq2GALU25Wa8vM | Test new prompt (Aug) | no transcript | — | |
PuJ4MxVXMDBmcJTe85AaTP | Test new prompt (Aug) | no transcript | — | |
Rb6sVH4J6gztZt8JdnVHPN | Test new prompt (Aug) | no transcript | — | |
gaZmpZisMFKmGUUizxi3aQ | Test new prompt (Aug) | no transcript | — | |
nZeExdNrqLHJCinNupTAjd | RBI Bakeoff 2026-07-23 | YES | The agent confirmed the full order then directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
QQkkyeuPMjNT7wioApsmgY | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order (spicy chicken sandwich only) and instructed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
6ni7mWmLskAejqkGnBDz4U | RBI Bakeoff | YES | The agent took the full order (spicy chicken sandwich) and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
Vi2pgSX43VfguhfNz7KDNq | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent confirmed the full order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
fTpApLyXxSixnWXUnw5WbD | Simulation Run 2026-08-17 01:07 | YES | Agent captured full order and directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
I'll do the chicken sandwich by itself and a side of fries.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
Q98gcqqkbqGpDCHTwJYeEv | RBI Bakeoff 2026-07-23 | NO | The agent did not read back the order and escalated to a human team member for assistance. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
bepHxfU2yP4y7ex9JMHFwd | Simulation Run 2026-08-17 01:07 | NO | Agent confirmed full order but escalated to a human team member instead of sending customer forward. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
49AgFhbhZFayr35s9eV94u | Simulation Run 2026-08-16 21:10 | no transcript | — | |
54txcjY8DVd3PtgoAvXyLt | Simulation Run 2026-08-16 21:10 | no transcript | — | |
93tLXkhC3evMjsZGykryDM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AE4aiSvBBCuv6uTtgKf8VK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CVFmjgJdpUFPRmVWKq5VCi | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DJFzMsDvXTpvKX3vCZcN3R | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Fyg9icBe8ijNBY4fbt8z5M | Simulation Run 2026-08-16 21:10 | no transcript | — | |
TQyjwuKJehtYebAKTsbN76 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Wqb9tJgcmrLayFhbF5qzQR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YQdojmkrA76dmoeUTc8Lqo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4dTWtHQ7hgGVRcrDTRwJ2J | Test new prompt (Aug) | no transcript | — | |
7k9wth8zquhnidNDqFqTRg | Test new prompt (Aug) | no transcript | — | |
9Smq7o3V4TxMdVkEBWaup7 | Test new prompt (Aug) | no transcript | — | |
FCAeHpKE4njfYtqi8YEqKf | Test new prompt (Aug) | no transcript | — | |
gg6uk3mtKRCEnLvVWbDcmv | Test new prompt (Aug) | no transcript | — | |
AFPg4PPWs5EA59b3vXgX3E | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent captured full order and instructed customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
WzBCy7HLefdHCBE2Wk578t | RBI Bakeoff 2026-07-24 | YES | Agent took full order, confirmed order accuracy, and directed customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
XoWkpNoUNe7z678LRm3L2s | RBI Bakeoff | YES | The agent took the full order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
JUfTWKqjeUwDkHQBasMHaU | RBI Bakeoff | YES | Agent captured full order of chicken sandwich and fries, then directed customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
L7ihSb9beCxndF7ou3faJr | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent captured the full order and instructed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
I'll take the 3-piece chicken combo, spicy, add a pie - make it the strawberry - and a premium strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
6ayoJPdJdWkUi6kxwk78Gy | RBI Bakeoff 2026-07-24 | NO | Agent did not read back order and referred customer to an employee, indicating escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
5NszwkXDNVch3o9rRJhPBs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CHVcupRG3bLkRtfurWGrL9 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DDR2tGZaPE567SZzGxwmgJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LyvbFaPSC8xf7MAHodhAyv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Tp5zRn23rx8sGYECfcgLB7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
arYDUZnb8SaZdZqvDxHh5m | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gC9SuUwoTpp4SmjNXjt3jJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mNZub4sg9phdAguFctQxxp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mRSqbx5smyZYpEifiWNvqW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
o4s77uEFTvdGBjFNuTgZiH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mNnELgYevhUozBLeBDRyJ7 | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript lacks agent's response and direction, so order capture and next steps are unclear. | empty |
2iX6KKEeiWCaSpdxeJyqFa | Test new prompt (Aug) | UNKNOWN | Transcript lacks confirmation of full order capture and directing the customer to pull forward or next window. | empty |
L5CVTFBaEY9AJDiCVDRyrN | Test new prompt (Aug) | no transcript | — | |
NX47eW4sLNqQ7w3VcP9UGd | Test new prompt (Aug) | no transcript | — | |
NswVgfa8fV4FZbqPCouz9a | Test new prompt (Aug) | no transcript | — | |
SPzk4EdkJgGtBqWAY9XZHR | Test new prompt (Aug) | no transcript | — | |
V6wFtU7AXHafWCjg5oFuH6 | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and instructed the customer to pull forward without any escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
MUmx9hcNjJgn9MS9iRPuCL | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
Vn68sAaGGs6u4b6emw4aXL | RBI Bakeoff | YES | Agent captured full order, confirmed with customer, and directed them to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
JpQSfUSJLC8N6MVnyW94xm | RBI Bakeoff | YES | Agent captured the full order and instructed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
APAh7gwUxhkfMnjAXgCFbt | Simulation Run 2026-07-20 23:03 (scratch) | YES | Agent fully captured order, confirmed accuracy, and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
Can I have a Cajun Rice please?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
VvaQ2397RQqBf7xZZD4pnC | RBI Bakeoff | NO | Agent instructed customer to pull forward but mentioned an employee will assist, implying handoff to human. | 1x Red Beans & Rice |
3mVXSpXZH6nsGEVCo98FRK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
5bhVdpx2kVjGfRt5bKR2Wg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7AVrD2xxgAndvfirb2H6g3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HGRYrrFfYwNYn6fNqoHqHj | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KGcVbXTqyqoXDSBiz5SmAX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KycvbUgW4T3koziEu5jgcD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QxkJwFqPC9dL8bE3qNDpHr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cT9RJ894D4CYMcPt8sMcEQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cnua9BHAWF2zT3TAUkRVEz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eMnYfpdQ3GUpZJwMYiNSQ2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
oHDAyCc3JKQi4ZyRvfjmEU | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript only shows a single item request, no completion, or direction to pull forward. | empty |
6e2Eyx7Vw5mNPnFTwz236a | Test new prompt (Aug) | no transcript | — | |
87Ut6rNiEDcNQB68Nq3waN | Test new prompt (Aug) | no transcript | — | |
TQsUHBAYMAmGCnKEMNJfHu | Test new prompt (Aug) | no transcript | — | |
dXWzAJ3gpVxtF7xHRgKWy7 | Test new prompt (Aug) | no transcript | — | |
ng24Jr3QyUEQLgYZYK2h5S | Test new prompt (Aug) | no transcript | — | |
S8kkZJ9N2qRBgtQaj4mBrj | RBI Bakeoff 2026-07-23 | YES | Agent captured full order of red beans and rice and directed customer to pull forward without escalation. | 1x Red Beans & Rice |
g8odDoHmcdvDfK3Rx6ufDq | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent captured the full order and directed the customer to pull forward without escalation. | 1x Red Beans & Rice |
TiLhNa7WMjgTbtJWYEXqgG | RBI Bakeoff 2026-07-24 | YES | Agent took full order (red beans and rice regular) and directed customer to pull forward without escalation. | 1x Red Beans & Rice |
krt6nEVVA4Rb3jz9Cag3yF | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Red Beans & Rice |
KTvesJvriTWJo3byJAjtRP | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalating to a human. | 1x Red Beans & Rice |
Start by ordering the 3-piece signature chicken combo, spicy, with mashed potatoes and a Coke. Before the order is finalized, change it to the 4-piece combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
JLexbjZxHm9qgaGnJy994Q | Simulation Run 2026-07-20 23:03 (scratch) | NO | Agent repeatedly said 'An employee will assist you,' indicating escalation to a human. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
7mLtJDj6pUnu2LYsi9F6XK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
88VVK5sokq7ctRbyBgRuJc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
G5BJrxJUntZRW8hN7EhaDL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KMM9pSvfTyZNL4nm2ntaoc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Ms92yU9Cc7Pa8rZYvEN9cN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NUHnHpurqx8ZpdWAn8yPhq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PGMY6gzCoaFwYMPmQGtBAV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Qe4jqnyh52moou9U9oWidS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
USXyBkNHWBd5ZAvFhEN9Fg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VCxDhfroRvteEWZjrb3UEm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QP63ihfqUCAN5Ly2EeWqug | Test new prompt (Aug) | no transcript | — | |
U6H9dxGCShSdjXDk5VENDV | Test new prompt (Aug) | no transcript | — | |
WNZn9YE2xN2G7NgeaoLikP | Test new prompt (Aug) | no transcript | — | |
hVBMkv8xDUPUK2uzhmrfhY | Test new prompt (Aug) | no transcript | — | |
jiFaAzcyXh9f4yUQAyF97c | Test new prompt (Aug) | no transcript | — | |
KxKAj6ywas4VY8f5ctjwTh | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the customer's order, confirmed it, and directed them to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
Tnt6J3KvRntASsQ3eWVqFw | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully took the order and told the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
Ew6htRnxofg3mMFAyzBXRv | RBI Bakeoff 2026-07-24 | YES | The agent confirmed the full order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
LNqMBPHpgu3oCBQRUConbr | RBI Bakeoff | YES | Agent took full order, confirmed it, and directed customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
egnV4H7F6XzkP4MfjiocoP | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
cvWUndyqjt3hJCzPm6PMWo | Simulation Run 2026-08-17 01:07 | YES | The agent took the full order, confirmed it, and instructed the customer to pull forward with no escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
Give me the chicken wrap bundle with a mango lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
CYjcTbanorT2n9f3MYRhAP | Simulation Run 2026-08-16 21:10 | NO | The agent did not confirm the full order or direct the customer to pull forward; conversation is incomplete. | empty |
9Vf94VDqUNdszHjsKw8pMq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BBGd2vXrA5RXm2JTuguMKC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BnSvK7T85yz4ucmwcxRquB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
G2w7TWsRSLcSTRZaBtkncP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
V5aY5LLuC88yDpNEgqvBFs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
a4pNfbnphZjyPKu9iUpEFA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fhDennZSnZiGwUXYGggmmw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kpiBgqNuEnXLv63FaWjVDi | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nwPmftwfkpvookqoMLSHyK | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent capturing the full order or directing the customer to pull forward. | empty |
nm4ef2aNmgVmiCFwfNztiA | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript does not show the agent taking the full order or directing the customer forward. | empty |
MP98n85rHadLY9AR9ympTx | Test new prompt (Aug) | no transcript | — | |
PhEdeWsgaE75aguanfBaQq | Test new prompt (Aug) | no transcript | — | |
Y6MsfWLpQtoRN4uNPo8u9v | Test new prompt (Aug) | no transcript | — | |
YSVndB7a4ouHtsBFarSXpL | Test new prompt (Aug) | no transcript | — | |
mrAQGd662sP2MaHmkshhF2 | Test new prompt (Aug) | no transcript | — | |
2cYAJhyeGQE5ZuEvh9PWqE | RBI Bakeoff 2026-07-23 | YES | The agent took the full order, confirmed it, and directed the customer to pull forward without escalation. | 1x Classic Wrap Regular Combo |
8NvLa6WksFracgJ3ny5DJf | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured the order and directed the customer to pull forward without escalating or handing off. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
j8VKuEguLSYUmVLcfcJfVo | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order, confirmed it, and directed the customer to pull forward without escalation. | 1x Wraps Bundle (Classic Wrap, Chilled Mango Cane Sweee |
JApxHQnTEbjCvFqek9tNNH | RBI Bakeoff | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Wraps Bundle (Frozen Mango Cane Sweeeet Lemonade) |
NsStSozY3HozRf5rxrM72i | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Blackened Ranch Sauce; 1x Chilled Mango Cane Sweeeet |
EPE5msR93E7MhcKzcoTTdC | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Wraps Bundle (Classic Wrap, Frozen Mango Cane Sweeee |
Can I get the Ghost Pepper Sandwich combo? Actually, change that to the regular chicken sandwich. And make it spicy.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
TCXD4TRozAiahoy6hyx2EK | Test new prompt (Aug) | NO | The agent did not confirm the full order or direct the customer to pull forward; order completion is unclear. | empty |
5xrGTczqoaepzKT4MBFgJc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DqcPZrhUTAK4B8FongtNBp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FnW8JDMyzyCvXXPapTJND2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
TCMgGTqw5vqpkrqwgnUPhJ | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript cuts off without the agent confirming the full order or directing the customer to pull forward or the next window. | empty |
XTk3qEptvfPVnTPeRM4JRT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XkBr9UYwXkdfRtySAqk7TS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Z2AP9FumVbtRUtcQWs5MXk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cgNzU8HnSceWadYzzB8sKP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mkP5JS2jk3KbJWCNZJ2gAu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
msx3az5A7xfM48chRL7ePJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
g8Mg22baPUEJaF3mG43HHq | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript lacks explicit confirmation of completing the order and directing the customer to the next window without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
5i3muKjoWY6w7uC4X7ZKru | Test new prompt (Aug) | UNKNOWN | The transcript ends before the agent confirms the full order or directs the customer to pull forward or the next window. | empty |
Bb5YHEXsCMn4BqKMFsgr2v | Test new prompt (Aug) | no transcript | — | |
KNWzipX3TEmPHyZXsAhc7F | Test new prompt (Aug) | no transcript | — | |
TWQqYgtBPkUpNa75VYYHTb | Test new prompt (Aug) | no transcript | — | |
LWWyszi7aKFyRjSRDtNBVs | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, S |
XfEDrbD8BpPcVGTWCnSdCX | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured the order with detailed items and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, S |
GSxaS2emSBvGdy8qa6aCbz | RBI Bakeoff 2026-07-24 | YES | The agent took the full order and told the customer to pull forward without escalating. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, S |
D8SwV4ib8s8zCDiUrJsr7j | RBI Bakeoff | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, S |
TSwmtw7Us9wosqdXfMSNdd | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, F |
J7t9KEsPxUHdmJZxCg2G8M | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, S |
I'd like the 3-piece signature chicken combo, spicy. I don't want fries. What other sides do you have?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
49LfPrruDUg5EsxXMJVCp4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
6T5EMor62V8YmvwiMhddhm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
92YPWMKx3uvUkotdfSbrmo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LhjcFyqCNrsxNdDAHKjsuv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
P4ueMvD3vZNdxhuby3htnQ | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript is incomplete and does not show if the order was fully taken or if the customer was directed forward without escalation. | empty |
SL3YsTEENs8LwntC7uanzJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Vx7UwcXVc8rzkrYrtaDT4t | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bL2uN4iTxWgKVEi96UgfKq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kcEbf2d2nGZWRsLMGMMoiz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mFjYijbRUDQkoQiJLxcVyR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9yvP2PN69ATJiniFU83E5c | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript does not show full order capture or customer being directed forward without escalation. | empty |
2ykdJw4ZYQT6cfSTP9RHhM | Test new prompt (Aug) | no transcript | — | |
BfepHHzvx9AVaer3Xu6BQP | Test new prompt (Aug) | no transcript | — | |
PhKxeuU67ZgiygwoGsbKWz | Test new prompt (Aug) | no transcript | — | |
ikorqk83To7WpFkwss2QD2 | Test new prompt (Aug) | no transcript | — | |
mdkCRwxzuMH2uhTXDjfvrh | Test new prompt (Aug) | UNKNOWN | The transcript does not show the full order being taken or any direction to pull forward or next window. | empty |
ipSo2f4vu7czgbThJe7gHc | RBI Bakeoff 2026-07-23 | YES | The agent took the full order details, confirmed them, and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Home |
gt2dUHcsqMkteUvbaqfPUx | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Home |
Q4Q3C5PRzPtvLcw8scVHHE | RBI Bakeoff 2026-07-24 | YES | Agent fully captured order and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
8w4TBztRPg5tqf9WfAfgnn | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Red |
j8aHYsveUxjQP3menTmBEe | RBI Bakeoff | YES | The agent took the full order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
j7cEABt89u6GzfD9cfq69u | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent fully captured the order and told the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
Can I get the ghost pepper sandwich combo, swap the fries for red beans & rice, and a Dr Pepper?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
7Awm5CYWZyXXAShFb5WpXL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
G82qWsEuF56zzGeQnYQFHJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
U9cufcbHPdJM6chD49wvbA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UN5AtCU9ShCDKuSGhANqtV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
X8o6pLev8KwQn9ZSqpPkTN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cwStomkMtR9rggLTRVSrgA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dpVpoEHsGcPZAB8KE9QfBA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dyTsKmMJaGE23aHELjLtKc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fQhWeY2rAFLkAEfbSmkdbE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
idckCmhwM3oom7bFdnjHNu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Tv9NHQtfFEKvkTCQHmaL6e | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript does not show the agent's response or order completion steps. | empty |
2Wo7U5NpBVCrtswgZJ8pqq | Test new prompt (Aug) | no transcript | — | |
EeDJB5aDBgZFEvay2tyTJ8 | Test new prompt (Aug) | no transcript | — | |
Y9sGh5eKfFLMB79gwY2hUE | Test new prompt (Aug) | no transcript | — | |
hGtSJTbvnfD4xWaMq8A9A5 | Test new prompt (Aug) | no transcript | — | |
jwYnU34v2rDQGdifwzXRDP | Test new prompt (Aug) | no transcript | — | |
Hz2jCgeCVZZm3cFruJS3Gs | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and instructed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
AjVMUFH2HNuH39NERQGtxU | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent took the full order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
NNCBn4kfN7i7FRo55uXwV3 | RBI Bakeoff 2026-07-24 | YES | Agent confirmed the full order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich Regular Combo (Red Beans an |
DAs4btzGmYoEaM466kCcoY | RBI Bakeoff | YES | Agent took full order, confirmed it with customer, and directed to pull forward without escalation. | 1x Classic Chicken Sandwich Regular Combo (Red Beans an |
7Ffci9hf27qgGvwiGmz7VQ | RBI Bakeoff | YES | The agent fully captured the order, confirmed details, and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
HnwTGAbx74YVHyNkoqHebb | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich Regular Combo (Red Beans an |
I'll do the 12-piece family meal with all dark meat, spicy, Cajun fries and cole slaw, and two Sprites.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
8r7yUGk3McXQ79Ha4Ekrde | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9kAbiWFasEayKLSjgU4Q9i | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DjDoJ3jCDWDrjJmGp7GKsV | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript ends before the agent confirms or directs the customer, so the order status is unclear. | empty |
HYZwNyPMsfGjQhKhwXp5fQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HjqueaMC6JZfKjxv5sLuP4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LTnhRFqtggcdi72tPLRDMy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NrFrgq7oXRvmNJ3nUyuwgv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bo4TbKXggfsb36kgvSAMNC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cvyLNMSgKvkjWxFNAdFXYT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dfsDJvzgt47o3p8hUp4VFn | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show if the agent completed the order or directed the customer to pull forward, nor any escalation. | empty |
9vuDM2DHxQeoFa2cscUWqk | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent's response or direction, so order completion and direction are unclear. | empty |
ARmBuaKm7WRquiQuM4mamb | Test new prompt (Aug) | no transcript | — | |
L6hVCPxCkFVvxokjn6qY68 | Test new prompt (Aug) | no transcript | — | |
Wc3rASxbNgWcZVrh77oVHa | Test new prompt (Aug) | no transcript | — | |
XSdykmQCsC4wVhtYDRpDqJ | Test new prompt (Aug) | no transcript | — | |
i2ZNng5Aq8RV6Qxe9YgEBB | Test new prompt (Aug) | no transcript | — | |
YSNxN5jfFzchRDMYKXjVab | RBI Bakeoff 2026-07-23 | YES | Agent fully captured order, confirmed with customer, and directed them to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
SEEQCNNKgtuBeKhQ9oVBvF | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalating. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
gS8ojanG5pL6ddUD2JaDnp | RBI Bakeoff 2026-07-24 | YES | The agent confirmed the full order and directed the customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
MG8eDzSvoLtigGYPGfCRD2 | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
cmBgv5i6SpEDgBbm6rV5bG | RBI Bakeoff | YES | Agent fully captured order and clearly directed customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
48eWt9nZ4EdvyGPZede6qH | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
Do you have nuggets?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
8HSZfeV9i9G9nRmZidiAYL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AuwxKtYF3rFypSc6fgFC5T | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EjaEWRXX9gYMuHbD47jYum | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NQktHLPGpP5Zqg5ULEvW2q | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WyNgD94ig8kBbLDzucuHyD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dirm7ppdBqfJhtGd68YFtE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
edGx7dVax22UbkBo4vwn6K | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fcZ36FoUt5fUwRw9vn4NcS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jfzjZDmyPt252MWztU3bDh | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kzR5VewsyzwJsSetC55Jim | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7xVjCNu2P9BUiygwmHseAP | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent taking an order or directing the customer forward. | empty |
DREvqMKD8kin3nSFmq7q7b | Test new prompt (Aug) | no transcript | — | |
N9NnWHYpoCtjwy5VUUxA8t | Test new prompt (Aug) | no transcript | — | |
TA9BMmxyT3jCPmeC4aEW5d | Test new prompt (Aug) | no transcript | — | |
WjhuGReZjXeZbF9ywRLV6B | Test new prompt (Aug) | no transcript | — | |
dBe43txbvcvU8QBiuAH2C6 | Test new prompt (Aug) | no transcript | — | |
QaunAaktJKp2v5sh9CrLpg | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order details and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Classic, Wild H |
MvGLBkJwid4vnwsCSJRPKQ | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured order and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Dinner (Classic, Buttermilk |
npeQc57PM3ukpnE9c4j52r | RBI Bakeoff 2026-07-24 | YES | The agent took the full order, confirmed accuracy, and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Dinner (Cajun Fries, Classic |
5T6WMEqRUB7Uk5vVXGHPZG | RBI Bakeoff | YES | The agent took the full order including tenders, sauces, fries, drink with flavor, confirmed it, and instructed to pull forward without escalation. | 1x 3 Piece Chicken Tenders (Classic, Blackened Ranch); |
8VfYN52xmfiBdqBikUisCE | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalating or handing off to a human. | 1x 3 Piece Chicken Tenders Large Combo (Cajun Fries, Ho |
cU3mJF4NGPt7pmudMpE6bn | Simulation Run 2026-07-20 23:03 (scratch) | YES | Agent took full order, confirmed it, then directed customer to pull forward without escalating. | 1x 5 Piece Chicken Tenders Large Combo (Cajun Fries, La |
I'd like the 5-piece tenders combo, blackened and spicy, with cole slaw and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
8mQEkwkhfErtS6pgXDXTXN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DWXtX6SdDoCnbXq7DKWk26 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GYRUMhx3L5tfb8MT7AaSdY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JebgHNgc6toH6FyBzZ8wJG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MHbkqhvKhLNEggDSz8jjLt | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QBDFNwUiGEEZgDEVniEJsP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QUagHvxxJvEUBTJWRBTA3u | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fYfGJTRW5PTfq9uaMz86rW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iVt6fKuDp8kV7ipnft652m | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kmjPjuxk29b5VsDZc8i5U3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Ds3CNoto7Mg64KtMegrcfu | Test new prompt (Aug) | no transcript | — | |
GwTfLg569NFmBZKteDjRZR | Test new prompt (Aug) | no transcript | — | |
LdVteuXRxQ5C3raYQiwVVj | Test new prompt (Aug) | no transcript | — | |
k8yFmarrBKaJVcpdtP8LjQ | Test new prompt (Aug) | no transcript | — | |
maNQrow4JHJbfyDywNHWnp | Test new prompt (Aug) | no transcript | — | |
3bvTsWRsp8mdfSxWANBvM3 | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
gUs9p86kHQmw3bdrQMdEkQ | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
6eK56WfRLRmgNw6RHA2fUu | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
KcoHR6oo2B2MjCZe6Bw2GP | RBI Bakeoff | YES | Agent captured the full order details and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
7xkkyxWMrj2aGWnMKiwevZ | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
bmcb66CfDapyX8u7VNjDrd | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
RqSGLJHETx3yVfnobogCgX | Simulation Run 2026-08-17 01:07 | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Coleslaw, Coc |