Speak naturally and conversationally like a real drive-thru customer. Stay in character and only order/respond as a customer would. You place a large, complex multi-item order with several modifications and substitutions.
Test case names jump to that scenario's conversations below.
Failures first within each scenario. Simulation IDs open the transcript in Coval. The judge note is Coval's written reason for the Completion verdict.
Give me the chicken wrap bundle with a mango lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
KuurwUdQaQ63XpMEpksHnP | RBI Bakeoff 2026-07-23 | NO | The agent did not complete the order but repeatedly escalated to a human employee to assist. | 1x Wraps Bundle (Spicy Wrap, Classic Wrap, Chilled Mang |
bea24BgGDHLpFCfoq7W8vG | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent did not hand off the order themselves but escalated to a human team member for verification. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
39q2xhhVwTd37yWw5RbMYb | RBI Bakeoff | NO | Agent escalated to an employee for order verification, not completing order alone. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
5E94Br2Xyvxxd79NaMEa6F | RBI Bakeoff | NO | Agent failed to read back the order and told the customer to get an employee if it looked wrong. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, S |
TVd5Zd6PX9rJ4Ur6JBjNkH | Simulation Run 2026-07-20 23:58 (scratch) | NO | Agent couldn't read back the order and suggested employee help, indicating incomplete order handling by the agent. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
65xA3DVzeTVGzGnVjJyzTX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9jrK7RGyLALmNCSotLFLHb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DHGNBzgb3pkHWeiwaMgP7Z | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EU2SyuX6s7R5p8kTxpyYdS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SKcE5SVEzMDWPGWFZFwTQP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aqgTWGqiX5XtZgkSm4uykE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
awuaGiRi2LhdkkffsZFGSZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ieU6e7hieqrgJWLxSK5ViS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iwJe44Sr93odJdUJV3QXaN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kgRJcE8P5BQyJjxJ9fG2s8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
icvXF3ejkitsVdBK5AphJa | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent responding, taking the order, or directing the customer to pull forward. | empty |
DHVdkFM6U2sJH2dicEHzPB | Test new prompt (Aug) | no transcript | — | |
QNiYKvwY7YxECDNFMboXVi | Test new prompt (Aug) | no transcript | — | |
ZRxgdvUyRaSGbdaJrAoziS | Test new prompt (Aug) | no transcript | — | |
eTHjiJTphHGSBWg6dC96Yn | Test new prompt (Aug) | no transcript | — | |
nsgxqjsC6igqFGeX669Doe | Test new prompt (Aug) | no transcript | — | |
hsTZ4w9dDsQK3iRWpSBHBN | RBI Bakeoff 2026-07-24 | YES | The agent captured the full order and directed the customer to pull forward without escalating to a human. | 1x Wraps Bundle (Spicy Wrap, Classic Wrap, Chilled Mang |
3mrrUqg24MthVi5aeBcE2u | Simulation Run 2026-08-17 02:54 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Wraps Bundle (Frozen Mango Cane Sweeeet Lemonade, Cl |
I'd like the 3-piece signature chicken combo, spicy. I don't want fries. What other sides do you have?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
YXsRTxMJKfvhPDrtfbmTan | RBI Bakeoff 2026-07-23 | NO | The agent failed to read back the order and escalated to a human employee for assistance. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
ZdYdPKUR4cXxMowB8ZGMYe | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human team member for order verification before completing the order. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
mNz6yqFUndPPzxftMKznEQ | RBI Bakeoff 2026-07-24 | NO | The agent did not complete the order alone and escalated to a human team member to assist further. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Red |
eFsRxcD992Fmx6SLKtdFpj | Simulation Run 2026-07-20 23:58 (scratch) | NO | The agent escalated to a human team member when the customer couldn't see the screen. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
55gJUYohH5jfYJYCQUuHVC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
6UZAyiAgsagt9vyMwHss8b | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript ends before order is fully captured or customer directed to next window. | empty |
9fZ8nJHF6DXRKN6y9yFfEy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BRAcvMyDYMn5Fz7yXFmXn4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NMthfWTykE3YgzH6NTUpgk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Qg7cwUe7RWzHDsvZLbk3fH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QvYDNnaNvduhPxnrs5NDg7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Spuof7TRbEvU6Up2ENznCe | Simulation Run 2026-08-16 21:10 | no transcript | — | |
arvskH4QVgn4bHsuJNrAmr | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent taking the full order or directing the customer to pull forward. | empty |
c2odyTYpRMGqEWJWTouzL2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Y653aePVfqLCZJPTDihTkP | Simulation Run 2026-08-17 01:07 | no transcript | — | |
HUY2sEFphLP5CirgdMuYaC | Test new prompt (Aug) | no transcript | — | |
KJaWx9EwFBrKP74STAuAs9 | Test new prompt (Aug) | no transcript | — | |
LLtryUPrNkb4zAHdG8Y49p | Test new prompt (Aug) | no transcript | — | |
MyiNZWaKXZkgSAdxgA9p3R | Test new prompt (Aug) | no transcript | — | |
kTfQu2FjsypwdMTY4qEv8z | Test new prompt (Aug) | no transcript | — | |
EcZvzSC97y5hNrAuMKpohW | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
UreUn6Qvu8YUDG2KmVtpMx | RBI Bakeoff | YES | The agent fully captured the order with all modifications and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
TpkFVJUHLqyw6jYu6LVN3R | Simulation Run 2026-08-17 02:54 | YES | Agent took full order, confirmed it with the customer, then directed them to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
Can I get the ghost pepper sandwich combo, swap the fries for red beans & rice, and a Dr Pepper?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
XxQxEu5JibHzRtm6bjyY3m | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent did not complete the order or direct the customer to pull forward, instead escalating to a human. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
6SidWtNFX9dppnNt9HqXEU | RBI Bakeoff 2026-07-24 | NO | The agent could not read back the order and said an employee will assist the customer, indicating escalation to a human. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
ZJtDSjGcMKfm2AnecCopvb | RBI Bakeoff | NO | The agent escalated the order to a human employee for assistance instead of completing it themselves. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
oPgA5FxqrBgjfjEUJih5B2 | RBI Bakeoff | NO | Agent handed off to a human team member instead of directing customer to the next window. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
3NmyQBrgdshC9gLmeUkwC3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
3sfhdiub5vwiJvPA83RY7e | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4dHorPLK5SwWA8c3sSYPMs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9KZ5X6WDa5ADJWw3dKXJN3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DWen8wdRgC76UpsuMCxJqW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NpUJBComWcND96iKu6tTeF | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RDmsyKvQXsYXkC8g8E4eAR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WeTcCq5hWbWLifhf8Wq2EL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
X5SJ8n3i9scrYtGW2ro8JM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XD7B2jjS4V35ioxgocBeih | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9YiXH8bsVUYUQGUdscjgsC | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript only shows the customer order, no agent response or direction was provided. | empty |
Bmvm4BbqHNjGf3MbU3749E | Test new prompt (Aug) | no transcript | — | |
ELcUDgfUmYmSLwGvvdV2CV | Test new prompt (Aug) | no transcript | — | |
GBnqoiGg3U4zpYQmnAKUoZ | Test new prompt (Aug) | no transcript | — | |
ThujSiFAMsLMcXLbCyhssB | Test new prompt (Aug) | no transcript | — | |
UHuTJThKKvsXv4qUxUDWiq | Test new prompt (Aug) | no transcript | — | |
YCkmuHqAF2FZQbVtwNDtcs | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
KoYErXKTB6AsYmPcPdBGbC | Simulation Run 2026-07-20 23:58 (scratch) | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich Regular Combo (Red Beans an |
8srzetSDCi7vVhHFgyhBsB | Simulation Run 2026-08-17 02:54 | YES | The agent captured the full order, confirmed it with the customer, and directed them to pull forward without escalating. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
Can I have a Cajun Rice please?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
ZbJT8HG6tAG5JSpKGMEhz2 | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human team member stating 'An employee will assist you'. | 1x Red Beans & Rice; 1x 12 Piece Signature Chicken Fami |
Cw39cQ8Hw8FM6qGuwn9cAu | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent escalated to a human team member instead of directing the customer to pull forward after taking the full order. | 1x Red Beans & Rice; 1x 5 Piece Chicken Tenders Regular |
cfni4H85i9EDdNmfiEtSvn | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human team member to assist with order confirmation before sending customer forward. | 1x Red Beans & Rice; 1x 12 Piece Signature Chicken Fami |
KSMX6ipCiBwz5Hcw9LrPc9 | Simulation Run 2026-07-20 23:58 (scratch) | NO | Agent did not read back the full order and escalated to an employee to assist at the window. | 1x Red Beans & Rice; 1x 12 Piece Signature Chicken Fami |
3TvYfiWEwZdeLKE7DtXUBf | Simulation Run 2026-08-13 22:00 | NO | The agent did not fully capture the order and handed off to an employee twice for assistance. | empty |
62iXYmGhkA32fKVEVWXeCm | Simulation Run 2026-08-13 22:00 | NO | Agent repeatedly handed off to an employee and failed to confirm the full order or total, escalating to a human. | empty |
DuF6RELd754Cbi67UUGskx | Simulation Run 2026-08-13 22:00 | NO | The agent did not read back the full order and escalated to another employee before directing the customer to pull forward. | empty |
Ehyq6SYu9t7AfNkUNBUZuB | Simulation Run 2026-08-13 22:00 | NO | Agent failed to read back the full order and escalated to an employee for assistance. | empty |
TZQkGpgG2xyizhR5aC5jue | Simulation Run 2026-08-13 22:00 | NO | Agent did not complete order themselves and instead said 'An employee will assist you,' indicating a handoff. | empty |
8d7fk8AU2CXDbzMqtVo9FE | Simulation Run 2026-08-13 22:42 | NO | The agent escalated to a human instead of completing the order and directing the customer forward. | 1x 12 Piece Signature Chicken Family Meal (Large Mashed |
HVVBFpgQhoHzjd4cdvvMQA | Simulation Run 2026-08-13 22:42 | NO | The agent escalated to a human employee to assist with order review before the customer could proceed. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Custom |
MYjdYwsHiwLeKSqoWpPK2g | Simulation Run 2026-08-13 22:42 | NO | Agent asked customer to check screen and mentioned employee assistance before directing to pull forward, indicating escalation. | 1x Red Beans & Rice; 1x Cajun Fries; 1x 12 Piece Signat |
UzEvTtBEDg5TwU8hfpcfdL | Simulation Run 2026-08-13 22:42 | NO | The agent did not read back the full order and escalated by saying 'An employee will assist you.' | 1x Red Beans & Rice; 1x Cajun Fries; 1x Homestyle Mac & |
23yCrBRAy6LTZ88hK9fBEN | Simulation Run 2026-08-13 21:27 | unjudged | empty | |
6VZh2zqrDz8oqjpetEBZbF | Simulation Run 2026-08-13 21:27 | unjudged | empty | |
ARcnuUVZjWuLESzutfL5qA | Simulation Run 2026-08-13 21:27 | unjudged | empty | |
FySrgbpWmTTagcKPEuvyYh | Simulation Run 2026-08-13 21:27 | unjudged | empty | |
H5KQU8kJwVAxzKUTDMwYTJ | Simulation Run 2026-08-13 21:27 | unjudged | empty | |
QoW8LQcvCJexJibRdhmhXe | Simulation Run 2026-08-13 21:27 | unjudged | empty | |
RnH6FT3GmZ3Hv6xCNUVCrZ | Simulation Run 2026-08-13 21:27 | unjudged | empty | |
UnKq7dAcxgVADSjBrEhht7 | Simulation Run 2026-08-13 21:27 | unjudged | empty | |
Upoj88H6LY8cTByQY5n9jq | Simulation Run 2026-08-13 21:27 | unjudged | empty | |
ZPqTCA83fzoVPUwPkE7nW8 | Simulation Run 2026-08-13 21:27 | unjudged | empty | |
6LKEUno3kFLKsu3zXQibHM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8HSbauy3c7LdGWngbh7XCY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
C5yuB6RnSiuYn6nJaLo6UU | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CpwzxRnp7DYNB3pXRFmg4q | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GGEBEc8sXTvJ74FnPU43RK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
H8vGQvMts95s5UDG9pePLw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZiQybvR7f3SQwkXn76EafS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eCEBj4duTDs5GCMdACQoTa | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mtCWo2KHmXNJsoGfTvBEc2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nvAMa8TwovCLm6uwYavmPM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UJ9xRmpLcRazn85yfc2S66 | Simulation Run 2026-08-17 01:07 | UNKNOWN | The agent did not capture the full order or direct the customer to pull forward in the transcript. | empty |
3hGF6ua4VLNb6eoTiajQfC | Test new prompt (Aug) | no transcript | — | |
9izhEBaAy7uNFgHTtU5k3k | Test new prompt (Aug) | no transcript | — | |
EfuNSpsfiguD75aNGiXnmZ | Test new prompt (Aug) | no transcript | — | |
F5zsz4pj7xqF9fgNKVjcZK | Test new prompt (Aug) | no transcript | — | |
WPQxnq8pbivsRnnXVFCQhZ | Test new prompt (Aug) | no transcript | — | |
aBpxBKFoEnNoNUrCwcRrhL | RBI Bakeoff | YES | Agent took full order, confirmed details, and directed customer to pull forward without escalation. | 1x Red Beans & Rice; 1x 12 Piece Signature Chicken Fami |
ApnHt4udStrx64vBCfZHUG | RBI Bakeoff | YES | Agent fully captured the customer's detailed order and directed them to pull forward to the window without escalation. | 1x Red Beans & Rice; 1x 12 Piece Signature Chicken Box |
6Gnbd2ZWeNu9nmDwLdzWVv | Simulation Run 2026-08-13 22:00 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | empty |
E24xH5sSjLEi5nyjDGA5vn | Simulation Run 2026-08-13 22:00 | YES | The agent captured the entire order and directed the customer to pull forward without escalation. | empty |
EzZenM9BtuNpaEP5spqyeq | Simulation Run 2026-08-13 22:00 | YES | The agent took the full order and directed the customer to pull forward without escalating to a human. | empty |
QAWSqXsShU33mKdhW4Md8Y | Simulation Run 2026-08-13 22:00 | YES | The agent took the full order, confirmed it with the customer, and directed them to pull forward without escalation. | empty |
YJMHbCPRv9zvfraBXYPqRC | Simulation Run 2026-08-13 22:00 | YES | The agent took the full order and directed the customer to pull forward without escalation. | empty |
BTt4bH76mH7nKyqkTjX6TF | Simulation Run 2026-08-13 22:42 | YES | The agent fully captured the customer's order and directed them to pull forward without escalating or handing off. | 1x Red Beans & Rice (Rice); 1x 5 Piece Chicken Tenders |
C6EZQEkv4qqzkhb9SE7yLQ | Simulation Run 2026-08-13 22:42 | YES | The agent took the full order, confirmed it, shared the total, and directed the customer to pull forward without escalating. | 1x Red Beans & Rice; 1x 12 Piece Signature Chicken Box |
Fy5bn32rbcfrq4ma7poNQ4 | Simulation Run 2026-08-13 22:42 | YES | The agent took the full order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x Red Beans & Rice; 1x 12 Piece Signature Chicken Fami |
bTnazN3838RThpiQrqc5iy | Simulation Run 2026-08-13 22:42 | YES | The agent fully captured the entire order and directed the customer to pull forward without escalation or handoff. | 1x Red Beans & Rice (Rice); 1x 12 Piece Signature Chick |
gLbb7XQYxPhZo7vqsSh46R | Simulation Run 2026-08-13 22:42 | YES | The agent fully captured the order and instructed the customer to pull forward without escalation. | 1x Red Beans & Rice; 1x Cajun Fries; 1x 12 Piece Signat |
kt8dwzPAQZJ4utLnEgojmD | Simulation Run 2026-08-13 22:42 | YES | The agent fully captured the order and told the customer to pull forward to the window without escalation. | 1x Red Beans & Rice (Rice); 1x 12 Piece Signature Chick |
by3g4evXUZEB9m8w5ybobA | Simulation Run 2026-08-17 02:54 | YES | Agent captured the full order details and directed the customer to pull forward to the window without escalating. | 1x 12 Piece Signature Chicken Family Meal (Large Red Be |
I'll do the 12-piece family meal with all dark meat, spicy, Cajun fries and cole slaw, and two Sprites.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
Y84TaPT6kY2iKPCmuBs5my | RBI Bakeoff 2026-07-23 | NO | The agent did not read back the full order and repeatedly escalated to a human employee to assist the customer. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
X89ZiqMn7bnm5qVdTSqwZB | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated the conversation to a human employee instead of directing customer to next window. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
CEQ3nXsXs8jgaSSYaHT6Vf | RBI Bakeoff 2026-07-24 | NO | Agent failed to confirm the full two-piece order correctly and denied reading back, implying incomplete capture and potential escalation to employee help. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
AmTPWqZtepsPwqzKAtV4Xo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KHMso9WkZ7SHqp4RKkW33k | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KSpJpePMtjVLxrC9Bx2Ux5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YM5EVwvpTv45zXhk3Yu4En | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aj9aytFNNitXu2BjN5rVM9 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dz7AfozSi282YgjBbnaxnn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
egS2cNnvNYmysyw4gEQ6yW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
msZXBSNTj5dMcAuzxuDKgU | Simulation Run 2026-08-16 21:10 | no transcript | — | |
n7cp3ArzSrkRJKbqeHBtqv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
oCNTpBWFoSbMbZLjRVFNby | Simulation Run 2026-08-16 21:10 | no transcript | — | |
2FPg99hFT4mdmY22Z5MTdX | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent taking or confirming the full order or directing the customer forward. | empty |
PsAeouBqBuQhhfUTPcBTd5 | Test new prompt (Aug) | no transcript | — | |
PuH7M9dTCLVwCjXCqVH4GK | Test new prompt (Aug) | no transcript | — | |
YRxKj5pmoGLqXUwrXQjmkH | Test new prompt (Aug) | no transcript | — | |
Ym453KJbA9sKZHCt7zqWew | Test new prompt (Aug) | UNKNOWN | The agent never confirms or directs the customer to pull forward or the next window, nor completes the full order. | empty |
gCS9MzQLtnJsyYXovMcQ7d | Test new prompt (Aug) | no transcript | — | |
nQwJWhFogeZt9qHgoaWgBt | RBI Bakeoff | YES | Agent took the full order, confirmed accuracy with customer, and directed them to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
TveVzhrPUzCSBEHHek27Zx | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward to the window without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
cntcQqTgdjjqRNPn98CNZk | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order, confirmed accuracy, and directed the customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
95fMj2bNZq4KmCRVzc5spe | Simulation Run 2026-08-17 02:54 | YES | Agent took full order, confirmed it, and directed customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Spicy, Dark |
Order five classic tenders by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose cole slaw and a Sprite.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
cMPoBfZ4yZk3sZ5527XEKn | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent did not accurately capture the order; changs 5 tenders to '5 Piece Chicken Tenders Dinner' and order price changed, no clear confirmation by customer; agent did not… | 1x 5 Piece Chicken Tenders Dinner (Blackened Ranch, Swe |
cScsqL2sK7pZpLHftzspCU | RBI Bakeoff | NO | Agent escalated to a human team member upon customer's request to read back the order. | 1x 5 Piece Chicken Tenders (Blackened Ranch, Classic); |
iRcMFnnrb4TJ25xoVFcic8 | Simulation Run 2026-08-17 01:07 | NO | Agent did not confirm or complete the order, nor direct customer to pull forward or next window. | empty |
6pfuiR4HkVkheAYrgC7cNh | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BQnoL8JxtgiSe8E7vUcfzQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NAthWrG3DTrkVprFpKescP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
TteTHuxyp99HkJR4eykimV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aY2UD6jiZG5Mu9ierViLGX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eQrD8cHWGggZNzXeDXjpeG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
esnX4oneWdLtgUHsMs64UD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
f7xfL4HAjZiNFzENhXLEJX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kEziE2u6X3JcFPCxqTYDnx | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mktpEES5mfhLQ3gE7GUYxo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4D3UQkM8Mav4RqWfu9psVL | Test new prompt (Aug) | no transcript | — | |
PLAGU6mgnvJ7YNmpE9yYvW | Test new prompt (Aug) | no transcript | — | |
RTJtrVsNMUgoWxdUVrkTC7 | Test new prompt (Aug) | no transcript | — | |
XApuTxaJXRSq9fpu55zZrH | Test new prompt (Aug) | no transcript | — | |
nxLEqpkp6oya8Acz3cUbvG | Test new prompt (Aug) | no transcript | — | |
Qn4QXHnK7VkVMzDmwLxGaH | RBI Bakeoff 2026-07-23 | YES | Agent took full order including sauces and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, S |
W9oiHSDtocMqBe4t4RWbXE | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and told the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, S |
GERoubjYeF97HpBnRnpwXh | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, S |
mSgw6X8zjrZkDHECt3c7Bq | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Dinner (Blackened Ranch, Bol |
iVY2RiksVfM7gogeBHy3YZ | Simulation Run 2026-08-17 02:54 | YES | Agent fully captured order, confirmed it with customer, and directed to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, S |
Can I get the Ghost Pepper Sandwich combo? Actually, change that to the regular chicken sandwich. And make it spicy.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
khiG7HdqYeLMirBzGJjw7G | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent did not read back the full order and referred to an employee for assistance. | 1x Spicy Chicken Sandwich Large Combo (Chilled Mango Ca |
MSzCa2pQ7TjN6TqWRwns9r | Simulation Run 2026-07-20 23:58 (scratch) | NO | Agent escalated to an employee after order confirmation and did not direct customer to the next window alone. | 1x Spicy Chicken Sandwich Large Combo (Frozen Mango Can |
WuuoxSm2So2AvyfJwGWa9t | Simulation Run 2026-08-17 01:07 | NO | The agent did not confirm the full order or direct the customer to pull forward; no completion or forwarding occurred. | empty |
6radFaBA6jDFVn4LXxL76N | Simulation Run 2026-08-16 21:10 | no transcript | — | |
734RjnQFupdNCbA7gvBTA2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FmzGnCJMDmPcebfrog7XaX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HehreRGgPKb4ZGcAGAcwfs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MzEfhQ7Ug8yZDQMbAa27YR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QaUuMcyke72KS55KA79iG2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SoqBZQeNwrpsiG5QF2Ddfw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UtWRGBTSVPZD68tcfSFa4N | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZA2qsaLwL7PBypRLvP33hB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aRSyHsiY5CvtnKTj9Q8dPn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VRKRpgKC3Hsw37Tisndzy6 | Test new prompt (Aug) | no transcript | — | |
YSBbiJHWbrWE8fz7CUEvk8 | Test new prompt (Aug) | no transcript | — | |
bGXhZ8NXRAEcYM4NVoK69u | Test new prompt (Aug) | no transcript | — | |
dwN7btfgyxADUSZxgaodXv | Test new prompt (Aug) | no transcript | — | |
jSg2aqACe5zYRsCVbE5YBv | Test new prompt (Aug) | no transcript | — | |
UZUaYgqKZsPPmhYS5aNtjx | RBI Bakeoff 2026-07-23 | YES | Agent fully captured order details and directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Large Combo (Cajun Fries, Mas |
U5rQYevnd6VVycY5tXsxFG | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and instructed the customer to pull forward without escalating. | 1x Spicy Chicken Sandwich Large Combo (Cajun Fries, Mas |
aYeNHLAh5ER2pAhatkTPKt | RBI Bakeoff | YES | The agent fully captured the order details and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Large Combo (Cajun Fries, Hom |
R4uZGthvz8aWCRkkH9bTrg | RBI Bakeoff | YES | Agent captured full order and directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Large Combo (Cajun Fries, Hom |
a4PjUWWTYNU5Ey43o2Pzyv | Simulation Run 2026-08-17 02:54 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Large Combo (Cajun Fries, Mas |
Order one regular bacon and cheese sandwich by itself. Do not ask for a combo or a large. If the agent first offers to make it a regular combo, accept with fries and a Coke, then accept a subsequent l
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
abSSoo3evw5gpJswddSum5 | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent couldn't read back the order and deferred to an employee if needed, indicating escalation to human assistance. | 1x Bacon & Cheese Chicken Sandwich Dinner |
2ws4Q5CkdeJveK2XSjWVRy | RBI Bakeoff 2026-07-24 | NO | The agent did not read back the order and mentioned an employee would assist if needed, indicating a handoff or escalation. | 1x Bacon & Cheese Chicken Sandwich Dinner |
Dp7qYF8s7cHgcUJiaazeWy | RBI Bakeoff | NO | Agent confirmed order but did not direct customer to pull forward or next window. | 1x Bacon & Cheese Chicken Sandwich Dinner |
5SfgpnwehUHYoEhFb6NHAE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
6A2Afa2WhcqEEBGYDEKwEK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7utLc7dm8Y86SNbCYxidKM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DWYbn47ceaDvSDE8dphr3E | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GUgt6DaaCsU24i2GMnAiYR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YCosTiVHcnT6NthGpQkevj | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Z5K5GnEwKHKEjsvSqa2Z8D | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fMJNxNpHKp653A3sTqgPWo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
n87x9on7c4UnExAStHSPSY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
oEqgYAcg6jWA3qb6hnG6GM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CRime8P4Q4qoaPjjLU2mJM | Test new prompt (Aug) | no transcript | — | |
DLTiwZK4V6rCfwcqybigS6 | Test new prompt (Aug) | no transcript | — | |
R9rfivChRxNUh6JDVEjcsz | Test new prompt (Aug) | no transcript | — | |
WVh2vCFdjh6iWZUGW5gbRS | Test new prompt (Aug) | no transcript | — | |
kTgqu5EhXexa6qjNV95mC9 | Test new prompt (Aug) | no transcript | — | |
YB7AfnqdNUbbdXER3zydRS | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and instructed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
JbrXB6Eir6LiYuSFkeyin9 | RBI Bakeoff | YES | Agent fully captured the order and directed the customer to pull forward without escalation or bailout. | 1x Bacon & Cheese Chicken Sandwich Dinner |
6a2LWyRPDR459B7PAv4j9C | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent took the full order and directed the customer to pull forward without escalation. | 1x Bacon & Cheese Chicken Sandwich Dinner |
cfxaNTfVCpdgiQu4fKaeVV | Simulation Run 2026-08-17 01:07 | YES | Agent took full order and directed customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
kum8ABEr3RguEo7f7jvhXu | Simulation Run 2026-08-17 02:54 | YES | The agent fully captured the order and told the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
Order three pieces of spicy signature chicken by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose mashed potatoes and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
KEAk2eeF52K4P7aj6wznmr | RBI Bakeoff 2026-07-23 | NO | Agent repeatedly mentioned 'An employee will assist you' indicating escalation to a human. | 1x 3 Piece Signature Chicken (Spicy) |
kfnPvxuoN5YBY6yhmbGo2z | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent escalated to a human employee for help instead of completing the order and sending the customer forward. | 1x 3 Piece Signature Chicken (Spicy) |
hGRVxwU2bvJWbVYuA7zjhh | RBI Bakeoff 2026-07-24 | NO | The agent escalated to a human team member repeatedly and did not direct the customer to pull forward or the next window. | 1x 3 Piece Signature Chicken (Spicy) |
MJWQWbPQyiu5dJBUUrsDon | RBI Bakeoff | NO | Agent escalated to a human multiple times without sending customer forward or confirming order completion. | 1x 3 Piece Signature Chicken (Spicy) |
KUPkqXovP5NHMnb5JWrccC | Simulation Run 2026-08-16 21:10 | NO | The transcript ends before the agent directs the customer to pull forward or the next window, and no order completion is confirmed. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
KZHuUHnbrY99N57n2z4m7y | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NYGLUyPUkMXvXCZfmFEkpV | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript lacks information on order completion or directing customer to pull forward or next window. | 1x 3 Piece Signature Chicken (Spicy) |
NiAao5RCXmXmkND9jXbPc7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Qk53qcjjMcsGx6AiSNyHY2 | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent confirming the full order or directing the customer to pull forward or the next window. | 1x 3 Piece Signature Chicken (Spicy) |
BeP5vWWVSLTLnqmFktzpiu | Test new prompt (Aug) | UNKNOWN | The transcript does not show the agent completing the order or directing the customer to pull forward; it ends with customer order request. | empty |
G522eSXEAu6Jr4udsnteEk | Test new prompt (Aug) | no transcript | — | |
MBVhZk6raZMyXfNy2n7obL | Test new prompt (Aug) | no transcript | — | |
PMjWmoLARcRvTH47hBFPke | Test new prompt (Aug) | no transcript | — | |
kd7Cobe6nZLWDhvozfsLZx | Test new prompt (Aug) | UNKNOWN | The transcript shows the customer ordering but does not include order completion or directing the customer to the next window. | empty |
bD4JtmKZx4W6w2fWWUEiPv | RBI Bakeoff | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken (Spicy) |
KzxXKeKHatT2v4iASxXYYs | Simulation Run 2026-07-20 23:58 (scratch) | YES | Agent took full order and directed customer to pull forward without escalating or bailing. | 1x 3 Piece Signature Chicken (Spicy) |
FAAKLKjrydPc3dD6GuiWqM | Simulation Run 2026-08-16 21:10 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
LeA39KEtqBwzJWtGF5ZoKu | Simulation Run 2026-08-16 21:10 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
PahcvKp4wokXpf9V5kgDHx | Simulation Run 2026-08-16 21:10 | YES | Agent captured full order and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
UpcWnTNfxBAi9ywDeTikFH | Simulation Run 2026-08-16 21:10 | YES | Agent took full order, confirmed accuracy, and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
cZTa3QdkFZ5gj3mcB7949h | Simulation Run 2026-08-16 21:10 | YES | Agent confirmed full order of 3 spicy chicken pieces and did not escalate or hand off. | 1x 3 Piece Signature Chicken (Spicy) |
LXeEu35NK8XXRBoUW3incC | Simulation Run 2026-08-17 01:07 | YES | Agent captured the full order and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
ezo5Q7HBpf3uS6pemY6AhL | Simulation Run 2026-08-17 02:54 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
Do you have nuggets?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
mmMGRYoQ7AaBLW55do3Ja9 | RBI Bakeoff 2026-07-23 | NO | Agent failed to read back the order and directed customer to pull forward for employee assistance. | 1x 12 Piece Chicken Tender Group Bundle (Spicy, Butterm |
Tw28c76BuybrZG9yjPQSwR | RBI Bakeoff | NO | Agent failed to read back full order and escalated to a human before sending customer forward. | 1x 12 Piece Chicken Tenders Family Meal (Spicy, Blacken |
2wxSDWMJqgp5Hv22VRsmoG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4Yk7myT8qBNB7xWXnmu2Cy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7yL899Ea6JGxcpTbmKWhVV | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript does not show the agent taking an order or directing the customer to pull forward. | empty |
QhKVKnM8PuQmLqktGc6MYH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RkcrpZmdErvsjyZJvZH9Gy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VvPc56c9aWDktu4hta7J6n | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YErUXS4a7JFXFP2NAFHjDk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YT6dEKgRSDgKmy3krCdujL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
a4o24JKtB4v6j5Bd8TEd77 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gX5LczRW9Yxj53M5892zeb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DbTxQC4oyECDAVqtZGrojE | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript shows only initial greetings and a question about nuggets; no order was taken or directed forward. | empty |
F9GE6kt2ECG6LRrcEhipm5 | Test new prompt (Aug) | no transcript | — | |
NvGo7V6zCM4Y6CNZgYr6i6 | Test new prompt (Aug) | no transcript | — | |
PBGJ6edtzndjm5x2JRPWvs | Test new prompt (Aug) | no transcript | — | |
TM8RkagiuECPwJk3VRMpec | Test new prompt (Aug) | no transcript | — | |
euuHNcANr7AWQgFMjLQVes | Test new prompt (Aug) | UNKNOWN | The transcript shows only initial greeting and inquiry about chicken nuggets without order completion or directing customer forward. | empty |
XKBaGrfwt9pEK7v7nuNXFU | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent captured the full order and instructed the customer to pull forward without escalation. | 1x 12 Piece Chicken Tenders Family Meal (Spicy, Large M |
8NHCEmmvv5FRkU7ThfC5DU | RBI Bakeoff 2026-07-24 | YES | Agent fully captured the customer's order and directed them to pull forward without escalating or handing off. | 1x 12 Piece Chicken Tenders Family Meal (Spicy, Blacken |
oKhpNju5UxMp6gjLCkndFT | RBI Bakeoff | YES | The agent captured the full order and instructed the customer to pull forward without escalating to a human. | 1x 12 Piece Chicken Tenders Family Meal (Spicy, Large M |
2wBZxzqRUFbYSHJ86mhHwA | Simulation Run 2026-07-20 23:58 (scratch) | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 12 Piece Chicken Tender Group Bundle (Mashed Potatoe |
DAXCDPhJnQruCfv78BUoto | Simulation Run 2026-08-17 02:54 | YES | The agent took the full order with details and directed the customer to pull forward without escalating. | 1x 12 Piece Chicken Tenders Family Meal (Spicy, Large M |
One bacon and cheese sandwich combo, large, with fries and strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
fxzKtjGtxUKXCYngNZLnhD | RBI Bakeoff 2026-07-23 | NO | Agent did not read back the full order and escalated to a human employee for verification. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
kXRijcvjuuxGnR6eG6Gwg4 | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human team member instead of fully completing order without handoff. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
4vTkLtg2hqamvNrvnzHNxd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
5WPVPsVkEHYyUWNANZcVwF | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BGxhpUaCGSz49nsa3zG6WL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DZxtgwrxASqxre6RforNdZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Pq7YAnNsRcsD3P4mYQMqzE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
TiGZX24kzR8WraBufCVeWE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bfPL2r7pz4WsN25MwnVHig | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dLXfu2dgDEJ65DPv7sLgSv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iKiCuRTajGLG4vamv3k7XF | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nAzuEwEVKUPPAoUUikwAnJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
F84YeSmF4wuPevNHFByxo5 | Simulation Run 2026-08-17 01:07 | UNKNOWN | The agent did not confirm the full order or direct the customer to pull forward/the next window in the transcript. | empty |
C46aE4vzdRESU2zhn5sMbc | Test new prompt (Aug) | no transcript | — | |
PpQBPD9GDfwRxTjhY3ZusL | Test new prompt (Aug) | no transcript | — | |
R3Ch6LDFsUyrgfbRmrSikP | Test new prompt (Aug) | no transcript | — | |
fknB6pog5q3HZ4gioV3oCz | Test new prompt (Aug) | no transcript | — | |
jabhVoeQVc4iqHQGyuHiB9 | Test new prompt (Aug) | no transcript | — | |
JWM7G86U2QPU4GAqk7AtRu | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the customer's order and directed them to pull forward without escalating or bailing. | 1x Classic Bacon & Cheese Chicken Sandwich Regular Comb |
aZn8YV2zhNvKGgdGoJLkie | RBI Bakeoff | YES | Agent fully captured order, confirmed it, and directed customer to pull forward without escalating. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
24NsUYLqnPHMBtpQrVN4UQ | RBI Bakeoff | YES | Agent fully captured order details and directed customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
RCjWsi9NtcvTfJYAK7CoMh | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalating. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
8ixKg5RqtUf6YcYGPccCMU | Simulation Run 2026-08-17 02:54 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
Start by ordering the 3-piece signature chicken combo, spicy, with mashed potatoes and a Coke. Before the order is finalized, change it to the 4-piece combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
8uDW5AWTieqisEcbnRj6Q5 | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human team member after failing to read back the full order accurately. | 1x 4 Piece Signature Chicken Large Combo (Mashed Potato |
jzJ9QLzHgJqZQbimrRQwCG | Simulation Run 2026-07-20 23:58 (scratch) | NO | The agent did not complete the order and repeatedly escalated to a human employee for assistance. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
6YUWYtU9zHLW5ekXoiSnRs | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript ends before the agent confirms the order or directs the customer to pull forward. | empty |
7xgEWFmA8MN3r2toqFrguM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8hjNkfRVNVJGFWaka2FERs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JXqApCcYmq2PdBzgrguaHn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KaJsm8ukBqFyFtGHovf4o5 | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript lacks confirmation from the agent that the order was fully captured or the customer was directed forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
XxCpwRbhqKArwue4P52LAa | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bLtg5RqFshabEE3bRKkab5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eJmJ5WKBQrT8gQ6gxfgyfg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gcU68obarsSVcvrgLYPcFp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mDtzE3SJjz3RVq5K8bqZRE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4VddedQctPTgeWpUZXvGoy | Test new prompt (Aug) | no transcript | — | |
BuKHrdJmGrbwrfDAzVFc3X | Test new prompt (Aug) | no transcript | — | |
CYqp6KQybXjTopBK5ez3mG | Test new prompt (Aug) | no transcript | — | |
QHLwi2xR4iXE7hQJmL4jDk | Test new prompt (Aug) | no transcript | — | |
U4MvBTWNo34wo7HzvW2Chv | Test new prompt (Aug) | no transcript | — | |
iUWSVxUQttLUdTdd4fxmJw | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Large Combo (Spicy, Mashed |
7RM6qe4BCvVLNHRANZwRnq | RBI Bakeoff 2026-07-24 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
V3UgVqjDZquSmYFKxgh8hg | RBI Bakeoff | YES | Agent took full order, confirmed it with customer, and directed to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Mashed Pota |
cGmWSBHBYTeRCp6Xjkjnvr | RBI Bakeoff | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Large Combo (Spicy, Mashed |
5Bw4Wu8YnE9Cruq8wc2AuC | Simulation Run 2026-08-17 01:07 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Large Combo (Spicy, Mashed |
Nt3gYcemtY4rDCKbJSLppF | Simulation Run 2026-08-17 02:54 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Large Combo (Spicy, Mashed |
Order one classic chicken sandwich by itself. Do not ask for a combo. If the agent offers to make it a combo, accept and choose Cajun fries and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
DFpYUqgufGpz9Q9R7tZJcw | RBI Bakeoff | NO | Agent escalated to a human employee instead of directing customer forward. | 1x Classic Chicken Sandwich |
3M5CAvFUGoNzwN2xzdr2wV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
3aUp4A7jQw8pFQ8AuZTHzY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
3uFkaCxjoTkhimMN8ZYEVw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4L64jFa2me4LrsMSbdy8Gf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
64cHQdjYetiiErC3UGCGjt | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8TX7nJU9orzKayT9vTjbD8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bBtQKUmrziTe7ihvoGTAuM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ecnWf9XAMhzCkqrEoV9CJG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gTjSV7xovDzrcT8oLqdukX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kpZ2Lva6JreyMo4UFgjtr4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cNRHVHW3X6zEBR7GZpuSiP | Simulation Run 2026-08-17 01:07 | UNKNOWN | The agent did not capture the full order or direct the customer to pull forward in this incomplete transcript. | empty |
KSajvM56n5cgTaKbmCcdFP | Test new prompt (Aug) | no transcript | — | |
LsCqSsmjSmtEi6ggabaPHt | Test new prompt (Aug) | no transcript | — | |
PEDKE8T76LEvqw25C5EUMr | Test new prompt (Aug) | no transcript | — | |
hCMjUrniWQ3e7brB38giZk | Test new prompt (Aug) | no transcript | — | |
nJPh8Xan5RHeuc26QaBQ6V | Test new prompt (Aug) | no transcript | — | |
WkABcEmbhMFSriC7vEEcJz | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
3zA3YmqrC2ouXJYTHuwKW5 | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
XqBg62msBUH9Qy5PBEyMTc | RBI Bakeoff 2026-07-24 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
CJZAiJJjL82459WxkoEag8 | RBI Bakeoff | YES | Agent took full order, confirmed it, and directed customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
feTu3pEMBDNz362SzG5ek3 | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent took the full order (classic chicken sandwich) and asked the customer to pull forward to the window without escalation. | 1x Classic Chicken Sandwich |
GCJK2bZok7zKiirsBMK8D4 | Simulation Run 2026-08-17 02:54 | YES | Agent captured the full order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich Large Combo (Cajun Fries, M |
I'd like the 5-piece tenders combo, blackened and spicy, with cole slaw and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
DeR3Fs93y6m6PpWnv5H2fE | RBI Bakeoff | NO | Agent failed to capture customer's requested order details correctly and escalated to a larger combo with modifications. | 1x 5 Piece Chicken Tenders Large Combo (Blackened, Spic |
2qHathmrraRMtSDKSbpBnq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
2ypYmakMvAuKoEaqdt2HLt | Simulation Run 2026-08-16 21:10 | no transcript | — | |
3TkJYUCX4ohTCTrYXhnKf5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LKjGvgYSdZiUkxgXhfpNU3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RBkVkkGaZrFnQ4oNdRxarp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VWPCtgUpuJTaYf2tETtUKQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cKd3y2WNtWQwxEZJYdaBVn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
izYGBv373DECawRSsPfQLz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kUDxXCsxuZ6FJBrRYUjRhd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mUpJ8yFhXVivsLYLXAmViQ | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent confirming the full order or directing the customer to pull forward/next window. | empty |
2NbxoxeUqirao5BcG9GtNW | Test new prompt (Aug) | no transcript | — | |
88HWHds93zxmy9FEVZXDif | Test new prompt (Aug) | no transcript | — | |
8TkqCKeaRBboaek2eFNQnQ | Test new prompt (Aug) | no transcript | — | |
Wve6Xhvcr4R3WAhP5fqbiL | Test new prompt (Aug) | no transcript | — | |
eDmarrx6SZu6eMErxGx7po | Test new prompt (Aug) | no transcript | — | |
KDoSrbkJbX9p69tMU9PEhy | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order, confirmed it, and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
cCkLc4teQD8AEUKLH9yJJy | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Sp |
APySbSdgQaiURbLYghPyCp | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalating to a human. | 1x 5 Piece Chicken Tenders Regular Combo (Coleslaw, Coc |
DQgKEqogDfE6oZXhZxo5jC | RBI Bakeoff | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalating. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
VoALXubJdrbmfrnXms3Qnt | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
Vj44ugJT3PEb3LHBKJqzB4 | Simulation Run 2026-08-17 01:07 | YES | Agent took full order with modifications and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Sp |
KyZfAc4py62oyJhyk7nyRn | Simulation Run 2026-08-17 02:54 | YES | The agent fully captured the order details and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
One Ghost Pepper Sandwich, no combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
2QzYEKv5a9R6d6H2FtNU8X | Simulation Run 2026-08-13 21:47 | no transcript | — | |
2krBPLXmq9cpwbkvABqnwG | Simulation Run 2026-08-13 21:47 | no transcript | — | |
2sgWVmKFepTkpteQCNKyGr | Simulation Run 2026-08-13 21:47 | no transcript | — | |
3bCkjF8As3yzWAt7p3ityE | Simulation Run 2026-08-13 21:47 | no transcript | — | |
4oN7SCDNjALQpK6UkxTSog | Simulation Run 2026-08-13 21:47 | no transcript | — | |
6vrYw7LWHCYA7bsqTUzEKu | Simulation Run 2026-08-13 21:47 | no transcript | — | |
7FWdWHWSyNMKYjSLAs7dSc | Simulation Run 2026-08-13 21:47 | no transcript | — | |
7kcXCAhzfffVgQRXoKfiKH | Simulation Run 2026-08-13 21:47 | no transcript | — | |
82AypaowrLafArpvG3UoLA | Simulation Run 2026-08-13 21:47 | no transcript | — | |
83Uwnfa4GBT6E4R2gniKZn | Simulation Run 2026-08-13 21:47 | no transcript | — | |
8AabiroAERaGTLAko233R6 | Simulation Run 2026-08-13 21:47 | no transcript | — | |
8BtXWDZNTkD6oXNiBSRXZQ | Simulation Run 2026-08-13 21:47 | no transcript | — | |
8CL9N363ybFmcDREzKjCnn | Simulation Run 2026-08-13 21:47 | no transcript | — | |
8Gxj6wRPW2rn7QbgwiPGTD | Simulation Run 2026-08-13 21:47 | no transcript | — | |
8foKUPgxXwRUPzstgBRSWk | Simulation Run 2026-08-13 21:47 | no transcript | — | |
AZxVrdNoshRydsSDCmPVGB | Simulation Run 2026-08-13 21:47 | no transcript | — | |
DVNgYeEjWV8PqHcYLYP6AU | Simulation Run 2026-08-13 21:47 | no transcript | — | |
Dcxkno22N5KrEF9NVMP5u6 | Simulation Run 2026-08-13 21:47 | no transcript | — | |
E4iRzsqCypyo5zHcE6mAzN | Simulation Run 2026-08-13 21:47 | no transcript | — | |
EKUD6CdyaoDCP67LtTg9XJ | Simulation Run 2026-08-13 21:47 | no transcript | — | |
Fe2TXuE5xkBcBjtpyu47ad | Simulation Run 2026-08-13 21:47 | no transcript | — | |
GEC8i4sunNN7dxuuTpfa2b | Simulation Run 2026-08-13 21:47 | no transcript | — | |
GQLd29FMPPRcSksqDq7nDC | Simulation Run 2026-08-13 21:47 | no transcript | — | |
HvrZwfzWsPbPJo9idL5xzB | Simulation Run 2026-08-13 21:47 | no transcript | — | |
Je2kqnCNG3xXoBdbKx3FZd | Simulation Run 2026-08-13 21:47 | no transcript | — | |
K9RxgW5hLVTMHpHMjJqsaV | Simulation Run 2026-08-13 21:47 | unjudged | empty | |
KWm7Y2uHeXWKJ9nbynCvwM | Simulation Run 2026-08-13 21:47 | no transcript | — | |
KiUQP9FitvEEtAsvWymNZu | Simulation Run 2026-08-13 21:47 | no transcript | — | |
KonnUBbFZmrS4vuS7UKZW9 | Simulation Run 2026-08-13 21:47 | no transcript | — | |
KpSFTC8wjqk2CNqU7C8jX4 | Simulation Run 2026-08-13 21:47 | no transcript | — | |
M9EFNr6odpZtoxn32tg8AE | Simulation Run 2026-08-13 21:47 | no transcript | — | |
MiAT28CkKVXEQeAKf8GkJU | Simulation Run 2026-08-13 21:47 | no transcript | — | |
Nq33MWLLZD7odgJkzLabsM | Simulation Run 2026-08-13 21:47 | no transcript | — | |
PTrxLRS3E285NHWqVdRTJ6 | Simulation Run 2026-08-13 21:47 | no transcript | — | |
PaWGDsxwThUEWv5rCxooq6 | Simulation Run 2026-08-13 21:47 | no transcript | — | |
PdD92aodaFwTr9SCUvnLSP | Simulation Run 2026-08-13 21:47 | no transcript | — | |
PnGvCNj4SQhJ8FX8QEWPNM | Simulation Run 2026-08-13 21:47 | no transcript | — | |
QEWCEG9owzDaSWv5k7JGkb | Simulation Run 2026-08-13 21:47 | no transcript | — | |
QHkEatyCiTzQVgizB6XXCN | Simulation Run 2026-08-13 21:47 | no transcript | — | |
QRgbmxgTfTti3frhx5Dunq | Simulation Run 2026-08-13 21:47 | no transcript | — | |
QhubbbQGwiAdMiYgXWEQEi | Simulation Run 2026-08-13 21:47 | no transcript | — | |
SRzFaxWnpxE6LzsAYeDdnp | Simulation Run 2026-08-13 21:47 | no transcript | — | |
ShQcxj4iFvP3spT4BrMexb | Simulation Run 2026-08-13 21:47 | no transcript | — | |
T8yedqz5bkLVFynUgKRB2z | Simulation Run 2026-08-13 21:47 | no transcript | — | |
TJXZTcWH8ZUWHAMcoqCQZE | Simulation Run 2026-08-13 21:47 | no transcript | — | |
TTjffmNUMFqaSXB659g6sx | Simulation Run 2026-08-13 21:47 | no transcript | — | |
URPdeR6UrT3cGq9FAuNUwi | Simulation Run 2026-08-13 21:47 | no transcript | — | |
X9rkRK2dhiNfa4bpEZQdFR | Simulation Run 2026-08-13 21:47 | no transcript | — | |
Y7dgRVfPKFK9Mt9ZE4ojWU | Simulation Run 2026-08-13 21:47 | no transcript | — | |
YHv6KSYzxwnEJQiZcXfcEA | Simulation Run 2026-08-13 21:47 | no transcript | — | |
Yxn9jxQ8uVSYQQvETNAMMY | Simulation Run 2026-08-13 21:47 | no transcript | — | |
afMW4DXDeQz96Awf6Twv2j | Simulation Run 2026-08-13 21:47 | no transcript | — | |
b7wxLsqXEJv8FSGMfShBru | Simulation Run 2026-08-13 21:47 | no transcript | — | |
c3A4TKsJ5co6bxpF3FZNg4 | Simulation Run 2026-08-13 21:47 | no transcript | — | |
c6cnCuCCiCftbvBxr9ZfqN | Simulation Run 2026-08-13 21:47 | no transcript | — | |
cAX39yM4hPtGPwdw9KiUNc | Simulation Run 2026-08-13 21:47 | no transcript | — | |
eTSfit4mm6naSCeLZufiJv | Simulation Run 2026-08-13 21:47 | no transcript | — | |
eZZ3jWAWFBRdcsDwAUQ5DE | Simulation Run 2026-08-13 21:47 | no transcript | — | |
eiKqA3cvmFw32vdELda6vH | Simulation Run 2026-08-13 21:47 | no transcript | — | |
ftfPGJFfmFRYrAZhpjXkpc | Simulation Run 2026-08-13 21:47 | no transcript | — | |
gvmW4YwcY5RXasHGF8mZk9 | Simulation Run 2026-08-13 21:47 | no transcript | — | |
hGUdCdkW7ghhiTEkKBu7jf | Simulation Run 2026-08-13 21:47 | no transcript | — | |
hJ7bLYBAG97GrVBxeGoU7i | Simulation Run 2026-08-13 21:47 | no transcript | — | |
iFy9qugh8TEVFiR4mjjnH2 | Simulation Run 2026-08-13 21:47 | no transcript | — | |
jShwGUQZWxQpgbA23xGhyi | Simulation Run 2026-08-13 21:47 | no transcript | — | |
jfyM3VbrbKZ54JRPNAKvzp | Simulation Run 2026-08-13 21:47 | no transcript | — | |
kHs7meg2Ds9upEzEy9EtYL | Simulation Run 2026-08-13 21:47 | no transcript | — | |
kJJ5jzS7oMK8zwaZnUmpCi | Simulation Run 2026-08-13 21:47 | no transcript | — | |
kW7evAVxGjYjZzCgGCoLsP | Simulation Run 2026-08-13 21:47 | no transcript | — | |
mPXjaRagDbCNxQ6jQzucuq | Simulation Run 2026-08-13 21:47 | no transcript | — | |
mnLMeYHxBfFb6QYGFBeqGF | Simulation Run 2026-08-13 21:47 | no transcript | — | |
mwwSsPyosEJehLBxBfWdQm | Simulation Run 2026-08-13 21:47 | no transcript | — | |
nEoJaqcSPWaUApiTTbWSVX | Simulation Run 2026-08-13 21:47 | no transcript | — | |
njjTqoALAR4Bg5n2c5fh4d | Simulation Run 2026-08-13 21:47 | no transcript | — | |
oSWBxShLEbFB72GdxnyBb4 | Simulation Run 2026-08-13 21:47 | no transcript | — | |
oZCmt4Mm44eUZpQw7NsteH | Simulation Run 2026-08-13 21:47 | no transcript | — | |
2g44FwF2nNt7xTeTX2jhoS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BQEDv25dH6HuQvR6Htf6db | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KPbuyLiBA9LxgbpFpon2EA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LBh2VTig2KBPUHp6GseRMF | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XnktsxU9SxP5MQkpezUgrs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Zn9M4pfms4JyaDMfcxPWfK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iHk5yAKjREVhRzTnmCasEf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iQsEnyCTMmowYkf2LMLKkf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ishyPtwoWpefGv7p27fge6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
moYYZ8KQLhHmpFNVLj2363 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
2aJPrTr7GKd7aVyyJJM4Ht | Test new prompt (Aug) | no transcript | — | |
D7SDtdu6efVxHQMLSz7QSe | Test new prompt (Aug) | no transcript | — | |
DDpoiTTN4kTfTXxNYPWc9s | Test new prompt (Aug) | no transcript | — | |
NLpuz3viTLd2mV2kEYV9hd | Test new prompt (Aug) | no transcript | — | |
SbPU52ziMAWMjN5sLCRDme | Test new prompt (Aug) | no transcript | — | |
Mv9K6rjMf8NZhimAACZ8Xg | RBI Bakeoff 2026-07-23 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
gJzN7NQwsak2iepicCDftU | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent captured the full order and directed the customer to pull forward without escalating. | 1x Spicy Chicken Sandwich |
8os4AKHe4nnaWqbJ9W7SnR | RBI Bakeoff 2026-07-24 | YES | The agent took the full order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x Spicy Chicken Sandwich |
3Rzv3tq9RzuQxxJ6nztNVN | RBI Bakeoff | YES | Agent fully captured the spicy sandwich order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
VGtsjJuQVB2U2PszAdUJRq | RBI Bakeoff | YES | Agent took the full order for one classic spicy sandwich and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
2zpCeAhPvwKTr33oSxXyow | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent took the full order (classic spicy sandwich only) and told the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
22yCf8ezfsL7dtPWoA3i6D | Simulation Run 2026-08-13 21:47 | YES | The agent fully captured the spicy chicken sandwich order and directed the customer to pull forward without escalation. | empty |
7Tz2QAcHRD5iQoNzWCVLzd | Simulation Run 2026-08-13 21:47 | YES | Agent took order fully, confirmed it, and directed customer to pull forward without escalation. | empty |
7fRWmWb7pD98LPeP5vyYLw | Simulation Run 2026-08-13 21:47 | YES | The agent took the full order and directed the customer to pull forward without escalation. | empty |
AGGFkAiAQgFhvrkEyRwNcq | Simulation Run 2026-08-13 21:47 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | empty |
ATcctWaXbJcu3w9aNsKpng | Simulation Run 2026-08-13 21:47 | YES | The agent confirmed the full order and directed the customer to pull forward without escalating. | empty |
CKyZELPSfL7m55Fo7TARKo | Simulation Run 2026-08-13 21:47 | YES | Agent fully took order, confirmed it, and directed customer to pull forward without escalating. | empty |
DobedgC3YEmpoKk3yvCUCF | Simulation Run 2026-08-13 21:47 | YES | The agent fully took the customer's order for the spicy chicken sandwich and directed them to pull forward without escalation. | empty |
GfYGwHEF87jqeW96P8w65A | Simulation Run 2026-08-13 21:47 | YES | Agent fully captured the order and directed the customer to pull forward the window without escalation. | empty |
GosVdbaJAKoc9op7kWFXwi | Simulation Run 2026-08-13 21:47 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | empty |
HjuMMQZQ2A9hnCRKwF5iju | Simulation Run 2026-08-13 21:47 | YES | The agent took the full order and directed the customer to pull forward without escalation. | empty |
Hwsx2saNCMvouf98SmjbPi | Simulation Run 2026-08-13 21:47 | YES | Agent captured the full order and directed the customer to pull forward without escalating or handing off. | empty |
JmWYFtZ3Hboq9UCmR6JoiW | Simulation Run 2026-08-13 21:47 | YES | Agent confirmed full order and directed customer to pull forward without escalation. | empty |
LjSPSQZMppiGkautctzTm5 | Simulation Run 2026-08-13 21:47 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | empty |
PJQ53QjZ7wJar4k6FWZxqD | Simulation Run 2026-08-13 21:47 | YES | The agent confirmed the full order and directed the customer to pull forward without escalation. | empty |
SiczAmPj6JH73AKiKUTdBq | Simulation Run 2026-08-13 21:47 | YES | The agent fully captured the spicy chicken sandwich order and directed the customer to pull forward to the window without escalation. | empty |
Ut5LggidEGXFBQEntfxKjk | Simulation Run 2026-08-13 21:47 | YES | The agent confirmed the full order and directed the customer to pull forward without escalating. | empty |
VLkANmVmBW9otZN9Vs5UhC | Simulation Run 2026-08-13 21:47 | YES | The agent took the full order and directed the customer to pull forward without escalation. | empty |
XBGUXSSfmBf8uNySmKpccZ | Simulation Run 2026-08-13 21:47 | YES | Agent captured the full order and directed the customer to pull forward without escalation. | empty |
XpRNfg4oZ3AMybiZEEehXr | Simulation Run 2026-08-13 21:47 | YES | The agent confirmed the full order and directed the customer to pull forward without escalation. | empty |
c39ng5J6M4AXZmSwT6niRw | Simulation Run 2026-08-13 21:47 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | empty |
cLU66vYirHLrdofn3RGiy6 | Simulation Run 2026-08-13 21:47 | YES | Agent took the full order and directed the customer to pull forward, no escalation occurred. | empty |
esx65GWZvUPk9FKWDrJXEu | Simulation Run 2026-08-13 21:47 | YES | The agent took the full order and directed the customer to pull forward without escalating. | empty |
g2RE4kVhzMf9JFXobsdUSr | Simulation Run 2026-08-13 21:47 | YES | The agent fully captured the order and directed the customer to pull forward without escalation or handoff. | empty |
iDXoSLYFCa7LnZCFVs3UKm | Simulation Run 2026-08-13 21:47 | YES | The agent took the full order and directed the customer to pull forward without escalation. | empty |
YDwx7rNWNdMpJ4DfKK84NQ | Simulation Run 2026-08-17 01:07 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
eGueBGftRiBjvP6dRhJhRJ | Simulation Run 2026-08-17 02:54 | YES | The agent took the full order and directed the customer to pull forward without escalation. | empty |
I'll do the chicken sandwich by itself and a side of fries.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
5nUp64GksKWdssqh7UdoAp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FWVnqeTo3uCdmZ9qEZG4Z6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Gb4Zq8QfVwAPwua2rS5tEM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KCWELQoFmZAEpxBuAtbwy8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KjpobGwveEcEbmTcV6aC69 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Mxx9pj3bueyiAf83mm7NTM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Rqm67Xjm2zaCqsAA9kaoFV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VrEpQn2RRTZwdWvyHEpc9J | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jHZ6hhqWV73z2veC2Zb7zj | Simulation Run 2026-08-16 21:10 | no transcript | — | |
oM3pJSNdcWW5BqisrKTb57 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9KDemyfULupbbiCub7psWe | Test new prompt (Aug) | no transcript | — | |
CsNaatXor659ReZLEfb6mV | Test new prompt (Aug) | no transcript | — | |
GXB23T4UWjsKWo7eVPRuRQ | Test new prompt (Aug) | no transcript | — | |
VNnPCfgdmbg5X56y7quaDV | Test new prompt (Aug) | no transcript | — | |
o4Fc4TwxULYSBWRkDdo5VG | Test new prompt (Aug) | no transcript | — | |
ibj5pbQxnqvaT9JhsHthHU | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
2nHMFogMYSkVPF3MksJ2Dd | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
VhCzNRCtrKQJWBdypVtiKF | RBI Bakeoff 2026-07-24 | YES | The agent took the full order, confirmed it, and directed the customer to pull forward without escalating. | 1x Classic Chicken Sandwich Regular Combo (Cajun Fries) |
TSmPdMBcx8xSqkFZWCfYHX | RBI Bakeoff | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
oUNe7upwCC9f8zjmNBNWwV | RBI Bakeoff | YES | Agent took full order, confirmed it, and directed customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
YRky4zW2Z9MrDVpDN6FQJe | Simulation Run 2026-07-20 23:58 (scratch) | YES | Agent captured the full order and directed the customer to pull forward without escalating to a human. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
MN7S8AX3UhCJ3HPknJhqa7 | Simulation Run 2026-08-17 01:07 | YES | Agent took full order, confirmed accuracy, and directed customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
jAv2zXNy72ddmwZTCSCyRw | Simulation Run 2026-08-17 02:54 | YES | Agent fully captured order and directed customer to pull forward without escalating or handing off. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
I'll take the 3-piece chicken combo, spicy, add a pie - make it the strawberry - and a premium strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
Aavd2L2UemLsCwQ33wJx6v | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Ab9cWev9ehE73P6TouJtfw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
K2VDEDh2dgu8ims9Eo3Nti | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LugrKir22PRVqnfXXiThAQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MDsgFCSBTCWeobgdeapyGX | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript ends without agent confirming or directing customer forward after full order capture. | empty |
UUbLnp47FrN5a3tzqubNmu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WSkLZCwW994BX87pHrULHF | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XQu32k8DVRZJxLQyRcd6PW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZTbbU9ZNvqNMRGDQy34eGL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mRP3Voa4nnhEjVuXaTt4mT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jDCJbENnDLT2evzhxsCxWH | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript lacks agent's response, order confirmation, or directions to pull forward without escalation. | empty |
66YmmPQ3W2d6NXLmfc3VhW | Test new prompt (Aug) | no transcript | — | |
L8fwfonWZYXZhhy94xWMqM | Test new prompt (Aug) | no transcript | — | |
QVAXxt2Xnw96fbjYpVq4GL | Test new prompt (Aug) | no transcript | — | |
RySDZmryxC2Mrw7zxyR5YQ | Test new prompt (Aug) | no transcript | — | |
kL4Bg27n9pVpfHZYn5KruY | Test new prompt (Aug) | no transcript | — | |
EbUxSyuTN4jkrauSeJriHb | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
3CxFAvQekhqGHJnKYubuCP | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
SKnN892dFpznS8iZWHRJQ6 | RBI Bakeoff 2026-07-24 | YES | The agent took the full order and directed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
NkY6wQb8w7mVerAibYFFHS | RBI Bakeoff | YES | The agent captured the full order and directed the customer to pull forward without escalating or handing off. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
BxUhHrSdeEzu9yWfz8j7yN | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
e9rkqvYeDvT2RkPdXStaYT | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
7rDPP5b7XzWZgUWVDjNGZv | Simulation Run 2026-08-17 02:54 | YES | Agent captured the full order, confirmed it, and directed the customer to pull forward without escalation. | 1x Strawberry Cream Cheese Pie; 1x 3 Piece Signature Ch |