Speak naturally and conversationally like a real drive-thru customer. Stay in character and only order/respond as a customer would. You speak with a strong Southern US (Texas/Louisiana) drawl.
Test case names jump to that scenario's conversations below.
Failures first within each scenario. Simulation IDs open the transcript in Coval. The judge note is Coval's written reason for the Completion verdict.
I'll do the 12-piece family meal with all dark meat, spicy, Cajun fries and cole slaw, and two Sprites.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
h7xGURDgHdzhQMHiNqiyiy | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent escalated to a human employee instead of completing the order alone and directing customer to pull forward. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
5rDHgtRtAjRwerx2JxdpCB | RBI Bakeoff 2026-07-24 | NO | Agent confirmed order but only entered quantity 1 instead of 12-piece family meal and did not handle full quantity as per customer. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
8SBCcweYQBnXYEfPTkzx5V | RBI Bakeoff | NO | Agent escalated to a human team member to assist after user asked for order to be read back. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
3XW87iTbLpvpDsjNf38rpS | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript ends before agent confirms order or directs customer to pull forward or next window. | empty |
5HGqgj9Ki52eAk4RTV3ZAK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7QLufaetYXbs43tzokBiBv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BWkhpLJwj5Vb5LFwshT2vv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GGyLQYTKwrifegz6g23VHa | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LhTsFZyByA8Vsqb3QQEVd9 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
TuHkqNv5xX342wsuiHx9Up | Simulation Run 2026-08-16 21:10 | no transcript | — | |
a7T8c2upLXWjv8fEqBj7RB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gYGXuSsjPPRstqh4rDpHEr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iLStuKoQ33rns6JLpSkecf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FNtG8wT2YPCmF9qCbMHCgg | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript only shows customer order, no agent response or direction provided. | empty |
JcjzXeBxxG76bA4iZVAP4z | Test new prompt (Aug) | no transcript | — | |
MDF5Ta3BGoXXLLaSGgwAqt | Test new prompt (Aug) | no transcript | — | |
U2HksxmdoDBdDyqnv2n3TD | Test new prompt (Aug) | no transcript | — | |
aCS8XsxYtARnhUhhQrCV5A | Test new prompt (Aug) | no transcript | — | |
g9TrV4DLbwkQBtdroduRzG | Test new prompt (Aug) | no transcript | — | |
ho9bHiYNX4jn5TQ2FEaXoC | RBI Bakeoff 2026-07-23 | YES | The agent captured the full order and instructed the customer to pull forward to the window without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
9PDdHRPie56iu3XSZVy6D2 | RBI Bakeoff | YES | Agent took full order, confirmed correctness, and directed customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
dz67iPZAMfSXnBVwPAXvLc | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent confirmed the full order and instructed the customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
One bacon and cheese sandwich combo, large, with fries and strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
NCe8QHwSm8jvUpessXVTqm | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human employee multiple times without sending customer forward. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (C |
hdweVSYcbucrB4C89ZTDAM | RBI Bakeoff | NO | Agent escalated to a human team member to assist with order verification instead of directing customer forward. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (C |
AGMMsmZ5zeKXwjXjo6k65A | RBI Bakeoff | NO | The agent escalated to a human team member to assist with reading back the order, failing to fully complete the order themselves. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (C |
28usyo4Q9QhYDKsspL7PEV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4JL4geHRfhCf33gN4EdfmS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
68Cszzv9ZwD3TBNRpa6VpM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9zEiebJeppy6AfMr8z8J5d | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DqmJ7wx34mXEBfs5y6wGp5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HMgsipUqc2qsGpuobcn9Yu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
X6Vgcrz3bGJP2YTq6PcFiQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
b7uF9GK7zwRZJdpdaVpovQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fNc9isCaEFV44QAYbENTrC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iwKfCt9Ux5tLU2eAcmukgu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Ye2rNLvRRkCydicN4tDCKY | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript lacks a clear indication that the agent captured the full order and directed the customer to pull forward or the next window without escalation. | empty |
674YZa6LNW2UApd3GWtiyo | Test new prompt (Aug) | no transcript | — | |
8ZMiAC7M4e6W4v6cGVgN9D | Test new prompt (Aug) | no transcript | — | |
GFn9etwn9vzzasvxR7k7FA | Test new prompt (Aug) | no transcript | — | |
LPgA7KM9CPnYvnE83dDg6z | Test new prompt (Aug) | no transcript | — | |
mNR8HvmABacPtrjzpDpZZa | Test new prompt (Aug) | no transcript | — | |
D2DEkXzdPFifoyyADegnCq | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured the order and explicitly directed customer to pull forward without escalation. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (C |
8PgWvfHxtceFgG4xnzybvs | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (C |
RGkjDgspibd7i6aFwCrhTm | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (C |
Order three pieces of spicy signature chicken by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose mashed potatoes and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
R9xyGryrKUJjTb2DSX2DH6 | Simulation Run 2026-07-20 23:03 (scratch) | NO | The transcript does not show the agent directing the customer to pull forward or the next window. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
F9uCPCAN5hhjDjzVzjnfiW | Simulation Run 2026-08-16 21:10 | NO | Agent did not complete order or direct to next window; escalated to human employee. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
GYYz2LWKEV9iFimg3m9Reu | Simulation Run 2026-08-16 21:10 | NO | The agent never directed the customer to pull forward or the next window after taking the order. | 1x 3 Piece Signature Chicken (Spicy) |
4y7ZZ2H5CG5NKnQbdg7iGp | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent directing the customer to pull forward or the next window, nor if the order was fully completed or escalated. | 1x 3 Piece Signature Chicken (Spicy) |
HJokyLvoh7uPm2BQL5TM2Z | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript lacks information about order completion or directing customer forward; no escalation mentioned either. | 1x 3 Piece Signature Chicken (Spicy) |
LMg7tbZRxqc8XJ2SbeJwRP | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript lacks any direct indication that the agent completed the order and directed the customer to pull forward or the next window without escalation. | 1x 3 Piece Signature Chicken (Spicy) |
M385zihAy8Qa7ecDqMDfvL | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript lacks agent confirmation of order completion and direction to pull forward or next window. | 1x 3 Piece Signature Chicken (Spicy) |
WmJgpUH2h7qt72ZJZPEWUD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
b8LGby2V6Y52MtuAD4mAB4 | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent directing the customer to pull forward or the next window, nor any handoff or escalation. | 1x 3 Piece Signature Chicken (Spicy) |
cjkyZgWEtGDCMNXzQhrB7W | Simulation Run 2026-08-16 21:10 | no transcript | — | |
maWdFyuPH2UWeKasz3QqyP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AMZvPaHoYHLgpcgaaVuUxF | Test new prompt (Aug) | UNKNOWN | The transcript ends before the agent takes the full order or directs the customer to pull forward. | empty |
FUDVQtYPyNWYAtGSuprWSp | Test new prompt (Aug) | UNKNOWN | The transcript does not show the agent completing the order or directing the customer to pull forward/next window. | empty |
RrkmKUsamjw4ERMCDiWMzr | Test new prompt (Aug) | UNKNOWN | Transcript shows order request but no indication of order being completed or customer directed to pull forward. | empty |
brXJJMZE5C4wMMrp7uEzEf | Test new prompt (Aug) | UNKNOWN | The transcript contains multiple customer requests but no agent responses confirming order completion or directing the customer to pull forward. | empty |
dzUpT9H7UPLyWhb7FgiE2E | Test new prompt (Aug) | UNKNOWN | The order was stated but agent's full order capture and direction to pull forward is not documented. | empty |
ZYD7zGAoa7oCi3DE42sgLf | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
heXxT6bpskjE8WA2BQEpVZ | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured the order and directed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
CVPinhsG4FGjhqu9TuDqAR | RBI Bakeoff 2026-07-24 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
6mrAsfQZRmxiCjNScuCeq9 | RBI Bakeoff | YES | The agent fully captured the order and instructed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
KtE6wnAE5U7mjvKzcqUB2A | RBI Bakeoff | YES | Agent fully captured the order and directed the customer to pull forward without human escalation. | 1x 3 Piece Signature Chicken (Spicy) |
F78M7BKE6QHvuYWX3f8bsm | Simulation Run 2026-08-17 01:07 | YES | The agent fully captured the order and instructed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
Give me the chicken wrap bundle with a mango lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
57ymjVhh5DnzSDSZBwUFjK | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent did not capture the full order; only the classic wrap combo is in the order, missing blackened tender wrap and mango lemonade. | 1x Classic Wrap Regular Combo |
5rAFv4iU94tVmYnBZC5GJt | RBI Bakeoff 2026-07-24 | NO | Agent escalated the conversation to a human team member instead of directing customer forward. | 1x Wraps Bundle (Classic Wrap, Chilled Mango Cane Sweee |
6tsjZV2QXcPUHBLSmor3UZ | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript only includes order requests but no confirmation or instruction from the agent to pull forward or escalate. | empty |
7uGke3cm64yXTDd4AZs9HP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9vrKcdejb2ZHy5DeTqPrW2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AFA2CSvrwGAZKLVEF4ifHR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
F3bE8hJcBoEef6kVvJwSWF | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Np99kisubpJLMrt8BjyGvC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Rkann553M6MkXZEfzkepzg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bHVXmmstBYye86VycbvM46 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ju6RH26H7bm3SV9fRYnSyR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kR4un6fTSJqfxgL5pKczXn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YgRRY9WPR6a6ZByZdX7vt8 | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript does not show the agent capturing the full order or directing the customer to pull forward. | empty |
2kbkNcxzAaCG4usfo3PkJJ | Test new prompt (Aug) | no transcript | — | |
FTBjG4HsVw3zsPLyabsGq2 | Test new prompt (Aug) | no transcript | — | |
c3qjqkohvQcFSBYMTLb3DY | Test new prompt (Aug) | no transcript | — | |
ewWdkWGB8X2CCYqFSrwNAV | Test new prompt (Aug) | no transcript | — | |
jYV7X2KBZcFQcN7Tqp7eyk | Test new prompt (Aug) | no transcript | — | |
hGJUsQSqtudxB3wHFYEaNG | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
C46aAHknMNc9PpFqZic6Zw | RBI Bakeoff | YES | Agent fully captured the customer's order and directed them to pull forward without escalation or handoff. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
YzzVUTz3ceKkfoHvzEXYrK | RBI Bakeoff | YES | The agent fully captured the order details and directed the customer to pull forward without escalation. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
6Sg45yDgaPRL5ud5M6TeSK | Simulation Run 2026-07-20 23:03 (scratch) | YES | Agent fully captured order and directed customer to pull forward, no escalation or handoff noted. | 1x Wraps Bundle (Classic Wrap, Chilled Mango Cane Sweee |
Can I get the ghost pepper sandwich combo, swap the fries for red beans & rice, and a Dr Pepper?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
LSkeGYER9oPn9n3hsbYym4 | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent did not direct the customer to pull forward; instead, escalated to an employee for assistance. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
3MeRBrNhUyESwE56BCTKdC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BtcYRL4fV9dJfMKZpNPFxf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Kk7j4SZBUkAcqnpcVaQxbS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LLKGCBjgjADkLsAiLWBKpH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MTd8NGVU4HqbSQU8agzKgN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NuerKQaxvCJGMM44JBo8kG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VXkSTYAtkg97cEFBNXs5ey | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bgh6y5qnhRJv3xxpRcXqyH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dC76X5hLRYv564ozzdGuVS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mwpvMFYi2oJr6mieM79hAG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jdxT6ygy7pzMHXreuJqUjH | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not contain any agent's responses capturing the order or directing the customer to pull forward. | empty |
EeW4KtiEGqK6ZL6R8wf4jw | Test new prompt (Aug) | no transcript | — | |
KxurfqMYrQGqoGcyvvpzvH | Test new prompt (Aug) | no transcript | — | |
YTzRe6TLpNSzh6ZfQjUPoN | Test new prompt (Aug) | no transcript | — | |
a2AnHy39695Rz66Ctifset | Test new prompt (Aug) | no transcript | — | |
eAUTNjDr8xzcmPPs6J82n6 | Test new prompt (Aug) | no transcript | — | |
TUPxfEWDuQ6KatfNvFQa6F | RBI Bakeoff 2026-07-23 | YES | The agent took the full order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
g3LXnXYUwinTWhmHGmTWEG | RBI Bakeoff 2026-07-24 | YES | Agent took full order, confirmed details, and instructed customer to pull forward without escalation. | 1x Classic Chicken Sandwich Regular Combo (Red Beans an |
g6QaggamM4FAS75xpUu6Z2 | RBI Bakeoff | YES | The agent fully captured the order, confirmed it, and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
B3KjWAGSsFeqBYfH45Hcdy | RBI Bakeoff | YES | The agent took the full order, confirmed it, and directed the customer to pull forward without escalating. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
JfBVUAht652drhfV7aBubX | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent fully captured the order and instructed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
I'll do the chicken sandwich by itself and a side of fries.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
DSvQwWuHREdrCAs3iyktK8 | RBI Bakeoff 2026-07-23 | NO | The agent said an employee will assist, indicating escalation and no direct direction to pull forward by the agent. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
9fVyWkxwygEkVSLHM5BQWW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GESi2CrCBcNBho2adga99C | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HNrFeokK4MNVUEY9wTE6qv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HSUxxvsq48xGYmkyuT4fxm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RhQka6nQRMjSq6LaAg6egM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
TNcndaZSLHr5L2auZFHvJD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WuAd8cCiK2KA2cNrxDSmRv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cLnabgNqKqav66f84UUekP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gAqbPD34kJsSGKpTeio5sB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gdz6VD4sW273jvxAk3gR8Q | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VQfzCPKxRXyXuTPsdkYXux | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript confirms order capture but does not show agent directing customer to pull forward or next window. | 1x Cajun Fries; 1x Red Beans & Rice; 1x Spicy Chicken S |
5YmZhyTwaQpX6hFKFBzkua | Test new prompt (Aug) | no transcript | — | |
QxJqa287FpDJUDrPSYNW4y | Test new prompt (Aug) | no transcript | — | |
TYL4mbccWW5uYJk8VrC7tL | Test new prompt (Aug) | no transcript | — | |
XcEKU23xuYgLjhk5xe7Ec9 | Test new prompt (Aug) | no transcript | — | |
kenLJav9JjZVy5Z3pnfkfo | Test new prompt (Aug) | no transcript | — | |
cm3f8zFmBek9vdZLxXEfYj | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent took full order, confirmed it, then directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich; 1x Cajun Fries |
Q2Uf82hkLUra4QdgsYfKwd | RBI Bakeoff 2026-07-24 | YES | Agent captured full order details and directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich; 1x Cajun Fries |
QGmQrhtYW4cTYENtJ4M6Zu | RBI Bakeoff | YES | Agent took full order including modifications and directed customer to pull forward without escalating. | 1x Spicy Chicken Sandwich; 1x Cajun Fries |
GpUNt5itnuuKpzU8vtwC8Y | RBI Bakeoff | YES | Agent captured full order and instructed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich; 1x Cajun Fries |
fwiaBeVRueuRTvuq5GMKTV | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent took the full order and instructed the customer to pull forward without escalating. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
I'd like the 5-piece tenders combo, blackened and spicy, with cole slaw and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
TjhAC7FDeshi8EXJs8f6ge | Simulation Run 2026-08-17 01:07 | NO | Agent escalated to a human by saying 'Let me get an employee to help you out.' | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Sp |
3KtxKDMKLxfde2zZUsxnAE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4gom33JjtaqMjANy7THExD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
5BGJMnNAudNHU2MwqFqdnX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
5VQKTp5URhG3rENCMwG3Yb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8ZVPRPkehf7eMM8TKw4NjQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8bgoXRVV68yTfTmBaZf39D | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Bxe7riek4fUhREE4vikktb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
C6NXZR8aWmvqB8zzmVazqG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HPGjrEXmNmg5fWYMn5ptzr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
isaAnsrAxxktggLFDtqDZc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7Gg5KFckJmJVb2zPfxNfP8 | Test new prompt (Aug) | no transcript | — | |
GMs4oEx7jRtp4ECYxFZD3Q | Test new prompt (Aug) | no transcript | — | |
Yxkhsg5vVxVzDjDkakZZAC | Test new prompt (Aug) | no transcript | — | |
dvV8CVoa7EvrscTzaRaZCV | Test new prompt (Aug) | no transcript | — | |
oJ9voumsaUadDbn7JeZehh | Test new prompt (Aug) | no transcript | — | |
YBdzdcUBghMnYRoQVtJoQf | RBI Bakeoff 2026-07-23 | YES | The agent took the full order with all modifications and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Blackened, Cole |
7gMijn7XVvdGut6A3QCWsX | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 5 Piece Chicken Tenders Large Combo (Blackened, Cole |
aVUvdjNQnRhnT63ppsmnwW | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
44TpGvLXudvmsgk7FeGKQn | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Blackened, Cole |
c5LLnqfjXXcVBCxsTrJm96 | RBI Bakeoff | YES | Agent took the full order with details, confirmed accuracy, and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
kAFvVVTCysPwrQJqB5Uvou | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Blackened, Cole |
I'd like the 3-piece signature chicken combo, spicy. I don't want fries. What other sides do you have?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
5hgfHJmAHxQZ2pfjjX27kM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7HavJ83JXVFoixBWVYNbxm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
C6FtvFSv5CPVar5ntA2BdL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FoP56cgGqrcQxhzU3n5eTG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GQhf5CG2Kox3mtdoaRHDnd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PuccHzUCRnixGgavUtaX2k | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent completing the full order or directing the customer to pull forward or the next window. | empty |
TZdAF8FwPVGNoHZkXP5jkf | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript ends with the customer asking about sides; no order completion or direction to pull forward is given. | empty |
TebXfTfVXqMmj2qHY7DMKe | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dfWFq885XvzyjJVbKVW2gq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
k7jG4BpT3Wi72E9A8RZ5TA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RpecGo3vmHQ78orBfTkZae | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript only shows the customer ordering and asking about sides; no agent response is present. | empty |
9HcabUVKoWSe4nJfGPz2VC | Test new prompt (Aug) | no transcript | — | |
9jtqyWvAwK2qsVFqiRzj7e | Test new prompt (Aug) | no transcript | — | |
Sxnc8ijjv3BdZ8ykSStnba | Test new prompt (Aug) | no transcript | — | |
TGYqHCXehVoVkvAzFwj9x6 | Test new prompt (Aug) | no transcript | — | |
mC24jqLWJ34pKSzegKHKGc | Test new prompt (Aug) | no transcript | — | |
mguqvf4HngG6twyGigZEQS | RBI Bakeoff 2026-07-23 | YES | Agent fully captured the order and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
npdAcyyNeBTWTBhHjv7n2b | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured the order and directed customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Red |
LoXWiCysgVXAiRusq8Utqb | RBI Bakeoff 2026-07-24 | YES | Agent fully captured order and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Red |
kkJBUFi9APTF6dRqMev7Kh | RBI Bakeoff | YES | The agent took the full order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Red |
N5oTYrXeEMzMpQR7MWgAZD | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Red |
DjbgPDVx7ZXGukJnMXbTSK | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent fully captured the order and told the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Red |
Order one classic chicken sandwich by itself. Do not ask for a combo. If the agent offers to make it a combo, accept and choose Cajun fries and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
Cujgv6Mhk3BnqJjP5u4ZN6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Eipwt7uJWfEiPw8tDBjErk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LgwJfZJX4yHkQe9GU7GG9C | Simulation Run 2026-08-16 21:10 | no transcript | — | |
R5GjHj96vVPTzk2ExypYz7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UTNYEbm36J86PSgcWqdjEY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Vyc3Expeq9kAuHb82vrdcH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bzctj4ArcKzvHd9epGFX5Q | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dv8AteURBJbinwMEBVw5cT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jVydffH8btQfkaskVYCyZm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mWeuhWcvrqdkhdB98pqkcc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LznNcyVcRZuRKVLizBEGNn | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent taking the full order or directing the customer forward, nor any escalation. | empty |
4GGWN42fiMCwU25t37MCJa | Test new prompt (Aug) | no transcript | — | |
5f5USZg3GMmQP9sY5qL9L5 | Test new prompt (Aug) | no transcript | — | |
GbqviqHj28fmprR64krBJx | Test new prompt (Aug) | no transcript | — | |
RHn9A2psiUCw7y5niQjfxU | Test new prompt (Aug) | no transcript | — | |
UVoexroXZTyMGxfXAZtyLu | Test new prompt (Aug) | no transcript | — | |
ne9kmUpNFzUc8bqHTZ5vpJ | RBI Bakeoff 2026-07-23 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
KYFFQTUwZ5VhJRjb4KdSeQ | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent took full order and directed customer to pull forward without escalation. | 1x Classic Chicken Sandwich Large Combo (Cajun Fries, M |
K42BnRwRWLry6ABbepfBPq | RBI Bakeoff 2026-07-24 | YES | Agent took full order (one classic chicken sandwich), confirmed it, and directed customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
EKiyhFCAoLr2cccg6jCfR3 | RBI Bakeoff | YES | Agent fully captured order and instructed customer to pull forward, no escalation occurred. | 1x Classic Chicken Sandwich Large Combo (Cajun Fries, M |
HCMWvsrPk3qVoTHhfArosp | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
FU2j3Ae8fiQLYgyR6wPf6W | Simulation Run 2026-07-20 23:03 (scratch) | YES | Agent took full order of one classic chicken sandwich and directed customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
Order five classic tenders by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose cole slaw and a Sprite.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
2esAC8rMkxjAoFYYZp2tki | Simulation Run 2026-08-16 21:10 | no transcript | — | |
3Sc3dRm7ujt7E2TbhHHr7L | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Bh52f2QAGvaEUVVYioJ7Jh | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EboGoN6DBLSsQTEnWD3K6z | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EdPWA7rpfpk2GBfEAycaMv | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent completing the order or directing the customer to pull forward. | empty |
McHG7B99U2Z2Q2RNuSREgq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
S5m5QXUQffJ4BHnFgdYiuw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
biZ5jzThN7tCwQBjdeYdDX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
f4aWXp4229tC9LhNUyShon | Simulation Run 2026-08-16 21:10 | no transcript | — | |
g6VjT94BzLQhmGGopmeZQw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EsR6VpJtNWrMgfBkLGtFPz | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript is incomplete and does not show the agent taking the full order or directing the customer to pull forward. | empty |
2okYkC5iUb2itixcQD2ZdV | Test new prompt (Aug) | no transcript | — | |
3YbPYGkWLw9QB3was67H4T | Test new prompt (Aug) | no transcript | — | |
7SkubzDfukaVq3abi9YDdK | Test new prompt (Aug) | no transcript | — | |
BzrcUDMGVZw6kaUWxKBsUe | Test new prompt (Aug) | no transcript | — | |
faRMyzyAhvGFYsY5BttvDw | Test new prompt (Aug) | no transcript | — | |
F2NNatJouBaqZwvWM3bURn | RBI Bakeoff 2026-07-23 | YES | The agent took the full order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, M |
8fbqKi6K85qHSmJVPViJbd | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured order and directed customer to pull forward the window without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, M |
8Bbj2FYPsB4U5DEgS4vHAr | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, B |
joGQvUzN4fic53ZxpehLqR | RBI Bakeoff | YES | Agent captured the full order and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, M |
XnFR4DvYeNy9E3cby6fFNA | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, M |
K7UWQQtQoKhby78okBNRHH | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, S |
Start by ordering the 3-piece signature chicken combo, spicy, with mashed potatoes and a Coke. Before the order is finalized, change it to the 4-piece combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
BkusaXmbDaxv24cPdQUMJA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CjuCFbdkQJthi8UpNcwExt | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Dmehctsm8aPxqpvbS7zprG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FRY6RjFbB3YxKSpp9cd67U | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GZkYT6HAzMuHMavcfoyggW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Ms6eefvJiN6wd3M9VsVr3f | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SDxfifqGNDDqgWu2kdt7yG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YfuPmsSACQQNe4Hn5ACsdA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
daCkoAndY7MQN455B7YTrF | Simulation Run 2026-08-16 21:10 | no transcript | — | |
n9G7SJoiX8FCWP9WgV7CW9 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9xoMRbYgte6WvFQjQmRMPK | Test new prompt (Aug) | no transcript | — | |
FqZW8HDZNqaDWbun4zewYq | Test new prompt (Aug) | no transcript | — | |
K8ieyT5P8GXxM5NQemRnyZ | Test new prompt (Aug) | no transcript | — | |
boLhpTX8HcGvuJhSmEKYnV | Test new prompt (Aug) | no transcript | — | |
hEquEg9dwQ9CKpAQUPJBEn | Test new prompt (Aug) | no transcript | — | |
9ZucBQnUdYuL7rLLc4hCrZ | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
bhgGLJ9qVshkqDxfv8h3SH | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
GHgxJukp6WMFsDE4W9ap4E | RBI Bakeoff 2026-07-24 | YES | Agent fully captured the order and directed customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
4CFkwtqR87MKpNfxXshJem | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
hkZQsnKUeRr7c8TERdLt6G | RBI Bakeoff | YES | The agent took the full order and told the customer to pull forward without escalating to a human. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
QyHMPJrbfqBxX6YTmejpW9 | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent fully captured the revised order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
XbGoJezsEksGFQEzZ5nei2 | Simulation Run 2026-08-17 01:07 | YES | Agent captured full order, confirmed it with customer, and directed to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
One Ghost Pepper Sandwich, no combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
3x8wXXf449oDdVoeCBToTL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CSZkRUfndwqw5Giki7LR3S | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FLUGEUCVR9TGpitFD3xyVi | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HA6fAfQsWmpaJ8os9tUVrT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KSZjAoHu7ut4TDaaQjRKCY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
P3EhdnwoJCpzof49A6PTCs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QZb4cw7eiLH7BiqByadxYc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YYY5edDQW2XVoVDbjuEmut | Simulation Run 2026-08-16 21:10 | no transcript | — | |
a6gsjg6NkjYBZxHw7JibBU | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dqzncvEajWtQjNqBqZTfga | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9fJFqMqogiTTgn2KUgWRZD | Test new prompt (Aug) | no transcript | — | |
Gr5XX5n5mkP3UdbQpBfGoq | Test new prompt (Aug) | no transcript | — | |
Kq3qAjCYvoz7i4CYkFt9sm | Test new prompt (Aug) | no transcript | — | |
fVG5Q6TbFkmza93j7axdes | Test new prompt (Aug) | no transcript | — | |
i3rr7JL6pYrXLBToZgamYu | Test new prompt (Aug) | no transcript | — | |
D57HBB3tBztoZoYa8QnCo4 | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order for the spicy chicken sandwich and directed the customer to pull forward without escalating. | 1x Spicy Chicken Sandwich |
7zbJ8WQEdmESFFGh3yNdXb | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
aduQioraLLK4PSCj38ngBD | RBI Bakeoff 2026-07-24 | YES | Agent fully captured the spicy chicken sandwich order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
QBsg8YfKCpKmw972d7oYUk | RBI Bakeoff | YES | The agent fully captured the order and instructed the customer to pull forward without escalating. | 1x Spicy Chicken Sandwich |
T9kRf7KNWh7H3jQrJcZeNu | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
W4ABMXJALkrmr2JzWzSWtv | Simulation Run 2026-07-20 23:03 (scratch) | YES | Agent fully captured the order and directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
K7Rof9wwZNTBn5uxsKfSeo | Simulation Run 2026-08-17 01:07 | YES | The agent took the full order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
I'll take the 3-piece chicken combo, spicy, add a pie - make it the strawberry - and a premium strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
6kRsQMNpPcw7k357E2w3SG | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript does not indicate if order was confirmed or if customer was directed to the next window without human escalation. | empty |
7XaEXnqbrEcAbMjRDy7msR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Eq3Mb7pqK66SjYqeWbL7SW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QN4kRuT6VsUc3fCrqiw6tf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YhFs4H9hv9ydUMQnY9Gtre | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gbfDxxLf85eqEeWyn34mNs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iZthRmofKJtiVnnDCrEgSR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
khCPJB7RgFycgjsqAUXfGZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kk4yRqVqtAdsyUTwc7SFTX | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript does not show the agent confirming the order or directing the customer to pull forward or the next window. | empty |
mddSkra5t4axbBAoHkYS2w | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QKhcJjyttxPVrTZ9SvNrUE | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent directing the customer to pull forward or the next window, nor indicates escalation or incomplete order. | empty |
2YjzG7QQ3ZbneomBgTx6Jg | Test new prompt (Aug) | UNKNOWN | The agent took the customer's order, but the transcript ends before directing the customer forward or escalating. | empty |
4NBeESBZqvqwQep2Kr9s4s | Test new prompt (Aug) | no transcript | — | |
HCKL9jWTyp29Xy2okzsDgw | Test new prompt (Aug) | no transcript | — | |
LkrhwbrJahSqyPucGyya7h | Test new prompt (Aug) | no transcript | — | |
ZSkGUCYqqVRmRNWdPqHt4S | Test new prompt (Aug) | no transcript | — | |
6zsCrVAfkEz2yaq69vD6LB | RBI Bakeoff 2026-07-23 | YES | Agent fully captured order and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Chille |
8e7UhCZRrFXBf2pWohKyWj | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
QDxsYm4i2Ff3TBARVXrKK3 | RBI Bakeoff 2026-07-24 | YES | Agent took full order including combo, sides, and drink, then directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Cajun |
bUw8vfPKvuBqnozqoY83Mb | RBI Bakeoff | YES | Agent captured the full order and directed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
cvJN9m5v9cuMjDhER7Wncb | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
RUbE4VyhTHiNhs4EGYgehy | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent fully captured the order and instructed the customer to pull forward to the window without escalating. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Cajun |
Can I get the Ghost Pepper Sandwich combo? Actually, change that to the regular chicken sandwich. And make it spicy.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
3DWMKYM5EPVGZj2o6oq5nJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8hX57MES7u28M4hQqVgzg6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DxkLT7WuYQToTv2VWNLL7u | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KJ2Lj4GwwrnJaE8RBV5AkB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MtFqgXaiRsrY2YXhDcg6Y4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Q9d8gJTYbQ3vhpVYyoRouo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VS4CSTwHXewtqmjjEAS5YM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
X6xv9BuCi3uWQChScERgBj | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Yg6iGUPof6GcWYbfiNcoyH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
n4uRJryHRtgpiCKnYee7Tv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GhBwhRvKQvtwtoYk5PpQS2 | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript does not show the agent taking the order or directing the customer forward. | empty |
3uDq98qZnKWbvZTGGNiJiS | Test new prompt (Aug) | no transcript | — | |
GYK7cRDo3J9TF5yJrXMZeX | Test new prompt (Aug) | UNKNOWN | The transcript does not show the agent confirming the full order or directing the customer to the next window. | empty |
JHnjG2hzrzqbUyDgbMgbSc | Test new prompt (Aug) | no transcript | — | |
KwpBAUn9Qvg4smGE5Bjh6a | Test new prompt (Aug) | UNKNOWN | The transcript cuts off before the agent confirms the order or directs the customer to pull forward or the next window. | empty |
cPZX6FBjq9XEFyytakKrs5 | Test new prompt (Aug) | UNKNOWN | The transcript does not show the agent confirming the full order or directing the customer to pull forward/next window, nor any escalation. | empty |
GsmNKt3et6LKDc3Bycse8j | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
JLyWi6bEEpESDsdsPHQFFP | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent took the full order and directed the customer to pull forward without escalating. | 1x Spicy Chicken Sandwich Large Combo (Cajun Fries, Mas |
hrVHsNVguZUjX4eD8rGSdB | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Large Combo (Large Cane Sweee |
EA44TwMgumDjDghwwNv388 | RBI Bakeoff | YES | Agent fully captured order and directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
UWDtjA87MftGzUrwiWcZR4 | RBI Bakeoff | YES | Agent took full order, confirmed it, and directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
MFcq9d5i8PEg6jMfNc39vV | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Large Combo (Cajun Fries, Mas |
Order one regular bacon and cheese sandwich by itself. Do not ask for a combo or a large. If the agent first offers to make it a regular combo, accept with fries and a Coke, then accept a subsequent l
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
658s8g5TNz2PwXSDGMnTvJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
6VyAZMbRiLCFhDUWu8ftVR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7evxD7sGEWzAAdpifD7P6E | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CeZh2ZqtvzhegAuwPmoQ4D | Simulation Run 2026-08-16 21:10 | no transcript | — | |
L7wDhn8tJpFgJSkn7eJJF8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NgFk38c4F8gr7K2g3o8HQz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
R4jJeuZBGHKkH2Gnyqgys6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
U45R9ApxwgNFJPBquPgXTh | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Yk6PFbXH9fBEF8D2gCCHCP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
c2rYAqsYBu6bHQhPBVtNU9 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
2t5LkYeVvG2x82j3j7nZtG | Test new prompt (Aug) | no transcript | — | |
7fiBgjQmJfU7iLasRNW58f | Test new prompt (Aug) | no transcript | — | |
DSaL7FEDyiqkVJHoHYb8YM | Test new prompt (Aug) | no transcript | — | |
XCbL8JaASU9DnusZfk6AeU | Test new prompt (Aug) | no transcript | — | |
d6YMwjoMzzMJGcQLCPHjcT | Test new prompt (Aug) | no transcript | — | |
cEtz2NNjodeGrERYWYJm8j | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the classic bacon and cheese sandwich order and directed the customer to pull forward without escalation. | 1x Bacon & Cheese Chicken Sandwich Dinner |
3xEcpp3BSyA5iWwAShbRsK | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x Bacon & Cheese Chicken Sandwich Dinner |
NnhYSW4Am2svAX5uMgd4sT | RBI Bakeoff 2026-07-24 | YES | Agent took full order and directed customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
XaHDyY4SJou5DBpqDYj53f | RBI Bakeoff | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
EcpQ6uxA4Yv8EsHjPA7bJ3 | RBI Bakeoff | YES | Agent fully captured order of one classic bacon and cheese sandwich and directed customer to pull forward. | 1x Classic Bacon & Cheese Chicken Sandwich |
nHfYj9PdHrH5VQt4Vqxoj2 | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
KsskYphAJyCzKLM9VTDvVY | Simulation Run 2026-08-17 01:07 | YES | The agent confirmed the full order and concluded the conversation without escalating or bailing. | 1x Classic Bacon & Cheese Chicken Sandwich |
Can I have a Cajun Rice please?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
9cpAdHs8F5c36NSKeshMHV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
F4UTerohmR8zaarfTjsThQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Q67gCn2rYCweU7V5GScaDU | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VtNh6USr2rtPnyNAyFFDGY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
btkevPKdkPtWtgPNuRQiY6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eQ3z9zpeZmhoAkPsxy6kqP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ehQCAeDncnq5tGXJNKWbv8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iVsXQvHVjraXGcTcN5UfgZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kjYU5MhiLzx47B74wogE6L | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mYqjv6S8Q3JjZhGyy9Scj3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JcSV6LXTUp9z4cdK6CBJ83 | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript only contains a request for a Cajun Rice, no order completion or direction provided. | empty |
3CkhFRwC6yUazzRtyT9MhG | Test new prompt (Aug) | no transcript | — | |
LSKp4r4ZarTX7FjMGzhdJ2 | Test new prompt (Aug) | no transcript | — | |
ZcM7EZ7FGrHxUy4Ff2w2TH | Test new prompt (Aug) | no transcript | — | |
boZ533tXSwZn7HCe77Yb4k | Test new prompt (Aug) | no transcript | — | |
dCH4cPsAV7GK5Gg6YK7DcJ | Test new prompt (Aug) | no transcript | — | |
FyweTewpms2eNpDhW5yvP5 | RBI Bakeoff 2026-07-23 | YES | Agent took full order, confirmed it, and instructed customer to pull forward without escalation. | 1x Red Beans & Rice |
P8fhqtDzqJUkLq3aKJdt7g | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the large red beans and rice order and directed the customer to pull forward without escalation. | 1x Red Beans & Rice |
bDJ3sLXin4fSaQt77AwKRZ | RBI Bakeoff 2026-07-24 | YES | Agent captured entire order of large red beans and rice and directed customer to pull forward without escalation. | 1x Red Beans & Rice |
FifyczcZrhDMZFMAETiCz4 | RBI Bakeoff | YES | The agent took the full order, confirmed it, and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Large Combo (Large Cane Sweee |
QHs9XRtsMdeZuKuzXEwavd | RBI Bakeoff | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Red Beans & Rice |
H6wqgJweSWTarcJTK8o8CN | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent fully captured the order for red beans and rice and directed the customer to pull forward without escalation. | 1x Red Beans & Rice |
Do you have nuggets?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
7DbirUbzaKJZqt5wtMZ3n6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BgpBTt59UDp2rvjoxXvTUF | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Fj2WsQvHcCzcoJkmmB6GvJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Qykb33UbyHnSVrGsctrwkp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RkKDJPho6kYFmBwKNvNiJi | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SXXJRzCtAMPvo5duWuRM8T | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Tg9j7KhYP7ZSbx3LD6AFXN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YcPKhE6VNf249yn37bhTMy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dKoAwHiZ4YmMBjteikqF2m | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jdxCypT9ooEFHvaxjQYas6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iNYE5PWe89VxizQsBshh3y | Simulation Run 2026-08-17 01:07 | UNKNOWN | The conversation does not include any agent responses or ordering process details. | empty |
DCCgMkero7YEHoQKXSu9Nj | Test new prompt (Aug) | no transcript | — | |
K6HbtWEYnUUnnkiQXVffod | Test new prompt (Aug) | no transcript | — | |
PGa6p3pRBfPaEfFskFJ7yL | Test new prompt (Aug) | no transcript | — | |
b8apym3oESu33NyEb7e9eS | Test new prompt (Aug) | UNKNOWN | The transcript does not include any order-taking or direction to pull forward or next window. | empty |
i5qvoCBozY2J53BLwGuJ2M | Test new prompt (Aug) | no transcript | — | |
KRTsnkCvCpxaX4rq3NTrCk | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Spicy, Blacke |
DH9Hoat2jWg3RCP8N75eug | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Chicken Tenders Regular Combo (Cajun Fries, |
XoQuagtFXifTXMftDu4Gn3 | RBI Bakeoff 2026-07-24 | YES | The agent took the full order with sides and drink and directed the customer to pull forward without escalation. | 1x 3 Piece Chicken Tenders Regular Combo (Buttermilk Ra |
aetwaherGHexuhuUtUfrvx | RBI Bakeoff | YES | Agent fully captured the customer's order and directed them to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Spicy, Cajun Fr |
Z8L8xGUNrGAkcahHkWEVEb | RBI Bakeoff | YES | Agent took full order including customizations and sent customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Spicy, Blackened Ranch, Swe |
HypmGkvXK6VNZtVWFSpU3w | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent took the full order, confirmed it with the customer, and told them to pull forward without escalating. | 1x 5 Piece Chicken Tenders Regular Combo (Spicy, Red Be |