Speak naturally and conversationally like a real drive-thru customer. Stay in character and only order/respond as a customer would. You speak African American Vernacular English (AAVE) naturally. (NOTE: stand-in General American voice - source a dedicated AAVE voice via /add-voice for authenticity.)
Test case names jump to that scenario's conversations below.
Failures first within each scenario. Simulation IDs open the transcript in Coval. The judge note is Coval's written reason for the Completion verdict.
Order five classic tenders by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose cole slaw and a Sprite.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
RMnyAs38BCaaPBPR9ZXEqL | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent failed to fully capture the correct order and indicated an employee would assist, showing incomplete order handling. | 1x 3 Piece Chicken Tenders (Blackened Ranch); 1x Sweet |
AMQnUUGFMG7Me3CnZ5aNFY | RBI Bakeoff | NO | Agent failed to read back order and escalated to a human team member for help. | 1x 3 Piece Chicken Tenders Dinner (Blackened Ranch); 1x |
hCFCxjw29pgjoZqzeTP3Tc | RBI Bakeoff | NO | Agent changed the order from 5 classic tenders to a 3 Piece Chicken Tenders Dinner without clarifying; order incomplete. | 1x 3 Piece Chicken Tenders Dinner (Blackened Ranch); 1x |
4i26wsVgJN934iJeFN2qZC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ALPvJ3sbWrV8UQeEG5UHYz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PytYjMKQsHkTd87b4q98m7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QPdBcm3qjQQYWFrXwUFLxW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
T7a4btK5KYku7RxdBeMYCb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WbSZ7tMjy5pQhqwfqfnW9b | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZCRqbukVbiwvwjuExrHLAY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jtS9cQQeEaVJAusdedWzcR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jtxr26rX8uHbS6aQEouS3j | Simulation Run 2026-08-16 21:10 | no transcript | — | |
oRZZPwBEmmm8xQseYWtSpd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BKESm3miNwszL9FcVARpXP | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript lacks agent response and order completion details; no direction provided to pull forward or next window. | empty |
A7zsTEpRApQjHx6tfj5f6C | Test new prompt (Aug) | no transcript | — | |
DAkVCBxDYxau2dYBi5mfyp | Test new prompt (Aug) | no transcript | — | |
HWya66pxTuzHPJQuzapw5w | Test new prompt (Aug) | no transcript | — | |
UZ7evaPv7AhRw6vTxATqac | Test new prompt (Aug) | UNKNOWN | Transcript does not show order completion or direction to pull forward/next window. | empty |
nHNmn9Ei3zk4i3usNQZnvx | Test new prompt (Aug) | no transcript | — | |
G5A8EjaJhByg5EqMdCnBh8 | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and instructed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, S |
72wfbvdUkUkaEYM24p85Uj | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, S |
msJBGPJMU3ccuM2EYD3h3i | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent fully captured the order with all modifications and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Classic, Colesl |
eZbcahR24aFRms8PHHVxSt | Simulation Run 2026-08-18 16:41 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | empty |
Order one regular bacon and cheese sandwich by itself. Do not ask for a combo or a large. If the agent first offers to make it a regular combo, accept with fries and a Coke, then accept a subsequent l
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
XnZc9FQ7uskE5tGe7pSABh | RBI Bakeoff 2026-07-23 | NO | Agent did not direct the customer to pull forward; instead, they said an employee would assist, indicating escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
HWxptG9gbMFgeFM9Gno6tj | RBI Bakeoff | NO | Agent escalated to human by saying 'An employee will assist you' instead of sending customer forward alone. | 1x Bacon & Cheese Chicken Sandwich Dinner |
QKCb574txFhqXFdoQiMHzm | RBI Bakeoff | NO | Agent captured the full order but repeatedly stated 'An employee will be right with you' instead of directing to next window without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
2EQUWYXaZiLwLytGHmEqbw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4mxTkxN26a3QHrTRLbnPMd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8VtKU5eBQkKRgHHHqivDFS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FeQr7irL5HixbPFT79BjBo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HVpDvG9FmCigEQh47qaBD8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JJBPkemN7gUSB4rHzSizRL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LndbMpUGC3m3huRTPeS4yF | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SZ8SKmtJ7ZdH4rEH4DHZpK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
TLn6i5PRFY2WabPbwvRyCp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eDC8MhsTYbPnfFvx9QUvXr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LMyqrJP5bETeuEZe5zt7ov | Test new prompt (Aug) | no transcript | — | |
djqjM6xgWDbxkSS3275KAM | Test new prompt (Aug) | no transcript | — | |
fZ5CWPh2N2jkaTpqgifpNY | Test new prompt (Aug) | no transcript | — | |
gb4KqZKRecxsqPw9HJ8hF8 | Test new prompt (Aug) | no transcript | — | |
irThruRaNuQgWmPEdyHUXB | Test new prompt (Aug) | no transcript | — | |
bvTEnstT4cym7yxj7eRFbT | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured order and directed customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
C5VWDmtqjK5AGGJ2kQN7gm | RBI Bakeoff 2026-07-24 | YES | Agent captured full order and directed customer to pull forward without escalation. | 1x Spicy Bacon & Cheese Chicken Sandwich |
ZBEgHxHCZrhFpsJW3FdrZC | Simulation Run 2026-07-20 23:03 (scratch) | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
kNqd4dBhLWqhGUiaAFohvB | Simulation Run 2026-08-17 01:07 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
DjwrrTHa4VknMd239mVjer | Simulation Run 2026-08-18 16:41 | YES | The agent confirmed the full order and directed the customer to pull forward without escalating. | empty |
One bacon and cheese sandwich combo, large, with fries and strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
aNLtZaBRr945p6z9JZWAji | RBI Bakeoff 2026-07-24 | NO | The agent repeatedly refused to read back the order and escalated to an employee for assistance. | 1x Spicy Bacon & Cheese Chicken Sandwich Regular Combo |
3HKNLxBr55dwtpaT4rU67M | RBI Bakeoff | NO | Agent said 'I can get an employee to help you verify it,' indicating escalation to a human team member. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
g8TaRYP8Zy8ZFusKMm4UEA | Simulation Run 2026-07-20 23:03 (scratch) | NO | Agent escalated to a human multiple times and did not confirm order or direct to next window alone. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
3pnFSP45wDaB9D6NP7hxTi | Simulation Run 2026-08-16 21:10 | no transcript | — | |
5acn8tZZcVHN75YbCaiUmq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
C45rtxGdJwVGNvPbFXmFL9 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DyoDqSnEcPy4hXwJUdQ4gw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FhUKgoZFi837rx5turqTeN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GQmU5vbpsfR3XjFfFq5coU | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KLXNEqzYqL5kdmp9XFSTTm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
P27LL3EiC3GsSQvZMocfaW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dbehA88QdurLU9qh5hG8iB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hrzZjFh3SUf68rtVzvP94W | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ELBjNxWqeLoLBq7MhVDdMa | Test new prompt (Aug) | no transcript | — | |
P82adfknVzywTdNV5DGJJq | Test new prompt (Aug) | no transcript | — | |
WBpXVW7MKSDM23SJGMSUAn | Test new prompt (Aug) | no transcript | — | |
XoXSCeAGLvF2JJZkFbdc3v | Test new prompt (Aug) | no transcript | — | |
bZ6MtwfASBf7JbV3vxLJ4C | Test new prompt (Aug) | no transcript | — | |
h5HHA7aJv98aMdzEU9swzz | RBI Bakeoff 2026-07-23 | YES | Agent took full order, confirmed accuracy, and directed customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
mTkFZmGyspQQzPPMQf9fpN | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order, confirmed it, and directed the customer to pull forward, with no escalation. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (C |
AxdYB9de6DXHaeotWkbbnn | RBI Bakeoff | YES | Agent took full order, confirmed accuracy, and directed customer to pull forward without escalation. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (C |
SyyvE4zxuG3GMo6uvXmS29 | Simulation Run 2026-08-17 01:07 | YES | The agent took the full order including bacon and cheese sandwich combo, fries, and strawberry lemonade, then proceeded without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
QVc5rfqmejNa6GujKkvBud | Simulation Run 2026-08-18 16:41 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | empty |
Order three pieces of spicy signature chicken by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose mashed potatoes and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
9EacVF6ozCj95ApsQg5od8 | Simulation Run 2026-08-16 21:10 | NO | The agent took the order but never directed the customer to pull forward or the next window. | 1x 3 Piece Signature Chicken (Spicy) |
keKUio9ZLe2UumiQJV7nuL | Simulation Run 2026-08-16 21:10 | NO | The transcript does not show the agent directing the customer to pull forward or the next window after taking the full order. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
NGwDxvYQtBMZSPq5K4hFxq | Test new prompt (Aug) | NO | The agent did not take the full order or direct the customer to pull forward or next window. | empty |
bwtuinmkBbwyf6DxEtNTdm | Test new prompt (Aug) | NO | Order was repeated but not fully confirmed or completed, and no direction to pull forward or next window given. | empty |
2C599FokhSbnpPFr7xgadK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7WoLeZdFexr63dL3nXDaXU | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent confirming the full order or directing the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken (Spicy) |
7pPr952wxvpqWAAPYwKh7A | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent confirming the full order or directing the customer to pull forward or to the next window. | 1x 3 Piece Signature Chicken (Spicy) |
ErCjJG9LQ7HqQNDFhHj6sW | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript ends without the agent capturing the full order or directing the customer to pull forward or next window. | empty |
FigZhFpZu5KAwTihXvpo2Z | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript ends before agent directs customer to pull forward or next window; no completion or escalation present. | 1x 3 Piece Signature Chicken (Spicy) |
FkRHS4qpMQrMonDtJYt9qf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GUeCfZCmjySeWGQGWSgiQa | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent directing the customer to pull forward or complete the order. | 1x 3 Piece Signature Chicken (Spicy) |
nQoCBMLNZXXweVrnUXWyNP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
2MQrxy8hHQYngaPpJK3f9J | Test new prompt (Aug) | no transcript | — | |
hwXEcuvBTSmUphCKcz3VXe | Test new prompt (Aug) | UNKNOWN | The transcript doesn't show the agent completing the order or directing the customer to pull forward. | empty |
nYgchPZEPaGYjhtBD6p85W | Test new prompt (Aug) | UNKNOWN | The transcript is incomplete; the agent neither confirms the entire order nor sends the customer forward. | empty |
in5Lzz8BurCrtvyBFDWJHs | RBI Bakeoff 2026-07-23 | YES | Agent fully captured the order and instructed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
JqjKVQMZKCZAZLuRPUDaBb | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent took full order and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
bLVP7REMHGZTJeWTrNqrXd | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
7vLQcfDUUJJsv9ptZEGPKm | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
TnAWiemWbN9oYGpUtatUAr | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
SpnXsxszsPignkUfvpNqru | Simulation Run 2026-07-20 23:03 (scratch) | YES | Agent captured the full order and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
hk8hqCLrNVxbyXQSLQnQnr | Simulation Run 2026-08-17 01:07 | YES | Agent fully captured the order and directed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
FXz6et7ZXnqUYJ6CjGh3zk | Simulation Run 2026-08-18 16:41 | YES | Agent took the full order and directed customer to pull forward without escalating or bailing. | empty |
Can I have a Cajun Rice please?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
kzpvRZd7P7BBWmC3iXSm3o | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent did not direct the customer to pull forward or the next window after taking the full order. | 1x Red Beans & Rice |
k5rdiY9uTxR5gpRspya2Go | Simulation Run 2026-08-16 21:10 | NO | Agent never confirmed the full order nor directed the customer to pull forward or next window. | empty |
69kJV6uSxXTPnPkgDdd6GY | Simulation Run 2026-08-17 01:07 | NO | The agent did not complete the full order or direct the customer to pull forward or the next window. | empty |
FEJcJQT4ed3whzDPzUQFbM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FNptAp4oPuDrgj7NtjsYey | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GxjaCTJjLYaBtr9fV4QhpR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WL7TCyGQtZESSAdJbRVqgL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ba4ELRuoYjyMiVFsxho3Mw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dYwGzgcLMVSPN5Amr3qjBY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eDPR4e5tdHShreRvAZPRxf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gEq2GAL6oioX74Ky5p8XyC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gw42LsxB6X3aWWt7e3kxLv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
77YYPf8bb4P35pSQG4a8rq | Test new prompt (Aug) | no transcript | — | |
FSbtvji3wstXY9qQA7bXdU | Test new prompt (Aug) | no transcript | — | |
PFPVTqiZTF5SbhgVTYKoAC | Test new prompt (Aug) | no transcript | — | |
c8SRHsNjCg9QDwqMvY8dgh | Test new prompt (Aug) | no transcript | — | |
dLYitL7cG2RFYzSBmfTsmK | Test new prompt (Aug) | no transcript | — | |
272WPvorFjtNCXJjuqSUga | RBI Bakeoff 2026-07-23 | YES | The agent fully took the order and directed the customer to pull forward without escalation. | 1x Red Beans & Rice |
dVJowf4JT9JVsTYLKf6aPv | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Red Beans & Rice |
SFquvszrT4hvyi3z8CXAA9 | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Red Beans & Rice |
MdaqxZU38ZwLBkbzehK5mY | RBI Bakeoff | YES | Agent fully captured the order (large red beans and rice) and directed customer to pull forward without escalation. | 1x Red Beans & Rice |
Vu59ajpAnZSqqqyEVnpgAy | Simulation Run 2026-07-20 23:03 (scratch) | YES | Agent fully captured order for large red beans and rice and directed customer to pull forward without escalation. | 1x Red Beans & Rice |
bZ3ZQu27Myap7wK6ohNAFJ | Simulation Run 2026-08-18 16:41 | YES | The agent took the full order and directed the customer to pull forward without escalation or handoff. | empty |
Order one classic chicken sandwich by itself. Do not ask for a combo. If the agent offers to make it a combo, accept and choose Cajun fries and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
oAjPgFzupR3Z7xhGEemVYk | RBI Bakeoff | NO | Agent said 'Employee will assist you,' indicating escalation to a human team member. | 1x Classic Chicken Sandwich |
XZnRCCHeEMzeQao5QzXYAX | Simulation Run 2026-07-20 23:03 (scratch) | NO | Agent did not direct the customer to pull forward/next window but repeatedly escalated to an employee instead. | 1x Classic Chicken Sandwich |
6iZxDZ698XLMwxL9KjHKx9 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8LZHHTd5gdR9sPr2qw7aeS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AMakg5j22EcfwX2Mtm7Bi8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Dbksi9Nf8Tg8nkWpkgNeeQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HFRNpK3bZggWi7NfqdaPsH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SatUWHv9nGBkpiafi5VNfJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bBTL8fTLoUxANDJuuwyytF | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bNV4CufksYRxSsdos2Hq7p | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eyxjwk9dmq5q9HTw3a9bEt | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fqCuyqjtXmDtCNYNAkDqSn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YeQZrdhzcyR8E5im2aJCPf | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript ends before the agent confirms or directs the customer forward; order is incomplete. | empty |
6xBtR6L2emZkYuGQV6VtpN | Test new prompt (Aug) | no transcript | — | |
9eg2tZzpmrtFKS8oQ2WR6f | Test new prompt (Aug) | no transcript | — | |
KJ4EJUbPABBbNzJhWz7Ueh | Test new prompt (Aug) | no transcript | — | |
VEXahnDUQvGgvG4VMPd2Af | Test new prompt (Aug) | no transcript | — | |
fDmqmk7gDCUVKX9wJzj9if | Test new prompt (Aug) | no transcript | — | |
oMgSxmc4dgksvAN2fEjkjc | RBI Bakeoff 2026-07-23 | YES | The agent took the full order of one classic chicken sandwich and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
QMSjdNz7SEV925vxEV5inv | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent captured the full order (one classic chicken sandwich) and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
E2YtiDBnxA2GegvV5pUZ8T | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
eZTSUbMJYVmQgJ8Nbrp567 | RBI Bakeoff | YES | The agent took the full order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x Classic Chicken Sandwich Large Combo (Cajun Fries, L |
fBxBHzc5C7zqnmwCZXb4RK | Simulation Run 2026-08-18 16:41 | YES | Agent took full order and directed customer to pull forward without escalating or bailing. | empty |
I'll do the chicken sandwich by itself and a side of fries.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
dLrXgUa8M29ZC5uiTaw82f | RBI Bakeoff | NO | The agent escalated to a human team member rather than directing the customer to pull forward. | 1x Spicy Chicken Sandwich; 1x Cajun Fries |
2WL4Gc83b4brtEJJPt7Re7 | Simulation Run 2026-07-20 23:03 (scratch) | NO | The agent said 'Employee will help fix that,' indicating escalation to a human. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
64ATnLUQ6pDXbrLgp6ngxe | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8KZgGz6nzXpvV3TEbEVPdD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8ZMvromfFXx7PWnvd4vCGT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
B7xK7svP35PcbAAKbyk7DU | Simulation Run 2026-08-16 21:10 | no transcript | — | |
TwKDeW3hEWEfU75ZWkCcew | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VMB6VysgxTFbG9K34uhML3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fVWuSrX59fYazGy774twnc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hF9ZroVG2swGt7PVLmrxaz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jYZE7d56XC2SFW9vSfFDvP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
oMpQFufdS3kX5ozeLVBQiX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kt3ZUpcQAyzHV4zd4ZZSNY | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent directing the customer to pull forward or the next window. | 1x Cajun Fries; 1x Spicy Chicken Sandwich |
8x6XB7xsYKoLVV7bkDjDid | Test new prompt (Aug) | no transcript | — | |
ZxgoD3KCDttGwHhfuWP9AN | Test new prompt (Aug) | no transcript | — | |
bD4F99EZ6aZ3WXDv2huLri | Test new prompt (Aug) | no transcript | — | |
fBgbAGXiDHeycfHCcJzxhy | Test new prompt (Aug) | no transcript | — | |
mULez2enZqepbKFLyGEH2t | Test new prompt (Aug) | no transcript | — | |
kj6hPqtvQ8FiNdJuk34zFu | RBI Bakeoff 2026-07-23 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich; 1x Cajun Fries |
8HLCBVBNUjwvmsv9b82KN7 | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x Spicy Chicken Sandwich; 1x Cajun Fries |
mr2wM9jXtxfFZxJeGFtH6e | RBI Bakeoff 2026-07-24 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
5Bm2en96GJPjCSpKoF8zFm | RBI Bakeoff | YES | The agent took the full order (chicken sandwich and regular fries) and directed the customer to pull forward with no escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
abTNory5Dzd7svAc3XKf8T | Simulation Run 2026-08-18 16:41 | YES | Agent fully captured the order and directed customer to pull forward without escalation. | empty |
Can I get the Ghost Pepper Sandwich combo? Actually, change that to the regular chicken sandwich. And make it spicy.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
Qbx9ThzRXK7e72qyX4bW9p | RBI Bakeoff 2026-07-24 | NO | Agent did not read back the full order and escalated to a human for assistance. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
U9QMYnopq8EUmXt7vmzg9f | RBI Bakeoff | NO | Agent could not read back order and deferred to employee assistance, indicating escalation or bail-out. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
2SJu8RfqcVQXAVskeE3oBt | Simulation Run 2026-08-16 21:10 | no transcript | — | |
35JhgVwdxcv6trZhaERVvg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4AqcwSShEgmb89KsFopR2s | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8SfbpywhFMSfb5k79kD9tn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CWggHgFmuxVY7r3ZazZ5px | Simulation Run 2026-08-16 21:10 | no transcript | — | |
K7pRzghSFJ32h3jRrQ9e84 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
R8L6r47QeKCHD4kbokJzhV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VuNMFH3QZ9ipLhmV5QcLhf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gE7nc3ufJSuWM4V5p9Qd2A | Simulation Run 2026-08-16 21:10 | no transcript | — | |
o4aAfg9JAyqrtMRefTb9Br | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hdFygafpa8nxGqtFGLsqEV | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript only shows the customer ordering and changing their order, no agent response or direction given. | empty |
63cavDhUUbRRtuj2cJ9GQK | Test new prompt (Aug) | UNKNOWN | The transcript does not include the agent confirming the full order or directing the customer to pull forward/next window. | empty |
ECbyV2C4ViJ6XRWsPYSSFS | Test new prompt (Aug) | no transcript | — | |
HkL3XX5rVZ2NBnGKkNb3WU | Test new prompt (Aug) | UNKNOWN | The agent did not fully capture the order or direct the customer to pull forward/next window in the transcript. | empty |
Pak2iyDNYbYVRBC3K9R9Sw | Test new prompt (Aug) | no transcript | — | |
e5KFh35QBMM9kHetBAVBGp | Test new prompt (Aug) | no transcript | — | |
3GKhRU9mxNQbHbdMQPWRPv | RBI Bakeoff 2026-07-23 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
Sw364mAcKMmX7fwVuTzhz7 | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent took full order, confirmed it, and directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Large Combo (Cajun Fries, Mas |
iSHoeunDwzdfEzBJUe4fEv | RBI Bakeoff | YES | The agent fully captured the order and told the customer to pull forward without escalating. | 1x Spicy Chicken Sandwich Large Combo (Cajun Fries, Mas |
7AuyFnPm9Tss8ct5YEq5Za | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
jGECo8mDCVqLgj9YjsuMoa | Simulation Run 2026-08-18 16:41 | YES | Agent fully captured the order details and directed the customer to the next window without escalation. | empty |
I'd like the 5-piece tenders combo, blackened and spicy, with cole slaw and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
7riuJnj9EsfUiUUXDHXAdH | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent rescinded initial order choice and repeated sauces without completing the new order before sending customer forward. | 1x 5 Piece Chicken Tenders Large Combo (Blackened, Cole |
FqDhExUm8TWjZhiBK9wY9S | Simulation Run 2026-08-17 01:07 | NO | Agent never directed the customer to pull forward or to the next window after taking the full order. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Sp |
4YP5x2WAKAKMDpxdLZwC2M | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AYxdyaUz8XLuHow4L43mGW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BWvuSt3hxd3w8Ey5M2CQz8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Hhei4WLSivwnBEsRdrDmoD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Mc3YcYf72Tm9qqvyukby75 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZfW5FQDeaLtJNEk65VEEcz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bHXvFD2XRj6qpx2bTbrDHG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hV2fBGSxHmZHqEwen7J73c | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mEvMdpihsdaEHcjgetwuAN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mNTHFn9AmGZdoWirXkyuRj | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Af5eeHZhGNGob2KaH5AgUy | Test new prompt (Aug) | no transcript | — | |
BDeGaqjrY5CsDYZntaQrB7 | Test new prompt (Aug) | no transcript | — | |
HkkKiZamDJa3fv8PjSLF9f | Test new prompt (Aug) | no transcript | — | |
g3Re2p4sUF4dH5BCWZSBKm | Test new prompt (Aug) | no transcript | — | |
jw5yu4KxrgQst3cMx23eii | Test new prompt (Aug) | no transcript | — | |
XxqvC8AuN5LcXLqekxVbsE | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Blackened, Spic |
NPyHBCCx7LaaKSMcfCDeuS | RBI Bakeoff 2026-07-24 | YES | The agent took the full order including modifications and sent the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Sp |
933APjkrQx2troDbikLP7L | RBI Bakeoff | YES | The agent fully captured the order details and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Blackened, Cole |
8Nb8JtSwCnyiDY93uUFmHr | RBI Bakeoff | YES | The agent captured the full order details, confirmed with the customer, and directed them to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Blackened, Cole |
SLZHPrm7J3CyHXHQTZS5e6 | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent fully captured the order, confirmed sauces, and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
XkYBwPxn5hjNuSpzQ8CbqU | Simulation Run 2026-08-18 16:41 | YES | The agent took the full order, confirmed it, and directed the customer to pull forward without escalation. | empty |
I'd like the 3-piece signature chicken combo, spicy. I don't want fries. What other sides do you have?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
dDezyevYC5oDSBVHxQu6xi | RBI Bakeoff 2026-07-24 | NO | The agent escalated to a human by saying 'An employee will assist you,' not sending the customer forward directly. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Red |
37KFA2AauQHQ8Cw3NgsA7u | Simulation Run 2026-08-16 21:10 | no transcript | — | |
6d7qNqRBmzCozTn8Xsw7SL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GAugu8NGA3GV5TjRrfpUVL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LP4g3xS9GQXn3NskqWHa2K | Simulation Run 2026-08-16 21:10 | no transcript | — | |
M7duuxui7TnGCXAhD2rTCB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YYjStj6kGs4cJwCdhWDzz4 | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript ends before the order is fully captured or customer is directed forward. | empty |
gykdcJVGBCo2CPMH7c2gP3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
idZGeER3bAvPhdGRDEFsXg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
j46AfpuhyMJL7gEzTYNc5f | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent completing the order or directing the customer to pull forward. | empty |
jXJuErj6abudDxaLump6DB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LEfsF3y4mevWGXSJjESo9U | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript does not show order completion or directing customer to pull forward/next window. | empty |
4dq39cFkAdCqPYQWYoo63R | Test new prompt (Aug) | no transcript | — | |
68SbFcSZqxkfpNnBixnTvN | Test new prompt (Aug) | no transcript | — | |
MEFKHwKoPrV8ztccTqUUXn | Test new prompt (Aug) | no transcript | — | |
ZhDz5TswyrFmJtny3Mtgec | Test new prompt (Aug) | no transcript | — | |
gq8njp6wsKdptcz6NoJu4Z | Test new prompt (Aug) | no transcript | — | |
NLcHiucCoEwL39or8s4eb8 | RBI Bakeoff 2026-07-23 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Red |
MnnWZpBbuiao8vH5KnXYup | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the customer's order and directed them to pull forward without any escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Red |
TexnsLDZZX94AU6Cc7qJUx | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
SUHNPntpdiR7NogF6enPgh | RBI Bakeoff | YES | The agent captured the full order and directed the customer to pull forward without escalating or handing off. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Red |
DvmZEPKkoKhfUCr2PvUfnv | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent captured the full order and directed the customer to pull forward without escalating to a human. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Red |
6TtEY8WXx56KR4RVBqU84S | Simulation Run 2026-08-18 16:41 | YES | Agent took full order and directed customer to pull forward without escalation or handoff. | empty |
Give me the chicken wrap bundle with a mango lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
BN39pSHnBPgwCaeiWwTxsG | RBI Bakeoff 2026-07-23 | NO | The agent failed to capture the full order correctly; the final confirmed order only includes the frozen lemonade, not the wraps. | 1x Frozen Mango Cane Sweeeet Lemonade |
33hG4uEhYfNgUcdopiH7w5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
3ozJrMDiifbTE8nQUUWSDZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
6RhraUUx3jUc7zv5Nib49S | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JoaEfwAdLonfSnrHCGTSLg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KKBydZZWFsZQnCveApoJCV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Lh2R9d2pQdRCa8awGUk5DB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
U8LuXBGCi7SNyJtc6LBC5g | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UDiWjwCQo5nafwCYhHVumG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cLEaafuY5fpuU7vfseCuEo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dwTHdMJvqWzyYcCwUryijt | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RmDhHm2n4oM5nEL3gjG6XH | Simulation Run 2026-08-17 01:07 | UNKNOWN | The conversation does not show the agent taking the full order or directing the customer to pull forward or to the next window. | empty |
W2q2FcgJFnhwnsfFVDwrKJ | Test new prompt (Aug) | no transcript | — | |
Zx4Bmxcdppuro2tMmtejpn | Test new prompt (Aug) | no transcript | — | |
aEZ9iHLog9oC2pmnodHhZD | Test new prompt (Aug) | no transcript | — | |
bnvq4di2gVwKYEG4KDKEmM | Test new prompt (Aug) | no transcript | — | |
mDL9hvMwMrKz3kKyN4UN4Z | Test new prompt (Aug) | no transcript | — | |
2ddrsmKCFFwBZqzSA9YD8N | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent captured the full order and directed the customer to pull forward without escalating or handing off. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
68kfMSShQFFTmVnmVASMAG | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Wraps Bundle; 1x Frozen Mango Cane Sweeeet Lemonade |
R8ivMQphMbHu2fpFSoG5go | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Wraps Bundle (Classic Wrap, Chilled Mango Cane Sweee |
Navo53r8Q2D5RtcxJkrAeb | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
5EJVgFydUNPCmTXD8FsD7Z | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Wraps Bundle (Frozen Mango Cane Sweeeet Lemonade) |
nRRKmo5MT3sMqVUkuTgsbm | Simulation Run 2026-08-18 16:41 | YES | The agent took the full order and instructed the customer to pull forward without escalation. | empty |
Can I get the ghost pepper sandwich combo, swap the fries for red beans & rice, and a Dr Pepper?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
Jgg67mgP9gmEGLYAwc9QxR | Simulation Run 2026-08-17 01:07 | NO | The agent never confirmed the full order or directed the customer to pull forward without escalation or handing off. | empty |
2nxFjmGtF8M6aDwrWxoLx3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CuJ3gnNRjMzFnUcdhnShck | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DHHQLov3YiS3daCHkrNsby | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Dr4CJvTKYUDSn5yopmzHrH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Ggv6DKHhV6DZEiN5bwRAZ6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NBUKWyvaWUBrhpBsfzajrE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NwXbKsERF8BLkPZvrA2dye | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Qq3ozqULwgaNfz3vSXoBPM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
TYjw9uEZt8FwuwDyjNY7KE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
U2Hw45bY3aCQn2NwZnwoc7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
6c3pfMdwYqXjmeJBTPYRDn | Test new prompt (Aug) | no transcript | — | |
FV2NSiVuyDJUGTtEn7Vue7 | Test new prompt (Aug) | no transcript | — | |
aY73XgQXkisYw9tu6YRNnt | Test new prompt (Aug) | UNKNOWN | The transcript does not show completion or directing the customer to pull forward; no escalation is evident either. | empty |
d2AxSsn8VmoPmEijDNzXtT | Test new prompt (Aug) | no transcript | — | |
hZTwsrLMTCwDvDguZBWbu6 | Test new prompt (Aug) | no transcript | — | |
kXoh2bsxGXZSMoCxhqNpbw | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
XsWDG5cH9Ch5LVKSFFd3Kg | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured the order with modifications and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
CgYzFXNbxf7Ps4xYRsZLjj | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the customer's order with modifications and directed them to pull forward without escalating. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
TbAzRJC9phyJsdNbrVTjr7 | RBI Bakeoff | YES | The agent took the full order and directed the customer to pull forward without escalating to a human. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
KUwqNr6Extc4znDJgKCrKF | RBI Bakeoff | YES | Agent fully captured the order and directed customer to pull forward without escalating. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
5dkj7HS5zxYmW3WBw6VD5X | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent fully captured the order with modifications and directed the customer to pull forward, with no escalation. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
XSKZT66VAeahHw5suhHApr | Simulation Run 2026-08-18 16:41 | YES | Agent captured the full order and directed the customer to pull forward without escalating or handing off. | empty |
Start by ordering the 3-piece signature chicken combo, spicy, with mashed potatoes and a Coke. Before the order is finalized, change it to the 4-piece combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
9UbDarEudhTAYMnJbbysjJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
F3AqJkjQpYfvVaCgUsnWge | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JKjLWj6aLzWnJMMuABhJh8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NhxjBEmukXWaJf98g5PeEP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PjaYA4xrzEznnde6FnWZK2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RCWPf3DQJEvrRoVUahtm6h | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SRFtKufayDiJ9CT57aytgv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WjXKtd2ubryPsbdkatkkmy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZyVjARyVFHmXXkNDTkkLJH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nHghtief2x2NnwrSbqMPKK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
46rovLtVoDMaK64pvzyWbw | Test new prompt (Aug) | no transcript | — | |
C6YpYDv7HoW5wnycfGbb8h | Test new prompt (Aug) | no transcript | — | |
gfLyagDjQJqqNEBRDDP6EB | Test new prompt (Aug) | no transcript | — | |
jPqHbiTLfTpeMLuYZXudDw | Test new prompt (Aug) | no transcript | — | |
kjJwSzGZCGHKJhpyXHaU5v | Test new prompt (Aug) | no transcript | — | |
HyFSoK7r5CGE7johnz9ahG | RBI Bakeoff 2026-07-23 | YES | The agent captured the full order and directed the customer to pull forward without escalating or handing off. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
jUoaSDKsY7gvTkT5qihkzK | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
4ZesGxn8rmktRmGDUq9ded | RBI Bakeoff 2026-07-24 | YES | Agent fully captured the order and directed customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
KhbiyYmJ5hjHYDYBjeobGF | RBI Bakeoff | YES | The agent took the full order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
mQEQkXDJZGNbAQV7XUQuuM | RBI Bakeoff | YES | Agent fully captured the order and directed customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
2inhwzVWXJuJc2wadjLL5d | Simulation Run 2026-07-20 23:03 (scratch) | YES | Agent took full order, confirmed it, and directed customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
L3Nz7gmdmTTwexaYrAkUCk | Simulation Run 2026-08-17 01:07 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
Mco93GPn5HKKRVtxNGUpcE | Simulation Run 2026-08-18 16:41 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | empty |
One Ghost Pepper Sandwich, no combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
7mtKnJbdCsQete5rBNXCou | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CCQ8DroJ3oZZwiUoQezKQt | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EVRsoLuvQ9rfpC4T2vJeF8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HVvvA24i7698zrm6g7okMH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
L4MBrqz3HaUX7xgCvW9vi7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MEwoZBV5n2FQAfkGGK5S7n | Simulation Run 2026-08-16 21:10 | no transcript | — | |
U6jcn2f39GXJguLhbJHRT3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Vxx8XyjfCz2utBQQmc47jG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
k7MMJqrXP7aLAA9EgbkD47 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mCbgZwak9vpM7Kp6XENkDP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HTPges69PJrRn7iwgTG3Vp | Test new prompt (Aug) | no transcript | — | |
LBtq4CovY9Z79sisRrttj7 | Test new prompt (Aug) | no transcript | — | |
PxPLqNc4H6BmvGRS58And5 | Test new prompt (Aug) | no transcript | — | |
XAidKL3j7dphYDJLE3p3Kb | Test new prompt (Aug) | no transcript | — | |
kMQApdDW8jNzR96MUogtGm | Test new prompt (Aug) | no transcript | — | |
L5ydK55qBXRfgwWnbCvffC | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x Spicy Chicken Sandwich |
nwJ9qYnxf7U9qwjxtxKWHZ | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent took the full order (spicy sandwich only) and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
YqC96LCrPmADT6QRefKKFG | RBI Bakeoff 2026-07-24 | YES | The agent took the full order of one spicy sandwich and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
XjK5uqNoNdz54x4b7FzH6x | RBI Bakeoff | YES | Agent fully captured order and directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
dMDwyzGEeTaZWXgz5dDTLp | RBI Bakeoff | YES | The agent fully captured the order and instructed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
5bquUXHXBrvBGKdxot6fvW | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent took the full order for one spicy sandwich and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
QzNtYJTSNKUyKDgJkFVA9M | Simulation Run 2026-08-17 01:07 | YES | Agent took full order of spicy sandwich and directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
WcHjp5x5snW8UX7YqvtJuq | Simulation Run 2026-08-18 16:41 | YES | Agent confirmed full order and directed customer to pull forward without escalation. | empty |
I'll do the 12-piece family meal with all dark meat, spicy, Cajun fries and cole slaw, and two Sprites.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
23MFZxvtiy4nAMEvwTCd49 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4sCkmYt6k36as9wEdEMbDA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7ZdrerSSuQXUdSTtedkA6T | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Eb72Y7HhJfwdGpovuadtej | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GPHdtaJQ9Zkd9wH2jrpobG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HK6jTJ94gMCFHom4wWK54n | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MGiPeXeFtJ6MZaktKxBFzm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MfaPuKDUTULSuBnkooMZee | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jSF8bypdjKZQy88ebSA55p | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ktbHaYga78brXWAMKwhV8N | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Yj4XnAkuD8ZQmmNUEaQMuy | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript only shows customer's order, no agent response or direction to pull forward. | empty |
8J3vZyDwx2iUMrrcApescZ | Test new prompt (Aug) | no transcript | — | |
8Np6gutZ5MgWGKzAaizXhZ | Test new prompt (Aug) | no transcript | — | |
QVcbsYbTE46Bsz7ZdpLnHp | Test new prompt (Aug) | no transcript | — | |
YpFrvGPy52yuVEeHsaQSHp | Test new prompt (Aug) | no transcript | — | |
fhGLsrZvCjMN7TtT2VdvKm | Test new prompt (Aug) | no transcript | — | |
gfrCDDYjWot3iah85k4kGS | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and instructed the customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
gdnhnPnsgtGZ4iaZa858Ld | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and instructed the customer to pull forward without escalating or handing off. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
kUp84Gmxt8W77N2nHmkDwQ | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
dxhnGoRbbZdHNeTjiGT4P4 | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without any escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
dF3KAvZk99HRds2wTm8GxD | RBI Bakeoff | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
FMuC9UV5b6Gc5PS4G2hefz | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
WR8ikRwWCWD42T9CfctYTg | Simulation Run 2026-08-18 16:41 | YES | Agent fully captured the order and directed the customer to pull forward without escalation or handoff. | empty |
I'll take the 3-piece chicken combo, spicy, add a pie - make it the strawberry - and a premium strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
973w44HkZfB2LCpJxehLsy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MAwZ8G9nVBSQx2H2K6h4K7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PSKXQUq6fguVNmZRXmaXor | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WrZzKGuEnnKTDRgq9pgTyL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WtUaeztBbGpmvZMYBVwevT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XJwYhLd8MTtR4QZ3LZV7MJ | Simulation Run 2026-08-16 21:10 | UNKNOWN | Agent repeats the greeting but does not confirm order or direct customer to pull forward/next window. | empty |
bifwXWPnwRjfQYtUxtLy2C | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent confirming the full order or directing the customer to pull forward/next window. | empty |
cFDj9zvn9fX9eZh2uv7KMJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jxPjtxr4VJbimHnhJesWAY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mo6gaPkb6g8Q4PiJaFzY29 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
H64UPakznZ8HF6gH8bCX4v | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript does not show agent taking order or instructing customer to pull forward. | empty |
Rx9a2btNa5Dkt7SccxxJhq | Test new prompt (Aug) | no transcript | — | |
WzPrYNzSaZVAkC8NZEt2mH | Test new prompt (Aug) | no transcript | — | |
YR56E7VBhEGoSg8YJ3gTCv | Test new prompt (Aug) | no transcript | — | |
hM6oeDhwwZ5FfEEkFXo5td | Test new prompt (Aug) | no transcript | — | |
hx7NiDEW44eEvpCMvUPzU4 | Test new prompt (Aug) | no transcript | — | |
NTeRicQ8XmroEXu4vFiVJa | RBI Bakeoff 2026-07-23 | YES | The agent captured the full order and directed the customer to pull forward without escalating to a human. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
8cBcjhCPNypQqcK6BpsJMb | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent captured the full order, confirmed it, and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
k5CFjUiL5quyQs8VaGYFsc | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
Q6WYDZg4Kemv5FFMN83Hkc | RBI Bakeoff | YES | Agent captured the full order and directed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Cajun |
AJtCqsMJqWYqVWYBeHJp8D | RBI Bakeoff | YES | The agent took the full order, confirmed additions, and directed customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Caju |
c7qGAGrmghwEVULdSAeLHM | Simulation Run 2026-07-20 23:03 (scratch) | YES | The agent took the full order and directed the customer to pull forward without escalating to a human. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
cMvZqPgFroEGqD6TtsGeRZ | Simulation Run 2026-08-18 16:41 | YES | The agent took the full order and directed the customer to pull forward without escalation. | empty |
Do you have nuggets?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
4TGzJWgSQUjnhSL45wUTWP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
83x8VpAyc4g3kymjJ45a5s | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9Xi653HuaamVjMYEZeWs2u | Simulation Run 2026-08-16 21:10 | no transcript | — | |
P4QLCKwxtQ9ptedpdgkRSK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
USLjD3GZYBUu2XQ7qeDYAb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZsPfkVSZQgbqhSE7iinK4w | Simulation Run 2026-08-16 21:10 | no transcript | — | |
evzeGutJvkj5kbvnafPhJU | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fQy9F3uZ9B2g8X4xaHKNrn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hYqmTXVnKbM7aTe5LsGboQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iaPczeH35cbY7cMgykSbKq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VKt5Ns6FXmexgCfKbvsg6K | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not contain any interaction with an agent taking an order or directing the customer forward. | empty |
6ioxbhmJqsP9bdXPZSgUHn | Test new prompt (Aug) | no transcript | — | |
8qqTozR2VMxKqty9byyirX | Test new prompt (Aug) | no transcript | — | |
PCdQHacQ4pyDQFtC5Cj4wy | Test new prompt (Aug) | no transcript | — | |
QRJbW9vaQr7WXmZAVydCej | Test new prompt (Aug) | no transcript | — | |
oTZdJjYjK2MtRtcFLspMov | Test new prompt (Aug) | no transcript | — | |
nvpZQwFfvgoBiQ2ZeXNGqA | RBI Bakeoff 2026-07-23 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Cajun Fries, Ma |
33JT59uqoS7nke2RR67aGV | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order, confirmed accuracy, and directed the customer to pull forward without escalation. | 1x 8 Piece Chicken Tenders Family Meal (Blackened Ranch |
Lv2pRxhUTspfA8fqii4u9y | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 8 Piece Chicken Tenders Box (Spicy); 1x Cajun Fries; |
aaDgXx5GuFfoXVKJoZ9Nzu | RBI Bakeoff | YES | The agent fully captured the customer's order and directed them to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Spicy, Cajun Fr |
fTWaPq3UfKXLG48FZSVHkB | RBI Bakeoff | YES | The agent took the full order, confirmed it, and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Spicy, Blackene |
7Hr4wQKUGBEvMUNd6LTCdC | Simulation Run 2026-07-20 23:03 (scratch) | YES | Agent captured full order and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Cajun Fries, Fr |
DfVFnfv28xTCrHkY7Fc7pX | Simulation Run 2026-08-18 16:41 | YES | The agent took the full order and directed the customer to pull forward without escalation. | empty |