You are calling from a noisy cafe. Speak normally, occasionally ask the agent to repeat themselves, and continue the task despite background noise.
Test case names jump to that scenario's conversations below.
Failures first within each scenario. Simulation IDs open the transcript in Coval. The judge note is Coval's written reason for the Completion verdict.
Can I get the ghost pepper sandwich combo, swap the fries for red beans & rice, and a Dr Pepper?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
NLjXC6xUwcKMwrjkq8rvZg | RBI Bakeoff 2026-07-23 | NO | The agent escalated to a human team member instead of directing the customer to pull forward/next window. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
3SaGtVLsRP8kTrk5LSgoJx | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent escalated to a human team member instead of directing the customer to pull forward. | 1x Classic Chicken Sandwich Regular Combo (Red Beans an |
3y9pLtRVwbCnZM6j7DsRvr | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human employee instead of completing order and directing customer. | 1x Classic Chicken Sandwich Regular Combo (Red Beans an |
VpEhXmZd2WD9KMig6jCata | RBI Bakeoff | NO | Agent escalated to a human by saying an employee will assist the customer. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
7UnjnrisqzeUZeij2Gowka | RBI Bakeoff | NO | The agent escalated to a human by stating an employee will assist the customer instead of directing them to the next window. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
YAQnxFtpHymC7aW6ozHXty | Simulation Run 2026-07-20 22:35 (scratch) | NO | Agent escalated to a human after capturing the order, failing to direct customer to next window. | 1x Classic Chicken Sandwich Regular Combo (Red Beans an |
JgBaap3EEsUAqDQ7cHZNxz | Simulation Run 2026-08-17 01:07 | NO | The agent did not fully capture the order or direct the customer to pull forward or the next window, nor was there any indication of handing off or completing the order. | empty |
6akFRK2wFp3urb8YcdN8C7 | RBI Bakeoff 2026-07-24 | no transcript | — | |
3EtfYVJNcKZnxCxv9i37Kn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
3aHZ3eeL9uy6FKvbN6k9dc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9uz3mapag928L8CMdVk3Yg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DJNGSN3JoLTUMiKoGbPNqa | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Dfe6bgKkdCoDNKAsdh6MDP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DwdbdqdTJKjLGwGX6kfFD7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LFRRyKcK9Ry9bk8dgVu7yJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NMiwBxuZJVnGF7byagycaX | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript ends without the agent confirming the full order or directing the customer to pull forward or the next window. | empty |
a3RPHhKwcQF2fG7z8UhsB7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mAczrYJpwQLqsZfTamh76t | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4JSqPWogpRzLtAkuZraH28 | Simulation Run 2026-08-18 22:27 | no transcript | — | |
kXr28SuxSFKZUFxyZ2rFp2 | Simulation Run 2026-08-18 22:29 | no transcript | — | |
5odZwDfVVTMXVAB4ENqSDt | Test new prompt (Aug) | no transcript | — | |
5qq5N5JKizU232vM2YdZj6 | Test new prompt (Aug) | no transcript | — | |
FBH6eLdBRvLVhKAxtY2zE4 | Test new prompt (Aug) | no transcript | — | |
QRKQo4q6zHweqHzDeyDiUa | Test new prompt (Aug) | no transcript | — | |
SxvppU3GAVfVvoYTXf9ucr | Test new prompt (Aug) | no transcript | — | |
hAvAFAVSR6zw8VUhMnbRVm | Simulation Run 2026-08-17 01:45 | YES | The agent took the full order, confirmed it, and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
nxU6Xs5dNtJgqw6VwQ8kE9 | Simulation Run 2026-08-18 22:13 | YES | The agent captured the full order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
Give me the chicken wrap bundle with a mango lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
CBEEirBHpsjP2eU2U3o93h | RBI Bakeoff 2026-07-23 | NO | Agent did not read back the full order and escalated to an employee for help at the window. | 1x Wraps Bundle (Classic Wrap, Chilled Mango Cane Sweee |
eXAYEabZ3itcF9tLeq8EbB | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent did not hand off the order to the customer or direct them to pull forward; instead, they escalated to a human team member. | 1x Classic Wrap Regular Combo (Frozen Mango Cane Sweeee |
KqzqVKWVgZbcHddt4h5op2 | RBI Bakeoff 2026-07-24 | NO | The agent escalated to a human by stating an employee will assist and did not direct the customer to pull forward the next window. | 1x Blackened Wrap Regular Combo (Chilled Mango Cane Swe |
mATKcFXWFJSQ2joM7szPeR | RBI Bakeoff | NO | The agent escalated to a human team member and did not direct the customer to pull forward or the next window. | 1x Classic Wrap Regular Combo (Chilled Mango Cane Sweee |
keSy3A89wUNBFZnCb6DvHC | RBI Bakeoff | NO | Agent failed to read back order and escalated to a human team member for assistance. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, S |
RXzR5GTkX6cRhrHWxXUpJ8 | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent escalated the order to an employee instead of directing the customer to the next window after capturing the full order. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
8WytQco6XtFB8useKCVkGu | RBI Bakeoff 2026-07-24 | no transcript | — | |
6GRkxCsPo8bo9M9uVo695L | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EUtW5hmYws5xUZktektjxm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Fe8EySMbXPHCGGkVUegiuY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MtzvsRWWnzaYnnw26WaUe8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RVJptKQX63Ek8mYX39Y8qV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SbHQ9A3pCmt3xB9AJYzurj | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VNfpGHufn6AECTa9sU353x | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aEnXwBJQeBRXEiCRk9QvXC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aUckamoiH8JUffn2hgsKzx | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bLLNKqyE2heGaFdREdGonB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7GpKgCTh4FGMyT7cX7ZqiE | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript does not show the agent taking the order or directing the customer forward as no agent responses are present. | empty |
Zxx7HiAWhzKa4oxW5ytrE8 | Simulation Run 2026-08-18 22:27 | no transcript | — | |
Apo7rRzM2mnJ8cNcFgxnqw | Simulation Run 2026-08-18 22:29 | no transcript | — | |
CBPfrKQSGzWAnE3aAQvSu5 | Test new prompt (Aug) | no transcript | — | |
Lvnt8D9nDSBsdXVw5DeYrw | Test new prompt (Aug) | no transcript | — | |
dKmnFeprnaeCpUmv6hG3Jd | Test new prompt (Aug) | no transcript | — | |
hcY3rETRGAHzZccjbQNuNt | Test new prompt (Aug) | no transcript | — | |
jRqunR9NZRvcH2hqEeGT6d | Test new prompt (Aug) | no transcript | — | |
jrt8ZRQX7MfyS5itthZqsr | Simulation Run 2026-08-17 01:45 | YES | The agent captured the full order and directed the customer to pull forward without escalating. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
UVZz5YrGdSYyX6EehjLjRD | Simulation Run 2026-08-18 22:13 | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x Wraps Bundle (Classic Wrap, Blackened Ranch Wrap, Fr |
I'll do the 12-piece family meal with all dark meat, spicy, Cajun fries and cole slaw, and two Sprites.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
d38JwXfGV8m4eSCeGYg7ej | RBI Bakeoff 2026-07-23 | NO | Agent handed off the order to an employee without completing the order or directing to next window. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
Yjix2w235JdGhEzKJYqozh | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent did not complete the order and escalated to a human team member for assistance. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
eVoZJ2k3ADn6gJUVH9jnFr | RBI Bakeoff 2026-07-24 | NO | Agent acknowledged the order but repeatedly stated 'An employee will assist you' without completing or directing to next window. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
RzEBqkUfeDztAQvbw4BFau | RBI Bakeoff | NO | The agent escalated to a human team member instead of completing the order and sending the customer forward. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
NWCrzEHgKjCGMAdjyjPZwN | RBI Bakeoff | NO | Agent escalated the conversation to a human employee instead of directing customer forward after full order. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
3EpWjrBh2776hkqoaueN6b | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent failed to read back the full order and escalated to a human employee to assist the customer. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
iWVJV74GXtMbbaSPKx9gCA | RBI Bakeoff 2026-07-24 | no transcript | — | |
7StUTEpM6PJtNj56x9apLM | RBI Bakeoff | no transcript | — | |
6AxyGe4NVqLShWdLLYGB99 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AinrmkWzS3owv9Ho2g3HJh | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YWQdnbJgPzpkNeh3GiZCXQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Yixtjd2JWkMaditFTfSn6J | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ctzMUq5Eou5tQe83pYNXwo | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript lacks completion; no indication the order was confirmed or customer directed forward. | empty |
dPjL7JCJCnaXJNoPNLiGWE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dfmuxEP6nTaiDvuTEUM6eK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
imDRjiHF9GFAPhBDTACV6C | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kSNnKWoDFQ32sXTPErwinc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nHiTk5pfEGryiJmrtBApKU | Simulation Run 2026-08-16 21:10 | no transcript | — | |
L4w6ee3McNoEKEaPsf8sB6 | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript is incomplete and does not show order completion or customer direction. | empty |
KSFkhsos5FH9eSYMwtpW8b | Simulation Run 2026-08-18 22:27 | no transcript | — | |
BUEs9HxmRqq8x6a5CXnmVR | Simulation Run 2026-08-18 22:29 | no transcript | — | |
89x79iuvucSrGsTweR3AUL | Test new prompt (Aug) | no transcript | — | |
8rykgcd7uRpRPWBYkjZFLR | Test new prompt (Aug) | no transcript | — | |
BaKAGVgUExgfmGqcFLxK9n | Test new prompt (Aug) | no transcript | — | |
GLSxAUvLLF5bFTr7JQm3D7 | Test new prompt (Aug) | no transcript | — | |
GwGS2E5oR98WjFXDGuKUjg | Test new prompt (Aug) | no transcript | — | |
XPXoN9aqdGQiscFr2JpxsW | Simulation Run 2026-08-17 01:45 | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Large Cajun |
P2LgtgPtWtgfcAqQuuEJrr | Simulation Run 2026-08-18 22:13 | YES | The agent fully captured the customer's order and directed them to pull forward without escalating. | 1x 12 Piece Signature Chicken Family Meal (Spicy, Dark |
I'll take the 3-piece chicken combo, spicy, add a pie - make it the strawberry - and a premium strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
oRuGKRzL7fpp7SSTKeiGTv | RBI Bakeoff 2026-07-23 | NO | The agent escalated to a human team member instead of directing the customer to pull forward after taking the full order. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
4qoqeRvqXxvXaXfaGYu72w | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human employee to verify the order instead of completing it themself. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
Vcfuk2qGAUPkfzBVr7rzhM | RBI Bakeoff 2026-07-24 | NO | The agent said 'An employee will assist you,' indicating escalation to a human team member. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Cajun |
H6CEFryaPHpnMgBci2cCUS | RBI Bakeoff | NO | Agent repeatedly stated an employee would assist, indicating escalation to a human team member. | 1x 3 Piece Chicken Tenders Large Combo (Spicy, Cajun Fr |
KTnXSSmhHgm2FBn5RWda9b | RBI Bakeoff | NO | The agent escalated the conversation to a human team member instead of directing the customer to pull forward. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
Ec2mvkEkd3V9qyv6EnBC4u | Simulation Run 2026-07-20 22:35 (scratch) | NO | Agent escalated to a human team member instead of directing customer forward after order was taken. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
D3EiwTEGyFFvQK4wNxZBTS | RBI Bakeoff 2026-07-24 | no transcript | — | |
3nGpq7seU3SnUfU8BVyKuD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
H8qmoqQ3Qn3YJzYMevKa45 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RkXBVz57VExXbZUvbLCNbS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Xkm2idjXkXFTy4zLMG7RVG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cT8Vrq3kGf8JTx7UFjaX7A | Simulation Run 2026-08-16 21:10 | no transcript | — | |
foMEgA7HWEi8V8YjyujztC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hxk9fRDrsmgxLco83L9qbq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iBGKwkhix2jn5HSiYN5kj4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iKZnyxgbu54w5dK3M3PfTN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jatSbArZz2pFPaEGZBxSda | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nDmnVpQxp2vcBDXTGtgr2U | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not contain the agent taking the full order or directing the customer to pull forward/next window. | empty |
STG5xvdPFiJQisJ9s9ApoU | Simulation Run 2026-08-18 22:27 | no transcript | — | |
XrfKVueKzXArXA9pnPfdbe | Simulation Run 2026-08-18 22:29 | no transcript | — | |
73URs6udvpqELx4YvRitTn | Test new prompt (Aug) | no transcript | — | |
Pi4XK7Qcxzr3yGFnTvMN5h | Test new prompt (Aug) | no transcript | — | |
XGaQzTaykxsMsv57fHQsLQ | Test new prompt (Aug) | no transcript | — | |
YUr724xhmhq3UQnSrjtuUd | Test new prompt (Aug) | no transcript | — | |
mY5Sx77p94jPYgXxbis4ju | Test new prompt (Aug) | no transcript | — | |
a42kcRBAsqECrHCvWgsR3B | Simulation Run 2026-08-17 01:45 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Regular Combo (Cajun Fries |
hHJQ3Jpt2KFNHm9JDHBaA5 | Simulation Run 2026-08-18 22:13 | YES | The agent captured the full order, confirmed it multiple times, and directed the customer to pull forward without escalation. | 1x Strawberry Cream Cheese Pie; 1x 3 Piece Signature Ch |
Can I get the Ghost Pepper Sandwich combo? Actually, change that to the regular chicken sandwich. And make it spicy.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
HWp5Z9uf3TVrycno7xTDZc | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human team member instead of directing the customer forward after order capture. | 1x Classic Chicken Sandwich Regular Combo (Sprite, Caju |
nS7mcFHExuLw5NgQg9RGPt | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated the order to a human by stating 'An employee will assist you'. | 1x Classic Chicken Sandwich Regular Combo (Cajun Fries, |
ioabvvTQRYLMJ6NDqhFuFk | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human by stating an employee will assist multiple times, not directing to next window. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
ZfKNoYJYMZtMeV5w4n7zPe | RBI Bakeoff | NO | The agent escalated to a human by stating an employee will assist the customer. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
k9mqx7ZKBVkgV8qZzArXLx | RBI Bakeoff | NO | Agent escalated to a human employee for order verification instead of directing customer forward. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
CLAK7gg5BC88vwXvdasykw | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent escalated to a human team member by stating 'An employee will assist you.' | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
FuVCMszxLLikoWVbJ32tbm | RBI Bakeoff 2026-07-24 | no transcript | — | |
Hy3y56UqwtXEG2AHT5oReV | RBI Bakeoff | no transcript | — | |
52VAZTPN5AoEwju3KaEvwY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
6mjirk8JuSA7MbPRhzTSMs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8H3HAFadPZefycLKzjYZRS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HYCzYszLNd5cbMpa8fVrHp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HduQUwytU4GSCQbgjebwCQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LuNFarAfQzPdqJP9XGXn3h | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LyphkKNVNXYL2mTzoJyYHt | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QBjGroueQ6Z6sGTXHuDZUN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SWnR4DiQ8RaDGA5uS2HVnX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hHkLg73BFzXvXfFxeqUUYM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NJr7V49UWSbkQdS3DAg7Le | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the order being fully captured or directing the customer to pull forward or next window. | empty |
DmnrQb47CwsQFVhTcMjCEu | Simulation Run 2026-08-18 22:27 | no transcript | — | |
jTxPTZG5M58pjG9qbiwMeA | Simulation Run 2026-08-18 22:29 | no transcript | — | |
8PSKiN3TCbPbNSvzXR3hEM | Test new prompt (Aug) | no transcript | — | |
SSCfPkFr4sJddFAuRie2LT | Test new prompt (Aug) | no transcript | — | |
a9aZFCbBUbuVwJcaPysddv | Test new prompt (Aug) | no transcript | — | |
ahKPF8X3FtZ3je2XBVRwRj | Test new prompt (Aug) | no transcript | — | |
diYeUJqwGsAa3wysRXvQFF | Test new prompt (Aug) | no transcript | — | |
DwWAHneoXV5ZcaQKjQZiFP | Simulation Run 2026-08-17 01:45 | YES | Agent took full order, confirmed it, and instructed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, F |
YbWy56ctLgQKSMUYDKzs2f | Simulation Run 2026-08-18 22:13 | YES | Agent took full order, confirmed it with customer, and directed to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, M |
Do you have nuggets?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
nwGvD3EduoTJb7ZjnvKYrC | RBI Bakeoff 2026-07-23 | NO | The agent escalated to a human and did not complete the order fully by themselves. | 1x 3 Piece Chicken Tenders Regular Combo (Buttermilk Ra |
GLviFybjdbEqXkTg2p2LyC | RBI Bakeoff 2026-07-24 | NO | The agent escalated to a human employee after the customer requested order confirmation. | 1x Blackened Ranch Sauce |
ToRACtz5RohZUNmaJTP4gn | RBI Bakeoff | NO | Agent states 'I can help at the window. Employee will assist you,' indicating a handoff to a human team member. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened Ran |
UVwUpUu2GC6QXwEiJEXLPS | RBI Bakeoff | NO | Agent completed order but escalated by saying 'An employee will assist you,' not directing customer to pull forward or next window. | 1x 3 Piece Chicken Tenders Large Combo (Buttermilk Ranc |
EPBxn4wouWkdhJCHBGbDsb | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent escalated to a human team member instead of directing to next window after full order capture. | 1x 5 Piece Chicken Tenders Large Combo (Spicy, Cajun Fr |
EwjCrBtLcVzM2kDo4Xm7ue | Simulation Run 2026-08-17 01:45 | NO | The agent never directed the customer to pull forward or the next window and did not complete the order without escalation; order read-back requested. | 1x 5 Piece Chicken Tenders Large Combo (Spicy, Buttermi |
fqTi6zexLAw8qv7yWtwxex | RBI Bakeoff 2026-07-24 | no transcript | — | |
9Gn5G2mbFYxGf9yBKaKS9b | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9m82QP3qUDeGffUrTbwLpo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JbZmKCbvgjxPU3DvTWruKb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KUpHeM7uDk83fsXQvCCSvV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
L9yoo4XVkRixhRLU4q3JuE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WoWA5WAQcKSpMjXod33TPc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bDJevZKz3NNR79gBabpQSn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fzBdKkSTiuQyL9XeZKU8Gv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kTnHsqsbR2Rd8rAwYNFJyD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
myqjrj8mUDQRKpsv4xzASc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bL2KtoZviaxJjPt5Wmf37H | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show any order being taken or the customer directed forward, nor any escalation. | empty |
75BnaaaeeR3gKZUY84xLQH | Simulation Run 2026-08-18 22:27 | no transcript | — | |
HSTaePEZWjPVCkrsTAbc9k | Simulation Run 2026-08-18 22:29 | no transcript | — | |
2hPK8fECCAqmmG42bwLHUh | Test new prompt (Aug) | no transcript | — | |
CXnrUEFqJEsBC8r2KbLPfo | Test new prompt (Aug) | no transcript | — | |
EMAxGeccgEov9TuwYUmFBk | Test new prompt (Aug) | no transcript | — | |
MWkPFH5tkcedUfqjJ3PgRw | Test new prompt (Aug) | no transcript | — | |
X5oUhsZ3a3eRSSm8SkU7mf | Test new prompt (Aug) | no transcript | — | |
DKBeLmmWaygnoJSNRtxPq3 | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent took full order, confirmed accuracy, and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Spicy, Blackened Ranch, Swe |
W8RBCc6FfRwVEqp7YnewMT | Simulation Run 2026-08-18 22:13 | YES | The agent fully captured the detailed order and directed the customer to pull forward without escalating or handing off. | 1x 5 Piece Chicken Tenders Large Combo (Spicy, Blackene |
I'd like the 5-piece tenders combo, blackened and spicy, with cole slaw and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
GDdscBKN8GGRAgoBL33EAt | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human team member instead of completing and sending the customer forward. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
KeKzCMmU5amUMFuadNnJf8 | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human team member instead of directing the customer to the next window. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
nqY9PGpmHuA8GpnsDCW2mk | RBI Bakeoff 2026-07-24 | NO | The agent escalated to a human by stating an employee will assist and did not complete the order by reading it back or directing to the next window. | 1x 5 Piece Chicken Tenders Large Combo (Blackened, Spic |
ES4AbgQErFhtU4jaUSqjnw | RBI Bakeoff | NO | The agent did not complete the order by directing the customer to pull forward; instead, they escalated to a human team member. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
jPRbyGcw8gQt8skjXT6aDv | RBI Bakeoff | NO | Agent said 'An employee will assist you,' indicating escalation to a human team member. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
Y2bYP2byJv6aNcuZAjpK2x | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent escalated to a human by stating 'An employee will assist you,' failing to complete the order fully by itself. | 1x 5 Piece Chicken Tenders Regular Combo (Spicy, Colesl |
kzbo4VdE4cWZ5VLCYRUuVx | RBI Bakeoff 2026-07-24 | no transcript | — | |
5eFXzqGFQfaKKUUX679tUH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8gK74MhLJsWobxRoYJBSzn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GbN5zbrYoA2HBjt9ziKkhg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JcRwGyBbjQ6L6YYCQLPzmg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QEzxqgQVkBjUdm8u2dPvV9 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZskAyY8ei9dGpoWEQM4uTk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aMBS66uW7F9JPb3gqVn2r7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
f6VerNfUFDUomTMibsQLdP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fLDZ9KYB4oRwEr8xPibqMF | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hSq9cqBuQ5R3pkg2EmYJRv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iEHyy3yWCLgDQEj5Mid9DM | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent completing the order or directing the customer to pull forward or the next window. | empty |
K8pDskBASEmJQcCa7v4gwK | Simulation Run 2026-08-18 22:27 | no transcript | — | |
LsUCaJ48PMmW5agTAfCLoZ | Simulation Run 2026-08-18 22:29 | unjudged | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co | |
QSVqHffsMg9yBLaAqqVkPY | Test new prompt (Aug) | no transcript | — | |
T4EnSveyH6HKdJG6xWbFwu | Test new prompt (Aug) | no transcript | — | |
YiR8pySQrmfiRvMrW4PcLX | Test new prompt (Aug) | no transcript | — | |
aTVoGZX67z5hNTb7jkers5 | Test new prompt (Aug) | no transcript | — | |
kmWAsFVJEyjnXPYvyp339X | Test new prompt (Aug) | no transcript | — | |
LmSJeS4McBiQu6HTL23u4L | Simulation Run 2026-08-17 01:45 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
fHei3vDSJkPtBLRkxJiB5K | Simulation Run 2026-08-18 22:13 | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
One bacon and cheese sandwich combo, large, with fries and strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
XgLnW2UXfUEZfSVc4rgiiV | RBI Bakeoff 2026-07-23 | NO | Agent failed to complete order by reading back and escalated to a human for verification. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
6uAFrjmVpsJTtE4xgyWtAt | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human team member to assist the customer. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
SE5RMKsnTaikxh9LZRx8tx | RBI Bakeoff 2026-07-24 | NO | Agent confirmed the order but ultimately escalated to a human team member for assistance. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
arHoPtSc6LjtGJFM7pN5FP | RBI Bakeoff | NO | The agent handed off the order verification to an employee and did not complete the order themselves. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
FqH3qVKCzFJPCH4BfZ3mJa | RBI Bakeoff | NO | Agent did not direct the customer to pull forward or the next window after capturing the order. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
LU9oMb6vCre8kGo25z9gfQ | Simulation Run 2026-07-20 22:35 (scratch) | NO | Agent did not direct the customer to pull forward; handed off to a human instead. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
7xUt84iigH3KpyhWjYLQyx | RBI Bakeoff 2026-07-24 | no transcript | — | |
QnMj39LHr65qrS3LjQrHxv | RBI Bakeoff | no transcript | — | |
4ZPmUSkkwMaVU5nkM43yJ6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CqyGpfRV8cGok7SWxi3sDA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EkAQ39RuZpsGsdBxVyjT7p | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MMwLgCX7eySVETuEEsAPua | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PfZEoVvfr68pbiFSBrJier | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VvgzqWRqQN3qjDiGHV3XZ4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aTpEY8AVmCJePa2Q4fXBLR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gTUoSmzfPUDmhctXow79Jk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kNW9DDoZARA7B6vtHZjKGz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mjMHDpdviCthBn8damKsTW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QXEdBiUMgXCBETr5LyUCDX | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript only shows the customer order; no agent interaction or direction given. | empty |
4YHnd8TtSFmVna9a8KizGB | Simulation Run 2026-08-18 22:27 | no transcript | — | |
DcCGBurvju8XnJ8FHjbFLu | Simulation Run 2026-08-18 22:29 | no transcript | — | |
3kVehQHaMp6EdurbPhURWG | Test new prompt (Aug) | no transcript | — | |
EVvSW8S27ZFD9mWgKUeXhG | Test new prompt (Aug) | no transcript | — | |
HRXGAcfwWwzp7oTdNr4hkz | Test new prompt (Aug) | no transcript | — | |
dPhSm9jVHR2NnvA2rTJZZw | Test new prompt (Aug) | no transcript | — | |
gxrEj9hFDa8viH53PM3StX | Test new prompt (Aug) | no transcript | — | |
Sii7TSVypNnTvJNmjA53PN | Simulation Run 2026-08-17 01:45 | YES | The agent fully captured the order and directed the customer to pull forward to pay, without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
54TwFQDP3Gyk5iZiEQCsvp | Simulation Run 2026-08-18 22:13 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
Order five classic tenders by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose cole slaw and a Sprite.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
Yuxnqthq92An6aRD7qDZi9 | RBI Bakeoff 2026-07-23 | NO | The agent handed off to a human team member instead of directing the customer forward after taking the order. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, S |
FCsSvzxhUjbH8NE9aUf6PA | RBI Bakeoff 2026-07-24 | NO | The agent captured the order but repeatedly escalated to a human and did not complete the order or direct the customer forward. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, B |
fR3UFvDYs5cu58qKVXo5Dz | RBI Bakeoff | NO | Agent escalated to a human team member instead of directing customer forward after capturing order. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, B |
GM669tmg5Yb3GjGj4BFJoZ | RBI Bakeoff | NO | The agent did not direct the customer to pull forward; instead, they said 'An employee will help confirm your order,' indicating escalation to a human. | 1x 5 Piece Chicken Tenders Regular Combo (Classic, Cole |
FTyhXQuvs8NaSroBM9xt8V | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent escalated the order to a human team member and did not complete or direct the customer forward. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, B |
cqxDD3CFCKkGgh2vxrGYEY | RBI Bakeoff 2026-07-24 | no transcript | — | |
BhJncZpRDBmc94UU5E2fFs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EyRso8TRCiXyqFb7pGWcog | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Gi8ZVF3ryyufPodTDS9gUt | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HBiyMboHsG9mPFPWUVvECo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HgAfRhpL62j9MLmsGPiE5B | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PrLobrSHKAzUQAiwpLrwev | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PzLDUjbAX8Wp9Vg5HkviVp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
W6eu35o5GB7cfe4TwtQujq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
b9p9jFwqcZZmwTPoJV2Pkj | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eh26YGysgV3g2m4Yf38wcs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
A5sfN5D6oxqpeR2pUbGgSM | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript does not show the agent completing the order or directing customer to pull forward. | empty |
B4jaxNfAFpL6kkkTEgB3cc | Simulation Run 2026-08-18 22:27 | no transcript | — | |
HBtHFT7jemamwPTYT3cn4X | Simulation Run 2026-08-18 22:29 | no transcript | — | |
B5Zhv8svctNK2hNEqTPs4v | Test new prompt (Aug) | no transcript | — | |
CcxUsK7ZKAjv6Qf8icYnxx | Test new prompt (Aug) | no transcript | — | |
KtHKKqrojxHTPN6roh7i4P | Test new prompt (Aug) | no transcript | — | |
WNuFNsxZAibgvUgqS4cnXJ | Test new prompt (Aug) | no transcript | — | |
oBNz7Emo6dh863wJmo6Y66 | Test new prompt (Aug) | no transcript | — | |
B8pAiaozxttr9kKre6fiF5 | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Classic, Colesl |
hoWe4m3e8vzu96Lf4ajZBo | Simulation Run 2026-08-17 01:45 | YES | Agent fully captured order and told customer to pull forward without escalating. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, S |
YZcvxtW4teRfiEeQTAopyU | Simulation Run 2026-08-18 22:13 | YES | Agent took full order, confirmed it with customer, and directed to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, B |
I'll do the chicken sandwich by itself and a side of fries.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
Qq8tZc6eRtDyuztZnTVXSn | RBI Bakeoff 2026-07-23 | NO | The agent did not direct the customer to pull forward or the next window and escalated to a human by stating an employee will assist them. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
L4GyZJj6ZjLeJxsim2cpV9 | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to an employee assisting the customer in person, not directing to next window. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
AfMPfPAxKpZfLmPK2mVHzL | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human employee instead of completing the order and directing customer forward. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
ZkrjYEE4TGcxihZfidJbqg | RBI Bakeoff | NO | The agent confirmed the full order but escalated to a human employee instead of directing the customer to the next window. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
aefxgEeVHzzRAjZSfmqSCu | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent handed off the order to an employee instead of directing the customer to pull forward. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
WNL2a7eSFHQez8CSLPiTKu | RBI Bakeoff 2026-07-24 | no transcript | — | |
FHSSEYDKguFX7PUQEXcM4F | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LyMcoZQVqFV2fqtaSwceCg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PujUkk9qhQfYpdvhqGkzGb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
R6QdkqohcSSWhqX33jbipu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WMGLpfW7puxfZZpbmWARLY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XsK23ZVwXYQNARrS5chuSP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YnYDSyiup5c5SrodFmJe7p | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jj8CgHp9HYayEPvxknNFDZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kMv2sKJt2BSmoUDniLq9qD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ktapQ6S6LpDv7KmqPsU6fu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UG3V7hHjsRDSC7JaXJD7Su | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show if the agent took the full order or directed the customer forward without escalation. | empty |
WNrnvcwuJ7t7Hdji2kPtWd | Simulation Run 2026-08-18 22:27 | no transcript | — | |
P8C8LLPy3fvehDa9JysUqk | Simulation Run 2026-08-18 22:29 | no transcript | — | |
FW2R92NWxHmZDeh27dY4ZX | Test new prompt (Aug) | no transcript | — | |
PYpBPXCE6rRiRYPjUStpnw | Test new prompt (Aug) | no transcript | — | |
e7eZeCaeGoCNRZjQG8mLqL | Test new prompt (Aug) | no transcript | — | |
mmXtLjYAd758A5JvpyREZQ | Test new prompt (Aug) | no transcript | — | |
oQ6NqVo2xLBz5BoczktsjS | Test new prompt (Aug) | no transcript | — | |
AbbdC3X3FTVkrJvwSbjvDg | RBI Bakeoff | YES | The agent fully captured the order, confirmed it, and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
8nYYbf43kYd7wX6DduCDLR | Simulation Run 2026-08-17 01:45 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x Cajun Fries; 1x Spicy Chicken Sandwich; 1x Buttermil |
9gH3SdDvnwNqcDpGK68h4b | Simulation Run 2026-08-18 22:13 | YES | Agent fully captured the order and directed customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
Can I have a Cajun Rice please?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
cUxzVrmoXHDaKHzpe78iPr | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human by saying 'An employee will assist you' after order was taken. | 1x Red Beans & Rice; 1x Chilled Apple Cranberry Cane Sw |
5fcyfbcdGdE9F9j46pEUCX | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent confirmed order but said 'An employee will assist you,' indicating escalation to a human. | 1x Red Beans & Rice |
WokERmgWVuSkgfXEKb7qxZ | RBI Bakeoff | NO | Agent escalated by stating 'An employee will assist you' instead of completing the order and directing customer to next window. | 1x Red Beans & Rice; 1x Bottled Water |
Kvrczp74hr5BwtEUHT68N8 | RBI Bakeoff | NO | Agent escalated to a human employee to verify the order and assist the customer. | 1x Red Beans & Rice |
FWqaWFgptv7zmAa8uknYoE | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent escalated the interaction by saying 'An employee will assist you,' indicating a handoff to a human team member. | 1x Red Beans & Rice |
TeQZL7tFNrYdCVZceXrQKA | RBI Bakeoff 2026-07-24 | no transcript | — | |
VWgyRuuirTxwy9xaaqtNCt | RBI Bakeoff | no transcript | — | |
92fLAX7mgtdR9XYkJBhQe5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BQcBeWg632dBP79AXZXXPq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JWmEodJG4ePkgeozxQZGry | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VYJDN5VGsbtTBh2mFurRmp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Wyu2EY497cXjXxSuQoWtMm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XzG5Zty2xiG34NAEsspysm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cpSQ89BumVbdaL4rTdePyZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
g6DUcGe5Qv8C9h4G5iTggC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gjATqzLk4CogRYYgWBFWm3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
oHHoKPLPizJ4UP7Au6Efnb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CLhjNdhWDF8HQfVGXUAhpJ | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not provide enough information to determine if the order was fully taken or if the customer was sent forward. | empty |
VaGBzcVVEvMXCsYcYGpC2L | Simulation Run 2026-08-18 22:27 | no transcript | — | |
LQHMQLuktGvwGyWZH4rn7i | Simulation Run 2026-08-18 22:29 | no transcript | — | |
4WE55XwrxMFkkc7Vz5h4AL | Test new prompt (Aug) | no transcript | — | |
B6ZDrqUPhBNHDRxNZB5KDJ | Test new prompt (Aug) | no transcript | — | |
Chmz7PcbsHNP8yswmNrCfp | Test new prompt (Aug) | no transcript | — | |
LbVWPkGh835rHxxV49Y4of | Test new prompt (Aug) | no transcript | — | |
N3v4djNjb65btfaCeEGL58 | Test new prompt (Aug) | no transcript | — | |
5VsT66PxKJr4ipeXrY6viw | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order for regular red beans and rice and directed the customer to pull forward to the window without escalation. | 1x Red Beans & Rice |
YSDASQX9hcyeXWyHzsAxpv | Simulation Run 2026-08-17 01:45 | YES | Agent took full order (one large red beans and rice) and directed customer to pull forward without escalation. | 1x Red Beans & Rice |
Gtp8nnWnrTt3KFYLGnHvem | Simulation Run 2026-08-18 22:13 | YES | The agent took the full order of one regular red beans and rice and directed the customer to pull forward without escalation. | 1x Red Beans & Rice |
One Ghost Pepper Sandwich, no combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
CjvFS7wBFgM3xmgNxJm3V6 | RBI Bakeoff 2026-07-23 | NO | The agent handed off the order to an employee instead of directing the customer to pull forward. | 1x Spicy Chicken Sandwich |
h8zgnCK3dM97RusuBrWhdF | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent escalated to a human team member for order verification instead of directing the customer to the next window. | 1x Spicy Chicken Sandwich |
jTR228Lcah4bspPLWu5GXQ | RBI Bakeoff | NO | The agent repeatedly deferred to an employee for assistance and did not take the full order or direct the customer forward. | empty |
4STd2TwmSrDXXvQBLsUt69 | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent escalated by saying 'An employee will assist you' instead of directing to next window. | 1x Spicy Chicken Sandwich |
cryWt96hTAEoFBXLXEGJoR | Simulation Run 2026-08-17 01:07 | NO | Agent confirmed the order but did not direct the customer to pull forward or next window in the transcript. | 1x Spicy Chicken Sandwich |
gmMFQYycZq79iwdAT2Gm36 | RBI Bakeoff 2026-07-24 | no transcript | — | |
95vTCRH66ojjvwXKkAhQtb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
B7nhHEtYMf8sJdygZQoLzr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Dagefwwgw6AVrcKNfrmeVh | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KLEagiTK4FCwoTTD3pcB8C | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KsMaU8gCRSW9p25JPWf2eS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Mr56vAXo8ECGQG8DvCP7ZH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NeSh2bXyyU7qfHCsxXX4hP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PGX2VzAhsV3r5KRaMZfPAk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UfautwYKnW7sEadkHm8Daa | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gZdEvdD54SRieC68AWBVcs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AJD44ginTnwpgLSjNUpDvi | Simulation Run 2026-08-18 22:27 | no transcript | — | |
YrYrAK3CbEPnwQ9sFUvv6Z | Simulation Run 2026-08-18 22:29 | unjudged | 1x Spicy Chicken Sandwich | |
9f3MJjnYC8aVuFzBgE7vpx | Test new prompt (Aug) | no transcript | — | |
MKaMxaixv3MDREKkoKtoSB | Test new prompt (Aug) | no transcript | — | |
QFHrKCGYWzcTWytv22DHQm | Test new prompt (Aug) | no transcript | — | |
d7SETWaVGTktEwjgnMESk9 | Test new prompt (Aug) | no transcript | — | |
jjq3kEMvExLaAVprymrqW6 | Test new prompt (Aug) | no transcript | — | |
cJrNNWTcXvw2wNPCjhLf3B | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x Spicy Chicken Sandwich |
5tw9jhnH7xHPX3P8xsougq | RBI Bakeoff | YES | Agent fully captured the order for a spicy chicken sandwich and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
nYkFLDQBovw6PCDz3vhXyR | Simulation Run 2026-08-17 01:45 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
dTby9yTChm4i36YGQUQzco | Simulation Run 2026-08-18 22:13 | YES | The agent took the full order (one spicy chicken sandwich) and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
I'd like the 3-piece signature chicken combo, spicy. I don't want fries. What other sides do you have?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
ADJAea7YnVHnv2oHsuGmm8 | RBI Bakeoff 2026-07-23 | NO | The agent escalated to a human by saying an employee will assist you after order confirmation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
6mVEWpDDnpM8KL5yk6NWLJ | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to an employee instead of completing order and directing customer forward. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
LoxJ2uUjKXdLmZy4dKDPJZ | RBI Bakeoff | NO | The agent escalated to a human by saying 'An employee will assist you.' | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
dDaBqKVWpWhxjg4wuYsLt6 | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent did not confirm the full order by reading it back and escalated to a human team member for assistance. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
j4ik46wcfJ5E3Jn36LeaxR | RBI Bakeoff 2026-07-24 | no transcript | — | |
5ec9D29zKwNFNiXRYmVJUZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
5v3hYcjYYchS4PHzSfrxYp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Hf9iP4EQ6KG7V8RevSyK4o | Simulation Run 2026-08-16 21:10 | no transcript | — | |
K3t3YeSnFB7by4amoPUJ2x | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Qp66n7SU9TmJTSanAZwuhy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VAD5jd6nnr87vMFNsnftH3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YJ7BW3vyNSHwEmNLqsdovP | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent fully capturing the order or directing the customer to pull forward/the next window. | empty |
gPFsxc6BWoc7VdZRgSdncD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kwXAtECMxN7qRdoTuARdwD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
muB4bmyMEA9p8d4Qo3o22i | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jB3hvGpcPDnVti5a8cwNyb | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript only shows the customer asking about sides and order details; the agent's response or direction is not present. | empty |
Q8cwNR2DLXnoEXdhwJPtbK | Simulation Run 2026-08-18 22:27 | no transcript | — | |
fUXFdBQq86hiReiyxWB38r | Simulation Run 2026-08-18 22:29 | no transcript | — | |
D5S3pFCmyui6mKrLJ6YK26 | Test new prompt (Aug) | no transcript | — | |
DNYY6Su4y4MmEa6TZ8BoQT | Test new prompt (Aug) | no transcript | — | |
Lt33cSBCAsVgVdL57XpYAa | Test new prompt (Aug) | no transcript | — | |
MsfEsyhnsmKoeCsnzWuBxG | Test new prompt (Aug) | no transcript | — | |
Y4t9Ezg7pK5qC2ojL39Tjw | Test new prompt (Aug) | no transcript | — | |
ibUgeAoGBTcrZ4uhwwjGxb | RBI Bakeoff 2026-07-24 | YES | The agent took the full order including sides and drink, confirmed it, and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
cWvSe6PHzLnKstf2M9p4zy | RBI Bakeoff | YES | Agent took full order including combo, side, and drink, then directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
2G3NxXghnF4WdPXmY99crc | Simulation Run 2026-08-17 01:45 | YES | Agent fully captured the order and directed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Red |
jcUkqETZvgm7J4rkPi8TEm | Simulation Run 2026-08-18 22:13 | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Cajun Fries |
Order one classic chicken sandwich by itself. Do not ask for a combo. If the agent offers to make it a combo, accept and choose Cajun fries and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
V6hq4NdxWXGRJ5fdMQsKz2 | RBI Bakeoff 2026-07-23 | NO | The agent escalated to a human by saying 'An employee will assist you.' | 1x Classic Chicken Sandwich |
ehMiTJQScTek2aCa8dnWxi | RBI Bakeoff | NO | The agent escalated to a human team member instead of completing the order and directing the customer forward. | 1x Classic Chicken Sandwich |
aNEcZgFv6ECc9SBTEBPpue | RBI Bakeoff | NO | The agent escalated to a human team member multiple times instead of completing the order and directing the customer forward. | 1x Classic Chicken Sandwich |
PfebyCnuBXPugAVDrG4fdC | Simulation Run 2026-08-17 01:45 | NO | The customer was not at the drive-thru and was not properly directed to pull forward without escalation or handoff. | 1x Classic Chicken Sandwich |
WA57gZZLiPfyRtE3hVNEn7 | RBI Bakeoff 2026-07-24 | no transcript | — | |
2SMUQas5dHNWozEpWE5aXc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4GCxj9vfJUFWv7HySPeFJs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7M5pWEw7NQau5oP4fWpDSg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Evhh2C5t9aJfdX4226VaRv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GryN6sBrSHGmWXQQQG5P4U | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Zr5aGee6XvM7hFe4ELErfa | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cH43HLyd3DhUtDsHnBbDDW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iZ8S6cHiV3gqrfEN8EcXer | Simulation Run 2026-08-16 21:10 | no transcript | — | |
koWX6BjFGtG5ovER7uH4kZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nTJG2jkS7Xtwti3z5YqdWe | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bZfLaHm8Ai3ENejHjoqoVZ | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript contains only greetings without any order or directing the customer forward. | empty |
LcGQfdYskSRUvb4Loc8JSD | Simulation Run 2026-08-18 22:27 | no transcript | — | |
J4arTFz9yGgpGxkVYEnNHx | Simulation Run 2026-08-18 22:29 | no transcript | — | |
GDoz87DstPC83ZHNKwhMzG | Test new prompt (Aug) | no transcript | — | |
MpDXtQksQvg5qcYKYEUQjn | Test new prompt (Aug) | no transcript | — | |
YBPmACn7FH9ssqTHNycz2i | Test new prompt (Aug) | no transcript | — | |
cg8GAA9cNoDj29jfBEwEo5 | Test new prompt (Aug) | no transcript | — | |
hfRsYKzNTcUKotjan2hEso | Test new prompt (Aug) | no transcript | — | |
SP5YaJTZmh86LUZCoHHX5v | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order (one classic chicken sandwich) and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
b5kYwDLp2uC3CQL68YLb4b | RBI Bakeoff 2026-07-24 | YES | Agent captured full order and directed customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
oABt4EHn82uLh4f8bCp43f | Simulation Run 2026-07-20 22:35 (scratch) | YES | Agent fully captured the order and directed the customer to pull forward without escalating to a human. | 1x Classic Chicken Sandwich |
3DXsqqwXGX5kYrQUCa7Aik | Simulation Run 2026-08-18 22:13 | YES | Agent captured the full order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
Order one regular bacon and cheese sandwich by itself. Do not ask for a combo or a large. If the agent first offers to make it a regular combo, accept with fries and a Coke, then accept a subsequent l
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
kvTzF8YZ4zsVTM6PwkFjRw | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human team member saying an employee will assist the customer. | 1x Classic Bacon & Cheese Chicken Sandwich |
6JnfFnqBvcaH6B8677qnJb | RBI Bakeoff | NO | The agent escalated the conversation to an employee multiple times instead of directing the customer forward. | 1x Bacon & Cheese Chicken Sandwich Dinner |
Ve9dW96wYTHsLEeHoW7h7N | RBI Bakeoff | NO | The agent escalated the conversation to a human by stating 'An employee will assist you.' | 1x Classic Bacon & Cheese Chicken Sandwich |
Tci8mrjUCaEz93gDFpELaz | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent escalated to a human team member to assist the customer instead of directing to the next window. | 1x Bacon & Cheese Chicken Sandwich Dinner |
ZuofybFD9N6A6sHai5pkJD | RBI Bakeoff 2026-07-24 | no transcript | — | |
VbDSFHAi3pg3t3iCoPPE3M | RBI Bakeoff | no transcript | — | |
Aqw6QFFHpEUz2gjRv7L6nr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
B4TdmBZj5XjV6sopcdQhwX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
B4WN3HghjzJUD6wxJFGqC7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Cjt4BkoNxUYDniEEMcNW4w | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Dt3QegTzHH3hEqmwxTTrxk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EySEJoPSB6RWEYaREu8gyW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NHm6eX9FLfG82EryHeXA39 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gsnS6itkERZPhcG536xeDN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iZosAt93Rj3WBZJx2saeXH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
o7q9zpbRJKaQwCGtEtEocQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kFCdfHztgvxECburdyXgT6 | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript ends with the customer confirming the order; no indication of sending the customer forward or escalation is present. | 1x Classic Bacon & Cheese Chicken Sandwich Regular Comb |
LedBJVoRnhpswqPgfqWBZv | Simulation Run 2026-08-18 22:27 | no transcript | — | |
Th8zWrnXq8U6kYrLbJw87B | Simulation Run 2026-08-18 22:29 | unjudged | 1x Classic Bacon & Cheese Chicken Sandwich | |
28VWBAt8rXgEeim3TQBe86 | Test new prompt (Aug) | no transcript | — | |
BqXWUfhJxXZtA6Tc5BoTmS | Test new prompt (Aug) | no transcript | — | |
EnknqMcvb3kVKrdVdUtMMo | Test new prompt (Aug) | no transcript | — | |
FvBw6vnTqm9PeKiGBppt3D | Test new prompt (Aug) | no transcript | — | |
YiXdsg8EmnNGLrfAvPsbtr | Test new prompt (Aug) | no transcript | — | |
Dg3BBZRck7m8mvr6tLVp8U | RBI Bakeoff 2026-07-23 | YES | Agent captured full order, confirmed it with customer, and directed to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
KnGqVrAC4ALZ9YFdCWWzEY | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent captured the full order and directed customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
cqXJvLG5jqu7bLYd97rMqJ | Simulation Run 2026-08-17 01:45 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
KDWr9vN2oUd3dSNhz5kng7 | Simulation Run 2026-08-18 22:13 | YES | The agent took the full order and directed the customer to pull forward without escalating or bailing. | 1x Classic Bacon & Cheese Chicken Sandwich |
Order three pieces of spicy signature chicken by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose mashed potatoes and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
k6kUM8L9g2r497JbTsn7zB | RBI Bakeoff 2026-07-23 | NO | Agent did not complete the full order or direct customer forward; escalated to human multiple times. | 1x 3 Piece Signature Chicken (Spicy) |
k5ohHLk6d2Xz6jCAMoWRLw | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent failed to complete the order and repeatedly escalated to a human team member for assistance. | 1x 3 Piece Signature Chicken (Spicy) |
bUHjUf55YWD4kVnFscnYBu | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human by saying 'An employee will assist you' instead of directing to the next window. | 1x 3 Piece Signature Chicken (Spicy) |
9a3rqyokoB6RVFUhEEtYWb | RBI Bakeoff | NO | Agent failed to read back the order and escalated to a human employee for assistance. | 1x 3 Piece Signature Chicken (Spicy) |
GrHVB3hdUUfLCPqcqHzSvu | RBI Bakeoff | NO | Agent does not send customer to pull forward or next window; no direction given after order confirmation. | 1x 3 Piece Signature Chicken (Spicy) |
D5LMwCHMEEBooTLMxkDGZh | RBI Bakeoff 2026-07-24 | no transcript | — | |
SRVUPWW5q2Y2GojCinUiN8 | RBI Bakeoff | no transcript | — | |
5ZK2NEwsN9ZMuyFsBSEL78 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8uqwHm5WbgqHmmBgNeA8wG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9ngYoLb4Tt4mH4kRfzTVvr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EmWPbw6PaqKer8YPjGySUv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GzUJddUWVp42o9xnhatnYa | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UYMCheZdkycyz73ufsabCJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
inrirtbTu2zB4BjJMRnEQ8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mKhJGs6mmiyyUc6dqtq7mn | Simulation Run 2026-08-18 22:27 | no transcript | — | |
dKk3qCJqG4BQhJNP9qq7Fi | Simulation Run 2026-08-18 22:29 | unjudged | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed | |
6VKNkZH3BMqWHe7ftXawJs | Test new prompt (Aug) | no transcript | — | |
6awa6feniKVSK2Bcf4PNWS | Test new prompt (Aug) | no transcript | — | |
LLCtDsFBVtAZfc3YpyDbz8 | Test new prompt (Aug) | no transcript | — | |
UJmSwj3txom7mmD6hJqW4P | Test new prompt (Aug) | no transcript | — | |
WUzj9khUQaUxt9odVGbAzY | Test new prompt (Aug) | no transcript | — | |
TDNMh5SYhwSjDZosSHbq2g | Simulation Run 2026-07-20 22:35 (scratch) | YES | Agent captured the full order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken (Spicy) |
As6gyq9Cfh8Cm5d4phagRd | Simulation Run 2026-08-16 21:10 | YES | Agent took the full order and sent customer forward without escalation or handoff. | 1x 3 Piece Signature Chicken (Spicy) |
E88C9dh9dwgHtvAu8hdSmN | Simulation Run 2026-08-16 21:10 | YES | Agent captured full order of three pieces spicy chicken and did not escalate or bail. | 1x 3 Piece Signature Chicken (Spicy) |
YKMsWuHCnNTEkXQ5YFKyq9 | Simulation Run 2026-08-16 21:10 | YES | The agent fully captured the order of three spicy signature chicken pieces and did not escalate; customer was directed forward. | 1x 3 Piece Signature Chicken (Spicy) |
Csuspe5RZGgvWo5jYW8tNr | Simulation Run 2026-08-17 01:07 | YES | The agent fully captured the customer's order, confirmed it, and directed them to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
HPwMt73A4sCUDD8oxUaXb4 | Simulation Run 2026-08-17 01:45 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
iCZd54Z4Kuo6DShRgE2UVW | Simulation Run 2026-08-18 22:13 | YES | The agent fully captured the order and directed the customer to pull forward without escalating or handing off. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
Start by ordering the 3-piece signature chicken combo, spicy, with mashed potatoes and a Coke. Before the order is finalized, change it to the 4-piece combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
fTNX6Sv3PcikQSoHDN5vXL | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human by saying "An employee will assist you." | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
JhEyShhUtuYrSVWDfjJ5qy | RBI Bakeoff 2026-07-24 | NO | Agent did not complete the order; escalated to a human team member for assistance. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
aTD2p3mZGJ9R7baxeGKa7r | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent escalated to a human team member multiple times and did not complete the order fully themselves. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
kM8wBoEP8JQjHXs3UdDK7g | RBI Bakeoff 2026-07-24 | no transcript | — | |
9durrETCYZC9YSZ2b6KeHS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AGhxYnAhCoWGbDoZfLSZEL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GXPT2DUj5kRd2gkbG9VLSV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HBZFP6KACiY5HX3CDXu9NG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LqzJUmN4g9peHNRhHoAAga | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MaNTG5CrAxUjpSzsjXKaei | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RPboDygu75CiEjEEf8jkTn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
TAs3xxW64i85pFq2wrTefP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
e5YoYndH9MAHGnWp6Y2YLz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hEpcrwVdJs7K4xLYR9kTXS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Lw3xcckjyR5uBfJwt9oZvX | Simulation Run 2026-08-18 22:27 | no transcript | — | |
6Qzj2CGm3RGxGLZ3rYrqKX | Simulation Run 2026-08-18 22:29 | unjudged | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash | |
E6ucz3ZVaDgY8PuWYe5na5 | Test new prompt (Aug) | no transcript | — | |
GwzpkXiooHrhhfhG4GZdwN | Test new prompt (Aug) | no transcript | — | |
LyhaNYdbw3AFtm93b7GBgV | Test new prompt (Aug) | no transcript | — | |
cKmaUVw9eJLxbsUbABMjq5 | Test new prompt (Aug) | no transcript | — | |
gy9vMMRJ6Q4rXUf94z3PQp | Test new prompt (Aug) | no transcript | — | |
9mL6oUZhW72ykLiqRX2TAT | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
AMmcrxH9UpiYhuowp2ijR4 | RBI Bakeoff | YES | Agent fully captured the order and directed customer to pull forward, without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
cYYnqx99XArY2ZTbyipdBR | RBI Bakeoff | YES | The agent fully captured the order and told the customer to pull forward without escalating. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
75CttkKyZVucvo68cLLG3r | Simulation Run 2026-08-17 01:07 | YES | The agent fully captured the customer's four-piece spicy chicken combo order with sides and told the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
W6J5uRDQ5R8XgVa4scbxUX | Simulation Run 2026-08-17 01:45 | YES | Agent captured the full order with all details and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
4LtnuZxdyeHBH54X8dTfCH | Simulation Run 2026-08-18 22:13 | YES | Agent took the full order and directed the customer to pull forward without escalating to a human. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |