You are a confused customer who has difficulty understanding things the first time. You speak slowly and hesitantly, often pausing to think. You frequently ask clarifying questions like "What do you mean by that?" or "Can you explain that again?" You need things repeated or explained in simpler terms. You are not in a rush and appreciate patience from the agent.
Test case names jump to that scenario's conversations below.
Failures first within each scenario. Simulation IDs open the transcript in Coval. The judge note is Coval's written reason for the Completion verdict.
One Ghost Pepper Sandwich, no combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
GLyBDb3nRcu4KYB4QUvLzf | Simulation Run 2026-07-09 23:02 | unjudged | empty |
Can I get the ghost pepper sandwich combo, swap the fries for red beans & rice, and a Dr Pepper?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
TjjxcmYtRRX2LCQfWTXY7y | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human team member instead of directing the customer to pull forward/next window. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
XUxy4sitXjUaFtN3oreZXi | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent did not personally direct the customer to pull forward or the next window; they deferred to an employee for assistance instead. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
DAW2VgRz7pxmQRNYAU9gmq | RBI Bakeoff 2026-07-24 | NO | The agent escalated to a human team member instead of sending the customer to the next window. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
jEcAj9NrhDs3riLSHTXrEb | RBI Bakeoff | NO | Agent deferred order verification to an employee and did not direct customer to pull forward or the next window. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
CKEUUeoLkzmtkCTUvmzHrv | RBI Bakeoff | NO | Agent escalated to an employee instead of directing to pull forward without handoff. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
JpN8UucXq4jZZrkyoeRBZe | Simulation Run 2026-07-20 23:58 (scratch) | NO | The agent escalated to a human team member for order verification instead of directing the customer forward. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
ECrzyJiqM4M3CZtp5G3Hfu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EJ4SgqL2H7zvAbw4qrvH6f | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KA9hP2qMkhb253aUXfXmR8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MRutiUH5oXiXp2QTFskmTC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Sd2FpjVLGpBKUqzusXKpJL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jC2Hb7uKxFBec2NeGNa3Ky | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jRCutGY7VF7KJfFj8cJWpr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kek5Y2hFHz4DCfVYE9eiiN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kw6RWMLcky6QvUUeDKPtwd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nCcWdr6AtYEHXh8uZDzK5X | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VGAJ7Fm4T3sK9jSxi5VnX2 | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript is incomplete and does not show order completion or directing the customer to pull forward. | empty |
m4F3Gu9YXU3PmcRrxphVf2 | Simulation Run 2026-08-18 22:29 | no transcript | — | |
CjNuunotcMiburXqjctitK | Test new prompt (Aug) | no transcript | — | |
FJmE59WRSZnpkLKiyAsDuY | Test new prompt (Aug) | no transcript | — | |
UtPdA3oFwVHGEEFNziYdLD | Test new prompt (Aug) | no transcript | — | |
cpcfR3N8xc9K7J7ExRGY7h | Test new prompt (Aug) | no transcript | — | |
jY3nN7pdvMRwUEUmDvugbg | Test new prompt (Aug) | no transcript | — | |
ZwoYjLMsVRGx6XXDSZxAos | Simulation Run 2026-08-16 23:53 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x Classic Chicken Sandwich Large Combo (Red Beans and |
gfEWRpWP789MV4W2Xinoew | Simulation Run 2026-08-17 00:35 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
Can I get the Ghost Pepper Sandwich combo? Actually, change that to the regular chicken sandwich. And make it spicy.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
6eg7w6t6PtehbHVa2rDS5G | RBI Bakeoff 2026-07-23 | NO | Agent completed order but escalated to a human employee instead of directing to next window. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
E6V2GyUPfksPUD5QyJX7f9 | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent stated 'An employee will assist you,' indicating escalation to a human team member. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, F |
VZ3rvexTSqRUk4cx9e2JKr | RBI Bakeoff 2026-07-24 | NO | The agent escalated to a human team member by stating "Employee will assist you." | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, F |
cJJwcB2Xo8ZJ9CffxQMeFF | RBI Bakeoff | NO | Agent escalated to a human team member instead of directing the customer to pull forward. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, S |
9abs7kYNdqnu4XL9fLSFjY | RBI Bakeoff | NO | The agent did not complete the order themselves and referred the customer to an employee to verify the order. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, U |
KU3yFrDNiWXiSisam8ribC | Simulation Run 2026-07-20 23:58 (scratch) | NO | The agent confirmed an employee will assist the customer, indicating escalation and not completing the order fully by themselves. | 1x Spicy Chicken Sandwich Large Combo (Homestyle Mac an |
5m5XkKyc3AYjffQPrDN6Sy | Simulation Run 2026-08-17 01:07 | NO | The agent did not confirm the full order or direct the customer to pull forward; no completion or forwarding stated. | empty |
9JBuPTAmaVikoY4mNNDdk8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CNsP6mYKCc4WAQRrp97Z4b | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Evvn6u2CtVo3r68XXxPfZg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
M7Cv2weFpxmBrrCgH5uHu8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PTxoizsfxLvC65Rc74Hwhb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PXnpwkPDDpMN9M8dKjzLk2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RnD4R6BQzM68KzUpVv8BvH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UnPPonVQe5t5NEn5ZovKfr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hMwpu9fmQoQpZQ5nNbtygk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mNGwaYWhDTtUMuwcbPdgjo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Cz2FFG2scyewgfrrRUmHMG | Test new prompt (Aug) | no transcript | — | |
MkAXDrWHXqkRD2RDMoLehQ | Test new prompt (Aug) | no transcript | — | |
Pryk9PXV6oJGaataMkoyF2 | Test new prompt (Aug) | no transcript | — | |
TqYtxWwWsebdReMr29srtL | Test new prompt (Aug) | no transcript | — | |
cM3paQbYAGrgLSJLGfyDX5 | Test new prompt (Aug) | no transcript | — | |
hVSJNXUdyTRtc7Z3ZorBmP | Simulation Run 2026-08-16 23:53 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Large Combo (Cajun Fries, Hom |
Mo4YFAWpqMAsZE9kG2o5BR | Simulation Run 2026-08-17 00:35 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Large Combo (Cajun Fries, Mas |
KTyRa3TAStFvAXkdhALu6m | Simulation Run 2026-08-18 22:29 | YES | The agent took the full order and instructed the customer to pull forward without escalating to a human. | 1x Spicy Chicken Sandwich Large Combo (Homestyle Mac an |
I'd like the 3-piece signature chicken combo, spicy. I don't want fries. What other sides do you have?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
dK3N54e8zzPiNL3ogV9C86 | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human employee instead of handling the order completion and directing the customer forward. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
LB6ffLaDwDY6TT8kfxopbE | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human team member instead of directing customer forward after order capture. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
J4cjT6KiECcC4g62tA6rNt | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human team member by telling customer to wait for an employee. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Home |
Wv4RCHMWgMa8kgEBzeUoGn | RBI Bakeoff | NO | The agent handed off the conversation to a human team member and did not direct the customer to the next window. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
mKjpWp6z3e9qNYs6CMuJhX | RBI Bakeoff | NO | Agent said 'An employee will assist you', indicating escalation to a human team member. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
YFvGEBuddEVN6bgrAV7Hqr | Simulation Run 2026-07-20 23:58 (scratch) | NO | The transcript shows the agent took the full order but never directed the customer to pull forward or the next window, and no final completion is indicated. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
5z6hXAk7g8bcaAKXZ88Sis | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EdnbjwvSdHKqa9iT94fNkR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
H2Y9XvX9i7USKK6QwFjpcp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HYGoHdziZppMfdgYns9xgQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HzWNSbJmAdrCjp8zJhTyAx | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NLi6N5xg9KXBy2gmfZfX6K | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VU646BsegtNZ55CgbGBhjK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cYUAaV7JD9uuCVnbY5bZR4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dgok7JKQiy7uknXK6TCTsT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kUjpWt3ViTGoXifeFtXxNV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gjMbzEELZbjvWKWw23HnoP | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript does not include agent responses or any indication of order completion or directing customer to pull forward. | empty |
QZsdth3nSR4SvMbodryKSs | Test new prompt (Aug) | no transcript | — | |
RZN2EXrb4kGybTruxpR8rj | Test new prompt (Aug) | no transcript | — | |
dBU9HjcDEWsgHQMmL3uUkR | Test new prompt (Aug) | no transcript | — | |
knugrTjjDWD9zkr25DfiVK | Test new prompt (Aug) | no transcript | — | |
koRk48oF4NA99YWiqEhtv3 | Test new prompt (Aug) | no transcript | — | |
YXSWq5yPSYsRBPhoKajYKW | Simulation Run 2026-08-16 23:53 | YES | The agent fully captured the customer's order and directed them to pull forward without escalating to a human. | 1x 3 Piece Signature Chicken Regular Combo (Mashed Pota |
YxCLPwKAygXTU62NuMHX6k | Simulation Run 2026-08-17 00:35 | YES | Agent fully captured order, confirmed it with customer, and directed them to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Home |
RMBERdWHyGgpnE3F6DTm2s | Simulation Run 2026-08-18 22:29 | YES | Agent took full order including modifications and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
Order one classic chicken sandwich by itself. Do not ask for a combo. If the agent offers to make it a combo, accept and choose Cajun fries and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
PRm5JHAdsATEXt9vzrLNsS | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent escalated to a human employee instead of completing the order and directing the customer forward. | 1x Classic Chicken Sandwich |
hgZKp9n4D5DL6nEwcHyFVk | RBI Bakeoff 2026-07-24 | NO | The agent said 'Needed, an employee will assist you,' indicating escalation to a human. | 1x Classic Chicken Sandwich |
XfjUww9JTAV7umTVBa9kp8 | RBI Bakeoff | NO | The agent escalated to a human when they said an employee will help and couldn't read back the order. | 1x Classic Chicken Sandwich Large Combo (Cajun Fries, L |
AwvKmeip5xUE6Ku8XYL5Ss | RBI Bakeoff | NO | The agent escalated to a human by stating 'An employee will assist you' after the customer was confused. | 1x Classic Chicken Sandwich Large Combo (Cajun Fries, H |
3SpUmxFtWkNmfrVGy4ugMc | Simulation Run 2026-07-20 23:58 (scratch) | NO | Agent did not complete order or direct customer to next window; escalated to human multiple times. | 1x Classic Chicken Sandwich |
HTCxSzHHV6rhjk6pCneZkZ | Simulation Run 2026-08-16 23:53 | NO | The agent initially confirmed the sandwich but then the customer added fries and drink, and the order was updated accordingly before directing the customer to pull forwar… | 1x Classic Chicken Sandwich Regular Combo (Cajun Fries, |
8siEKKjifuCcnTPCmbFcYG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9YTb8xgZvoyYdimHnsSwmc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Dn6K2Y4TiDGN8LgebwLQdM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MMy6acuiCGtKnBaaBedmVK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PH4tzS87AtH52AAbWjo8FN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RBhd5z4tZP2ZqhprnNMCJb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
TBAk8Tf9FdvB48JQ54b6cT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gpkn2aEwDfgDWkFA4RM3fM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
j5HmRJYVeB8phVs4Y2BeZd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jiHboD5VZeRKHgwFgM5K3k | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SamN8BQsfi4YmwapmLLz2n | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent taking the full order or directing the customer to pull forward. | empty |
3WfV3S24N5mfomiNKWXjwN | Test new prompt (Aug) | no transcript | — | |
XpNc74Th9xkVzhA5jJ4ei8 | Test new prompt (Aug) | no transcript | — | |
bXTNagdShuendXscere8Jc | Test new prompt (Aug) | no transcript | — | |
eqF3aD2pcjPLXmSkQ6sCN3 | Test new prompt (Aug) | no transcript | — | |
iTv7RpxsnhT8jPrRhZp8T2 | Test new prompt (Aug) | no transcript | — | |
Qav57qCG62AGo7DAEHMFyE | RBI Bakeoff 2026-07-23 | YES | Agent captured full order (classic chicken sandwich only) and directed customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
ZQcUFxKGBdmgXXhAKRP63L | Simulation Run 2026-08-17 00:35 | YES | The agent fully captured the order and directed the customer to pull forward to the window without escalation. | 1x Classic Chicken Sandwich |
kKeRSeYfoxXdJ3ywCpgyxG | Simulation Run 2026-08-18 22:29 | YES | The agent took the full order, confirmed it, and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich Large Combo (Cajun Fries, L |
Order three pieces of spicy signature chicken by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose mashed potatoes and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
Asx9YUMgKSYqkTy4hLk3jc | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human employee to verify the order, not completing fully independently. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
QPubfVoSBYUfYk9rqFYfUD | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent repeatedly directed the customer to wait for an employee to assist, indicating escalation to a human. | 1x 3 Piece Signature Chicken (Spicy) |
DYLBetiV8vEHwAaH2UBCo8 | RBI Bakeoff 2026-07-24 | NO | The agent did not complete the order independently and escalated to a human for order confirmation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
9GGx8tNJEkYCfgmpogVHd6 | RBI Bakeoff | NO | Agent confirmed that an employee will assist, indicating escalation and not directing customer forward independently. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
VLtEo3QDrZDNYiNFWhBkhx | RBI Bakeoff | NO | Agent escalated to a human after failing to confirm the full order and read it back to the customer. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
4SnkoqfEPqHkBSxvE8jfdA | Simulation Run 2026-07-20 23:58 (scratch) | NO | Agent escalated to a human by stating 'an employee will help confirm your order'. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
WGoeC4R2Yf9ZsSdPGo4VVU | Simulation Run 2026-08-16 21:10 | NO | Order was not fully confirmed or completed; no direction given to pull forward or next window. | 1x 3 Piece Signature Chicken (Spicy) |
6fpYQYTsQ7DkiofBDYvbtD | Simulation Run 2026-08-17 01:07 | NO | The agent did not direct the customer to pull forward or the next window after taking the full order. | 1x 3 Piece Signature Chicken (Spicy, Mixed); 1x Biscuit |
AqYoRK3cBXbrscnZAJHQH6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Cc4YZdux8kDH7rihFwwuhs | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript ends before order is fully captured or customer directed to pull forward. | empty |
LxrqGMScgeEREHugGVHH84 | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent confirming the full order or directing the customer to pull forward. | 1x 3 Piece Signature Chicken (Spicy) |
PXhbuxndmVDiDQqLRUKnpo | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent confirming the full order or directing the customer to pull forward/next window. | 1x 3 Piece Signature Chicken (Spicy) |
Srht2BtKPPnqBTQdYd4amd | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript shows order request but no confirmation or direction to pull forward is recorded. | 1x 3 Piece Signature Chicken (Spicy) |
ZkvxLSe7XXwXwr9P52koz5 | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript does not show the agent fully capturing the order or directing the customer to pull forward/the next window. | 1x 3 Piece Signature Chicken (Spicy) |
gHt2zkaSGBtbR9RcLE3ZxY | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript shows the customer's order but does not confirm if the agent directed them to pull forward or next window. | 1x 3 Piece Signature Chicken (Spicy) |
n9f6VPuuWT4E6mPBTytnWu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9TnhWpGckJFhKSzVbh9RcT | Test new prompt (Aug) | no transcript | — | |
AqvEQ79EkFXtjqcFF2rEbX | Test new prompt (Aug) | no transcript | — | |
JuZ3PqqCLw5rvzXPyTjS7Q | Test new prompt (Aug) | no transcript | — | |
bKr4PTD8iM5pugcgoKCb8c | Test new prompt (Aug) | no transcript | — | |
geoRxDCr82pkCjhL4f8RCJ | Test new prompt (Aug) | no transcript | — | |
LA5XTaWjSVzggSjUUSeqmk | Simulation Run 2026-08-16 21:10 | YES | Agent captured the full order of three spicy chicken pieces and did not escalate. | 1x 3 Piece Signature Chicken (Spicy) |
T8dwGgdj8WzMvc9RdDC97M | Simulation Run 2026-08-16 23:53 | YES | The agent fully captured the order with all items and directed the customer to pull forward without escalation. | 1x Biscuit; 1x 3 Piece Signature Chicken Large Combo (S |
SaemipgxwZnBTUAcBqgbx8 | Simulation Run 2026-08-17 00:35 | YES | Agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Large |
h5Ryf6joJvmEak7Q4PbiDj | Simulation Run 2026-08-18 22:29 | YES | Agent fully captured the order and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
Order five classic tenders by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose cole slaw and a Sprite.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
aJXK9kY4z6Gzt3JofPpCJK | RBI Bakeoff 2026-07-23 | NO | Agent escalated to human by stating employee will assist and show order multiple times. | 1x 5 Piece Chicken Tenders (Classic, Bold BBQ, Wild Hon |
hMVpm7piEm8o97GEyry2r7 | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent escalated to a human by telling the customer to wait for an employee twice. | 1x 5 Piece Chicken Tenders (Classic, Buttermilk Ranch, |
QgP8Ei5SVhRViLvwgNf7na | RBI Bakeoff 2026-07-24 | NO | Agent escalated to employee/human team member several times, failing to complete order alone. | 1x 5 Piece Chicken Tenders (Classic, Bold BBQ, Wild Hon |
W9pZwBkwFwytgvgi4VNUws | RBI Bakeoff | NO | The agent escalated to a human multiple times instead of completing order and sending customer forward. | 1x 5 Piece Chicken Tenders Dinner (Classic, Buttermilk |
5YwXgKJS93LD3qDdUYQeQG | RBI Bakeoff | NO | Agent escalated to a human after customer was unsure about order confirmation. | 1x 5 Piece Chicken Tenders (Classic, Buttermilk Ranch, |
Ew4jR2jgJGfKHhbaKndg3q | Simulation Run 2026-07-20 23:58 (scratch) | NO | The agent confirmed the order but repeatedly directed the customer that an employee would assist, not to pull forward or the next window, indicating escalation to a human… | 1x 5 Piece Chicken Tenders (Classic, Buttermilk Ranch, |
2kGMjpBCqtgvGArhRYAkoH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
6QioWQtjnxFXHStzrmGYYV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7HQ26rwDNKGsWgcGHaPb9w | Simulation Run 2026-08-16 21:10 | no transcript | — | |
86hhNzKeFbfGEAv86xwqv3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9sLNTBPe5GeCRExKyJPzrG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
D3tZdryYi6jfKfpsSvfj2E | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HFXDeS7wGE4DTPbDwSybAS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NikwpuVKXj3Nrx9CEnQURH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WPcjxL6hJV8tk5QH3Z2pZC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nVSB7P7EwFnPPquEc7JPjZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WKjtDc46ziXWSFDUAHbUTG | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript does not show the agent taking order or directing customer forward; no escalation evident either. | empty |
5TRM4RFTcXYFsZgyAMmM6Y | Test new prompt (Aug) | no transcript | — | |
G5vf3w4JwYUj7gqfuxACzv | Test new prompt (Aug) | no transcript | — | |
L38he38fwfHfVRSxmL98mv | Test new prompt (Aug) | no transcript | — | |
RtdFnQE6343by7Sb9akpd5 | Test new prompt (Aug) | no transcript | — | |
hguVy9MrWEFGHWt7NQNTdr | Test new prompt (Aug) | no transcript | — | |
Y7DveEXDb3jrxJxr8wd6cV | Simulation Run 2026-08-16 23:53 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 5 Piece Chicken Tenders (Classic, Buttermilk Ranch, |
9nkHzqQGQ2f8GWB9TvsUfT | Simulation Run 2026-08-17 00:35 | YES | The agent fully captured the order and directed the customer to pull forward without escalating or bailing. | 1x 5 Piece Chicken Tenders (Buttermilk Ranch, Blackened |
dHRwifJYLsBnjto8AWtYGm | Simulation Run 2026-08-18 22:29 | YES | Agent fully captured the order details and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Classic, Butter |
I'd like the 5-piece tenders combo, blackened and spicy, with cole slaw and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
UwtUKyMr4Uv7SzvepffGYi | RBI Bakeoff 2026-07-23 | NO | The agent did not direct the customer to pull forward or the next window but instead escalated to a human employee. | 1x 5 Piece Chicken Tenders Large Combo (Mashed Potatoes |
e8fAsiH4mj2Jeyk39kVk8j | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human team member instead of directing customer to pull forward after taking order. | 1x 5 Piece Chicken Tenders Regular Combo (Spicy, Popeye |
SpwgTGgJtfpLo3bfRcV98L | RBI Bakeoff 2026-07-24 | NO | Agent stated 'Employee will assist you', indicating escalation to a human team member before directing the customer forward. | 1x 5 Piece Chicken Tenders Large Combo (Spicy, Coleslaw |
WuomVFj8gaUGwAxkRbDGPo | RBI Bakeoff | NO | The agent escalated to a human employee instead of sending the customer to the next window. | 1x 5 Piece Chicken Tenders Regular Combo (Spicy, Colesl |
74zFvHx89ADjtc24t8EbJ2 | RBI Bakeoff | NO | The agent escalated to a human team member due to customer's difficulty with the screen and lack of readback capability. | 1x 5 Piece Chicken Tenders Regular Combo (Spicy, Butter |
4vmACyDmpNjwJ3WeGfyT8W | Simulation Run 2026-07-20 23:58 (scratch) | NO | Agent escalated to a human employee instead of directing customer to the next window. | 1x 5 Piece Chicken Tenders Large Combo (Spicy, Blackene |
3ZC3ri9ex4JdYR9XqY2bpJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
59LQBxUg5MCaU5uRL4UXkL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EqsPwRZqYgJCerqiRenYTD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FtnNbmHv2JH2VfmJno9cpT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Wyy4WAN39QWACC4rCb9XxW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YrY8FrdPnUEpup5F57yd6k | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bUPFGGtK8VtJoGwweobBKw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
egzGERfEGovubVR4jU3hN5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fkqcr3BBAhU8SupZszBYJj | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kBdXpBefqVEGzZyaoqwKT6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SqcYAEpaTpaoPxiWzewcjt | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript fragment is incomplete; no indication agent took full order or directed customer forward. | empty |
AFG63YoyZZvyd3qhzrgH5r | Test new prompt (Aug) | no transcript | — | |
LaDXPV9RXaYXYT6z9DzztW | Test new prompt (Aug) | no transcript | — | |
R26jsoMPwMcF3F7gPNorbA | Test new prompt (Aug) | no transcript | — | |
g74DQhhf6gXSgwzMENAEpv | Test new prompt (Aug) | no transcript | — | |
jXz4N2CBiBzFR4nSDGdKCK | Test new prompt (Aug) | no transcript | — | |
JW7WrFKCNPVMec6iijsbQT | Simulation Run 2026-08-16 23:53 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
hQBDMgRDUgef8QVdXzEBjZ | Simulation Run 2026-08-17 00:35 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Coleslaw, Coc |
S8axA3Vny9N66vsyxoUVmm | Simulation Run 2026-08-18 22:29 | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Spicy, Colesl |
Do you have nuggets?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
fUiciuyisjtRrP7SWSHem5 | RBI Bakeoff 2026-07-23 | NO | The agent never captured a full order nor directed the customer to pull forward or the next window. | empty |
PpRXgRg8xUNXRuyDNPdQNp | RBI Bakeoff 2026-07-24 | NO | Agent did not send customer forward but escalated to a human for order verification. | 1x 5 Piece Chicken Tenders Large Combo (Cajun Fries, Ma |
eR8WysDFpUfdiPbB3Vf4Z9 | RBI Bakeoff | NO | Agent did not direct customer to pull forward or the next window; instead, the order was escalated to a human employee. | 1x 5 Piece Chicken Tenders Large Combo (Homestyle Mac a |
fVbE7NSAVuRz7wpbnHZKg4 | RBI Bakeoff | NO | Agent took the full order but escalated to an employee instead of sending customer to the next window. | 1x 5 Piece Chicken Tenders (Classic, Buttermilk Ranch, |
aJdbzNF5dyQ7ew7Rt6o77X | Simulation Run 2026-07-20 23:58 (scratch) | NO | Agent escalated to an employee twice and did not finalize order direction to pull forward or next window. | 1x 5 Piece Chicken Tenders Regular Combo (Mashed Potato |
fz7LzFHUvzTivhpcSCGvi3 | RBI Bakeoff 2026-07-24 Pass 5 | no transcript | — | |
77XrC9sfU2bPWqzEkTcdUk | Simulation Run 2026-08-16 21:10 | UNKNOWN | The agent did not take or complete the customer's order or direct them to the next window in the transcript. | empty |
E6CNJWfA7XfpsHB4TCk9sC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NSGMgDdH4QXJMzCLeywveR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PrDdjpjvFdpANyxWRv3c3J | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Sez3WunPuUx7nesidtEL8c | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZQgQ79ZCvoNoUN8xiyqejU | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dg2kwCRbDzhA6Jo7kEEqmv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hiDjnHPAYfPMhBaRi4Siuh | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iBCr8gnQZe3q4ny2S2sTat | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kEgSKruFfiGnSSWm9qZHNe | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Fa4J8ZpqVV6AQjZkEeGWCQ | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript shows only a product inquiry without any order taking or instruction to pull forward. | empty |
2KkFRSxvfvrFTnKjAzoLvV | Test new prompt (Aug) | no transcript | — | |
fQizuyyBgjcH5g9hQ6zoc9 | Test new prompt (Aug) | no transcript | — | |
k3LcQcxQEmYcAYM8LnseSh | Test new prompt (Aug) | no transcript | — | |
k9Cxob7AHXimMho3gcoQjB | Test new prompt (Aug) | no transcript | — | |
kUZq9Cr6Qk2UvCCsRLoxFQ | Test new prompt (Aug) | no transcript | — | |
fLgrDzHdQQ3Hkh62tW9CLy | Simulation Run 2026-08-16 23:53 | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 3 Piece Chicken Tenders Large Combo (Mashed Potatoes |
QpfJoA8ph7XZzoVbEhjRdz | Simulation Run 2026-08-17 00:35 | YES | The agent fully took the order with all details and directed the customer to pull forward without escalation. | 1x 3 Piece Chicken Tenders Regular Combo (Homestyle Mac |
b2sHLFjkAv2aCvWiCPy7mr | Simulation Run 2026-08-18 22:29 | YES | The agent fully captured the order details and instructed the customer to pull forward without escalating. | 1x 3 Piece Chicken Tenders Large Combo (Classic, Butter |
Start by ordering the 3-piece signature chicken combo, spicy, with mashed potatoes and a Coke. Before the order is finalized, change it to the 4-piece combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
ivSfUBZH62B9JkPj6uqA6i | RBI Bakeoff 2026-07-23 | NO | The agent escalated to a human when unable to read back the order, failing to complete the order themselves. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
H4CEnJMgJGMbWUhqcDY8oy | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent did not direct customer to pull forward or next window; agent said an employee will assist. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
Cv6ntf7S6DBbDMridUjAnQ | RBI Bakeoff 2026-07-24 | NO | The agent escalated to a human team member by stating an employee will assist the customer. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
VrcVPMjJrWbupJcaP7aaG5 | RBI Bakeoff | NO | Agent failed to read back the full order and escalated by stating an employee would assist the customer. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
PKmSveh4e2ePueDtnR7WRm | Simulation Run 2026-08-17 00:35 | NO | The agent escalated to a human employee instead of completing the order and directing the customer to the next window. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
mvRkjqVEWft3MmDEsiShs3 | Simulation Run 2026-08-17 01:07 | NO | The transcript shows the agent asked clarifying questions but never confirmed the full order or directed the customer forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
2W6EHdUajvGaASfw6d34Se | Simulation Run 2026-08-16 21:10 | no transcript | — | |
3XaiUcfBQbmc9gV6nXh9Pz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
P7KFBKskEAbirAaQzJycBf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RrBN6i8YdgTBqmYb9ycZoE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZgGgCsGg79nZrXyUsNmRTc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
b8oyYG7xDWofa5QFtF5zGW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bPQDhj62rvbmP9uBspbnwY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
h9tSb3QNC28pBw9Bm3xYZC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iXzxA6sPVZ9DirvpzLKWmf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
o8HdbqQk47Dr2MKspj5qDS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8wMANg6jyR5HuQSRGemo7e | Test new prompt (Aug) | no transcript | — | |
J2CnSeTT4fMS4xy9ZQficK | Test new prompt (Aug) | no transcript | — | |
MiQiXXAgqUPrqusX9gnrFs | Test new prompt (Aug) | no transcript | — | |
ZRoCiMDHyky2ERoyp6iuLH | Test new prompt (Aug) | no transcript | — | |
drAxbTuKHMAixK4Fbcu7YU | Test new prompt (Aug) | no transcript | — | |
4CvpfNuPbmu9TWKNHxr8CN | RBI Bakeoff | YES | Agent captured full order details and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
QFgpqb6fjV6iN6NPkcepkj | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order and explicitly directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
8y485pGNXz2qLxy4xPMCcv | Simulation Run 2026-08-16 23:53 | YES | The agent confirmed the full order and instructed the customer to pull forward, with no escalation or handoff. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
KNnvpZkQxc2njRAxvXpMrf | Simulation Run 2026-08-18 22:29 | YES | The agent confirmed the full order with the customer and instructed them to pull forward without escalation. | 1x 4 Piece Signature Chicken Large Combo (Spicy, Mashed |
I'll take the 3-piece chicken combo, spicy, add a pie - make it the strawberry - and a premium strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
epoQWeYNDmjC3Gse9oeJYy | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human team member instead of directing the customer to pull forward or the next window. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Frozen |
WZvFqdzX8MgQ3mR3ZwsNyT | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human employee instead of directing customer to next window. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Cajun |
7PqsQy33jkUtLJLdXrUejB | RBI Bakeoff 2026-07-24 | NO | Agent did not direct customer to pull forward or next window; instead, escalated to employee assistance repeatedly. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Caju |
YqokBfEmpFhzgBTLzTzS2h | RBI Bakeoff | NO | Agent escalated to a human after confirming the order and did not direct customer to next window. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
kTjNxAfKhusVctJyf4q9kJ | Simulation Run 2026-07-20 23:58 (scratch) | NO | The agent did not complete the order or send the customer forward, instead escalating to a human team member. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
PNuwmaboSTXzcHRBaFAF6R | Simulation Run 2026-08-17 01:07 | NO | The agent never took the customer's order or directed them to move forward; the customer repeated their order with no agent response. | empty |
2GmrMLdDMK4KRHzMyEpCVL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
3Aas2bBvoQzSkX3hhJ3VH4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
3x2ptPvREdLwi7Fh6xHSG4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
93RaQnrK6FbUD5gmSzbqzf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MLhn2cU2MSiA5XqHfiM8MT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
TbtL3DUvbHjKGHr3Ab3bgz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VqaYXA9s5PTEtPuBwGvepB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WsJhp43WkUhLp2azkyeLBu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YG9YmGZz9dyGXEnxPH6XAH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bTvYnepcVQJCXxvGiyzWZc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4mVKNRV2ApqPPDp9CKkmRq | Test new prompt (Aug) | no transcript | — | |
9fNx3aozx3RuGdJESS5dbT | Test new prompt (Aug) | no transcript | — | |
D4EGVo9r58FQUXRTnN3fbL | Test new prompt (Aug) | no transcript | — | |
T8M697w79JNRdY7Vkpf5fm | Test new prompt (Aug) | no transcript | — | |
daxB8e2naHQTrBFGvC7fCd | Test new prompt (Aug) | no transcript | — | |
W4bMDgukWddMCUECT2mf2e | RBI Bakeoff | YES | Agent captured the full order including combo, sides, drink, and dessert, then directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
7wLgaU8zGTdszvTGMp7FRL | Simulation Run 2026-08-16 23:53 | YES | The agent took the full order and directed the customer to pull forward without escalation. | 1x Strawberry Cream Cheese Pie; 1x 3 Piece Signature Ch |
eP5uVg8Gi48HjxT7ZgwBdZ | Simulation Run 2026-08-17 00:35 | YES | Agent took full order including combo modifications, confirmed it, and directed customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Caju |
HMdpMyhEfrCkAXaJp6zX4G | Simulation Run 2026-08-18 22:29 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Caju |
Give me the chicken wrap bundle with a mango lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
FeJGVYpvtJSPDkvusGDKcL | RBI Bakeoff 2026-07-23 | NO | Agent did not read back the full order and stated they would get an employee if there was an issue, indicating escalation readiness. | 1x Classic Wrap (Blackened Ranch); 1x Blackened Wrap |
gnccFiCe9F9C8VQ6jA6yED | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human by saying 'An employee will assist you' and did not send customer forward. | 1x Wraps Bundle (Classic Wrap); 1x Chilled Mango Cane S |
gkdH6qwuHfy3vdY5xcWA2n | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human and did not direct customer to pull forward after taking full order. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade); |
BSX6PyD4bzRqBnteziKYd2 | RBI Bakeoff | NO | Agent escalated to a human by saying 'An employee will assist you' after order confirmation. | 1x Wraps Bundle (Frozen Mango Cane Sweeeet Lemonade, Cl |
XBZqEjfZT7hDDYe2vMihAF | Simulation Run 2026-07-20 23:58 (scratch) | NO | The agent stated an employee would assist the customer, indicating escalation to a human team member. | 1x Classic Wrap (Blackened Ranch); 1x Blackened Wrap (C |
3MS2ACCg3AeVKmYjqmzyza | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7scJ9zT34hzpuxo9newwts | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GNChbZrLzW3AY2VzRUpgKu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JAFJN5W9cuD8AeUJwT3PuE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LSAunARmye8oiisEyMLkep | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PKRdgoEV9ywEmxKNbuFAhG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Pc8SPbP9QATvBYcs4NopY2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QLGRrkcHYMQawnTSW94QJs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WuJzkbt4kvPrumEDG8w9Ko | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hHGKb3SgArSrvYuGY8RPok | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RUJNMsrm3gPnAbDS2iX7FS | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript shows only customer statements; no agent response provided to determine order capture or direction. | empty |
KgbkxYrNDAprqwoCoUBQky | Test new prompt (Aug) | no transcript | — | |
NEtjP3E7tPTE6rjuAnJUBF | Test new prompt (Aug) | no transcript | — | |
T2ZXooLqiThfBSAvmfxUSs | Test new prompt (Aug) | no transcript | — | |
ZEAz2vPQpnMrBiJRvPzCfg | Test new prompt (Aug) | no transcript | — | |
gG9wYdvBPcx2uRjKDZwqSW | Test new prompt (Aug) | no transcript | — | |
kPAGi7ZKYeAoeK4NqZWCw5 | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Wraps Bundle (Classic Wrap, Frozen Mango Cane Sweeee |
FuMLmaSTaTeaV8b2Eqdpjz | Simulation Run 2026-08-16 23:53 | YES | The agent fully captured the customer's order and directed them to pull forward without escalation. | 1x Wraps Bundle (Classic Wrap, Blackened Ranch Wrap, Ch |
2Y8zctCh2bdLGoq5CiU9qD | Simulation Run 2026-08-17 00:35 | YES | Agent fully captured the order (two wraps with specified sauces and lemonade) and directed customer to pull forward without escalation. | 1x Wraps Bundle (Classic Wrap, Classic Wrap, Chilled Ma |
asSXzgpfcRvfTWnbR3LAJU | Simulation Run 2026-08-18 22:29 | YES | The agent fully captured the order details and directed the customer to pull forward without escalation. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, B |
I'll do the 12-piece family meal with all dark meat, spicy, Cajun fries and cole slaw, and two Sprites.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
gcBxKdKezj9icqwZ9ULgVa | RBI Bakeoff 2026-07-23 | NO | Agent confirmed need for employee to verify order and did not direct customer to next window. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
gAaq6cqqSe8rHyieAu362B | RBI Bakeoff 2026-07-24 | NO | Agent confirmed the order but then escalated to a human by saying an employee will assist. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
9uMoNS5CfY3CjB8WtgdRt4 | RBI Bakeoff | NO | The agent handed off the conversation to a human employee instead of directing the customer to pull forward or the next window. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
T6rgPekfobFAmsQBWCBxTd | RBI Bakeoff | NO | Agent escalated to a human employee instead of sending the customer forward alone. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
56gduMecapL2vTZEWCWXnX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
6wMd2Eu8SBURoKSr4NWxVm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8Yx9DyJkTst6xhsegBaHhL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
938Aw7zWCWcgkvuQ85nFfi | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BfH4qf68xKMmHjiW48uC9N | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EziRUsAJ8KNodKX37qTZGY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GKMh4gdkTov3Gc2UAkGn9y | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WNahsqaq29t24Wnm2crZNg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XpnQvuZdKZxff9ZUrT7H5C | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dNZcYzDVou5hwrn2mpyGqP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LnHTeKsrCivepWEYX9nkrg | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not include any agent response confirming the full order or directing the customer to pull forward the next window. | 1x 12 Piece Signature Chicken Family Meal (Spicy, Dark |
L4hNNLPdY4dfqHDuuRZvqu | Test new prompt (Aug) | no transcript | — | |
SKhGcLELKjvbmBbHoQjpnw | Test new prompt (Aug) | no transcript | — | |
XLLFtEUZUvroPByFR6AH7W | Test new prompt (Aug) | no transcript | — | |
eq5tt4AQFL7TBVocVJUY87 | Test new prompt (Aug) | no transcript | — | |
kBaHjwRU96BxzQNpufEnwE | Test new prompt (Aug) | no transcript | — | |
HeyDLtQgNU6XQvTNJMbTgB | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured the order with details, confirmed accuracy, and directed customer to pull forward without escalating. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
KRnJAtpzsHwRc2fE47Avbw | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent captured the full order including modifications and drinks, then instructed the customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
KWbx4vUMF4bssjdn9FJ9Ad | Simulation Run 2026-08-16 23:53 | YES | The agent confirmed the full order and directed the customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
P7s29GjSurx7WBqGFMKunM | Simulation Run 2026-08-17 00:35 | YES | The agent fully captured the order and instructed the customer to pull forward to the window without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
MYbWTNw4wyYJq2HXE95PxR | Simulation Run 2026-08-18 22:29 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
Order one regular bacon and cheese sandwich by itself. Do not ask for a combo or a large. If the agent first offers to make it a regular combo, accept with fries and a Coke, then accept a subsequent l
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
nTkD7j9LoGmL3zZUutC84V | RBI Bakeoff 2026-07-23 | NO | Agent did not direct customer to pull forward/next window; escalated to human assistance multiple times. | 1x Classic Bacon & Cheese Chicken Sandwich |
GmvGqeibX3osryxqXAWXyV | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human team member to help verify the order, not sending the customer forward directly. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
MKqfVcdheNqT3RJyw8Hd5e | RBI Bakeoff | NO | Agent did not direct customer to pull forward or the next window and repeatedly stated an employee would assist. | 1x Classic Bacon & Cheese Chicken Sandwich |
LTRWCBq3wv2EgeQTFXGp3c | RBI Bakeoff | NO | Agent escalated to a human multiple times, failing to direct customer to pull forward without handoff. | 1x Classic Bacon & Cheese Chicken Sandwich |
4N2g46DgHFPtZn7vJiwpmw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
6Js84AoRCjC7tiwoNPGw38 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8gCw7SJ6VDiNW68DxH9nQu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DnZXQsz2JSRx2QyyT5RaoQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JBvmJ7Dom8fLwkMy57gXT7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MmXr3zBWuew4RkTgBHPMEq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RwunzLMMiaEvaFoK4xoFNP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fWKm2Ec3irWz3ECk7pUcwu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nKWgVuBmBW9ZQPHRcCaUg4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
npmiEenP6CkmkHNimh4Vns | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8KykMiQ5ECHZBvp6hJnuQX | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show whether the agent took the full order or directed the customer forward without escalation. | empty |
AnbnZ3XQNY543xM4ttJ59R | Test new prompt (Aug) | no transcript | — | |
XhnPrKZiFqJZBFNHvo9Y4u | Test new prompt (Aug) | no transcript | — | |
ZP5XNDPw434aBbQEEwvaLu | Test new prompt (Aug) | no transcript | — | |
fSt646uPeC4EVGEAcdRWB9 | Test new prompt (Aug) | no transcript | — | |
jV7e9a5wv4SF54h8TSdK5P | Test new prompt (Aug) | no transcript | — | |
UcHTVamzF24rLvbN6TquBu | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order for a classic bacon and cheese sandwich and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
VigAUVSL5StPBWHbMw9Ehj | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
HM6SNpSKNjrBWPyYLbqM2T | Simulation Run 2026-08-16 23:53 | YES | The agent took the full order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
FsSPW8xHvRa53o3drckhZX | Simulation Run 2026-08-17 00:35 | YES | The agent took the full order (one classic bacon and cheese sandwich) and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
YvrH9UETP2a8rhtSrisorz | Simulation Run 2026-08-18 22:29 | YES | Agent fully captured order and directed customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
Can I have a Cajun Rice please?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
8YVTFJAS5xUxQBRSBpCTZj | RBI Bakeoff 2026-07-23 | NO | The agent escalated to a human employee to verify the order and assist the customer, not directing them to the next window alone. | 1x Red Beans & Rice |
75NkfSQrS7ozRZzwQk4myT | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human employee rather than completing order and directing customer forward. | 1x Red Beans & Rice |
QFMkoURoxz9exh4rPo7TcH | RBI Bakeoff 2026-07-24 | NO | The agent did not direct the customer to pull forward or the next window, but said 'An employee will assist you,' implying escalation to a human team member. | 1x Red Beans & Rice |
PzTsXLDVHzca7EpHfXkzrX | RBI Bakeoff | NO | Agent escalated to a human employee instead of directing customer to next window after order was captured. | 1x Red Beans & Rice |
24zet86yFPfxgUHcbwdTga | Simulation Run 2026-08-16 21:10 | no transcript | — | |
5i5G4aCmTDg2DXTHQVGfRE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7BfBWVASfCc3gakPBUTGWp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9CqigDUeRXJ67J7ryiR9DZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AJPJRKxnkFK7s46LceoJb4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DZrnAdGtCchLF6fRK5Tsmk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JaefVY6DWHcuX5Ptt9XUYH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KhvxsGAsLPgynpmyJ3VYxt | Simulation Run 2026-08-16 21:10 | no transcript | — | |
STjMyWUtMEjZiKUopA32vC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZAEYTsFkUcPzk36Geo5Cxx | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AZRTxAKVQSRMx9ks5BZQNT | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent taking an order or directing the customer to the next window. | empty |
DtS2KEcQePdEypWFPALDtc | Test new prompt (Aug) | no transcript | — | |
Vi4UxvKRNexKwnWAmvf5bu | Test new prompt (Aug) | no transcript | — | |
XYow7Uokm2vjWoynJKVCnB | Test new prompt (Aug) | no transcript | — | |
bSJeXk6VVsgEEngb6Pvcje | Test new prompt (Aug) | no transcript | — | |
cJENjvUXSsWcHQWhuzK8U6 | Test new prompt (Aug) | no transcript | — | |
friVsaj8bnB4e4eTNVVuKo | RBI Bakeoff | YES | The agent captured the full order for regular red beans and rice and directed the customer to pull forward to the window without escalating. | 1x Red Beans & Rice |
SKCYNLcahTS5MKg3ZS3xaF | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully captured the order for regular red beans and rice and directed the customer to pull forward without escalation. | 1x Red Beans & Rice |
bL7jBkSzd9qMkfQcPWfVUd | Simulation Run 2026-08-16 23:53 | YES | The agent fully captured the order for one regular red beans and rice and directed the customer to pull forward without escalation. | 1x Red Beans & Rice |
dvP8pJnXs4C8c4Y9eSY56s | Simulation Run 2026-08-17 00:35 | YES | Agent fully captured the order and directed the customer to pull forward without escalating or handing off. | 1x Red Beans & Rice |
EDpERTSJb7T9NcFEsKuEk9 | Simulation Run 2026-08-18 22:29 | YES | Agent took full order of regular red beans and rice, confirmed correctness, and directed customer to pull forward without escalation. | 1x Red Beans & Rice |
I'll do the chicken sandwich by itself and a side of fries.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
NwycfGcSndNBdDkm3VTrRT | RBI Bakeoff 2026-07-24 | NO | The agent escalated to a human by stating 'An employee will assist you' and directing the customer to wait, not sending them to the next window. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
T6iatXuXt49gvSSBL3hA2k | RBI Bakeoff | NO | The agent escalated to a human employee instead of directing the customer forward after taking the full order. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
MbXXmyf5Bmm4r2RHb3z5ef | Simulation Run 2026-08-18 22:29 | NO | Agent escalated to a human team member to help with the order confusion. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
BPZVLFQCQxNTfk5xbhrUt7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
E83hbtvxUsXBzToD8fXtsW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MaVRWRJd6eutWkFMNwoZWU | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QEKsE65S68y3MxZRJrGJLd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QcRGQKpGN879iyGzSfzJho | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ehmTXpB2SgJgVFAiHoAVYN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
enTTBzpv2YTEnFT4wkw9SB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mDmXhwQA9CiLTMv52vK98c | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nTrgWEpR7rZBbCvchfxgHY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
o6U3Rrqf8DSBKT5oHijLmg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BnaHbADmiFPwCnnhoRYo3N | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript does not show order completion or direction to pull forward without escalation. | empty |
3XMWLFe7mbkKrcCU8tguxU | Test new prompt (Aug) | no transcript | — | |
6zu7pSAvsqX8ZiDN3teo5i | Test new prompt (Aug) | no transcript | — | |
RFaXYwA8F6VVxMKNzSJJax | Test new prompt (Aug) | no transcript | — | |
Vc4GucNTGCJQ3xLoXmPWtN | Test new prompt (Aug) | no transcript | — | |
bNuysQau9yc4zpMy8mTVtg | Test new prompt (Aug) | no transcript | — | |
hnTT5eax2FUyfywdkJa6cy | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
9w6G3LxstM9cndf6yyZiE8 | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich Dinner (Cajun Fries) |
EMB7NtBZHHGVLqEawnoCYT | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward to the window without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
QEMjDn7X3YxLiUbd5US4Fc | Simulation Run 2026-07-20 23:58 (scratch) | YES | The agent fully took the order for a chicken sandwich and regular fries, confirmed with the customer, and directed them to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
P8btSdY6DmUw3fpWy54Suw | Simulation Run 2026-08-16 23:53 | YES | Agent fully captured order (chicken sandwich and fries) and directed customer to pull forward to the window without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
EHxZaCDvpzHGagBDfnnUeU | Simulation Run 2026-08-17 00:35 | YES | The agent fully captured the order and directed the customer to pull forward to the window without escalating. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
One Ghost Pepper Sandwich, no combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
ThUWxTDBaQaBGVCML7VD8K | RBI Bakeoff 2026-07-24 | NO | The agent could not read back the order and directed the customer to wait for an employee, indicating escalation. | 1x Spicy Chicken Sandwich |
VgtP3jki2aueVB5Ue7Zzqc | Simulation Run 2026-07-20 23:58 (scratch) | NO | Agent escalated to a human by saying 'Employee will assist you' and instructing customer to wait for assistance. | 1x Spicy Chicken Sandwich |
Z8HTEap6pizLXzdEuKpEr2 | Simulation Run 2026-08-16 23:53 | NO | Agent escalated to a human employee after capturing the order but did not direct the customer forward without handoff. | 1x Spicy Chicken Sandwich |
3gA5ZYz9GC2T55LSAFNhgs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4DdsQprtyZRFQUxt5vMMpp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
6YmTfTCKMci4buoc5SyaRx | Simulation Run 2026-08-16 21:10 | no transcript | — | |
72WuhsUtCwMRcznMgWKwES | Simulation Run 2026-08-16 21:10 | no transcript | — | |
A4NJSAj3VfjKRAgP3LWiRF | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FGdaFx2mvEw2Eaxgg8mjP6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
R57aECjUgCnAoQGVFwhyh5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SpZhtEDAZs9RBNcd5m89oS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dC7Q4zmrHLaFZovDxH7XPL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
e54xG5WvRkrRqGoBf46AZ9 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
57pTKJE6QNuMviHYen7D5m | Test new prompt (Aug) | no transcript | — | |
5KBk34AWeYnbhtrcqety4X | Test new prompt (Aug) | no transcript | — | |
YRnFUrW4ERFdWZSSGkVejh | Test new prompt (Aug) | no transcript | — | |
aknF76FRh5X3wY6bXB7nvx | Test new prompt (Aug) | no transcript | — | |
g3wAHdubvS6uvUPJTSMcUg | Test new prompt (Aug) | no transcript | — | |
eZHPbumWD4pAAeQ9u4jvQT | RBI Bakeoff 2026-07-23 | YES | The agent took the customer's full order and directed them to pull forward and pay at the window without escalation. | 1x Spicy Chicken Sandwich |
ejEaNvkemf8pdBVjtBEyPM | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent took the full order and directed the customer to pull forward without escalate or handoff. | 1x Spicy Chicken Sandwich |
GCuN9rZVbtycJ8DprTZAvs | RBI Bakeoff | YES | The agent fully captured the customer's order and directed them to pull forward without escalation. | 1x Spicy Chicken Sandwich |
6sWEjh7FspjJYw9HivFY8n | RBI Bakeoff | YES | Agent captured the full order (Spicy Chicken Sandwich) and directed customer to pull forward to the window without escalation. | 1x Spicy Chicken Sandwich |
a3qyNpTtvTGtfYjsa7BzHH | Simulation Run 2026-08-17 00:35 | YES | The agent fully captured the order for one spicy chicken sandwich and directed the customer to pull forward without escalating. | 1x Spicy Chicken Sandwich |
2JtHRDjHJ9ibN6e7yurpaF | Simulation Run 2026-08-17 01:07 | YES | Agent fully took order for one spicy chicken sandwich and directed customer to pull forward to the window without escalation. | 1x Spicy Chicken Sandwich |
F7F8EbpcSERKfrP3B5ziTL | Simulation Run 2026-08-18 22:29 | YES | The agent fully captured the order (one spicy chicken sandwich) and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
One bacon and cheese sandwich combo, large, with fries and strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
3Gk8orKbzA5BV2n5zCviSW | RBI Bakeoff 2026-07-23 | NO | Agent said 'They'll help with the rest there,' implying escalation to a human team member at the window. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
Hd4K9twCc2DKhhmgzBBS5r | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human by saying 'An employee will help you out.' | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
FkZVyG8dMZjUTwS2vvfrMT | RBI Bakeoff 2026-07-24 | NO | Agent did not direct the customer to pull forward or the next window and mentioned an employee will assist. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
2UuUTSrsH3NpXjq2WyYBPN | RBI Bakeoff | NO | Agent could not verify order alone and escalated to human for order verification. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
hrqcVzKKzAuLCD7cQbHvsu | RBI Bakeoff | NO | Agent confirmed full order but escalated by saying an employee will assist, indicating a handoff. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
6Tc9Pduphhy49fR6DA8RZ9 | Simulation Run 2026-07-20 23:58 (scratch) | NO | The agent did not complete the order fully by themselves and directed the customer to an employee to verify the order at the window. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
2fgHmiEUmnH4t6H7SRFMXe | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ALKXKFXSAwnAUmT8JfyzMk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DcRXdMWxxYNDoD7AoTbpcq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ExSjYh6tDvGGYN4gVPiCC2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SGgKBbm6nYcncEVL37vjNi | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UjGAi38KX6dkJeyTU7bCKP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XXcqvjwBS5Y86aUcZezTZW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
h5EYuitvqmcwGNoZQFGYQW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iJspuBq8nqqR2ZkQrBjwF7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
n34XLSx2qM7ATCn8ato63U | Simulation Run 2026-08-16 21:10 | no transcript | — | |
2LGgTT95ffvNXHR5i8cKBn | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript is incomplete; no agent response about order completion or directing customer forward. | empty |
67CYfoUMkLp397nkj8QfiT | Test new prompt (Aug) | no transcript | — | |
C4f8zw9KJxp7VvCN32omvM | Test new prompt (Aug) | no transcript | — | |
RyyJBZBN2pM4f58uiVvkRH | Test new prompt (Aug) | no transcript | — | |
bKC9fWTpmhcDFaSJ92jaCH | Test new prompt (Aug) | no transcript | — | |
e3NGscvobUGUrZesuiaU2p | Test new prompt (Aug) | no transcript | — | |
Pa3L83ZztxE9akEW34MXts | Simulation Run 2026-08-16 23:53 | YES | Agent took full order details and directed customer to pull forward without escalating. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
C8nGsaFpeyJsNiV78tQ4oz | Simulation Run 2026-08-17 00:35 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
KDxYJV6eMKvbMSMD8Trych | Simulation Run 2026-08-17 23:40 | YES | The agent fully captured the order including all sides and drink, then directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
38btr4SAWHFtDKDGFqoTTV | Simulation Run 2026-08-17 23:46 | YES | Agent took full order details, confirmed accuracy, and directed customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
9BzmubvXScGmaJwGvg8QC4 | Simulation Run 2026-08-17 23:46 | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalating or handing off. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
DfH6aSEwF5Zm7ma6z9h8vk | Simulation Run 2026-08-17 23:46 | YES | Agent fully captured order and directed customer to pull forward to the window with no escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
PRFiB2HdotB8gyYhuHxb5B | Simulation Run 2026-08-17 23:46 | YES | The agent captured the full order including sides and drink, confirmed it, and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
Qd6yDJMpvU8jP6b9sbYDea | Simulation Run 2026-08-17 23:46 | YES | The agent fully captured the entire combo order with all customizations and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
RECiUrGKZFC8wUjoyzUH2V | Simulation Run 2026-08-17 23:46 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
YFGVjQndRZjJPMXmaP5YMc | Simulation Run 2026-08-17 23:46 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
aHvZEdjv5wwZ9NYifFMFbS | Simulation Run 2026-08-17 23:46 | YES | The agent fully captured the order, confirmed order details with the customer, and directed them to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
dqNP8ChJb5tmEFuC8rmzvF | Simulation Run 2026-08-17 23:46 | YES | The agent captured the complete order details and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
h8ePYhw63Dq6LaayvXYpGd | Simulation Run 2026-08-17 23:46 | YES | Agent captured full order, confirmed it with customer, and directed to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
B2MWxUpcep8LCfAMCGXQUL | Simulation Run 2026-08-18 22:29 | YES | The agent fully captured the customer's large combo order with specific sides and drink, then directed to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |