You are an impatient customer who is in a hurry. You speak quickly and expect fast answers. You tend to interrupt the agent if they take too long to get to the point. You get frustrated with lengthy explanations and prefer direct, concise responses. You may cut off the agent mid-sentence if you feel they are being too slow or verbose.
Test case names jump to that scenario's conversations below.
Failures first within each scenario. Simulation IDs open the transcript in Coval. The judge note is Coval's written reason for the Completion verdict.
I'll take the 3-piece chicken combo, spicy, add a pie - make it the strawberry - and a premium strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
DrEesV5PPyPZtaRyvR5TCQ | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent escalated to a human by saying 'An employee will assist you shortly' instead of directing the customer forward themselves. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Caju |
A3NoDbhCqKc6gQAMUkBUfj | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human multiple times instead of directing customer to next window. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
fos7hhjNTVRxLq5oyfVRwN | RBI Bakeoff | NO | Agent escalated to human after refusing to read back order despite full order capture. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Caju |
W7XH6rpEKrfUZuzEJNbEnX | RBI Bakeoff | NO | The agent escalated to a human team member multiple times instead of completing the order and directing the customer to the next window. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Caju |
FkcmvU7ndGu9jnni7DeeEY | Simulation Run 2026-07-20 22:35 (scratch) | NO | Agent escalated to a human after order confirmation, not directing customer to next window. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
eZ6yTLtvuVJM5FYH7Piy7q | Simulation Run 2026-08-17 01:55 | NO | The agent escalated to a human when correcting the order quantity of strawberry pies. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Caju |
UQdiRpusCfUMEiTcEc6MqN | RBI Bakeoff 2026-07-24 | no transcript | — | |
2DUNZ2j5XiKHrEuzWUCHqm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4x3Zmok9rkCYuJghsgAJZ9 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Ay7jE6DmAiDLhZnFYHvgcJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PAqLaNwmhTx9aAJQCLM5cY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
STwuSKsCqU8bbBRzPSg3UM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Y3sNQA7RpTdpTbepeCsiY7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
d4oryvn7UZpF2Z8ZR5pb7C | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fMVaQRtfNwyyTp6XrHPmMz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
joEivzoYqwUfqGza99e7sa | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nXjuG7cbJPiozRejv58u6m | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SUshScBzDra6h4L9HpQFTZ | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript lacks agent messages and indication that the order was completed or customer was directed forward. | empty |
4mFpxBTnXB3W2Dq2jsGhwi | Test new prompt (Aug) | no transcript | — | |
BbuWoBtQiBEHNPuB9LQeBD | Test new prompt (Aug) | no transcript | — | |
ETWNMAZKwu7duoD7J976e4 | Test new prompt (Aug) | no transcript | — | |
WC6zp48rd39ERhqWfKdEox | Test new prompt (Aug) | no transcript | — | |
gNgnQT65sth5pMZVWvs3Ap | Test new prompt (Aug) | no transcript | — | |
oEiJqjppsazpR28AZzNzvM | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalating or bailing. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
QRyWWLMnJftnjK5LUHCXTJ | Simulation Run 2026-08-16 23:10 | YES | The agent fully captured the order and directed the customer to pull forward to the window without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Caju |
QHN4xKgjTT4FDAheCkdFVj | Simulation Run 2026-08-17 00:34 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
jxbnNQGMguhKa4KnmpJezH | Simulation Run 2026-08-18 22:57 | YES | The agent captured the full order, confirmed it with the customer, and directed them to pull forward without escalating. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
I'll do the 12-piece family meal with all dark meat, spicy, Cajun fries and cole slaw, and two Sprites.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
T26tZExU2UFbwxFqcwSv82 | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent escalated to a human team member and did not complete the order or send the customer forward without escalation. | 2x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
ndihmWWzxQYSRTLYVJf634 | RBI Bakeoff 2026-07-24 | NO | The agent did not complete the order; they escalated to a human for assistance multiple times. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
ADKAMQtnWSmb64cF9RtcCU | RBI Bakeoff | NO | Agent escalated to a human team member instead of sending customer forward after order capture. | 2x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
3Q7JaCgUXJnvS38LiLtRY9 | RBI Bakeoff | NO | The order was not fully captured due to a discrepancy in the number of Sprites, and the agent repeated the order incorrectly without correction. | 2x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
Z7dCbmiNvXmm2wEksPWpkD | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent escalated to a human team member instead of directing the customer forward after taking the order. | 2x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
o5Sm2UM5iR2LBNM7DjZG5P | Simulation Run 2026-08-17 01:07 | NO | Agent did not confirm or complete the order and did not direct customer to pull forward or next window. | empty |
4xfbE8fK8pB2gxmyacKdfP | RBI Bakeoff 2026-07-24 | no transcript | — | |
4fwUFUtvqT8A4UAn82WQoy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
5fCqNdHxKxH4EkEs436phJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
5fNtsomeKd84eTgpkvYnh2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KRGgeLYhwH8RYEPtndGBcw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NohzJJoym7BgyyevV7DWMS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SmsWgVqp7vj7rqSm4JATxh | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ceQTXPDdBBh6CbGD5FB3P5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
d8akQMxz7fjrV6UGuffNC4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
is8uwHmh3DMmPLrkUSkeMX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kiW7JGpVui9iqq45XXGdrc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GCADCMZXt6fZGMs2T3sAbp | Test new prompt (Aug) | no transcript | — | |
HvxeBmK7LwcoYAo6Qfk8ku | Test new prompt (Aug) | no transcript | — | |
MbRkgZmziqPuZXoDzwuoDj | Test new prompt (Aug) | no transcript | — | |
WWdTr6YHGsdEjm5N9EAsWk | Test new prompt (Aug) | no transcript | — | |
gJSTFiyD9vsrnykif8fojw | Test new prompt (Aug) | no transcript | — | |
gpxeN9zQXxpowwUoPQSHJh | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalating or handing off. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
Gt2cSQjvh24UA6adXqX4mp | Simulation Run 2026-08-16 23:10 | YES | The agent took the full order, confirmed it with the customer, and directed them to pull forward to the window without escalation. | 1x 12 Piece Signature Chicken Family Meal (Spicy, Dark |
Z2qcWtXEkdzkPhgUMKLDdh | Simulation Run 2026-08-17 00:34 | YES | The agent captured the full order and told the customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Spicy, Dark |
Dq9CYkbZiPdwVQ8aLfKmgW | Simulation Run 2026-08-17 01:55 | YES | The agent confirmed the full order accurately and directed the customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Spicy, Dark |
j2dEtmTkNxrqZ69H9ivPe5 | Simulation Run 2026-08-18 22:57 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 12 Piece Signature Chicken Family Meal (Spicy, Dark |
Order three pieces of spicy signature chicken by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose mashed potatoes and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
RMyQSdnpW724NzF823ytex | RBI Bakeoff 2026-07-24 | NO | The agent escalated to a human by saying an employee will assist the customer. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
NeyqLS4uEphBsNxVgBEP3f | RBI Bakeoff | NO | The agent said 'An employee will assist you,' indicating escalation to a human team member. | 1x 3 Piece Signature Chicken (Spicy) |
izCEpTnUToz63eL8a7VLAR | RBI Bakeoff | NO | The agent confirmed the order but repeatedly stated an employee will assist the customer, indicating escalation. | 1x 3 Piece Signature Chicken (Spicy) |
MX74PsHpqNx2vyyGCLEuEb | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent escalated the order multiple times to an employee/human team member. | 1x 3 Piece Signature Chicken (Spicy) |
kcjMWXWoQT9zAjcdpoNuQb | Simulation Run 2026-08-16 21:10 | NO | The agent did not confirm full order completion or direct the customer to pull forward/next window. | 1x 3 Piece Signature Chicken (Spicy) |
oBheecYqGEN5CoLGWPn9yb | Simulation Run 2026-08-16 21:10 | NO | The transcript contains no indication the agent directed the customer to pull forward or the next window. | 1x 3 Piece Signature Chicken (Spicy) |
HuviC9276Rbc3EnzeT2rBv | Simulation Run 2026-08-17 01:07 | NO | The transcript never shows the agent directing the customer to pull forward or to the next window, nor confirming completion without escalation. | 1x 3 Piece Signature Chicken (Spicy) |
miZjoFRvA9bCgQZXNR3Hmf | RBI Bakeoff 2026-07-24 | no transcript | — | |
5bRJazBs5XeRhSCdNvxGNo | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript does not show agent directing customer to pull forward or next window, nor escalation or handing off. | 1x 3 Piece Signature Chicken (Spicy) |
8rsyFk5RTkdZj7k25YNggd | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript does not show agent directing to pull forward or next window after full order capture. | 1x 3 Piece Signature Chicken (Spicy) |
BmSNR9P2Mv42cVHrWkYQj6 | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript shows order taking but does not include directing the customer to pull forward or the next window. | 1x 3 Piece Signature Chicken (Spicy) |
GFvLP2v4BifcAB8jhSwLDd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RHCTiWBQykjaSA4EPDzGgz | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript shows order was captured but does not show agent directing customer to pull forward or next window. | 1x 3 Piece Signature Chicken (Spicy) |
fDTSRbWmoT2sKcvmKu5K8w | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript does not show agent confirming full order or directing customer to pull forward/next window. | 1x 3 Piece Signature Chicken (Spicy) |
gMP3xiU7jrwATmarFeHEw3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CV3Zrz6TR94n5GEaga2EoY | Test new prompt (Aug) | no transcript | — | |
CYZyQEXYG9ioSwR2BUWWGn | Test new prompt (Aug) | no transcript | — | |
Y2SszPGKjzV5sCfVNMqSGU | Test new prompt (Aug) | no transcript | — | |
ZsD6o8xfCTdp9rXBAfPUwv | Test new prompt (Aug) | no transcript | — | |
cXV9mpxLZCegAyUgEmUdaB | Test new prompt (Aug) | no transcript | — | |
VDiRpwzEfhmmTbrz5dTgvH | RBI Bakeoff 2026-07-23 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken (Spicy) |
nzUM5AEQNmwrZBB8WEtsVL | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent captured the full order of three spicy chicken pieces and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken (Spicy) |
Mzk7XnH5cDPCucN9PmvagM | Simulation Run 2026-08-16 21:10 | YES | Agent took full order and did not escalate; order captured as 3 spicy signature pieces only. | 1x 3 Piece Signature Chicken (Spicy) |
aReyVtmk9dKGvmgpsgJ72M | Simulation Run 2026-08-16 23:10 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
BibzJLWfPUo7UV8QNhmuCZ | Simulation Run 2026-08-17 00:34 | YES | Agent captured the full order and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken (Spicy) |
TdG4GQWXmNGwm4kyPjXnjD | Simulation Run 2026-08-17 01:55 | YES | The agent took the full order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken (Spicy) |
QoU27wMgduWXMxSTipjEYf | Simulation Run 2026-08-18 22:57 | YES | The agent completed the full order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
Order five classic tenders by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose cole slaw and a Sprite.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
k3h22RG72Dk3mkFu2McK5h | RBI Bakeoff 2026-07-23 | NO | The agent repeatedly said they would get an employee to help the customer and did not confirm the full order without escalating until the end, indicating a handoff attemp… | 1x 5 Piece Chicken Tenders (Classic, Bold BBQ, Buttermi |
SPQrSDiZbmWbgHsUYTqcck | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent repeatedly states an employee will assist and does not direct the customer to pull forward or the next window. | 1x 5 Piece Chicken Tenders Dinner (Classic, Buttermilk |
horBgh7HjezSQB7hCCirey | RBI Bakeoff | NO | Agent handed off to an employee instead of directing the customer forward after capturing the full order. | 1x 5 Piece Chicken Tenders (Classic, Buttermilk Ranch, |
L2ATPo3f2C2o7rQQEbfnWv | RBI Bakeoff | NO | The agent said 'Employee will assist you,' indicating an escalation to a human team member. | 1x 5 Piece Chicken Tenders (Classic, Buttermilk Ranch, |
XTenmjqvGSLZnD3heG6Z8j | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent repeatedly escalated to a human employee instead of completing and sending the order forward. | 1x 5 Piece Chicken Tenders (Classic, Buttermilk Ranch, |
nXspTU7J35xVCCb8XEQGum | RBI Bakeoff 2026-07-24 | no transcript | — | |
5nFYRnWv2U2Wrk5962oNYZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7vECsNcApJpjejer2ky3AC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9MbyTLM8gHs48AHgYeoKig | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AGJSxc33q7jEqoRYTLKYbH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GvJJ8xpegZpcRpQAkfMTgK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
K3zfphRxUPuypPkAX9ta2D | Simulation Run 2026-08-16 21:10 | no transcript | — | |
T8ecnzbm9k7Vrc9pG7rfKh | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XJjwd3hNKXX2aSBq3ZPm7e | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dZ92FDZkXHyknfJsrrjFKC | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hWgNsmknEiraxQrKHdseDd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nCHJJMtK3E9eQZreBvWbiK | Simulation Run 2026-08-17 01:07 | UNKNOWN | The conversation is incomplete and does not show the agent taking the full order or directing the customer forward. | empty |
9CzHXWcBA8B6rcoPZU56RQ | Test new prompt (Aug) | no transcript | — | |
R9Cw6XHmWQE4axbrE7bX7v | Test new prompt (Aug) | no transcript | — | |
RUFWgmeQMHLoacXV4tmQ6c | Test new prompt (Aug) | no transcript | — | |
Twz25GQUHpyyNma7rdzK6c | Test new prompt (Aug) | no transcript | — | |
az58mdBhwwRGoL35CjYeDL | Test new prompt (Aug) | no transcript | — | |
RnxQVwNxYFeiDDKdERCHZH | RBI Bakeoff 2026-07-24 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Dinner (Classic, Bold BBQ, B |
WWqYRH5fM4t4LqCyTP4WJd | Simulation Run 2026-08-16 23:10 | YES | The agent fully captured the order, confirmed it, and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, B |
QJakAM8sGEcZfBQg8xQSHV | Simulation Run 2026-08-17 00:34 | YES | Agent took full order and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Buttermilk Ranch, |
ZTst2pfyrZxsYZmXYZCyFv | Simulation Run 2026-08-17 01:55 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, B |
Dpk2YMpB4oqTbHvrp8RY4g | Simulation Run 2026-08-18 22:57 | YES | The agent fully confirmed the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Classic, Blac |
Can I have a Cajun Rice please?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
dmAFv6oQ8GWM769WUYxndv | RBI Bakeoff 2026-07-23 | NO | Agent escalated to human by saying 'An employee will be right with you.' | 1x Red Beans & Rice |
4FR4jwHRfqUvqgAJrF2XPT | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent failed to confirm order details verbally and ended conversation without directing customer forward. | 1x Red Beans & Rice |
Av6BQ8Qm2wEyCD5cGH3yDp | RBI Bakeoff | NO | The agent escalated the conversation by saying 'An employee will assist you.' | 1x Red Beans & Rice |
MAYfprdnawRdU4QxacycXn | RBI Bakeoff | NO | The agent repeatedly said an employee would assist, indicating escalation to a human team member. | 1x Red Beans & Rice |
7EnzSWe8PTuFvbZp7dsMc7 | Simulation Run 2026-08-16 23:10 | NO | The agent escalated the order by saying an employee will assist the customer shortly, not directing them to the next window. | 1x Red Beans & Rice |
E7PTctBqA59vn7DeXkx8PN | RBI Bakeoff 2026-07-24 | no transcript | — | |
6eNofFaV8XjHfkYbKASzX7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9LqApEFmmAm9VkYDDRHiwh | Simulation Run 2026-08-16 21:10 | no transcript | — | |
C3pCVEq2NoYGECEtG4QLHR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EiCYKZmST3eZtBK2z4WhrD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FMka2VVvn8coCCc5Jav6QM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HipV5TyCyxFkm5j8ucdmT5 | Simulation Run 2026-08-16 21:10 | UNKNOWN | The agent did not complete the order or instruct the customer to pull forward/the next window in the transcript. | empty |
PDYTLQ8X6sFr3MvTeoZxr8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RypY2fjCo2rzLVhYch77Bx | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VehD5AXcRhHQdU5tKGbyzn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Xhc5PRMV3hSShJPNkHonjk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Q9ZAoiKYnMpptE48xc7AkJ | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent taking the full order or directing the customer forward. | empty |
22sZDKQ9P8U42pCD2fj8Re | Test new prompt (Aug) | no transcript | — | |
4WdBHjvn8GyfDjgpZKzgTn | Test new prompt (Aug) | no transcript | — | |
PGj6G3mM2VPmthnB3NNkq5 | Test new prompt (Aug) | no transcript | — | |
Ymo5dLFQvEgkz6h5chipAC | Test new prompt (Aug) | no transcript | — | |
a4tPHTcMSRusbKJdeMcxem | Test new prompt (Aug) | no transcript | — | |
fUiq6WipFiroxx9UihpND5 | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Red Beans & Rice |
3QUrAsAFGGUiFrfMjimYbd | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent fully captured the order (red beans and rice) and told the customer to pull forward to the window without escalation. | 1x Red Beans & Rice |
o5erW6Bpf8heEG7A7USHNC | Simulation Run 2026-08-17 00:34 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Cajun Fries; 1x Red Beans & Rice |
824mhA9onMLbh52SAAQcdg | Simulation Run 2026-08-17 01:55 | YES | The agent fully captured the customer's order and directed them to pull forward without escalation. | 1x Cajun Fries |
HHKvZq4WY7sNu4BA6kLNvp | Simulation Run 2026-08-18 22:57 | YES | The agent fully captured the order for one regular red beans and rice and directed the customer to pull forward without escalating. | 1x Red Beans & Rice (Rice) |
One bacon and cheese sandwich combo, large, with fries and strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
S2nt5XpzxTVxKpLrvjM494 | RBI Bakeoff 2026-07-23 | NO | Agent escalated to a human employee instead of directing the customer to pull forward. | empty |
ciZyDKcgRkCyEdr5vqhRW8 | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent escalated to a human team member multiple times and did not direct the customer to pull forward or the next window. | 1x Classic Bacon & Cheese Chicken Sandwich Regular Comb |
aVUFmPfhWtMFhfi2WUiCeq | RBI Bakeoff 2026-07-24 | NO | Agent escalated to a human multiple times and did not complete order or direct customer forward. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (C |
Db4jZpvxRZKvZu9t3wnHtL | RBI Bakeoff | NO | The agent escalated the order to a human team member by saying 'An employee will assist you.' | 1x Classic Bacon & Cheese Chicken Sandwich Regular Comb |
noFkHxkLEw7y3zikBTzdya | Simulation Run 2026-08-17 01:55 | NO | The agent failed to include the strawberry lemonade in the initial order confirmation before directing the customer to pull forward. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
YmjXaRMRDrWmkMLGqYNLXG | RBI Bakeoff 2026-07-24 | no transcript | — | |
4uLdZQAvwPEB8KrJN2rsgU | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8x3dv6E5qcMTGHkjo32uke | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AmhX7SHNYq6rFby4j2b6EW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CAuMz2eFddQS2CmMRxVart | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LpUHGVr5dNtQXydZKLDzH5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UfdXg8vE2MxoXzk2ehQgDL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
apYpN8eVAwSY6Yhy8E2zZJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
c6MHQrbEwPmASqiXUW6kj4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ddLk3kgewuZ3RQtMfRnTNk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hB5eALm56hyg9E3NLbwQsR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PtDUc8V5Hop4UBDykhWpFZ | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent capturing the full order or directing the customer forward, nor escalation. | empty |
HEdzATjYD7VkdfMbYNYfcN | Test new prompt (Aug) | no transcript | — | |
HFNXaBjbiyVHyuoYcNdJFP | Test new prompt (Aug) | no transcript | — | |
cet6AzXdn4mGWQVgM9Zmq3 | Test new prompt (Aug) | no transcript | — | |
iSR8suxePWW9CazaFkq4h9 | Test new prompt (Aug) | no transcript | — | |
oCnTXEpkjKxjmrEV4qVpqf | Test new prompt (Aug) | no transcript | — | |
9te6pw3n3tttCEoX54L22Q | RBI Bakeoff | YES | The agent captured the full order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
eKxqAcR838Z3mVDTuiZekt | Simulation Run 2026-07-20 22:35 (scratch) | YES | Agent captured full order details and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Regular Comb |
ToCwvDPHhQCXM4sSP6e9SG | Simulation Run 2026-08-16 23:10 | YES | Agent captured full order, confirmed it with customer, and directed to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
MuXuUSsuqSTZHrDq6tEvPo | Simulation Run 2026-08-17 00:34 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
nNG6PywTHrxG8CokQfE3Rx | Simulation Run 2026-08-18 22:57 | YES | The agent fully captured the order, confirmed it with the customer, and directed them to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich Large Combo |
One Ghost Pepper Sandwich, no combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
J688aB9ZNaYtWMzZpH5qDN | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent escalated to a human by repeatedly stating an employee will assist the customer. | empty |
cfXeQFyRTU9QvyXjZuPHPT | RBI Bakeoff | NO | Agent stated 'And employee will assist you,' indicating escalation to a human team member. | 1x Spicy Chicken Sandwich |
5czNDH2DsaV6ERMkiBFZbg | RBI Bakeoff | NO | Agent escalated the order by saying 'Let me get an employee to help you out.' | 1x Spicy Chicken Sandwich |
Ui9VdX2xCTRgHjcu5HwQz3 | Simulation Run 2026-08-17 01:07 | NO | Agent escalated by saying they will get an employee to help the customer. | empty |
Vb3ULd5F4cNAS4QoYRcit5 | Simulation Run 2026-08-18 22:57 | NO | Agent did not capture the initial Ghost Pepper Sandwich order fully; it redirected the customer to pick another sandwich flavor. | 1x Spicy Chicken Sandwich |
fWMkSU4jbYYun8iHiAY3LH | RBI Bakeoff 2026-07-24 | no transcript | — | |
9Ehh4sSGRndfz5PXaEfBkS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
B3KDgsguo9dN9GyjXv5Qcc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BLghwb5UyrFxtLPrKtT7hS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DdCNmbRZWYMWfzSSn79jVh | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HV7uLYAqDGnuJQLpjyY9ut | Simulation Run 2026-08-16 21:10 | no transcript | — | |
MsfaLP2yrRQddSZ8vq4Dgt | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QqnEAx2vRCviLUTqgk5yKj | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Sv7Qphf3cZmNdn3XNsuYff | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UGDtDKLkvT7VVQMabr6iX5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
hyWRtsJBZf7pFcK3BNmkre | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4zhEqY5oT9TEjEJb2YhXE8 | Test new prompt (Aug) | no transcript | — | |
SB335TdbQVPSsM66c8dDYx | Test new prompt (Aug) | no transcript | — | |
awESh8Crt9WDAmTKvVzS76 | Test new prompt (Aug) | no transcript | — | |
f8jw5UMxTTPMDJGVm4fwQk | Test new prompt (Aug) | no transcript | — | |
nNDBdrAiR34pGuUigv8EMR | Test new prompt (Aug) | no transcript | — | |
8xbxnWmcY2yZdzrLDgVGeo | RBI Bakeoff 2026-07-23 | YES | The agent confirmed the order as one Ghost Pepper Sandwich and instructed the customer to pull forward to the window without escalation. | empty |
kQkALmyamWTG7ir97xg88K | RBI Bakeoff 2026-07-24 | YES | The agent confirmed the full order (spicy chicken sandwich only) and instructed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
Yu8jXA7NpZLz8m9f2ci47q | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent took the full order of one spicy chicken sandwich and told the customer to pull forward to the window without escalation. | 1x Spicy Chicken Sandwich |
NaarotgfCPiiybrzdYzg5R | Simulation Run 2026-08-16 23:10 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
cdfQNuNZCdi2KNmCTvNz9g | Simulation Run 2026-08-17 00:34 | YES | The agent captured the full order and directed the customer to pull forward without escalating or bailing. | 1x Spicy Chicken Sandwich |
inJzJ8e5JFW5Zgo6dLLCET | Simulation Run 2026-08-17 01:55 | YES | Agent captured the full order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
I'd like the 5-piece tenders combo, blackened and spicy, with cole slaw and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
bXuNgUS75xRxfaf3Svkcpd | RBI Bakeoff 2026-07-23 | NO | The agent did not direct the customer to pull forward or the next window but escalated to a human team member. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
f4YizsNNYXWxfegqC75hUH | RBI Bakeoff | NO | Agent escalated the order to a human team member instead of directing customer forward. | 1x 5 Piece Chicken Tenders Regular Combo (Spicy, Colesl |
YUUfL4vEUQFLjZEqtwSLaL | RBI Bakeoff | NO | Agent failed to complete order and escalated to a human team member for assistance. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
LBaxFJjGkjSUFC8JyZstM5 | Simulation Run 2026-08-17 01:07 | NO | Order details were captured but no indication the customer was directed to pull forward or to the next window, and the transcript ends before completion. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened) |
UPYUvPByrxYVE6kNRTETzT | Simulation Run 2026-08-18 22:57 | NO | The agent failed to accurately capture the order (too many style selections) but still directed to pull forward without resolving. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
fqi9csF3EGTSfstrq5qfHE | RBI Bakeoff 2026-07-24 | no transcript | — | |
2RWzAQe2xWWfbtPMtiKE57 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
6aUbNFW2fqThbUCjvdomYg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8Gvf7KzzaYHNSN4HXvLLah | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FJBMpnFbqdFeudipcgiCqs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UeTJRi8o2FRQr65hjTeFG3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Xa4YvEkVeS46KNhdESEDTD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XitGsDFsEg5scBH26ta6UF | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ah6hxqafo4x8iCbVZ2n5H4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dYFoNaTTnZQy77rvT9qFkv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
j6fWDoYEq94wph4jWGiX2k | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JenaoBCsMmBqqnsvyJNwmy | Test new prompt (Aug) | no transcript | — | |
NnF3Srw8eKxeeT2DMBTC6H | Test new prompt (Aug) | no transcript | — | |
SPtpfeYvtPpePKrJEmunky | Test new prompt (Aug) | no transcript | — | |
dD9KxbBt48RrkKv4wvCa3H | Test new prompt (Aug) | no transcript | — | |
gYyRcsyhcJa4WePFhbar3H | Test new prompt (Aug) | no transcript | — | |
6KPoXjg923wakYfmrXqm8D | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Blackened, Cole |
AL4MeNAHD78zKbAeJqfkJN | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order details and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Blackened, Spic |
8fBEec2FoPwVXKdPeKjSGZ | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent fully captured the order, confirmed it with the customer, and told them to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Spicy, Colesl |
QiEBHvQX4HbVvGEfCD6bGi | Simulation Run 2026-08-16 23:10 | YES | The agent fully captured the order and instructed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Spicy, Colesl |
ZRuPWzafWfU9pcyDKkwFyY | Simulation Run 2026-08-17 00:34 | YES | Agent captured the full order details and directed the customer to pull forward without escalating. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
AFqxt6xxxNpwMoowzp3b6J | Simulation Run 2026-08-17 01:55 | YES | Agent fully captured the order and directed the customer to pull forward without escalating. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
Order one classic chicken sandwich by itself. Do not ask for a combo. If the agent offers to make it a combo, accept and choose Cajun fries and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
CCyEdngGiZUikhXU2yiwk5 | RBI Bakeoff 2026-07-23 | NO | The agent repeatedly failed to complete the order and continuously escalated to a human employee multiple times. | 1x Classic Chicken Sandwich |
MkXPL7qRTDMr4MDriCzBfz | RBI Bakeoff 2026-07-24 | NO | Agent did not send customer forward but repeatedly stated 'An employee will assist you,' indicating escalation. | 1x Classic Chicken Sandwich |
5qwMkniwwoBXDjFqZjbDH5 | RBI Bakeoff | NO | The agent repeatedly stated an employee would assist, thus escalating to a human and not completing order alone. | 1x Classic Chicken Sandwich |
mpVDvraaMGNaFvZc44qwcc | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent repeatedly deferred to a human employee to assist, not directing the customer forward. | 1x Classic Chicken Sandwich |
LoyiC2KY5LkMfU2JoG34xL | RBI Bakeoff 2026-07-24 | no transcript | — | |
APEQFaCBNxicLs9SLTysoq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Bches7SKbBDL2n8J2BeE9P | Simulation Run 2026-08-16 21:10 | no transcript | — | |
S6yhcceCfKNTBzLFL3HKvi | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Ykc3m2HaDkFEs9HB2QBvn4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aJ3hrPP62ZMbnyHJpWrPb6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dZoaoRknWMLBeAcod93yFD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fTR3wPyyvoCPL9nhMFoxYd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iVLRVeakkot3Q9tQo3AeQN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jWbfsBUsGnnYfGifJgQHwU | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mEr2RFaMAKKdvFKVNFxmZq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CWECxPyAuY7QrfgWgRNXZK | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript doesn't show agent capturing the full order or directing customer to pull forward/next window. | empty |
7LCrKctheLrEKVVqiJPXMB | Test new prompt (Aug) | no transcript | — | |
Mx58hJGGFjPYCuHmV342ZW | Test new prompt (Aug) | no transcript | — | |
iVb4f7QddswyuX5xg8kiPg | Test new prompt (Aug) | no transcript | — | |
mBM7orcbk9PrzprYjhXu2Z | Test new prompt (Aug) | no transcript | — | |
mDGiPCSNPXnFKnga7rQHhP | Test new prompt (Aug) | no transcript | — | |
EV3SnwtkkAbsrdPvqNmcnN | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and instructed the customer to pull forward without escalating. | 1x Classic Chicken Sandwich |
2NocGpFPpeSQXAa5WmwxqN | RBI Bakeoff | YES | Agent fully captured the order and directed the customer to pull forward, no escalation occurred. | 1x Classic Chicken Sandwich Regular Combo (Cajun Fries, |
M9diSdXvCFmirnbSggsRAP | Simulation Run 2026-08-16 23:10 | YES | The agent confirmed the full order and directed the customer to pull forward without escalating. | 1x Classic Chicken Sandwich |
BRDNk4qii9kZoPiu8BjsdG | Simulation Run 2026-08-17 00:34 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich Regular Combo (Cajun Fries, |
cXxPdq7QigT8m2HRmDD752 | Simulation Run 2026-08-17 01:55 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
R8STXCzbCEDdULjeGZPy8U | Simulation Run 2026-08-18 22:57 | YES | Agent confirmed the full order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
Can I get the ghost pepper sandwich combo, swap the fries for red beans & rice, and a Dr Pepper?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
Nxsy79sYNhX3WE9Lu2mG4D | RBI Bakeoff 2026-07-24 | NO | The agent said 'An employee will assist you', indicating escalation to a human team member. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
WgD6fsG3rtiC2Dz4FUDhk7 | RBI Bakeoff | NO | The agent escalated to a human by saying 'An employee will assist you shortly' instead of directing the customer to pull forward. | 1x Classic Chicken Sandwich Regular Combo (Red Beans an |
6gv7FeZMXry3Qd2XyoGtzn | RBI Bakeoff | NO | Agent failed to read back the full order and only instructed the customer to pull forward. | 1x Classic Chicken Sandwich Regular Combo (Red Beans an |
LDXtaKxAjARmsm7m4Brnsw | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent did not read back the full order and told the customer to confirm with an employee at the window, indicating escalation or incomplete handling. | 1x Classic Chicken Sandwich Regular Combo (Red Beans an |
PyWL9C5P3fWC3mLcq7PwEj | RBI Bakeoff 2026-07-24 | no transcript | — | |
4fCJe6Gsrm7f2n3ErAmvmp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
5Fxttaq8BchuQNju6EGLn6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
E7rEWEpVYWPTebcW4Uz4nQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FWAXR6XbfG5HNNimKZ4t7K | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GmFNddmN9Nichfm9gjj4ux | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HSyJymdA2su6o87C3NmMTc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SLQaKWfNL5DFHz9eGbVxT2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Vs5y9ZpTn3Kae4qYLVS3rx | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WfKiv7e8ucBbDDGAUFEqQV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nz6FddY3B4CyfVGJFVCDnL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
3KiNvuVAKumEcfstBAjfve | Simulation Run 2026-08-17 01:07 | UNKNOWN | The agent doesn't confirm, take, or direct the order; only the customer speaks about the order. | empty |
8gRhkMd6Wi4C2Mv3C24vPd | Test new prompt (Aug) | no transcript | — | |
SGyexXmz9WtKJFnzgxcFka | Test new prompt (Aug) | no transcript | — | |
ShgZjtUCVUZSj9a7JRZmC2 | Test new prompt (Aug) | no transcript | — | |
U6MqeSVKMgQyU59Gu6D36R | Test new prompt (Aug) | no transcript | — | |
jk5dffuyZ9be4PFqEeHvr5 | Test new prompt (Aug) | no transcript | — | |
LgJiJxyXAzftxuRKVLQ9tS | RBI Bakeoff 2026-07-23 | YES | Agent fully captured order and directed customer to pull forward without escalating. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
dVUfSUJbwS7hxpaVdGEFHo | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent captured full order and directed customer to pull forward without escalation or handing off. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
GmUWYUdBxHHi9U3qdfJu8H | Simulation Run 2026-08-16 23:10 | YES | The agent fully captured the order and told the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
RWbzaJMTRHz3AgouV6PGTj | Simulation Run 2026-08-17 00:34 | YES | The agent fully captured the order and instructed the customer to pull forward without escalation or handing off. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
A2N5Hn6ZcJKTgek49n3Zg5 | Simulation Run 2026-08-17 01:55 | YES | Agent fully captured order and directed customer to pull forward without escalation. | empty |
RMtGh9aUyEFkU5QdvSzAks | Simulation Run 2026-08-18 22:57 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
Do you have nuggets?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
38rcejCoGuJhnCxogWSQyZ | RBI Bakeoff 2026-07-23 | NO | Agent escalated the conversation to a human employee and did not complete the order themselves. | 1x 5 Piece Chicken Tenders Large Combo (Cajun Fries, La |
ejspfMRPY4eUiTMrpcJKCu | RBI Bakeoff 2026-07-24 | NO | Agent escalated by stating 'An employee will assist you,' indicating a handoff instead of directing the customer forward independently. | 1x 3 Piece Chicken Tenders Regular Combo (Classic, Caju |
iRu8gSv5t9GcYnJ7e4EzwN | RBI Bakeoff | NO | The agent did not direct the customer to pull forward or the next window; instead, the agent told the customer to check the screen for errors and mentioned an employee wo… | 1x 5 Piece Chicken Tenders Regular Combo (Spicy, Cajun |
CTANLChJxR7DgWPvKc9bAz | Simulation Run 2026-08-16 23:10 | NO | The agent never directed the customer to pull forward or go to the next window after taking the full order. | 1x 5 Piece Chicken Tenders Regular Combo (Cajun Fries, |
4tASqWp2JL4qcBHgYVzGAb | RBI Bakeoff 2026-07-24 | no transcript | — | |
3eMAD3C47udbix3WYcR6mb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
3s6ZcBp8WZeY6coSJhoKAT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
5RnkhVVrkDia7KwyKW9mWN | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BavCLCnbsqYqNoyqytUfTS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LPABnKkKxmQHpcMoNCxbtr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PHMW9xKTVxdmnzCavAfLr6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Pi5TNZ3VL7HqZ6sdSVSuBn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RCCLq2VUkUtS2k5dncbFcQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Z37L4qNzEgXpJsYfUj5v2W | Simulation Run 2026-08-16 21:10 | no transcript | — | |
a4tErswSNgCdLy2gdHtrzw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
icvnxcVd7TqeBQ4dF7A2q9 | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent taking the order or directing the customer forward. | empty |
JpY6h8aVSdmBGCUp7x7vy2 | Test new prompt (Aug) | no transcript | — | |
QULdG6HrCyFpLvjp3CkVgm | Test new prompt (Aug) | no transcript | — | |
UDQJ2RnQ8YDkrJ2vk6L8p2 | Test new prompt (Aug) | no transcript | — | |
ecqknbz9BoKPE8PbzJqWv7 | Test new prompt (Aug) | no transcript | — | |
iP5pENfJFUBQGTHDpf6xS4 | Test new prompt (Aug) | no transcript | — | |
AnwzDuNAoncEdWTaWXFHR7 | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent captured full order and instructed customer to pull forward without escalation. | 1x 3 Piece Chicken Tenders (Buttermilk Ranch) |
oMQmscQCtF3PghQfCZMb32 | RBI Bakeoff | YES | The agent captured the full order and told the customer to pull forward without escalation. | 1x 3 Piece Chicken Tenders Dinner (Buttermilk Ranch, Cl |
a3SY8XaqvzUAdrVLKdm6b5 | Simulation Run 2026-07-20 22:35 (scratch) | YES | Agent took full order (3 piece chicken tenders, side fries, ranch) and told customer to pull forward, no escalation. | 1x 3 Piece Chicken Tenders Dinner (Classic, Cajun Fries |
nu4q94rSgjrwcxBbApcbAD | Simulation Run 2026-08-17 00:34 | YES | Order was fully taken and customer was directed to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Cajun Fries, |
gzo7y4cYVHcFwjSdXKZ7aC | Simulation Run 2026-08-17 01:55 | YES | Agent took full order for five-piece spicy tenders and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders (Spicy) |
4YqjKN8h3a2ZjGCDXzcHvR | Simulation Run 2026-08-18 22:57 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 5 Piece Chicken Tenders (Classic, Buttermilk Ranch) |
Can I get the Ghost Pepper Sandwich combo? Actually, change that to the regular chicken sandwich. And make it spicy.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
8trjuCiRv2XtYqijYbkdmi | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent escalated to a human employee instead of completing the order and directing the customer forward. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
6dY6NBjup6EyayNDD5T4Af | RBI Bakeoff | NO | Agent said, 'Let me get an employee to help you out,' indicating escalation to a human team member. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
eocPooQp5X99aKRv5WKYaB | RBI Bakeoff | NO | Agent escalated to a human team member twice and did not complete the order alone. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
7dd6WzTQjF7b8tAi8cvhzJ | Simulation Run 2026-08-17 01:07 | NO | The agent did not capture the order or direct the customer forward; the order was repeated by customer only. | empty |
YYXWK6v8JzuZ8GXNEaN5TA | RBI Bakeoff 2026-07-24 | no transcript | — | |
2mrymRLsBJQqAnBQbneZWE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
H2f5YboiwHsXHPqQWrcRYz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
H9megY24eyePLoXh5SqkV6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HQ9xLwpkMVQgfAxhV9qagJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KUfMyeuMb4ekYuqWUSX6Ut | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LNfeeDj7H2rEuTSoNeH2ho | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PwdiNvbk98phYhxcGd8gF6 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QCXNqToSGo92FLdfpG2PZL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
j4J7Bd2WPtE9pGiyzR4E2i | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kCXK2E4Aco6xirBbdpeEoS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8DDRgkZE95hxKgXJR6XkHb | Test new prompt (Aug) | no transcript | — | |
ECfA8PLPYbED2bDM8LC8et | Test new prompt (Aug) | no transcript | — | |
RCNSisL3VxSnRurkc6CZj2 | Test new prompt (Aug) | no transcript | — | |
XsjbpxvV3qC38Vv8GnfkUH | Test new prompt (Aug) | no transcript | — | |
gBWJ6m5JVBrWF4WY2ZR39h | Test new prompt (Aug) | no transcript | — | |
YyitKxTVuKe8QuPtJtPsQN | RBI Bakeoff 2026-07-23 | YES | Agent captured full order including sandwich, side, and drink, then directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
L52qvLK7herupibzdw8Hpe | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x Spicy Chicken Sandwich Large Combo (Cajun Fries, Mas |
Ys3q4SyWptbRZRUitaYiBY | Simulation Run 2026-07-20 22:35 (scratch) | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
ETbZNmXEM4wc8SqRM6PEKP | Simulation Run 2026-08-16 23:10 | YES | The agent fully captured the spicy chicken sandwich combo order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
f4hoWCvsQZn5qVDdiKWS9v | Simulation Run 2026-08-17 00:34 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Large Combo (Large Coca-Cola, |
XSdNZHUJSz67Ab89R2EFhE | Simulation Run 2026-08-17 01:55 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
jAZhatkYbjhrnPvK5QUiMX | Simulation Run 2026-08-18 22:57 | YES | The agent took the full order, confirmed it, and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
I'll do the chicken sandwich by itself and a side of fries.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
9oKMtxV4HFLpPzhGufMYCK | RBI Bakeoff 2026-07-24 | NO | The agent escalated to a human team member for assistance multiple times instead of completing the order. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
mxEQ2BvhiUmbhuzaRuCtdR | Simulation Run 2026-07-20 22:35 (scratch) | NO | Agent escalated to a human employee multiple times and did not complete the order or direct the customer forward. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
U5kdXS4rA39txMJm9EFHmy | Simulation Run 2026-08-16 23:10 | NO | Agent escalated to a human employee to fix the order issue and assist the customer. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
ncJNufA5PCAKNgsLJhKdVE | RBI Bakeoff 2026-07-24 | no transcript | — | |
2vnFJGua23xe9sHXbPXXvx | Simulation Run 2026-08-16 21:10 | no transcript | — | |
47D8fmUt7BejUHFdyheBnb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7FLqKe7rS3sBQCLc7xVGqD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7cu6NypYXtXbNarnLDLgQg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CTyYUFpM7bfbzSeRd6odvY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DgtGwwPzRNM247n56pUzpf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UDHmUzRAu6NUZwrCKXAJDp | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Wds74ZPekqy5nKTGZmRFr2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Xcrirv44FV2kbvuZuJ3afc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
izcU9WLjdX9NyE5TDKEHUf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
bpxjsSjZAYSPDKpThAjDbo | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript does not show order completion or directing customer to pull forward/next window. | empty |
QrP8VNFj83wib9PyzS69JL | Test new prompt (Aug) | no transcript | — | |
TJsph3LLQgmLHLqwUEkdtA | Test new prompt (Aug) | no transcript | — | |
dT82YvUHSw3vYmkcVE8eEJ | Test new prompt (Aug) | no transcript | — | |
epELpPVikcv3xjoenS5HFX | Test new prompt (Aug) | no transcript | — | |
j368isYJoeNkZf7Zwa2HZo | Test new prompt (Aug) | no transcript | — | |
JPy6HHJyawpU9ynXy3AR3z | RBI Bakeoff 2026-07-23 | YES | Agent captured full order and directed customer to pull forward without escalating or bailing. | 1x Spicy Chicken Sandwich; 1x Cajun Fries |
XrKix7jc2pi8MhKKSTSUWM | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
eyVnmTSGgkhXBKr9QCu87e | RBI Bakeoff | YES | The agent fully captured the order and instructed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich Regular Combo (Cajun Fries) |
KvnBnTCwfRcfu9qq4FKQWh | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich Dinner (Cajun Fries) |
6jknDTRm4aQCMiGLC8FzqR | Simulation Run 2026-08-17 00:34 | YES | The agent fully captured the order and told the customer to pull forward without escalating. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
ZKvq3bgEAD5Q4rGM8xnKKW | Simulation Run 2026-08-17 01:55 | YES | The agent took the full order, confirmed it, and directed the customer to pull forward without escalation. | 1x Cajun Fries; 1x Spicy Chicken Sandwich |
9xoWeGKzvfRNxxkfaaMB4P | Simulation Run 2026-08-18 22:57 | YES | Agent fully captured the order and directed the customer to pull forward without escalating. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
Order one regular bacon and cheese sandwich by itself. Do not ask for a combo or a large. If the agent first offers to make it a regular combo, accept with fries and a Coke, then accept a subsequent l
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
YynXmhVr8UHShiBsBWxYq5 | RBI Bakeoff 2026-07-23 | NO | Agent escalated the conversation to a human by saying 'An employee will assist you' multiple times. | 1x Classic Bacon & Cheese Chicken Sandwich |
RDpw7aeufNascPGPMWRUY3 | RBI Bakeoff | NO | The agent did not direct the customer to pull forward or the next window after taking the order; no instruction to proceed was given. | 1x Classic Bacon & Cheese Chicken Sandwich |
jVcSu6wmTBvvAUiJaiakBM | RBI Bakeoff | NO | The agent handed off the customer to an employee, so did not complete order alone without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
aTYdtq5oQCjd8YCLu6DUG3 | RBI Bakeoff 2026-07-24 | no transcript | — | |
6HJWJvf7KpWpGcNMV3fQmD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
B8hTDempmXbPHmJZDa9i6e | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CbCCi29mAhM2J4jm8EC8bV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
K69PYcNKXFewoJDKxu6LHS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Vnnm26ZtJ3n4Avb7KktzP8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
b7Y7XW6kowfY7afM4p4ncY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dAVZfkufJovf8bAfptXibJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gFtk8KCFd3sBXyqhENW79M | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jenRNL67eysTfgiBV9eHWw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
oHSsFcUr5VmJrXUGqGjY4A | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HRYj2NrvUd4GSTDkNcNanY | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript does not show the agent taking or directing the order. | empty |
5DP59QoMxpPGjTC3Tbew3E | Test new prompt (Aug) | no transcript | — | |
Ghp4q8fSaahvnvBChQ8Dya | Test new prompt (Aug) | no transcript | — | |
MscKMVuZ8f8DUmpkoUzJkA | Test new prompt (Aug) | no transcript | — | |
QJhtNkdCTXYSXSH576xvA7 | Test new prompt (Aug) | no transcript | — | |
TiTczuTHLEEDNbCM6U9yTf | Test new prompt (Aug) | no transcript | — | |
mCqhwPt4AqZpzGpk9Wft8J | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent confirmed the full order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
FsyE3oEsy4nuWQxjQBPXAq | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
4Js3xR9dcA2yN89fVaoEQe | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent took the full order and directed the customer to pull forward without escalating. | 1x Classic Bacon & Cheese Chicken Sandwich |
oCU4WFYztEXKFjgJVJsmrV | Simulation Run 2026-08-16 23:10 | YES | Agent captured the full order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
77qtriwG6sxW2xyLfV9rWS | Simulation Run 2026-08-17 00:34 | YES | The agent confirmed the full order and repeatedly directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
kiJT98hiANSjEus5bNkL8i | Simulation Run 2026-08-17 01:55 | YES | The agent fully captured the order and repeatedly directed the customer to pull forward without escalating. | 1x Classic Bacon & Cheese Chicken Sandwich |
nAfGjCzWjD6ZCKfSabUFUu | Simulation Run 2026-08-18 22:57 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
Start by ordering the 3-piece signature chicken combo, spicy, with mashed potatoes and a Coke. Before the order is finalized, change it to the 4-piece combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
bhN63QEE2oecgRbg9VRJ4o | RBI Bakeoff 2026-07-23 | NO | The agent escalated to a human team member to assist the customer instead of completing the order and directing them forward. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
VStaSzuWAkfQeLfmxUREEB | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent escalated to a human team member instead of directing the customer to pull forward. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
CUZPVPjih2fqBusxQpHaho | Simulation Run 2026-08-17 00:34 | NO | The agent escalated to a human by saying they would get an employee to help. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
7r7PxEKxM8ixVbS9bJwMno | RBI Bakeoff 2026-07-24 | no transcript | — | |
35Zcvx2AyRddd2rqTC9GML | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Jpu7qVByo4dNHHZfbndynV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
K6KcmRQNo9JGfjuAVmsMYo | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NsbX59QaxUsEQPYRcAgzvs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YEQ6UkfLsXAT7x6Z5skzvD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZBqqyd2gCw2fZSs8A5gjVE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aKuCevybGjtrBHS2q34G4r | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ba9YtYTaZsLHAv2rki9MhG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
by9wFFByTe8XEL6xbvox5C | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kqdtwyFBQjDqk96okKXzUc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
N8YZhKLdHdaMhKQkDLBCeV | Test new prompt (Aug) | no transcript | — | |
RUkYTBKdv3KtUR2aR8Ekd6 | Test new prompt (Aug) | no transcript | — | |
XKJpdcdXiziUfUdaAqXt8R | Test new prompt (Aug) | no transcript | — | |
erMfcnZi8yEkZc6KBVA7K8 | Test new prompt (Aug) | no transcript | — | |
nXLsiC8PAC5QqoLvVpHSon | Test new prompt (Aug) | no transcript | — | |
bteXYiLDpMU6T96nbV695b | RBI Bakeoff 2026-07-24 | YES | The agent took the full order, confirmed it, and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
bBJeStiPXgRGKWphzCeMf2 | RBI Bakeoff | YES | Agent took full order, confirmed it, and directed customer to pull forward without escalating. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
HsqDp6BZzEFu6BdThnBd6A | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
MEtDyF8fZhK3vjWwMhCY37 | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
KQYyCzeTReqMZGTeqBNogX | Simulation Run 2026-08-16 23:10 | YES | The agent fully captured the order and directed the customer to pull forward without any escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
nSaioQWL4hi2hpij5Rk4PU | Simulation Run 2026-08-17 01:07 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
esUjrh6JTEG7kGodpXSZgF | Simulation Run 2026-08-17 01:55 | YES | The agent fully captured the order including all sides and drink, confirmed with the customer, and directed them to pull forward without escalation. | 1x 4 Piece Signature Chicken Large Combo (Spicy, Mashed |
b8WrN6XHrRyXN4F2fNLN7m | Simulation Run 2026-08-18 22:57 | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
Give me the chicken wrap bundle with a mango lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
G2ELhLkSGGBuAtTgyBMKeY | RBI Bakeoff 2026-07-24 | NO | Agent escalated the customer to an employee without directing them to pull forward or the next window. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
fmyZAbCisqoiEm9HpfuKRD | RBI Bakeoff | NO | Agent escalated the conversation to an employee, not sending customer forward directly after full order. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
4n5v4PQKe6ziKEBXkUkvxj | Simulation Run 2026-08-16 21:10 | NO | Agent repeated the greeting and did not capture or complete the order, nor sent customer forward. | empty |
HABL5zTc5GbYCw8BZuqkQ7 | RBI Bakeoff 2026-07-24 | no transcript | — | |
LLRaCz8zf3yniuyhKs4Gaa | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NMboqAL8qRkGJdtueNQt3f | Simulation Run 2026-08-16 21:10 | no transcript | — | |
TDFEMSTZtHqMKCcVvsfPAB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VH8Gn6zJThpW2BrE4oaLy5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WuV6n7PJqYhmgT9pssNTjT | Simulation Run 2026-08-16 21:10 | UNKNOWN | The agent never confirmed the full order or directed the customer to pull forward or next window. | empty |
WzcBDPaFRMgeXNGudkDNXx | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZnLHW946Rt2xpFFoVi69XW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
imYXkVrxMJWvbSWzrXfgGB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kkJgbVnis2jt4g4CRfk28z | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Z7rXm35daMGovcXct7o5iE | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent taking or directing the order forward, only customer's repeat request is seen. | empty |
Jn9CygJsWWyrwz8CnWqb2c | Test new prompt (Aug) | no transcript | — | |
MdqibtkuTQh4PtGut9wkyh | Test new prompt (Aug) | no transcript | — | |
gDnnZ4NHgSpYcp2BJVXRkE | Test new prompt (Aug) | no transcript | — | |
jexyDbeueLf2yaM3yvHbWS | Test new prompt (Aug) | no transcript | — | |
nsE6PnZxWgKMRApm6xAB4N | Test new prompt (Aug) | no transcript | — | |
LamyD3urPAEjf3Kbi8DTHf | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and instructed the customer to pull forward without escalation or handoff. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
6fYGKrgfKPkd3RbovaSmm7 | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order (chicken wrap bundle and mango lemonade) and directed the customer to pull forward without escalation. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
nDRprcHeRwrbLgED6jyMW6 | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
kNQUiNH37rKHdeY6zQnWi4 | Simulation Run 2026-07-20 22:35 (scratch) | YES | Agent took full order including wrap styles and directed customer to pull forward without escalation. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, S |
gkd7r2so3bHaPqchraxdtW | Simulation Run 2026-08-16 23:10 | YES | Agent confirmed full order and directed customer to pull forward without escalation or handing off. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, S |
NtN7hM6yo8SkE7Ubc6ESNf | Simulation Run 2026-08-17 00:34 | YES | The agent fully captured the customer's order and directed them to pull forward without escalation. | 1x Wraps Bundle (Classic Wrap, Chilled Mango Cane Sweee |
R3xhmCEMVUsqdkXkvRD9pt | Simulation Run 2026-08-17 01:55 | YES | Agent captured the full order and instructed the customer to pull forward without escalation. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
kWH5UDAuDeAsTo4k8cuggc | Simulation Run 2026-08-18 22:57 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Wrap Regular Combo (Classic, Chilled Mango C |
I'd like the 3-piece signature chicken combo, spicy. I don't want fries. What other sides do you have?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
RcxV5Yx3Cq7G4P7aDzD5i5 | RBI Bakeoff 2026-07-24 | NO | The agent escalated to a human employee instead of sending the customer forward after taking the order. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
it6EqAcXt9gjuSN7pyPm4E | Simulation Run 2026-08-16 21:10 | NO | Agent did not take the order or direct the customer forward; agent repeated the greeting twice without order capture. | empty |
2DQtP39iVDKVZyDk6tqTKu | RBI Bakeoff 2026-07-24 | no transcript | — | |
28tPnpExJuKiLgGFYZ8Zec | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NqeYS7T7EgneNKLqxsFFJH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Qj5q9T6aFBiHJDGyexL2cy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RYVCv6XcK8JLTQbDxnSHPf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XFghRDBDRzqDnQQKxdcvhT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZtvCCd9pV7VPwCMSqgz4rS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cBfXkcyiiWCZXpyPX4w7uv | Simulation Run 2026-08-16 21:10 | UNKNOWN | The agent did not take the full order or complete the transaction in the provided transcript. | empty |
iebULpx9UDePAAHinQ9HZK | Simulation Run 2026-08-16 21:10 | no transcript | — | |
oDAVQmbxm8K8CuvtNVzThC | Simulation Run 2026-08-16 21:10 | UNKNOWN | The agent did not complete the order or direct the customer forward in the provided transcript segment. | empty |
SvT2T9pqHSs8EPCSRLfRnv | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript has no information about order completion or directing customer forward, no agent actions shown. | empty |
C8e6xiPUaxbZ4RessBoEnq | Test new prompt (Aug) | no transcript | — | |
MYNHwc998wH4ksZPnxovS5 | Test new prompt (Aug) | no transcript | — | |
aKB6WaAWk2wu7NpM8J4ktn | Test new prompt (Aug) | no transcript | — | |
e8H6oHmMARFUcUwy4pTdKM | Test new prompt (Aug) | no transcript | — | |
oKsJ89E6a3LhmBV3JuZWA9 | Test new prompt (Aug) | no transcript | — | |
bvmgxDM7m6QMqnd3fNNZk2 | RBI Bakeoff 2026-07-23 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
esALx5urKHsTRxnqsk8uyV | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
nLwrKs3EfXPbzv4oBzyegw | RBI Bakeoff | YES | The agent fully captured the order, confirmed it, and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
grGEigLGTdvYPKozwS4H6x | RBI Bakeoff | YES | The agent fully captured the order with spicy chicken, coleslaw side, and Coke, then directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Cole |
4RLNnwKHrWQcFqSqAozCPf | Simulation Run 2026-07-20 22:35 (scratch) | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
T84Eg2vggiFLsin3mDADcc | Simulation Run 2026-08-16 23:10 | YES | Agent took full order (chicken combo, mashed potatoes, and Coke) and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
a5JNKX5pB2rKGs5Pfc6mEn | Simulation Run 2026-08-17 00:34 | YES | The agent fully captured the order including modifications and directed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
mvhAhiMBXfmerDFT8bNE3v | Simulation Run 2026-08-17 01:55 | YES | The agent fully captured the order, confirmed accuracy, and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
CPUi3SYiCGcHCzfWZKhM9X | Simulation Run 2026-08-18 22:57 | YES | The agent fully captured the order and directed the customer to pull forward without escalating to a human. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Cole |