You are the simulated caller/customer in the test scenario, not the service-side agent or business. Never introduce yourself as the nurse, banker, support representative, or company. Speak quickly and use short, energetic responses. Keep the conversation moving fast while still providing the details the agent requests.
Test case names jump to that scenario's conversations below.
Failures first within each scenario. Simulation IDs open the transcript in Coval. The judge note is Coval's written reason for the Completion verdict.
I'll do the 12-piece family meal with all dark meat, spicy, Cajun fries and cole slaw, and two Sprites.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
SrNMwrjQXwPYYWBsK9L9Mi | RBI Bakeoff 2026-07-23 | NO | The order includes two Sprites but system shows only one Sprite ordered, indicating incomplete capture. | 2x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
RkAH27zjroTHB5wQoxtEX4 | RBI Bakeoff | NO | Agent failed to capture the correct quantity of Sprites; only one was recorded instead of two, thus order not fully captured. | 2x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
EmXP4qEJxCx7529ece5d5N | Simulation Run 2026-07-20 22:35 (scratch) | NO | Agent asked about drinks after initial order but never confirmed the full order correctly (quantity mismatch) before sending customer forward. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
npVZSvG43vS2FHMpCTFggF | Simulation Run 2026-08-17 01:07 | NO | The agent did not confirm the full order or direct the customer to pull forward; no order completion is evident. | empty |
FQtrsuhhZDyfW6hQMTJVof | RBI Bakeoff 2026-07-24 | no transcript | — | |
36QMkMLd4N7PHRvZotFkxD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
6Jjjr35B44yoDrNz2e7vkZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
73BCQFkYUXMstnohrDBJtz | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent confirming the full order or directing the customer to pull forward or the next window. | empty |
AaJ9LvYdz2yFmvaz5TcWSL | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show order confirmation or directing the customer to pull forward or the next window. | empty |
CpBrnB9ZV7QKogpG7FpjRd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UB7yuBPLJUvKJT5TrCL6WJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
V7Eavmb5SPXa92NmnKTZLz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
a4CMFCWwsChSfm2vjRmqvG | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript does not show agent confirming full order or directing customer to pull forward. | empty |
enoVLS2DKZQRb7RBWsHYEz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jhcrogsgYLzPisPDNHxvhS | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent confirming the full order or directing the customer to pull forward/next window. | empty |
9w7BzsAuY42cBEMVq66sFP | Test new prompt (Aug) | no transcript | — | |
Gax3xoBRPQagkGDWTFcsSC | Test new prompt (Aug) | no transcript | — | |
KCohUBFmGGhE9C8Wmw9zf7 | Test new prompt (Aug) | no transcript | — | |
UBnN5tz8FaGQ5r6JsU2zQK | Test new prompt (Aug) | no transcript | — | |
fZWHkmjFgtWBD5btABt6NX | Test new prompt (Aug) | no transcript | — | |
jmJZyewWcVCCkSBsV9KzYW | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 2x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
ZnACwCNYrwBHGibh4pDDDN | RBI Bakeoff 2026-07-24 | YES | Agent fully captured the order and directed the customer to pull forward without escalating. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
g4yExnVeCUcqM99F6Jghxa | RBI Bakeoff | YES | Agent captured the full order and directed the customer to pull forward without escalating to a human. | 1x 12 Piece Signature Chicken Family Meal (Dark Meat, S |
Order five classic tenders by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose cole slaw and a Sprite.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
QqQcW5hMJataJfZfyVFyor | RBI Bakeoff 2026-07-23 | NO | The agent said 'An employee will assist you,' indicating escalation to a human. | 1x 5 Piece Chicken Tenders Dinner (Classic, Blackened R |
ngas8HE8wkM77FYmpH9qg9 | RBI Bakeoff 2026-07-24 Pass 5 | NO | Agent escalated to a human team member instead of directing customer forward. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, B |
WobG2LCx386BoD5DtnEMWb | RBI Bakeoff | NO | Agent escalated to a human team member instead of directing customer forward without escalation. | 1x 5 Piece Chicken Tenders Dinner (Blackened Ranch, Bol |
AUCip35AXq3gysXPxEvgyp | RBI Bakeoff 2026-07-24 | no transcript | — | |
2Fr5xpw7UZD5biqsV8YicP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4ue5EruKKSPVW9NQKTqKob | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8EE4nNBBwbPnSSCrv4SFbY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GvYoEejbUyZLQQyCCZM9Uy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KeDMFTxKKxFrVZEeRR8kCX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LoqspZWSTdj9Neqyw3Jmpw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QkjQbWz8WSPRCEYB2TkGxs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RyoxWgwAzhYpVfs6sceqhq | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iWBVWzASaCEgLNQPmR5VY5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jdWnUqZZohq49vLmdfQsA4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
i9sDZyuPHJe9YXcAsnMRHf | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript ends before the agent confirms the full order or directs the customer to pull forward. | empty |
Ewy9jfZXFQ8wzLMfMcDujM | Test new prompt (Aug) | no transcript | — | |
MNjEabB7LWfM9zhUd9SjGb | Test new prompt (Aug) | no transcript | — | |
RozadcCN5SsnhmKpdde7Tt | Test new prompt (Aug) | no transcript | — | |
WmyqxWGWWDMuW3tZgNrUFu | Test new prompt (Aug) | no transcript | — | |
cWT6duN4YKHnNr9N8Pdkpd | Test new prompt (Aug) | no transcript | — | |
CNSm5h7tR6LjuVyJogttpy | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the customer's order and directed them to pull forward without escalation. | 1x 5 Piece Chicken Tenders Dinner (Classic, Blackened R |
HMsvbmhoUxooZxKY3U9GCL | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalating or handing off. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, B |
FYmXdwjbWkAkHNfuonei6M | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x 5 Piece Chicken Tenders (Classic, Blackened Ranch, B |
Give me the chicken wrap bundle with a mango lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
9a4D9BBy4Bcg7XP9zdy5zR | RBI Bakeoff 2026-07-24 Pass 5 | NO | The agent escalated the conversation to an employee instead of directing the customer to pull forward. | 1x Wraps Bundle (Classic Wrap, Chilled Mango Cane Sweee |
SEcqstDg8dGQTe2uYBfUFV | RBI Bakeoff | NO | Agent escalated to a human employee instead of directing customer to pull forward/next window after capturing order. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
f9xwGUsxPfcqj2MeMT9tzC | RBI Bakeoff 2026-07-24 | no transcript | — | |
4T7ag9xr5gLn3vHjHYm57Q | Simulation Run 2026-08-16 21:10 | no transcript | — | |
6kY4p4EPyUmAdVkfDHxyLQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AiAgWt8PM6fDorNvZna3Hj | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ETcXKGiRHpc6DmY59okCnJ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EZKoSWSnfUYEv2v5BnDKnE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LDHMYaA5hVYGyUZLkRh5Ar | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YF9u53SbuN4qtQAmR3xWcj | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZKs8EEVE5A7s8Wj6GcSKvH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cfeoVmBm6bnCf5gqrAXvKR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iB4H4yYhHo2FqfRb2mVJJ7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Ad3DfoYN4dJTYkFA7E8Hmh | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript only shows the customer stating an order, no agent response or completion is shown. | empty |
BAwJ5ZkwJTfnHBpzbNobox | Test new prompt (Aug) | no transcript | — | |
HqGhjskULiQWQYwrvgYb8A | Test new prompt (Aug) | no transcript | — | |
RjhXhEpq5jq3puVftX9YKm | Test new prompt (Aug) | no transcript | — | |
RvAjzhNmojMcx6Vge4KdUi | Test new prompt (Aug) | no transcript | — | |
SrYYAB3jsD2uTM34ULXJk8 | Test new prompt (Aug) | no transcript | — | |
jEYfcbW9xBVKbQBmq8zNiv | RBI Bakeoff 2026-07-23 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
g9YcAwTNtAiUyQUo699hfr | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
Cd4TiBzwmpJZmDUUj3Q9pa | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
daiWUaKfQgNq5nZDoTtM4v | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent took the full order, confirmed it, and instructed the customer to pull forward without escalation. | 1x Wraps Bundle (Chilled Mango Cane Sweeeet Lemonade, C |
I'll take the 3-piece chicken combo, spicy, add a pie - make it the strawberry - and a premium strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
eUvrpzDVVhtVhrAVFrhkps | RBI Bakeoff 2026-07-23 | NO | The agent escalated to a human by saying an employee will assist the customer. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Chille |
gquJGMZQFT9JCGvvPSe4Pr | RBI Bakeoff 2026-07-24 | NO | The agent prematurely told the customer to pull forward before fully confirming the premium strawberry frozen lemonade and corrected the order afterwards, indicating the … | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
hz52TCNjLjjbyfa36KFpoU | RBI Bakeoff 2026-07-24 | no transcript | — | |
4RHB8uqD8asTX3xXqMxLWR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
B5bpmVVRWsQVjSgG6E2568 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BSqBUdhn7CLq6jH5caRsaM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GztJyjkHifQdDNVvPLacnc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Jvtx6t9eeP8bvUnUM7rS9t | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript does not show order completion or directing customer to pull forward/next window. | empty |
XsKDERpM3RWJ5JLHScsFrV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YXkG4JsPHcKD353bQoDzFe | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aF6w9KrshwQZuENDurCWJz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jCGPHhqks6nmZjJg86r6R7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nHHDg8cvwnF5YCw26BHNzs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
4KaycTmPMQRL36g9ivkZCP | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not include the agent completing the order or directing the customer to pull forward/the next window. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
AtWysPNYAmDJL2nHh9bXxk | Test new prompt (Aug) | no transcript | — | |
ZGWKQVZakqE97fNSKNnTgP | Test new prompt (Aug) | no transcript | — | |
amvWvsYqAQTTAzBtwzm3Cj | Test new prompt (Aug) | no transcript | — | |
nGigvAL6hiyDKgcMZUKZq8 | Test new prompt (Aug) | no transcript | — | |
npk2jB3njYByEkXWsfNgbn | Test new prompt (Aug) | no transcript | — | |
exNGnHZBxQHHeE4ZA9yXzp | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward, no escalation or handoff occurred. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
dPbiGgWYCY4sPyT2sQpFrC | RBI Bakeoff | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Chille |
UUNTDfjmyN7QooyvX9U9nq | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Chil |
89bWVbySi9AwbGrhwoXVkE | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Froz |
Order one regular bacon and cheese sandwich by itself. Do not ask for a combo or a large. If the agent first offers to make it a regular combo, accept with fries and a Coke, then accept a subsequent l
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
WbEXyeKLfNMebSr3pNuTFZ | RBI Bakeoff 2026-07-23 | NO | Agent escalated by stating "An employee will assist you," not directing customer to pull forward/next window. | 1x Bacon & Cheese Chicken Sandwich Dinner |
df2PcMXnYcHpypDV4r6bYY | Simulation Run 2026-08-17 01:07 | NO | The agent ended the conversation without directing the customer to pull forward or the next window. | 1x Classic Bacon & Cheese Chicken Sandwich |
dzrh7n2QvyPL9FbDRwtTM8 | RBI Bakeoff 2026-07-24 | no transcript | — | |
8jYXBJyhftEFx7LK9r69TZ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
93GVEwH9Fphasx3zP9PBd8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CaCvZm6B7niZ97TTyjLfMr | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CepmZuzRjzGnnFEGiMWBBa | Simulation Run 2026-08-16 21:10 | no transcript | — | |
G2HDM74jpu7HYF3cWvmSf9 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
RRztpJuYCECerM6nQpmSrb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SnsH22f44BpD6FBMYDivSx | Simulation Run 2026-08-16 21:10 | no transcript | — | |
V9vnUzrSX2jVDWTo68FgV3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WCRf5fdVNeto6Rn8QPtMyB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
kEY7F5oQTXPXQ2YUPRs8d2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
87CLzfNo4aLUhvGj4CCgD4 | Test new prompt (Aug) | no transcript | — | |
EBEJwnVSJ6FkVk3N7Mcnzs | Test new prompt (Aug) | no transcript | — | |
dVTRRZXSL6voBbdnYSwLsZ | Test new prompt (Aug) | no transcript | — | |
efft7rPChPA3wBiuHVKX7L | Test new prompt (Aug) | no transcript | — | |
emjV7tnyENmpj3s2aBBf2S | Test new prompt (Aug) | no transcript | — | |
eYiUKjkLG8swW5qzj5yMeR | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent captured full order and directed customer to pull forward with no escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
3hF82UYpxJEee2y8nabLNq | RBI Bakeoff 2026-07-24 | YES | The agent captured the full order and directed the customer to pull forward without escalating. | 1x Classic Bacon & Cheese Chicken Sandwich |
aBvR6oYnPesCxyPDGMgwEn | RBI Bakeoff | YES | The agent took the full order and asked the customer to pull forward without escalation. | 1x Bacon & Cheese Chicken Sandwich Dinner |
acHPUZqagPBSnKvMqbBfrX | RBI Bakeoff | YES | Agent confirmed full order and directed customer to pull forward without escalation. | 1x Bacon & Cheese Chicken Sandwich Dinner |
PcZsFoWweDDVodn5fpgUKq | Simulation Run 2026-07-20 22:35 (scratch) | YES | Agent took the full order and directed customer to pull forward without escalation. | 1x Classic Bacon & Cheese Chicken Sandwich |
I'd like the 3-piece signature chicken combo, spicy. I don't want fries. What other sides do you have?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
ivqYqMRoGU2FsyTm6oRrP6 | Simulation Run 2026-07-20 22:35 (scratch) | NO | The agent escalated to a human team member by saying 'An employee will assist you.' | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
9Ry9QDPRkoK3MqYgrwcDQX | RBI Bakeoff 2026-07-24 | no transcript | — | |
7cy8fFTzspMer9bvGKkB45 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BaepYMgW35PmwHxkuQExox | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FwdfPhFzxu2UPrDEYMMjPW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Gdbmcka6uyQJHBd63jWmm4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NNJD4LroC8b2XH49KfTPmS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
WeKVJsCqSzwRQPPuSdpCur | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Z58q8EvcJvmbdLaqEjuBdP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
a8YaqgWxmBhbEXdBhU7HWT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
m7De7NwWT6LDLypiSjLSBf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mWjBtD79ZqczXHEyJtzcTt | Simulation Run 2026-08-16 21:10 | UNKNOWN | The order was partially mentioned but the agent did not confirm or complete the order, nor direct customer to pull forward. | empty |
gg2g6cfkpPvvnKVL9R4Br8 | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript lacks any agent response or order completion details. | empty |
G6tzuCfLbNMfkGQz9GMxGw | Test new prompt (Aug) | no transcript | — | |
GaEDXiNX8LHqvCaoouGHXT | Test new prompt (Aug) | no transcript | — | |
MCYMtwgx2UduddmeuUwjz7 | Test new prompt (Aug) | no transcript | — | |
eHTgTtk7TnLTsRKs3yYo2k | Test new prompt (Aug) | no transcript | — | |
ntTWzao6zmPjYhWCz75ZYn | Test new prompt (Aug) | no transcript | — | |
Fbe5kZGnN6FrFuj38mGhjm | RBI Bakeoff 2026-07-23 | YES | The agent took the full order including modifications and sides, confirmed it with the customer, and directed them to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
dY2oNkaffite5CimaXFv3K | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent took the full order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
hWT5zkR43zEgF9qCV3ygAV | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
iAyorYYVjSQkFZXgbvp5Ej | RBI Bakeoff | YES | Agent took the full order and directed customer to pull forward without escalating or bailing. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
S7BazEHYqhk64MW3Uo3VzJ | RBI Bakeoff | YES | The agent fully took the customer's order and directed them to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
Can I get the Ghost Pepper Sandwich combo? Actually, change that to the regular chicken sandwich. And make it spicy.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
VRuFNWaLkFFee3EfqqR83R | RBI Bakeoff 2026-07-23 | NO | The agent escalated to a human employee to verify the order instead of completing it independently. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, S |
RqjoujZXEzMUeGBkxjYRQa | RBI Bakeoff 2026-07-24 | no transcript | — | |
AXT779ng9xbTF8Ci88eU56 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DXHjgHMGZLqgF9nnivZFDi | Simulation Run 2026-08-16 21:10 | no transcript | — | |
SWZqmvMGFH5g2mSHYtGvVD | Simulation Run 2026-08-16 21:10 | no transcript | — | |
TeAHrvYL6yd6iRfXksoNtb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
X5WbS6Z9uvXLarxPE9V8sz | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZN9hPn3wSmPdEe3m7n5yca | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ZavPGsACKkjrfY3fCyav4i | Simulation Run 2026-08-16 21:10 | no transcript | — | |
b2d4MABXxWAtUDK333gTUL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fjWwwiBdR43sdixojUp4p5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
nxxhY8Ef3TXx6L3JECLjFX | Simulation Run 2026-08-16 21:10 | no transcript | — | |
2pG2eWd99hTxmACxavrkmL | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript lacks agent's response completing order and directing customer forward. | empty |
8MdpygRjewXrPxPty5fJum | Test new prompt (Aug) | no transcript | — | |
926cUyHLxu7UifmcioJwmP | Test new prompt (Aug) | no transcript | — | |
XiCDMSkroeWSyH9brYCYCM | Test new prompt (Aug) | no transcript | — | |
fTCT3xtsA2LkGEhPiP9xgA | Test new prompt (Aug) | no transcript | — | |
hTrGuG3TdHtHrzbyh8ujdU | Test new prompt (Aug) | no transcript | — | |
Bz7tP4oHYNoFmuBQHrarXX | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, C |
VoVGpmJBFLCsEKQC7iNq6H | RBI Bakeoff 2026-07-24 | YES | Agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, S |
EnxcWZaP67dipKxMVj47VF | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, S |
ZzXLuJHebdBcsQJ35sqEDq | RBI Bakeoff | YES | Agent fully captured order, confirmed it with customer, and directed them to pull forward without escalating. | 1x Spicy Chicken Sandwich Large Combo (Cajun Fries, Mas |
32n2rJ7HQJTYzzDHFCK4Df | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent took the full order, confirmed it with the customer, and directed them to pull forward without escalating. | 1x Spicy Chicken Sandwich Regular Combo (Cajun Fries, S |
I'd like the 5-piece tenders combo, blackened and spicy, with cole slaw and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
eRfBYqGFWdiZG43oyP6kVc | Simulation Run 2026-08-17 01:07 | NO | The agent did not complete the order or direct the customer to pull forward; order capture was incomplete. | empty |
JsorNoGLmK353QmaKg92DL | RBI Bakeoff 2026-07-24 | no transcript | — | |
7Td8zJuMwavsxQTiwn5DRY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7r5byNkgyPqPuhLm3kfAZg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8enD3NhR3AUTxTCrTrfa2M | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Co44Wi5ZW84CHWMDFpmGEV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EfdEznzDMGsgN9gvrUkkkh | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LTdXMBkZHpDFLT86FawSoS | Simulation Run 2026-08-16 21:10 | no transcript | — | |
U7vENH38ycj8FLfRgPNTGQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
b29ZCrHL5Y5rrg8aPYYmvb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
fAnpxMkPCwvkJDYhLzK3Fm | Simulation Run 2026-08-16 21:10 | no transcript | — | |
jn6r2UT56zafYSetFYnHAY | Simulation Run 2026-08-16 21:10 | no transcript | — | |
3ZZKyGs3ceCQwdLUREtccG | Test new prompt (Aug) | no transcript | — | |
EmQUanoKGETGWD4WuUwEaz | Test new prompt (Aug) | no transcript | — | |
UxaS8S8KyHgrXbrPxVJkAA | Test new prompt (Aug) | no transcript | — | |
iP3JFTeSqjPQnT8CNAstv3 | Test new prompt (Aug) | no transcript | — | |
nNDpKC4s2LnsUW5qpAzqpr | Test new prompt (Aug) | no transcript | — | |
WDYEoUvhs3PvNv88b6uhMz | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the customer's order and directed them to pull forward without escalating. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
3b6vD6TVyshwi3dAA2i7xK | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
6GvhUDRcStx84t4bavx3UZ | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
7kHjd6q3UtxoYFDdhfcJZL | RBI Bakeoff | YES | Agent captured full order and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
LfqRUTQRuAQRkgh5enXX3s | RBI Bakeoff | YES | Agent fully captured the order and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
RKioboFzw9Bgzi7K4HVuXp | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent fully captured the order including modifications and sauces, then directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Regular Combo (Blackened, Co |
Order three pieces of spicy signature chicken by themselves. Do not ask for a combo. If the agent offers to make it a combo, accept and choose mashed potatoes and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
SEJ3Zib2HNrghQNaJeHxma | Simulation Run 2026-08-16 21:10 | NO | Agent escalated the order to a large combo, modifying original item, indicating partial capture and shift. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
UhSitR9h3mJKLTANURCjog | Simulation Run 2026-08-16 21:10 | NO | The agent escalated to a human team member instead of completing the order and directing forward. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
4nNXdyeq9gj9SCXfwhoBfC | RBI Bakeoff 2026-07-24 | no transcript | — | |
mDTJdqsXT4SuFzajFKDFa7 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
GdHg24MoyAEzLRaRKYrZj5 | Test new prompt (Aug) | no transcript | — | |
Hv4NpCmadEUXaKLwYMHroV | Test new prompt (Aug) | no transcript | — | |
JY7jP3AxHcEkoRxsVy36oh | Test new prompt (Aug) | no transcript | — | |
VUvN9x2dbPHYL3uQu4QqAU | Test new prompt (Aug) | no transcript | — | |
brMCKP6JwY58rV5B83WpRx | Test new prompt (Aug) | no transcript | — | |
YrLrW5vAh4qgct5Loib3zH | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and instructed the customer to pull forward without escalating. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
Y6AUKiCPkXyF28CUw83tWR | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent captured full order including modifications and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
cFeQM4M3UbTJDSjGJ8UU8S | RBI Bakeoff 2026-07-24 | YES | The agent captured the full order, confirmed it, and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
eDcfXVueAGUtjM4ZcQceqS | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
DQ4NtPC7AeNcvQyCMWN8Yg | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
5z7zty3HbtM9PuNNgZuwfP | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
7eeCamAJyZURYMziveVGC2 | Simulation Run 2026-08-16 21:10 | YES | Agent captured the full order and directed customer to pull forward without escalating or handing off. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
EymTpxatqzjcVRjm7zfmDi | Simulation Run 2026-08-16 21:10 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
LRy3dmGY22soLBZxzqymDj | Simulation Run 2026-08-16 21:10 | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
LwQ6XZRfLqx4cFYr7kauiM | Simulation Run 2026-08-16 21:10 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken (Spicy) |
YhEjRHuBWuL8YMcqPY7CCA | Simulation Run 2026-08-16 21:10 | YES | Agent captured full order and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
iTmyVMmein2R9Hewk3sM7L | Simulation Run 2026-08-16 21:10 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
mYGTFKKbMfnhc9WRwzthKV | Simulation Run 2026-08-16 21:10 | YES | Agent fully captured order and directed customer to pull forward without escalation. | 1x 3 Piece Signature Chicken Large Combo (Spicy, Mashed |
LxuQjWuLsikxniX6twKYw4 | Simulation Run 2026-08-17 01:07 | YES | Agent fully captured the order and told customer to pull forward without escalation. | 1x 3 Piece Signature Chicken (Spicy) |
Order one classic chicken sandwich by itself. Do not ask for a combo. If the agent offers to make it a combo, accept and choose Cajun fries and a Coke.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
Cpn8kmLEdh6vRbmiRYUCma | RBI Bakeoff 2026-07-24 | no transcript | — | |
7dZnP8QacvGMdiokvm5TWb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
AmdNGVM8Ptzd4dVVGvuPeu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
C7iiyNtrR9mhp4vnoPfMbu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CTA2GVxdEifQJ2woRV5Mzk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
G3YVA2sSeUkwaZq3XB3J3H | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JtpxC8DySGvcy9UkHaRLjd | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KVXkQV89eNGmtYoGFVjzLf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ePtAoDa7eCwQbi8Q55sfwc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
f33wqsYm4xjNJZBSCwD9DA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
j97h2X6TC3dSHiVCZJdXuh | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LkSdysyaiQnBv86Sw2Q9uU | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not contain any order information or direction to pull forward or next window. | empty |
5NbhvK7ZxNdSqWHwKiiKEJ | Test new prompt (Aug) | no transcript | — | |
QAS9FezRvuAQ7nmMPnd3bj | Test new prompt (Aug) | no transcript | — | |
VQjykuekWPjvVf45xPfAqW | Test new prompt (Aug) | no transcript | — | |
ecztanxZzcXZxKoGk6yUez | Test new prompt (Aug) | no transcript | — | |
iu7dBhoS6xfeYbVQKYcC3e | Test new prompt (Aug) | no transcript | — | |
8ywtcFDz5WYteHf3ymv6va | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
Bu5oqeugbrLd6iGrS4cwJ8 | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent confirmed the full order, verified it multiple times, and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
buLmcZ8LXfSzryeaeh8DH4 | RBI Bakeoff 2026-07-24 | YES | Agent fully captured the classic chicken sandwich order and instructed customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
4P3r5nEe3URdSALbgrDccF | RBI Bakeoff | YES | Agent fully captured order and directed customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
cX6xRCiEn5EhL9ejm248Lj | RBI Bakeoff | YES | The agent took the full order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich |
4g3vCT8WsWjEHa3D5nS3WJ | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent took the full order and directed the customer to pull forward without escalating. | 1x Classic Chicken Sandwich |
Start by ordering the 3-piece signature chicken combo, spicy, with mashed potatoes and a Coke. Before the order is finalized, change it to the 4-piece combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
mXCcezRB4LDvcpyLNcBbdi | RBI Bakeoff 2026-07-24 | no transcript | — | |
22tr3944rJ4CsinEoi8msg | Simulation Run 2026-08-16 21:10 | UNKNOWN | The transcript does not show the agent capturing the full order or directing the customer to pull forward or the next window. | empty |
5kQgkGXCVDprE3BJgRaL65 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9Giq7svnivcGBXUHLnzXxA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EQkUqpyRg3roibXddyYzn8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EzUh6RudFR5yQRCzFqEcEy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LC72Q8pyfxgvhQuFwV7BSH | Simulation Run 2026-08-16 21:10 | no transcript | — | |
ScNDuQkGjZjHKR3FfKmAmw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
j8Fu5yQdVb2rh824njwtmv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
mncahURempUXwckDgXAkMf | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript does not show agent directing customer to pull forward or the next window after the order. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
n2FQsEGD2Tg52NvbeVkfPw | Simulation Run 2026-08-16 21:10 | UNKNOWN | Transcript lacks clear agent confirmation and directive to pull forward or next window after taking full order. | 1x 3 Piece Signature Chicken Regular Combo (Spicy, Mash |
5NTQJGkXEGXGeFVyVrQJvv | Test new prompt (Aug) | no transcript | — | |
DQYg5HZaG4s9arXUmVRubv | Test new prompt (Aug) | no transcript | — | |
Jr5hrFZhxqDL3wkmvBgaTE | Test new prompt (Aug) | no transcript | — | |
T6XYxHLQbcyTCNggE7CJqJ | Test new prompt (Aug) | no transcript | — | |
dKG9MPbya7bNCx6S8rJj3f | Test new prompt (Aug) | no transcript | — | |
EcxJ5QcuM8XdjJBW5BiS2i | RBI Bakeoff 2026-07-23 | YES | The agent confirmed the full order with the customer and directed them to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
KNxr9pzQZAiy5JbVVrwLrt | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
jVRNgMRnSnycTkbXjzvQBa | RBI Bakeoff 2026-07-24 | YES | Agent took full order, confirmed accuracy, and directed customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
VT9fKxjLnHLjBB6jvpYYMa | RBI Bakeoff | YES | Agent captured full order, confirmed accuracy, and directed customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
6HgE3cSmJDSo3YzzzkbtMw | RBI Bakeoff | YES | The agent confirmed the full order, verified it with the customer, and directed them to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
chzViFid2Ju5RU4k3TadxS | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent captured the full order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
GCaKWgufmV6EAXVRV6FHnQ | Simulation Run 2026-08-17 01:07 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 4 Piece Signature Chicken Regular Combo (Spicy, Mash |
One Ghost Pepper Sandwich, no combo.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
AtpQcNeUoACnuWYVC4wAYY | RBI Bakeoff 2026-07-24 | no transcript | — | |
6Jc8F5mvwzA44uXd4xDjxg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8GbTjm3DMYF4Vt9p92sNeW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
98wTF7YFH4iShvYKHsEKWk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EXb6Dc34fWwy3NVqAC7JcQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NFM7GzQEYFUBUqcJJYgnSu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Q6V2cDvhReReTmAxHKM7Cw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Si2Nz4oA5XjfkhQnbUYVRx | Simulation Run 2026-08-16 21:10 | no transcript | — | |
V2YT8XFhGpV54qNYZLry9X | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YXJEAyKrcxvoeDAbaoeCU3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eJmsSZBTm8fYvxmuySinD5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
2rZDrKNVkFkJAQPZuVPmjc | Test new prompt (Aug) | no transcript | — | |
7EAinka9HDDjnWZLMWPERa | Test new prompt (Aug) | no transcript | — | |
Db2kF5JU5R7VLqqxhpxpEV | Test new prompt (Aug) | no transcript | — | |
Gi8Afuz3unpCcZGXUPCQy2 | Test new prompt (Aug) | no transcript | — | |
RoJayphNQfwuB5VhTcF2df | Test new prompt (Aug) | no transcript | — | |
fjz2pX3MmhWYUmLDK6TRuZ | RBI Bakeoff 2026-07-23 | YES | The agent captured the full order (spicy chicken sandwich) and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
bWowVA5Zc6Go44ETzog7GC | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent captured the full order (spicy chicken sandwich) and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
eAXjQAfgEQXJCtPzBpScbJ | RBI Bakeoff 2026-07-24 | YES | Agent captured the full order and directed customer to pull forward, no escalation occurred. | 1x Spicy Chicken Sandwich |
XmKHHS3PaMexfcywyQRhYA | RBI Bakeoff | YES | The agent fully captured the spicy chicken sandwich order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
Bmjc3QZbq8U72yuJVRqoLC | RBI Bakeoff | YES | Agent captured full order (Spicy Chicken Sandwich) and directed customer to pull forward without escalating. | 1x Spicy Chicken Sandwich |
CUiVsqy5n2L3X7oDzjF9VP | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent took the full order for a spicy chicken sandwich and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
95NHf6n7Y9T3CgUaBydgmR | Simulation Run 2026-08-17 01:07 | YES | Agent took full order and directed customer to pull forward without escalation. | 1x Spicy Chicken Sandwich |
Can I get the ghost pepper sandwich combo, swap the fries for red beans & rice, and a Dr Pepper?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
5KhokMLpCRZE2ZjBWvcDE5 | RBI Bakeoff 2026-07-24 | no transcript | — | |
7tCuZbFQuNaNw4EdUFeVeG | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BMr2D7B7QxK4Lib86Kvxqy | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BWUN5rX7HigNb6kZ9c6TNn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EPbskxHhVapE7eVs9x9VxV | Simulation Run 2026-08-16 21:10 | no transcript | — | |
H8BAaoaA4ShX5Z2adRaEkk | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JToWTDz6DKZNi7HcFc5aJ2 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LSnXKgtwADpVtQxxrR7aZs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
PDXvmqMjw5hXwQdCuqYUwR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YFHBc43HnG8c6FeuU4nSCW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YcS8MgTQhd3ALz3XaKFyjn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
UPWd5xtGXm7JfHzbZtFnAs | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript does not show the agent's response or whether the order was completed or the customer directed forward. | empty |
DE2MpCJPtrc9Cr4Cazau6s | Test new prompt (Aug) | no transcript | — | |
J8ajndyuZg6jeYmirg2Mg3 | Test new prompt (Aug) | no transcript | — | |
JoBNpHJoQfZGpRZR7wnDNR | Test new prompt (Aug) | no transcript | — | |
LhWXyMT3Lzbbm6k56mFsDe | Test new prompt (Aug) | no transcript | — | |
a826GyaGCaTZMfFvmYHhxu | Test new prompt (Aug) | no transcript | — | |
MrEAvrNb8WuvZdVr3V8JcY | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
ZRs3xn6fqsf6avPCmaftUg | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order with modifications and directed the customer to pull forward without escalating. | 1x Spicy Chicken Sandwich Large Combo (Red Beans and Ri |
hTKWyoeVm67iThzNEhPpxN | RBI Bakeoff 2026-07-24 | YES | The agent took the full order and directed the customer to pull forward without escalation or handoff. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
hhLrDme54y7B6t9qqUrkxf | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalating. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
NKKc9mik46TJ5p3Gtnui3d | RBI Bakeoff | YES | Agent took full order details and directed customer to pull forward without escalating. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
iLCF3mTXhqqSPeaCBgrT8B | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent fully captured the order and told the customer to pull forward without escalation. | 1x Spicy Chicken Sandwich Regular Combo (Red Beans and |
I'll do the chicken sandwich by itself and a side of fries.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
eA5xooz5MCJbsoew39mnkr | RBI Bakeoff 2026-07-24 | no transcript | — | |
3GFBeW2WqDVXohuxbNeY5p | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CaKstdKjdNJ7CDFzP5Qmko | Simulation Run 2026-08-16 21:10 | no transcript | — | |
DyzEA6MBT3TWBVXePuqCdf | Simulation Run 2026-08-16 21:10 | no transcript | — | |
EfENivzCTjHdu5oNMnt9Wv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Es3A3R5fBZNJyJG5Q7tyXB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
YSPUdaA2cmsG29zxVdBwuv | Simulation Run 2026-08-16 21:10 | no transcript | — | |
beUFVtvYCjV2uAQzMLGdGw | Simulation Run 2026-08-16 21:10 | no transcript | — | |
cqNmw6cvZUz8kgmADqrmd4 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
eaMgKsbiynnd8V9yoZmNT8 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
i4QNcnuVnsbh2Q75abdMZA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dGciGxAMM3LQEQsJ4hDYD7 | Simulation Run 2026-08-17 01:07 | UNKNOWN | The agent did not confirm the order was complete or direct the customer to pull forward/the next window; conversation incomplete. | empty |
3RcrRZJhKMPVhCLeJqL5pu | Test new prompt (Aug) | no transcript | — | |
5bPur5m7E2vmSLXgxwSVgk | Test new prompt (Aug) | no transcript | — | |
5sfuT6EGvmRHTBDhvxBaGC | Test new prompt (Aug) | no transcript | — | |
HXgQo9J7zHXhekxVB8ffQi | Test new prompt (Aug) | no transcript | — | |
dmiAdAWCnecSCWicv6RRDb | Test new prompt (Aug) | no transcript | — | |
Gv8uGGkmSV8pt7gRWdpy2p | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
6HSwdrdYH8Qwkqd4CKcjDK | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent confirmed the full order and instructed the customer to pull forward without escalating. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
KLkctqg4ZASXdJm73rUKaM | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
VEie6G27mVojF5APkxWnLZ | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation or handoff. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
c3jLEd69y9XBA8xWGo3vWf | RBI Bakeoff | YES | Agent fully captured the order and instructed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
Uj4V9SkA86Ntpovrs8qAfq | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent captured the full order then directed the customer to pull forward without escalation. | 1x Classic Chicken Sandwich; 1x Cajun Fries |
Can I have a Cajun Rice please?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
59rVJyceyTU8S3UQSyevJ4 | RBI Bakeoff 2026-07-24 | no transcript | — | |
2egCFyganPaKdbUKhaDXvL | Simulation Run 2026-08-16 21:10 | no transcript | — | |
BEkFWZDi6bj2PdVnv56ZCs | Simulation Run 2026-08-16 21:10 | no transcript | — | |
HApxGd4LVrG73b8RBFjP7q | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JkX3TEfQHzjHFYTU7oyJBE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
JskdKEKUbFFPhYiXyGKvgT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Mu3PE39yuaQPNd4MEjEY8s | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NkyXwDzkGbd2jJ5JqgLBgB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
XXZWnzTq65Wr5vrCsMfwYQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dBHv8wSnKQPbBfPW2a8dDQ | Simulation Run 2026-08-16 21:10 | no transcript | — | |
gDDQwVzCi9isNJmFyg8VBc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
j2peTkJpNJFZUKtwC7SoM4 | Simulation Run 2026-08-17 01:07 | UNKNOWN | The transcript is incomplete, missing full order capture and directing the customer forward. | empty |
5WVstZyKtkfa6DA6M2mkPW | Test new prompt (Aug) | no transcript | — | |
7E9erTovh8xJZSgRFpYtDF | Test new prompt (Aug) | no transcript | — | |
K2adETpmqrkiybkmewjnDY | Test new prompt (Aug) | no transcript | — | |
MBqWecVtHNC6ZTC7Y5bF69 | Test new prompt (Aug) | no transcript | — | |
hTSAYZxCJNaqxcJHhT4X4M | Test new prompt (Aug) | no transcript | — | |
UEacm5j8nkQFBJKkp22d3u | RBI Bakeoff 2026-07-23 | YES | The agent fully captured the order and directed the customer to pull forward without any escalation. | 1x Red Beans & Rice |
DtSXGCkQivJt99vTpyWWzE | RBI Bakeoff 2026-07-24 Pass 5 | YES | Agent captured the full order and directed customer to pull forward without escalation or handoff. | 1x Red Beans & Rice |
dxbpumoAPLDdv3Yg4HLo6c | RBI Bakeoff 2026-07-24 | YES | The agent confirmed the full order and directed the customer to pull forward without escalating or handing off. | 1x Red Beans & Rice |
UwJimBtJ3NaRZevc8YqWYU | RBI Bakeoff | YES | Agent took the full order (red beans & rice and biscuit) and directed customer to pull forward without escalation. | 1x Red Beans & Rice; 1x Biscuit |
9f2BZY6gVG47paQzG9AVEX | RBI Bakeoff | YES | The agent took the full order, confirmed it, and directed the customer to pull forward without escalation. | 1x Red Beans & Rice |
9wzRrobArEuHHReZzrchAv | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Red Beans & Rice |
Do you have nuggets?
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
TyniqA7wUbML7tPePBYHL3 | RBI Bakeoff 2026-07-24 | no transcript | — | |
2vAMwBTzKUvJqxwfDgfbra | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7JqRFkJYzReG6d5KPuJSSu | Simulation Run 2026-08-16 21:10 | no transcript | — | |
7jTZhmnSBdmKiG4mtasQUM | Simulation Run 2026-08-16 21:10 | no transcript | — | |
8PhUfS2eNRVN8WLQHyZgBP | Simulation Run 2026-08-16 21:10 | no transcript | — | |
CJuWMBbmPU4H6GutNWzEKA | Simulation Run 2026-08-16 21:10 | no transcript | — | |
KKWb8Xv4gCPUDkBkhcE3xE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
LBSVzbbQGSGzeUHbhr6ESW | Simulation Run 2026-08-16 21:10 | no transcript | — | |
S7YWQvqLUxSmzrC2byq62v | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VxvLcVzwxmq4jk8W3WPBvB | Simulation Run 2026-08-16 21:10 | no transcript | — | |
aX2YZYUPhwtjNJEQ3rfAnc | Simulation Run 2026-08-16 21:10 | no transcript | — | |
iPoXZNt5DigvH8p4umq5ys | Simulation Run 2026-08-17 01:07 | UNKNOWN | The conversation contains only initial queries about nuggets, no order or direction given by the agent. | empty |
7Qu4TcVZJp65KQXpPksVxe | Test new prompt (Aug) | no transcript | — | |
Bkh8MABjkUqWehMT53tWca | Test new prompt (Aug) | no transcript | — | |
E9aLaBL92JvAgaGKb3aCGj | Test new prompt (Aug) | no transcript | — | |
Q5tLNyZSsgWdxNM7hScaQt | Test new prompt (Aug) | no transcript | — | |
TELYxGvBu7Pq2mm3csXpHt | Test new prompt (Aug) | no transcript | — | |
WHwaW9FrFCycE77KXh6WnN | RBI Bakeoff 2026-07-23 | YES | Agent fully captured the order and directed customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Classic, Cajun |
NeNj5E5CAa8yNdnUV8RGXR | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent captured the full order and directed the customer to pull forward without escalating. | 1x 5 Piece Chicken Tenders Large Combo (Cajun Fries, Ma |
CLxGBkJULzouMbNdmzkYGz | RBI Bakeoff 2026-07-24 | YES | The agent took the full order with all modifications and instructed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Spicy, Cajun Fr |
RagLdW2FwATVCy8i9kREWH | RBI Bakeoff | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Cajun Fries, La |
H9GfWiNDhxf27odsVrB8DZ | RBI Bakeoff | YES | Agent captured full order and told customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Cajun Fries, Ma |
jKD4mtSXdTWXqTRaiy5kkU | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x 5 Piece Chicken Tenders Large Combo (Cajun Fries, La |
One bacon and cheese sandwich combo, large, with fries and strawberry lemonade.
| Simulation | Batch | Verdict | Judge note | Final cart |
|---|---|---|---|---|
B9AMph9ABqby9KEyj7DG7n | RBI Bakeoff 2026-07-24 | no transcript | — | |
9mYZDsybVAe35JSMHUmHkE | Simulation Run 2026-08-16 21:10 | no transcript | — | |
9uCDNuscbAZHNjEqhMUzHT | Simulation Run 2026-08-16 21:10 | no transcript | — | |
FdZd8JoqUq7Lmszr9ENzYg | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NEooVADszKdp27oniALpL5 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
NmF6etKAmDKQykLbTC4Kmb | Simulation Run 2026-08-16 21:10 | no transcript | — | |
QQxEoKzC6QdbqKoyieT2V3 | Simulation Run 2026-08-16 21:10 | no transcript | — | |
TQZ8bmuZcdBHSBgKeXjnnn | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VLpDEzZ2JxmeNerVbCnWAR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
VzUnqTorphJQNgH2m8SszR | Simulation Run 2026-08-16 21:10 | no transcript | — | |
dvgRyEe5xLabv3bkuymZhU | Simulation Run 2026-08-16 21:10 | no transcript | — | |
Lq8NJRw76LKXWEqJZk5UFW | Simulation Run 2026-08-17 01:07 | UNKNOWN | Transcript does not show agent interaction or order completion, so criteria cannot be evaluated. | empty |
3bQZApkRtGCF8ZCuVsQ5Ur | Test new prompt (Aug) | no transcript | — | |
7Qv3XQfirbqZsmqBDDJtNV | Test new prompt (Aug) | no transcript | — | |
N5GHQ756esmAqGhm3YD3cP | Test new prompt (Aug) | no transcript | — | |
PysSdCe2YvSK8TZf32q7bx | Test new prompt (Aug) | no transcript | — | |
hWbzG9BDJEHkTzLqTGG7xH | Test new prompt (Aug) | no transcript | — | |
gxVoZDxfuxLNejs3JxcTi9 | RBI Bakeoff 2026-07-23 | YES | The agent took the full order, confirmed details, and directed the customer to pull forward without escalation. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (C |
PrPsBZzko3xwgA5wCpAwfv | RBI Bakeoff 2026-07-24 Pass 5 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (C |
cZFdzdqR6EGApCQPmZY8tG | RBI Bakeoff 2026-07-24 | YES | The agent fully captured the order and directed the customer to pull forward without escalation. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (C |
ZkjKsNDm5rMECRoTuAyPyA | RBI Bakeoff | YES | The agent fully captured the customer's order and directed them to pull forward without escalation. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (C |
LqfQTcu5Tv9Ex8rCP3KKpJ | RBI Bakeoff | YES | Agent took full order and directed customer to pull forward without escalation or handoff. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (C |
gq5e6HxsKaHV4vwx5S5Vut | Simulation Run 2026-07-20 22:35 (scratch) | YES | The agent captured the full order with all customizations and directed the customer to pull forward without escalating or handing off. | 1x Spicy Bacon & Cheese Chicken Sandwich Large Combo (C |