BrowserStack AI Evals
EvaluationScenarios

Scenario Items

Add scenario rows by hand, understand the item columns, and generate rows with Assist.

Scenario Items

Each item in a scenarios dataset is one conversation the simulator will drive — a persona, a goal, and an opening message. Add items by hand, or generate them with Assist.

Items table

On a scenarios dataset's Items tab, each row shows:

ColumnDescription
Item IdUnique identifier for the scenario row.
SourceHow the row was created (for example added manually or generated).
StatusWhether the row is active in the current dataset version.
PersonaThe persona the simulator roleplays for this row.
GoalWhat the simulated user is trying to achieve.
Opening messageThe first message the simulated user sends.
Expected outputThe outcome you expect from the agent (optional).
Added byWho created the row.

Add a scenario manually

On the Items tab, click Add item.

In the Create new scenario dialog, set:

  • Persona (required) — pick from your persona library
  • Goal (required) — for example Return a damaged item and get a refund
  • Opening message (required) — for example Hi, my order arrived broken.
  • Expected output (optional) — for example Agent confirms refund and apologises for the damage.

Click Add to dataset.

Item provenance

The Source column shows how each row was created, so you can tell hand-written scenarios from ones drafted by Assist. Rows produced by Generate with Assist carry an AI generated provenance.

Create scenarios with Assist

Instead of writing every row, Generate with Assist drafts a set of scenarios from your personas and your agent's description, and stages them for review before anything is saved. See Generate with Assist for the full flow.