BrowserStack AI Evals
Settings & Configuration

Members & Roles

Manage team members, organization roles, and project roles.

Members & Roles

BrowserStack AI Evals uses a two-level RBAC model: organization roles control access to organization-wide resources, and project roles control access to individual projects.

Members are managed in your BrowserStack organization account (Settings → Members ↗ redirects there).

Role Levels

Organization Roles

Organization roles apply to all projects in your organization.

RoleDescription
OWNERFull control — create/delete projects, manage members, billing, org settings, org API keys
ADMINCreate projects, transfer projects, update org settings, manage members
MEMBERView organization members
VIEWERNo organization-level access

Project Roles

Project roles are set per project and override the base organization role for that project.

RoleDescription
OWNERFull project control including delete and all settings
ADMINAll write access except deleting the project
MEMBERRead + write access to data (traces, datasets, prompts, scores); read-only on API keys
VIEWERRead-only access to all project data
NONENo project access (uses organization role only)

Permission Matrix

Organization Permissions

PermissionOWNERADMINMEMBERVIEWER
Create projectsYesYes
Transfer projectsYesYes
Update org settingsYesYes
Delete organizationYes
Manage org API keysYes
Manage org membersYesYes
View org membersYesYesYes
Manage billingYes

Project Permissions

PermissionOWNERADMINMEMBERVIEWER
View projectYesYesYesYes
Update project settingsYesYes
Delete projectYes
Manage project membersYesYes
View project membersYesYesYesYes
Create/delete API key pairsYesYes
View API keysYesYesYesYes
Create/delete write-only keysYesYes
Manage LLM connectionsYesYesYes (update only)
View LLM connectionsYesYesYesYes
Manage integrationsYesYes
Create/edit tracesYesYesYes
Delete tracesYesYes
Create/edit scoresYesYesYes
Manage score configsYesYesYes
Manage datasetsYesYesYes
View datasetsYesYesYesYes
Manage promptsYesYesYes
View promptsYesYesYesYes
Manage protected labelsYesYes
Manage evaluators / eval jobsYesYesYes
View evaluators / eval jobsYesYesYesYes
Manage experimentsYesYesYes
View experimentsYesYesYesYes
Manage online evaluationsYesYesYes
View online evaluationsYesYesYesYes
Manage modelsYesYes
Manage annotation queuesYesYesYes
View annotation queuesYesYesYesYes
Batch exports (create)YesYesYesYes
View batch exportsYesYesYesYes
View audit logsYesYesYes
Manage dashboardsYesYesYes
View dashboardsYesYesYesYes

Inviting Members

Members are invited at the organization level from your BrowserStack account:

  1. Go to Settings → Members ↗ (opens BrowserStack account management)
  2. Click Invite user
  3. Enter their email address and select their organization role
  4. They receive an invitation email and must accept before gaining access

After joining the organization, you can assign project-specific roles from the project Members settings page.

Assigning Project Roles

  1. Go to your project Settings → Members ↗
  2. Find the member in the list
  3. Select their project role from the dropdown
  4. Changes take effect immediately

Setting a project role to NONE means the member's access is determined solely by their organization role.

Service Accounts

For automated pipelines (CI/CD, scripts), create a dedicated service account in your organization:

  1. Create a new user with the MEMBER organization role
  2. Assign it the minimum required project role (typically MEMBER)
  3. Generate project API keys under that account's session

Alternatively, use write-only keys (no service account required) for ingestion-only pipelines.