BrowserStack AI Evals
EvaluationTools

Tools

Register, version, and compile LLM tool schemas across TypeScript, Python, and Java SDKs.

Tools

The tool registry stores, versions, and fetches LLM tool definitions centrally. Tools are JSON Schema definitions that describe callable functions for LLM tool-calling. They can be compiled into provider-specific formats, attached to prompts, and used in agent workflows.

Manage Tools

Create, get, list, and update tools via SDK or REST API.

Decorators & Annotations

Instrument functions with OpenTelemetry spans using TypeScript decorators.

Variable Substitution

Compile tool schemas with runtime variable injection using Mustache templates.

Using Prompts in the Dashboard

Create and edit prompts, insert variables, test with values, and manage versions in the BrowserStack AI Evals dashboard.

Manage Tools

Create, get, list, and update LLM tools via SDK or REST API.

On this page

Tools