Skip to main content
This document provides a comprehensive reference table of workspace and organization operations and which roles can perform them. For an overview of LangSmith’s RBAC system, role definitions, and permission concepts, refer to Role-based access control. This page lists every API operation in LangSmith along with:
  • Which roles can perform each operation.
  • The specific permission string required.
  • Notes about partial access or special cases.
Use this as a reference for whether a specific role can perform a particular action.

Contents

Workspace-level operationsOrganization-level operations
Core resources:
Projects: Organize traces and runs
Runs: Individual execution traces
Datasets: Test datasets for evaluation
Examples: Individual dataset examples
Experiments: Comparative experiments
Core management:
Organization settings: Org info and configuration
Workspaces: Workspace management
Organization members: Member management
Roles and permissions: Custom roles
Monitoring and analysis:
Rules: Automated run rules
Alerts: Alert rules for monitoring
Feedback: Scores and labels on outputs
Annotation Queues: Human review queues
Charts: Custom visualizations
Security and authentication:
SSO and authentication: Single sign-on setup
SCIM: Identity provisioning
Access policies: Attribute-based access control
Development and configuration:
Prompts: Prompt templates (LangChain Hub)
Deployments: Deployment configurations
MCP Servers: Model Context Protocol servers
Billing and accounts:
Billing and payments: Subscription management
API keys and service accounts: Org-level keys
Workspace management:
Workspace settings: Members, settings
API Keys & Secrets: Authentication credentials
Tags: Metadata tagging system
Bulk Exports: Data export operations
Analytics:
Charts and dashboards: Org-level visualizations
Usage and analytics: Usage tracking and TTL settings
Additional information:

Legend

  • Allowed: User with this role can perform this action
  • Not Allowed: User with this role cannot perform this action
  • Partial: User has limited access (see notes)

Workspace-level operations

These operations are controlled by workspace-level roles and permissions.

Projects (Tracer Sessions)

Projects organize traces and runs from your LLM applications.
OperationWorkspace AdminWorkspace UserWorkspace ViewerRequired Permission
Create a new projectprojects:create
View project listprojects:read
View project detailsprojects:read
View prebuilt dashboardprojects:read
View project metadata (top K values)projects:read
Update project metadata (name, description, tags)projects:update
Create filter viewprojects:create
View filter viewsprojects:read
View specific filter viewprojects:read
Update filter viewprojects:update
Delete filter viewprojects:delete
Delete a projectprojects:delete
Delete multiple projectsprojects:delete
Get insights jobs (Beta)projects:read
Get specific insights job (Beta)projects:read
Create insights job (Beta)projects:read + rules:create
Update insights job (Beta)projects:update
Delete insights job (Beta)projects:delete
Get insights job configs (Beta)rules:read
Create insights job config (Beta)rules:create
Auto-generate insights job config (Beta)rules:create
Update insights job config (Beta)rules:update
Delete insights job config (Beta)rules:delete
Get run cluster from insights job (Beta)projects:read
Get runs from insights job (Beta)projects:read

Runs (traces and spans)

Individual execution traces from your LLM applications.
OperationWorkspace AdminWorkspace UserWorkspace ViewerRequired Permission
Send traces from SDK (create run)runs:create
Batch ingest runsruns:create
Multipart ingest runsruns:create
Post OTEL tracesruns:create
Post OTEL metricsruns:create
View a specific runruns:read
View thread previewruns:read
Query/list runsruns:read
View run statisticsruns:read
View grouped run statisticsruns:read
Group runs by expressionruns:read
Generate filter query from natural languageruns:read
Prefetch runsruns:read
Update a run (PATCH)runs:create
View run sharing stateruns:read
Share a run publiclyruns:share
Unshare a runruns:share
Delete runs by trace ID or metadataruns:delete

Rules (run rules and automations)

Automated rules that trigger actions based on run conditions.
OperationWorkspace AdminWorkspace UserWorkspace ViewerRequired Permission
List all run rulesrules:read
Create a run rulerules:create
Update a run rulerules:update
Delete a run rulerules:delete
View rule logsrules:read
Get last applied rulerules:read
Manually trigger a rulerules:update
Trigger multiple rulesrules:update

Alerts

Alert rules for monitoring run conditions.
OperationWorkspace AdminWorkspace UserWorkspace ViewerRequired Permission
Create alert ruleruns:read
Update alert ruleruns:read
Delete alert ruleruns:read
Get alert ruleruns:read
List alert rulesruns:read
Test alert actionruns:read

Datasets

Test datasets with examples for evaluation.
OperationWorkspace AdminWorkspace UserWorkspace ViewerRequired Permission
Create a datasetdatasets:create
List datasetsdatasets:read
View dataset detailsdatasets:read
Update dataset metadatadatasets:update
Delete a datasetdatasets:delete
Upload CSV datasetdatasets:create
Clone datasetdatasets:update
Get dataset versiondatasets:read
Get dataset versionsdatasets:read
Diff dataset versionsdatasets:read
Update dataset version (tags)datasets:update
Download dataset (OpenAI format)datasets:read
Download dataset (OpenAI fine-tuning format)datasets:read
Download dataset (CSV)datasets:read
Download dataset (JSONL)datasets:read
View dataset sharing statedatasets:read
Share dataset publiclydatasets:share
Unshare datasetdatasets:share
Get index infodatasets:read
Index datasetdatasets:update
Sync dataset indexdatasets:update
Remove dataset indexdatasets:update
Search datasetdatasets:read
Generate synthetic examplesdatasets:update
Get dataset splitsdatasets:read
Update dataset splitsdatasets:read
Run playground experiment (batch)prompts:read + datasets:read + projects:create
Run playground experiment (stream)prompts:read + datasets:read + projects:create
Run studio experimentdatasets:read + projects:create

Examples

Individual examples within datasets.
OperationWorkspace AdminWorkspace UserWorkspace ViewerRequired Permission
Count examplesdatasets:read
View a specific exampledatasets:read
List examplesdatasets:read
Create a new exampledatasets:update
Create examples (bulk)datasets:update
Update a single exampledatasets:update
Update examples (bulk)datasets:update
Update examples (multipart)datasets:update
Upload examples from CSVdatasets:update
Upload examples from JSONLdatasets:update
Delete a single exampledatasets:update
Delete examples (bulk)datasets:update
View examples with runsdatasets:read
View grouped examples with runsdatasets:read
Validate a single exampledatasets:read
Validate examples (bulk)datasets:read

Experiments

Comparative experiments for evaluating LLM outputs.
OperationWorkspace AdminWorkspace UserWorkspace ViewerRequired Permission
View comparative experimentsprojects:read
Create comparative experimentprojects:create
Delete comparative experimentprojects:delete
View examples with runsdatasets:read
View grouped examples with runsdatasets:read
View grouped experimentsdatasets:read
View feedback deltadatasets:read
Upload experiment resultsdatasets:create + datasets:update + projects:create + runs:create
Get experiment view overridesdatasets:update
Create experiment view overridedatasets:update
Update experiment view overridedatasets:update
Delete experiment view overridedatasets:update
Workspace Users have partial access because they cannot create projects, which limits their ability to create new experiments.

Feedback

Scores, labels, and corrections on LLM outputs.
OperationWorkspace AdminWorkspace UserWorkspace ViewerRequired Permission
List feedback formulasfeedback:read
Get feedback formulafeedback:read
Create feedback formulafeedback:create
Update feedback formulafeedback:update
Delete feedback formulafeedback:delete
View specific feedbackfeedback:read
List feedbacksfeedback:read
Create feedbackfeedback:create
Eagerly create feedbackfeedback:create
Update feedbackfeedback:update
Delete feedbackfeedback:delete
Batch ingest feedbackfeedback:create
Create feedback ingest tokenfeedback:create
List feedback ingest tokensfeedback:create
Create feedback with token (no auth required)N/A (token-based)
List feedback configsfeedback:read
Create feedback configfeedback:create
Update feedback configfeedback:update

Annotation Queues

Human review queues for LLM outputs.
OperationWorkspace AdminWorkspace UserWorkspace ViewerRequired Permission
List annotation queuesannotation-queues:read
Get annotation queueannotation-queues:read
Create annotation queueannotation-queues:create
Update annotation queueannotation-queues:update
Delete annotation queueannotation-queues:delete
Populate annotation queueannotation-queues:update
Get runs from queueannotation-queues:read
Get run from queue (by index)annotation-queues:read
Get queues for runannotation-queues:read
Get queue total sizeannotation-queues:read
Get queue total archivedannotation-queues:read
Get queue sizeannotation-queues:read
Add runs to queueannotation-queues:update
Update run in queueannotation-queues:update
Delete run from queueannotation-queues:update
Delete runs from queue (bulk)annotation-queues:update
Create identity annotation queue run statusannotation-queues:update
Export archived runsannotation-queues:read

Prompts (hub)

Prompt templates and chains in the LangChain Hub.
OperationWorkspace AdminWorkspace UserWorkspace ViewerRequired Permission
List prompt reposprompts:read
View prompt repoprompts:read
Create prompt repoprompts:create
Fork prompt repoprompts:create
Update prompt repoprompts:update
Delete prompt repoprompts:delete
List commitsprompts:read
View commitprompts:read
Push commitprompts:update
List repo tagsprompts:read
Get all tagsprompts:read
Create tagprompts:create
Update tagprompts:update
Delete tagprompts:delete
View eventsprompts:read
List commentsprompts:read
Create commentprompts:read
Delete commentprompts:read
Toggle likeprompts:read
Optimize promptprompts:update
List optimization jobsprompts:read
Create optimization jobprompts:create
Update optimization jobprompts:update
Delete optimization jobprompts:delete
Invoke prompt canvasprompts:update
List quick actionsprompts:read
Create quick actionprompts:read
Delete quick actionprompts:read
Update quick actionprompts:read
Some prompt operations support public access for shared prompts.

Charts (custom dashboards)

Custom visualizations and dashboards.
OperationWorkspace AdminWorkspace UserWorkspace ViewerRequired Permission
List chartscharts:read
Get chart by IDcharts:read
Create chartcharts:create
Update chartcharts:update
Delete chartcharts:delete
Render chartcharts:read
List chart sectionscharts:read
Get chart section by IDcharts:read
Create chart sectioncharts:create
Update chart sectioncharts:update
Delete chart sectioncharts:delete
Render chart sectioncharts:read

Deployments

LangSmith Deployment configurations.
OperationWorkspace AdminWorkspace UserWorkspace ViewerRequired Permission
Create deploymentdeployments:create
View deploymentdeployments:read
Update deploymentdeployments:update
Delete deploymentdeployments:delete

Workspace settings and management

OperationWorkspace AdminWorkspace UserWorkspace ViewerRequired Permission
View workspace infoworkspaces:read
View workspace statisticsworkspaces:read
Update workspace (name, description)workspaces:manage
Delete workspaceworkspaces:manage
View workspace membersworkspaces:read
View active workspace membersworkspaces:read
View pending workspace membersworkspaces:read
Add member to workspaceworkspaces:manage
Add members (batch)workspaces:manage
Update workspace member roleworkspaces:manage
Remove workspace memberworkspaces:manage
Delete pending workspace memberworkspaces:manage
View usage limitsworkspaces:read
View shared entitiesworkspaces:read
Bulk unshare entitiesworkspaces:manage

API keys and secrets

OperationWorkspace AdminWorkspace UserWorkspace ViewerRequired Permission
List API keysworkspaces:read
Generate API keyworkspaces:manage
Delete API keyworkspaces:manage
List workspace secretsworkspaces:read
Get encrypted secretsworkspaces:read
Upsert workspace secretsworkspaces:manage

Tags

OperationWorkspace AdminWorkspace UserWorkspace ViewerRequired Permission
List tag keysworkspaces:read
Get tag keyworkspaces:read
Create tag keyworkspaces:manage
Update tag keyworkspaces:manage
Delete tag keyworkspaces:manage
List tag valuesworkspaces:read
Get tag valueworkspaces:read
Create tag valueworkspaces:manage
Update tag valueworkspaces:manage
Delete tag valueworkspaces:manage
List tagsworkspaces:read
List tags for resourceworkspaces:read
List tags for resources (batch)workspaces:read
List taggingsworkspaces:read
Create taggingworkspaces:manage
Delete taggingworkspaces:manage

Bulk exports

OperationWorkspace AdminWorkspace UserWorkspace ViewerRequired Permission
List bulk exportsworkspaces:read
Get bulk exportworkspaces:read
Create bulk exportworkspaces:manage
Cancel bulk exportworkspaces:manage
Get bulk export destinationsworkspaces:read
Get bulk export destinationworkspaces:read
Create bulk export destinationworkspaces:manage
Get filtered export runsworkspaces:read

MCP (Model Context Protocol) servers

OperationWorkspace AdminWorkspace UserWorkspace ViewerRequired Permission
List MCP serversworkspaces:read
Get MCP serverworkspaces:read
Create MCP serverworkspaces:read
Update MCP serverworkspaces:read
Delete MCP serverworkspaces:read

Organization-level operations

Organization settings

OperationOrg AdminOrg UserOrg ViewerRequired Permission
View organization infoorganization:read
View organization dashboardorganization:read
Update organization infoorganization:manage
View billing infoorganization:read
View company infoorganization:read
Set company infoorganization:manage

Workspaces (organization level)

OperationOrg AdminOrg UserOrg ViewerRequired Permission
List all workspacesorganization:read
Create workspaceorganization:manage

Organization members

OperationOrg AdminOrg UserOrg ViewerRequired Permission
View organization membersorganization:read
View active org membersorganization:read
View pending org membersorganization:read
Invite member to organizationorganization:manage
Invite members (batch)organization:manage
Add basic auth membersorganization:manage
Remove organization memberorganization:manage
Update organization member roleorganization:manage
Delete pending org memberorganization:manage

Roles and permissions

OperationOrg AdminOrg UserOrg ViewerRequired Permission
List organization rolesorganization:read
List available permissionsN/A (user-level)
Create custom roleorganization:manage
Update custom roleorganization:manage
Delete custom roleorganization:manage

SSO and authentication

OperationOrg AdminOrg UserOrg ViewerRequired Permission
View SSO settingsorganization:read
Create SSO settingsorganization:manage
Update SSO settingsorganization:manage
Delete SSO settingsorganization:manage
View login methodsorganization:read
Update allowed login methodsorganization:manage
Set default SSO provisionorganization:manage

SCIM (System for cross-domain identity management)

OperationOrg AdminOrg UserOrg ViewerRequired Permission
List SCIM tokensorganization:read
Get SCIM tokenorganization:read
Create SCIM tokenorganization:manage
Update SCIM tokenorganization:manage
Delete SCIM tokenorganization:manage

Access policies (ABAC - Attribute-based access control)

OperationOrg AdminOrg UserOrg ViewerRequired Permission
List access policiesorganization:read
Get access policyorganization:read
Create access policyorganization:manage
Delete access policyorganization:manage
Attach access policy to roleorganization:manage

Billing and payments

OperationOrg AdminOrg UserOrg ViewerRequired Permission
Create Stripe setup intentorganization:manage
Handle payment method creationorganization:manage
Change payment planorganization:manage
Create Stripe checkout sessionorganization:manage
Confirm checkout completionorganization:manage
Create Stripe account linksorganization:manage

API keys and service accounts

OperationOrg AdminOrg UserOrg ViewerRequired Permission
List org service keysorganization:read
Create org service keyorganization:pats:create
List personal access tokensorganization:read
Create personal access tokenorganization:pats:create
Delete personal access tokenorganization:read
List service accountsorganization:read
Create service accountorganization:read
Delete service accountorganization:read

Organization charts and dashboards

OperationOrg AdminOrg UserOrg ViewerRequired Permission
List org chartsorganization:read
Get org chart by IDorganization:read
Create org chartorganization:manage
Update org chartorganization:manage
Delete org chartorganization:manage
Render org chartorganization:read
Get org chart sectionorganization:read
Create org chart sectionorganization:manage
Update org chart sectionorganization:manage
Delete org chart sectionorganization:manage
Render org chart sectionorganization:read

Usage and analytics

OperationOrg AdminOrg UserOrg ViewerRequired Permission
View organization usageorganization:read
View TTL settingsorganization:read
Upsert TTL settingsorganization:manage

User-level operations (no workspace or org context)

These operations are available to all authenticated users and don’t require specific workspace or organization permissions.
OperationAll Authenticated Users
View own user profile
Update own user profile
List organizations for user
Create new organization
List pending workspace invites
Delete pending workspace invite
Claim pending workspace invite
List pending organization invites
Delete pending organization invite
Claim pending organization invite

Permission inheritance

Organization to workspace

  • Organization Admin automatically has full permissions in all workspaces
  • Organization User and Organization Viewer only get workspace access when explicitly added to workspaces with workspace-level roles

Workspace role independence

  • Users can have different workspace roles in different workspaces
  • A user might be a Workspace Admin in one workspace and a Workspace Viewer in another

Special access flags

Some operations support special authorization flags:
FlagDescriptionExample Use Case
allow_public=TrueAllows unauthenticated accessPublic prompt repositories, shared runs
allow_disabled=TrueAllows access even if org/workspace is disabledView-only access during suspension
require_user=TrueRequires a user (not service account)Personal access token management
allow_authz_delegation=TrueAllows ABAC to override RBACAttribute-based access policies
allowed_services=[...]Restricts to specific servicesInternal service-to-service calls

Connect these docs programmatically to Claude, VSCode, and more via MCP for real-time answers.