Skip to main content

Documentation Index

Fetch the complete documentation index at: https://braintrust.dev/docs/llms.txt

Use this file to discover all available pages before exploring further.

Automations trigger actions based on events in Braintrust. Stay informed about production issues, export data to external systems, and manage data retention automatically.

​
Automation types

Braintrust supports three automation types:

​
Alerts

Send notifications when events occur:
  • Log alerts: Notify when conditions are met on production logs
  • Environment alerts: Notify when prompt environments are updated
Both alert types support:
  • Webhooks: POST JSON payloads to custom endpoints
  • Slack: Send messages to Slack channels
Use log alerts to catch errors, track quality degradation, or monitor usage patterns. Use environment alerts to track prompt deployments and version changes. See Set up alerts.

​
Cloud storage export

Periodically export project logs to an Amazon S3 or Google Cloud Storage bucket:
  • Logs: Export traces or spans in JSON Lines or Parquet format
  • Custom queries: Use BTQL to define exactly what data to export
Use exports for archiving, offline analysis, or feeding data warehouses like Snowflake or Databricks. See Export to cloud storage.
only available on the Enterprise plan.

​
Data retention

Automatically delete old data based on time-based policies:
  • Logs: Remove logs older than a specified period
  • Experiments: Delete completed experiments after retention window
  • Datasets: Remove dataset rows past their retention date
Use retention policies to manage storage costs and comply with data privacy regulations. See Configure data retention.
only available on the Enterprise plan.

​
Test automations

Before saving, test automations to verify configuration:
  • Alerts: Sends a test payload to your webhook or Slack channel
  • Export automations: Writes and deletes a test file in your target bucket
  • Data retention: Previews which data would be deleted
Testing ensures automations work correctly before they run in production.

​
Monitor automation runs

View execution history and status:
  1. Go to Settings > Alerts or Data management.
  2. View run history, timing, and any errors
For export automations, you can also:
  • Open the Export status dialog and click Rewind… to re-export data from a specific point in time.

​
Next steps

Set up alerts

Configure webhooks and Slack notifications

Export to cloud storage

Periodically export project logs to AWS S3 or Google Cloud Storage

Configure data retention

Automatically delete old data to manage storage and comply with regulations