Overview

Create and manage W&B automations to streamline your ML workflows

This feature requires a Pro or Enterprise plan.

This page shows how to create and manage W&B automations, which let you trigger Slack notifications or webhooks in response to project and registry events. Use this overview to understand the prerequisites and high-level workflow, then follow the detailed instructions in Create a Slack automation or Create a webhook automation.

Looking for companion tutorials for automations?

• Learn to automatically trigger a GitHub Action for model evaluation and deployment.
• Watch a video demonstrating automatically deploying a model to a SageMaker endpoint.
• Watch a video series introducing automations.

Requirements

When creating automations:

• A team admin can create and manage automations for the team’s projects, as well as components of their automations, such as webhooks, secrets, and Slack integrations. Refer to Team settings.
• To create a registry automation, you must have access to the registry. Refer to Configure Registry access.
• To create a Slack automation, you must have permission to post to the Slack instance and channel you select.

Create an automation

You can create an automation from the project or registry’s Automations tab, or directly from a line plot panel in the workspace.

Create from the Automations tab

At a high level, to create an automation from the Automations tab, follow these steps:

1. If necessary, create a W&B secret for each sensitive string required by the automation, such as an access token, password, or SSH key. Secrets let you reuse sensitive strings safely and keep them out of automation configurations. Define secrets in your Team Settings. Webhook automations most commonly use secrets.
2. Configure team-level webhook or Slack integrations to authorize W&B to post to Slack or run the webhook on your behalf. Multiple automations can use a single webhook or Slack integration. Define these actions in your Team Settings.
3. In the project or registry, create the automation, which specifies the event to watch for and the action to take (such as posting to Slack or running a webhook). When you create a webhook automation, you configure the payload it sends.

After you complete these steps, the automation runs whenever the specified event occurs in the project or registry.

Create a run metric automation from a workspace panel

From a line plot in the workspace, you can also create a run metric automation for the metric it shows:

1. Hover over the panel, then click the bell icon at the top of the panel.

   

2. Configure the automation using the basic or advanced configuration controls. For example, apply a run filter to limit the scope of the automation, or configure an absolute threshold.

For details, refer to:

• Create a Slack automation
• Create a webhook automation

View and manage automations

View and manage automations from a project or registry’s Automations tab:

• To view an automation’s details, click its name.
• To view an automation’s execution history (which actions ran and whether they succeeded), click its name and select the History tab. For more information, see View an automation’s history.
• To edit an automation, click its action () menu, then click Edit automation.
• To delete an automation, click its action () menu, then click Delete automation.

Go further

For more information, see the following resources:

• Automations tutorials: Build a project run failure alert or a registry alias-to-webhook automation in the W&B App.
• Automation events and scopes.
• Create a Slack automation.
• Create a webhook automation.
• Create a secret.