Job Notifications and Monitoring
Introduction
You can monitor and receive notifications for Jobs in Coalesce using built-in tools or through integrations with external systems. This guide covers the available options for configuring notifications, monitoring job status, and setting up retries for recovery.
Built-in Scheduler Notifications
If you're using the Coalesce Job Scheduler, you can configure email notifications directly in the platform. Notifications can be set up for job successes, job failures, or both. Multiple email addresses can be added to receive alerts.
External Orchestration Tool Integration
If you’re managing jobs with an external orchestration tool such as Airflow or Azure Data Factory you can configure these tools to send alerts. The orchestration tool can call Coalesce APIs to check job status and then trigger alerts through your configured channels such as email, Slack, or SMS.
API-Based Monitoring
You can also use Coalesce’s APIs to programmatically monitor job status and build custom alerting solutions. With APIs, you can:
- Use the job status API to check if jobs succeeded or failed.
- Retrieve detailed error messages and run results.
- Integrate with your existing monitoring and alerting platforms.
Retry and Recovery Options
We recommend configuring retry mechanisms to handle transient failures. You can set jobs to retry automatically from the point of failure and use scheduling with retry logic to ensure resilience across job runs.