Proposed Enhancement:
Add a new tile type or function in Magic ETL, for example:
1. Alert Tile
- Triggers when a specified condition is true (e.g., when a dataset contains rows, when a metric exceeds a threshold, etc.)
- Can optionally write an alert message to the activity log or push to Domo notifications.
2. Email Tile
- Sends an email to designated users or groups.
- Can use dynamic fields from the ETL (e.g., dataset name, counts, timestamps).
- Supports optional HTML/text templates.
3. Webhook Tile (optional)
- Allows Magic ETL to send a simple webhook payload to external systems (Slack, Microsoft Teams, PagerDuty, ServiceNow, etc.) without requiring a separate Domo Workflow.
Example Use Cases:
- Notify admins if any dataset has not updated within its expected frequency.
- Send automated data quality reports when a validation check fails.
- Alert analysts when a data feed stops due to expired Workbench credentials.
- Push summary status messages after ETL jobs complete successfully or with warnings.
Benefits:
- Reduces dependency on manual alert setup via Domo cards.
- Enables true end-to-end automation within ETL pipelines.
- Simplifies operational monitoring (no need for external scripts or workflows).
- Improves real-time awareness of data issues.
Example UI Concept:
A new Magic ETL tile named βSend Alert / Emailβ with configuration options such as:
- Trigger Condition: (Boolean expression or row count condition)
- Recipients: (User list, group, or dynamic field)
- Subject / Message Body: (Free text with variable substitution)
- Delivery Options: Email, Domo Notification, Webhook
Impact:
This feature would make Magic ETL a more complete data automation platform, aligning it with modern ETL tools that support in-flow alerting. It would also greatly reduce the operational overhead of maintaining separate monitoring dashboards and alerts.
