Dagster + Datadog
Publish metrics to Datadog from within Dagster ops and entralize your monitoring metrics.
About this integration
While Dagster provides comprehensive monitoring and observability of the pipelines it orchestrates, many teams look to centralize all their monitoring across apps, processes and infrastructure using Datadog's 'Cloud Monitoring as a Service.' The dagster-datadog
integration allows you to publish metrics to Datadog from within Dagster ops.
Installation
pip install dagster-datadog
Example
# Read the docs on Resources to learn more: https://docs.dagster.io/deployment/resources
from dagster_datadog import DatadogResource
from dagster import EnvVar, op, job
import os
@op
def my_op(datadog: DatadogResource):
datadog.get_client().increment("my_op.foo")
@job(resource_defs={
"datadog": DatadogResource(
api_key=EnvVar("DATADOG_API_KEY"),
app_key=EnvVar("DATADOG_APP_KEY"),
)
})
def my_job():
my_op()
About Datadog
Datadog is an observability service for cloud-scale applications, providing monitoring of servers, databases, tools, and services, through a SaaS-based data analytics platform.