July 21, 2023 • 2 minute read •

Dagster 1.4: Material Girl

The latest release brings major new dbt capabilities, new asset materialization controls, and more.

Name: Fraser Marlow
Handle: @frasermarlow

We are pleased to announce that Dagster 1.4.0 — “Material Girl” — is now available on Dagster Cloud and in Open Source. Full details on the release can be found in the release notes, but here are the highlights:

Supercharge dbt™

The headlining act on this release is the dagster-dbt enhancements. While Dagster already provided a dagster-dbt integration (as well as a dbt Cloud integration), we have gathered input from Dagster users who rely heavily on dbt and introduced brand new capabilities:

A new @dbt-assets decorator allows much more control over how Dagster runs your dbt project.
A new scaffolding command line interface makes it easy to create files and directories for a Dagster project that wraps an existing dbt project.
Improved APIs for defining asset dependencies between upstream dbt assets and downstream non-dbt assets. It is now much easier to specify dependencies between dbt models and upstream non-dbt assets by specifying Dagster asset keys in the dbt metadata for dbt sources.

View the Aug 2nd, 2023 event in which the Dagster team reviewed the new functionality.

Evolving asset materialization, improving the UI, and more

We continue to evolve asset materialization, giving you more fine-grained control and observability over when, why, and how your computations run. These include auto-materialization history, auto-materialization performance, asset backfill cancellation, and a new group-level asset status UI.

Dagster's new auto-materialization history provides complete transparency over how materialization rules were executed.

Dagster's new optional horizontal alignment. — Dagster's new auto-materialization history provides complete transparency over how materialization rules were executed.

The auto-materialization history provides granular details down to the partition level.

The new Assets Overview dashboard shows the status of all assets in your deployment, rolled up by group.

We have introduced two new experimental features: op-level concurrency limits and the ability to observe source assets without defining jobs.

We have also focused on improving some of the framework ergonomics, making it more logical and accessible. Improvements here include:

Deprecation of non_argument_deps in favor of a new deps parameter (makes it clear that this is a first-class way of defining dependencies, makes code more concise, while still accepting previous parameters)
Renaming Dagit to Dagster UI (reducing the number of terms that new users need to learn)
Auto-populating the launchpad with default field values (reducing cognitive load).

We have moved some features out of the “experimental” stage: DynamicPartitionDefinition and SensorResult.

Finally, we have a new UI layout change that is flagged as experimental and open to your feedback in the GitHub discussion found here. The new layout renders the graph horizontally left-to-right instead of vertically. You can try the new horizontal asset graph layout by enabling the Experimental horizontal asset DAGs feature flag in your user settings. Give it a try, and let us know what you think.

1.4 Contributors:

We would like to thank all of the contributors to the 1.4 Dagster Core release.

Contributors to the open source 1.4 release of Dagster.

We're always happy to hear your feedback, so please reach out to us! If you have any questions, ask them in the Dagster community Slack (join here!) or start a Github discussion. If you run into any bugs, let us know with a Github issue. And if you're interested in working with us, check out our open roles!

Follow us: