Thanks to everyone who joined us for the Dagster+ launch! Dagster+ is an exciting redefinition of #dataorchestration aimed at: • reducing spend via cost #observability • eliminating error-prone point-solutions • enabling #data teams to operate autonomously Learn more about Dagster+ and get started for free here: https://bit.ly/3JnpZ0l
Dagster Labs
Software Development
San Francisco, California 4,316 followers
Building out Dagster, the data orchestration platform built for productivity.
About us
Building out Dagster, the data orchestration platform built for productivity. Join the team that is hard at work, setting the standard for developer experience in data engineering. Dagster Github: https://github.com/dagster-io/dagster
- Website
-
http://www.dagsterlabs.com
External link for Dagster Labs
- Industry
- Software Development
- Company size
- 11-50 employees
- Headquarters
- San Francisco, California
- Type
- Privately Held
- Founded
- 2018
- Specialties
- data engineering, data orchestration, open source software, and SaaS
Products
Locations
-
Primary
San Francisco, California, US
-
Minneapolis, Minnesota, US
-
New York City, New York, US
-
Los Angeles, California, US
Employees at Dagster Labs
Updates
-
Dagster Labs reposted this
Collaborating with the Discord team has been a fantastic experience as they upgraded their data platform using Dagster Labs (Dagster+) as their data orchestrator. Zach Bluhm's recent blog post does a great job detailing their journey. We'd love to hear your thoughts! A big congratulations to the entire team for reaching this remarkable milestone! https://lnkd.in/g4abYVkF #dataengineering #data #dagster #dataplatform #discord #airflow #dbt
To continue delivering seamless service and insightful data analytics, Discord overhauled their data orchestration infrastructure. Moving away from in-house tools to using #Dagster & dbt, they were able to scale to 2000+ dbt tables and transform their data workflows. Check out this blog post for the full story: https://bit.ly/4f3gQZu
How Discord Uses Open-Source Tools for Scalable Data Orchestration & Transformation
discord.com
-
Dagster Labs reposted this
It has been an absolute pleasure partnering with the Discord team as they modernize their data platform with Dagster Labs (Dagster+) as their data orchestrator. Zach Bluhm does an excellent job authoring their experience in his recent blog post - let us know your thoughts. Huge congratulations to the whole team for this impressive milestone! https://lnkd.in/g4abYVkF #dataengineering #data #dagster #dataplatform #discord #airflow #dbt
How Discord Uses Open-Source Tools for Scalable Data Orchestration & Transformation
discord.com
-
Dagster Labs reposted this
It's an honor to work with the Zach Bluhm and world-class engineering team at Discord to power their data platform with Dagster. https://lnkd.in/eGXSD3f7
-
To continue delivering seamless service and insightful data analytics, Discord overhauled their data orchestration infrastructure. Moving away from in-house tools to using #Dagster & dbt, they were able to scale to 2000+ dbt tables and transform their data workflows. Check out this blog post for the full story: https://bit.ly/4f3gQZu
How Discord Uses Open-Source Tools for Scalable Data Orchestration & Transformation
discord.com
-
Dagster Labs reposted this
We recently shipped a new Asset Health dashboard in Dagster+. It’s a single place for data platform teams to keep tabs on the state of every asset across their organization. It's a powerful new tool to monitor execution failures, data quality problems, and freshness issues. As data orchestration becomes more asset-oriented and event-driven, the classic pipeline timeline view becomes less useful for monitoring. It helps you understand when things ran, but doesn’t paint a clear enough picture of the current state of the data assets you’ve built. For example, you probably don’t care much about failures that automatically recovered; but you DO care about datasets that are overdue or failing critical quality checks. You might set up alerts for this, but they often end up spamming a Slack channel that half the team has already muted. Asset Heath is designed to be the first place a data team goes on Monday morning. Its purpose is to strip away the noise, and help data practitioners quickly discover and diagnose issues with the datasets they’re responsible for. It's available now for Dagster+ customers.
-
Dagster is now available on Google Cloud Marketplace! GCP customers can now utilize their GCP credits towards their #Dagster subscription and enjoy simplified procurement and billing directly through their GCP account. Be sure to check out our listing and get in touch with our sales team to get started! https://bit.ly/4cwlptT
-
Dagster Labs reposted this
One of my favorite parts of working at Dagster is getting inside access to some of the best engineers I've had the pleasure of working with. Here's a great example of an RFC by Owen Kephart on the upcoming Declarative Automation work we are building, I learn a lot just by reading how Owen both illustrates problems and communicates his approach. https://lnkd.in/gA-ag6Ve
[RFC] Declarative Automation and the future of Auto-materialize Policies · dagster-io dagster · Discussion #22811
github.com
-
Archiving is one of the last (and most critical) stages of a #data lifecycle management strategy, when data that is no longer actively used is sent to a separate storage system for long-term retention. This can: • optimize system performance • reduce primary storage costs • ensure compliance Explore different data archiving strategies here: https://bit.ly/3zscYRx
Data Archiving | Dagster Glossary
dagster.io
-
On Episode 43 of the Podcast Ruined by a Software Engineer, Sandy Ryza joins Perry Tiu and discusses: • transitioning to and from software engineering and data science • data application performance • maintaining vast open-source projects Hear Sandy's insights on these (and more) and catch the full podcast here: https://bit.ly/4clow7V Alternatively, if you want to watch it, go here: https://bit.ly/4crAT2i
-