From the course: Azure Solutions Architect Expert (AZ-305) Cert Prep: Design Data Storage Solutions

Unlock the full course today

Join today to access over 23,200 courses taught by industry experts.

Design for ETL/ELT and data orchestration

Design for ETL/ELT and data orchestration - Azure Tutorial

From the course: Azure Solutions Architect Expert (AZ-305) Cert Prep: Design Data Storage Solutions

Start my 1-month free trial Buy for my team

Design for ETL/ELT and data orchestration

“

- [Instructor] To generate reports in dashboards with actionable insights, you may need to architect solutions that collect massive amounts of raw, unstructured data from multiple data stores, then transform it and publish it, ready to be consumed. In the Lambda architecture, this is the Cold Path. Data is extracted from data sources and copied to a central store. It is transformed from the raw state into a structure ready for analysis using batch processing that is triggered or scheduled, and then loaded into a data warehouse, or analytics engines, ready for analysis. This is also known as ETL or ELT. Azure Data Factory is the recommended Azure service for ETL or ELT, and Azure Data Factory is a cloud-based integration service for orchestration and movement of data at scale. Azure Data Factory is made up of multiple components. The main component is the pipeline, which is visually authored using a drag and…

Contents