Data Engineers who need to hit the ground running will use this book to build skills in Azure Data Factory v2 (ADF).
What You Will Learn Create pipelines, activities, datasets, and linked services Build reusable components using variables, parameters, and expressions Move Data into and around Azure services automatically Transform Data natively using ADF Data flows and Power Query Data wrangling Master flow-of-control and triggers for tightly orchestrated pipeline execution Publish and monitor pipelines easily and with confidence Who This Book Is For Data Engineers and ETL developers taking their first steps in Azure Data Factory, SQL Server Integration Services users making the transition toward doing ETL in Microsoft\'s Azure cloud, and SQL Server database administrators involved in Data warehousing and ETL operations.
Tools for implementing boilerplate processes such as change Data capture and metadata-driven Data copying.
The ability to trigger pipelines in response to custom events.
Extensions to integration runtime capabilities including Managed VNet support.
The introduction of reusable Data flow components such as user-defined functions and flowlets.
Improvements to flow control provided by activity deactivation and the Fail activity.
This edition, updated for 2024, includes the latest developments to the Azure Data Factory service: Enhancements to existing pipeline activities such as Execute Pipeline, along with the introduction of new activities such as Script, and activities designed specifically to interact with Azure Synapse Analytics.
Then it demonstrates the tools necessary to orchestrate, monitor, and manage those components.
It introduces components indispensable for the movement and transformation of Data in the cloud.
From creating your first Data Factory to building complex, metadata-driven nested pipelines, the book guides you through essential concepts in Microsoft\'s cloud-based ETL/ELT platform.
The tutorial-first approach to ADF taken in this book gets you working from the first chapter, explaining key ideas naturally as you encounter them.
Data Engineers who need to hit the ground running will use this book to build skills in Azure Data Factory v2 (ADF)