Category: Azure Data Factory

Azure Data Factory [EN]

Azure, Azure Data Factory

Variability in Azure Data Factory pipeline run times and how Azure region load affects them?

Azure Data Factory is a powerful tool, offering a vast range of possibilities, though it can be a bit intricate in terms of pricing and architecture. It’s very dear to me, as I appreciate it for many improvements and conveniences compared to its ancestor, SQL Server Integration Services. However, yearsCzytaj dalej / Read more

Azure, Azure Automation, Azure Data Factory

Azure Data Factory V2 and Azure Automation – Running pipeline from runbook with PowerShell

  Introduction Azure Automation is just a PowerShell and python running platform in the cloud. In marketing language, it’s a swiss army knife 😛 Here how Microsoft describes it: “Azure Automation delivers a cloud-based automation and configuration service that provides consistent management across your Azure and non-Azure environments. It consists of process automation,Czytaj dalej / Read more

Azure, Azure Data Factory

Azure Data Factory V2 – Incremental loading with configuration stored in a table – Complete solution, step by step.

Introduction Loading data using Azure Data Factory v2 is really simple. Just drop Copy activity to your pipeline, choose a source and sink table, configure some properties and that’s it – done with just a few clicks! But what if you have dozens or hundreds of tables to copy? AreCzytaj dalej / Read more