Azure Databricks

How to get Databricks WorkspaceID from REST API using PowerShell?

Getting information about ID of the Azure Databricks workspace is not so obvious. There is no information about it in the API specification: That’s probably because this property is not related to the content of the workspace 🙂 That’s right! Raw JSON responses are intended to deliver different setCzytaj dalej / Read more

Azure, Azure Data Lake Storage Gen2, Azure Storage Explorer

Connecting to Azure Data Lake Storage Gen2 from PowerShell using REST API – a step-by-step guide

    Introduction Azure Data Lake Storage Generation 2 was introduced in the middle of 2018. With new features like hierarchical namespaces and Azure Blob Storage integration, this was something better, faster, cheaper (blah, blah, blah!)  compared to its first version – Gen1. Since then, there has been enough time toCzytaj dalej / Read more

Azure, Azure Automation, Azure Data Factory

Azure Data Factory V2 and Azure Automation – Running pipeline from runbook with PowerShell

  Introduction Azure Automation is just a PowerShell and python running platform in the cloud. In marketing language, it’s a swiss army knife 😛 Here how Microsoft describes it: “Azure Automation delivers a cloud-based automation and configuration service that provides consistent management across your Azure and non-Azure environments. It consists of process automation,Czytaj dalej / Read more

Azure, Azure Data Factory

Azure Data Factory V2 – Incremental loading with configuration stored in a table – Complete solution, step by step.

Introduction Loading data using Azure Data Factory v2 is really simple. Just drop Copy activity to your pipeline, choose a source and sink table, configure some properties and that’s it – done with just a few clicks! But what if you have dozens or hundreds of tables to copy? AreCzytaj dalej / Read more

Useful Scripts

TSQL query for generating a report from SSISDB with SSIS package processed in execution

And the thanks goes to Michał Powaga for providing me that script below 😉 USE SSISDB; GO SET TRANSACTION ISOLATION LEVEL READ UNCOMMITTED; DECLARE @execution_id BIGINT = 70660; — your package id WITH msgs AS ( SELECT event_message_id , execution_path , package_name , package_path_full , event_name , message_source_name , package_pathCzytaj dalej / Read more