15 October 201915 April 2020 Michał PawlikowskiAzure, Azure Databricks

Azure Databricks deployment and error: SubnetMissingRequiredDelegation – VNet injection problem

The problem Are you surprised by the following error messages? Resource Microsoft.Databricks/workspaces [workspacename] failed with message : ResourceDeploymentFailure SubnetMissingRequiredDelegation Failed to prepare subnet. Please try again later? Sure, I was too 🙂 So, what the heck is going on? May I ask if you have used the benefits of theCzytaj dalej / Read more

5 September 201915 April 2020 Michał PawlikowskiMultidimensional, SSAS, Useful Scripts

SSAS database info (db size, partition size, processing status etc.)

Source: http://www.ssas-info.com/analysis-services-scripts/1197-powershell-script-to-list-info-about-ssas-databases slightly modified

param($ServerName = "localhost", $dbname = "db_name")

## Add the AMO namespace
$loadInfo = [Reflection.Assembly]::LoadWithPartialName("Microsoft.AnalysisServices")

$server = New-Object Microsoft.AnalysisServices.Server
$server.connect($ServerName)
if ($server.name -eq $null) {
    Write-Output ("Server '{0}' not found" -f $ServerName)
    break
}

foreach ($d in $server.Databases ) {
    if ($d.Name -ne $dbname) { continue; }

    Write-Output ( "Database: {0}; Status: {1}; Size: {2}MB" -f $d.Name, $d.State, ($d.EstimatedSize / 1024 / 1024).ToString("#,##0") )

    foreach ($cube in $d.Cubes) {
        Write-Output ( " Cube: {0}" -f $Cube.Name )
        foreach ($mg in $cube.MeasureGroups) {
            Write-Output ( "  MG: {0}; Status: {1}; Size: {2}MB" -f $mg.Name.PadRight(25), $mg.State, ($mg.EstimatedSize / 1024 / 1024).tostring("#,##0")) 
            foreach ($part in $mg.Partitions) {
                Write-Output ( "   Partition: {0}; Status: {1}; Size: {2}MB" -f $part.Name.PadRight(35), $part.State, ($part.EstimatedSize / 1024 / 1024).ToString("#,##0") )
            } # Partition
        } # Measure group
        foreach ($dim in $d.Dimensions) {
            Write-Output ( "Dimension: {0}" -f $dim.Name)
        } # Dimensions

    } # Cube

} # Databases

param($ServerName = "localhost", $dbname = "db_name")

## Add the AMO namespace

$loadInfo = [Reflection.Assembly]::LoadWithPartialName("Microsoft.AnalysisServices")

$server = New-Object Microsoft.AnalysisServices.Server

$server.connect($ServerName)

if ($server.name -eq $null) {

Write-Output ("Server '{0}' not found" -f $ServerName)

break

}

foreach ($d in $server.Databases ) {

if ($d.Name -ne $dbname) { continue; }

Write-Output ( "Database: {0}; Status: {1}; Size: {2}MB" -f $d.Name, $d.State, ($d.EstimatedSize / 1024 / 1024).ToString("#,##0") )

foreach ($cube in $d.Cubes) {

Write-Output ( " Cube: {0}" -f $Cube.Name )

foreach ($mg in $cube.MeasureGroups) {

Write-Output ( " MG: {0}; Status: {1}; Size: {2}MB" -f $mg.Name.PadRight(25), $mg.State, ($mg.EstimatedSize / 1024 / 1024).tostring("#,##0"))

foreach ($part in $mg.Partitions) {

Write-Output ( " Partition: {0}; Status: {1}; Size: {2}MB" -f $part.Name.PadRight(35), $part.State, ($part.EstimatedSize / 1024 / 1024).ToString("#,##0") )

} # Partition

} # Measure group

foreach ($dim in $d.Dimensions) {

Write-Output ( "Dimension: {0}" -f $dim.Name)

} # Dimensions

} # Cube

} # Databases

14 August 201915 April 2020 Michał PawlikowskiAzure, Azure Data Lake Storage Gen2

Maximum length of ADLS Gen2 path (and directory/file name)

Yeap 😐 If anyone was interested in this topic and did not find the answer in the official documentation (at least not explicitly), the answer is just above. I was wondering how far you could go in creating the directory path. I only found the limit given for anCzytaj dalej / Read more

18 July 201915 April 2020 Michał PawlikowskiMultidimensional, SSAS

“Internal error: An unexpected exception occurred.” when trying to filter simple dimension that has ragged parent-child hierarchy in multidimensional model.

Platform: SQL Server Analysis Services 2016 RTM and later (Multidimensional) In one of our projects, we encountered an interesting problem related to parameter filtering on one of our reports (SSRS). However, we would like to make sure that no mistake has been made before it hits as a bugCzytaj dalej / Read more

2 July 201915 April 2020 Michał PawlikowskiAzure, Azure Data Lake Storage Gen2, Azure Storage Explorer

Uploading files to Azure Data Lake Storage Gen2 from PowerShell using REST API, OAuth 2.0 bearer token and Access Control List (ACL) privileges

Introduction In my previous article “Connecting to Azure Data Lake Storage Gen2 from PowerShell using REST API – a step-by-step guide“, I showed and explained the connection using access keys. As you probably know, access key grants a lot of privileges. In fact, your storage account key is similarCzytaj dalej / Read more

11 May 201915 April 2020 Michał PawlikowskiAzure Databricks

How to get Databricks WorkspaceID from REST API using PowerShell?

Getting information about ID of the Azure Databricks workspace is not so obvious. There is no information about it in the API specification: https://docs.databricks.com/api/latest/workspace.html That’s probably because this property is not related to the content of the workspace 🙂 That’s right! Raw JSON responses are intended to deliver different setCzytaj dalej / Read more

29 March 201915 April 2020 Michał PawlikowskiBRAINDUMP

SELECT TOP 1 music FROM my_head ORDER BY composing_date desc

Sometimes people are really surprised that I can compose and play keyboards without any musical education, teacher or any theoretical knowledge. I don’t even know the notes… But somehow it just works. I learned everything by myself. I use only my sense of hearing, memory, and emotions. I inviteCzytaj dalej / Read more

10 March 201915 April 2020 Michał PawlikowskiAzure, Azure Data Lake Storage Gen2, Azure Storage Explorer

Connecting to Azure Data Lake Storage Gen2 from PowerShell using REST API – a step-by-step guide

Introduction Azure Data Lake Storage Generation 2 was introduced in the middle of 2018. With new features like hierarchical namespaces and Azure Blob Storage integration, this was something better, faster, cheaper (blah, blah, blah!) compared to its first version – Gen1. Since then, there has been enough time toCzytaj dalej / Read more

9 March 201915 April 2020 Michał PawlikowskiAzure Storage Explorer

How to sniff ADLS Gen2 storage REST API calls to Azure using Azure Storage Explorer

Introduction Azure Storage Explorer is the tool that is most useful for managing files in our Azure cloud. But it can also be successfully used to indicate how to correctly send REST requests in specific situations! And this short tutorial will show you how to do it 🙂 Czytaj dalej / Read more

1 July 201815 April 2020 Michał PawlikowskiAzure, Azure Automation, Azure Data Factory

Azure Data Factory V2 and Azure Automation – Running pipeline from runbook with PowerShell

Introduction Azure Automation is just a PowerShell and python running platform in the cloud. In marketing language, it’s a swiss army knife 😛 Here how Microsoft describes it: “Azure Automation delivers a cloud-based automation and configuration service that provides consistent management across your Azure and non-Azure environments. It consists of process automation,Czytaj dalej / Read more

Azure Data & Infra

Subjectively and uncensored...