Comparing Cloud Shell with PowerShell Editors

I love using Azure PowerShell to script creating and managing Azure resources. Yet there are two options I like to compare 1) A script editor such as Windows PowerShell ISE or Visual Studio Code; 2) Azure Portal's Browser-based Cloud Shell This post will be based on Windows environments, as opposed to mac and Linux based …

Continue reading Comparing Cloud Shell with PowerShell Editors

Debugging Azure PowerShell with Activity Log

I got the following error message in PowerShell, as I was trying to create an Azure virtual network with multiple subnets by running New-AzureRMVirtualNetwork This error message is too vague and need more information. So where do I look? There are two options. 1) The long and manual option Go to Azure Portal > the …

Continue reading Debugging Azure PowerShell with Activity Log

Re-Create HDInsight Cluster with Pre-Existing Azure Data Lake Store and Hive Metastore

Upon creating an HDInsight cluster for big data analytics development, the costs can be quite high at around $4 an hour. This adds up, especially when running idle most of the time. To save on the costs, I delete the cluster and re-create when needed. For simple development purposes, my HDInsight depends on Azure Data …

Continue reading Re-Create HDInsight Cluster with Pre-Existing Azure Data Lake Store and Hive Metastore

Using Azure Data Lake Store .NET SDK to Upload Files

Blog Series: Creating Azure Data Lake PowerShell and Options to upload data to Azure Data Lake Store Using Azure Data Lake Store .NET SDK to Upload Files Creating Azure Data Analytics Azure Data Lake Analytics: Database and Tables Azure Data Lake Analytics: Populating & Querying Tables Azure Data Lake Analytics: How To Extract JSON Files …

Continue reading Using Azure Data Lake Store .NET SDK to Upload Files