Azure Data Factory: Copy Data from Azure Data Lake Store to Azure SQL

On February 19, 2017May 8, 2017 By Roy Kim (MVP)In Azure, Azure PaaSLeave a comment

Objective: From Azure Data Lake Store, copy data in a .tsv file to a database table in Azure SQL DB. My take on Azure Data Factory is that of ETL but less of the transformation and move data from on-premises and cloud sources to Azure data-oriented services. Read further about Azure Data Factory https://docs.microsoft.com/en-us/azure/data-factory/data-factory-introduction In …

Continue reading Azure Data Factory: Copy Data from Azure Data Lake Store to Azure SQL

Azure Search: Pushing Content to an Index with the .NET SDK.

On February 4, 2017February 1, 2018 By Roy Kim (MVP)In Azure Data Platform, Azure IaaS, Azure PaaS2 Comments

Blog Series Azure Search Overview Pushing Content To An Index with the .NET SDK I hold the opinion that for a robust indexing strategy, you would likely end up writing a custom batch application between your desired data sources and your defined Azure Search index. The pull method currently only supports data sources that reside …

Continue reading Azure Search: Pushing Content to an Index with the .NET SDK.

Azure Search Overview

On February 2, 2017November 6, 2018 By Roy Kim (MVP)In Azure, Azure Data Platform, Azure PaaS2 Comments

Blog Series Azure Search Overview Pushing Content To An Index with the .NET SDK Azure Search is a platform-as-a-service offering. This requires code and configuration to set up and use. Applicable corporate scenarios Enterprise search on many repositories of data or files that are intended to be available for a wide audience. A lightweight one-stop …

Continue reading Azure Search Overview

Create HDInsight Spark Cluster with Azure Data Lake Store

On December 3, 2016April 24, 2017 By Roy Kim (MVP)In Azure, Azure Data Platform, Azure PaaSLeave a comment

The Spark cluster is one of the several cluster types that is offered through HDInsight platform-as-a-service. The unique capabilities of the Spark cluster are the in-memory processing that supports overall performance benefit over Hadoop cluster type. As a result, build big data analytics applications. For further overview read https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-apache-spark-overview I will walk through and comment …

Continue reading Create HDInsight Spark Cluster with Azure Data Lake Store

Power BI and Read Only Access to Azure Data Lake Store

On November 29, 2016April 23, 2017 By Roy Kim (MVP)In Azure, Azure PaaS, Power BILeave a comment

Blog Series: Creating Azure Data Lake PowerShell and Options to upload data to Azure Data Lake Store Using Azure Data Lake Store .NET SDK to Upload Files Creating Azure Data Analytics Azure Data Lake Analytics: Database and Tables Azure Data Lake Analytics: Populating & Querying Tables Azure Data Lake Analytics: How To Extract JSON Files …

Continue reading Power BI and Read Only Access to Azure Data Lake Store