Azure Batch Parallel Task Execution From the previous blog post of Part 4, I have shown a parallel execution of tasks of a .NET console application. In this blog post, I will show details and illustrations of the execution and monitoring features of Azure Batch. Execution 1 The following are conditions, parameters and data setup …
Continue reading Azure Batch for Internet Data Collection Part 5: Monitoring
A unique capability of Azure Batch is realized when executing tasks across many nodes in a pool concurrently. That is horizontal scaling. To do this in on-premises servers, it would be very costly and labour intensive. For example, would you be able to ask IT to provision 20, 40, 100+ VMs just to use for …
Continue reading Azure Batch for Internet Data Collection Part 4: Parallel Task Execution
From the previous blog post Part 2, I have created a batch account, deployed my .NET console application as an Application Package and created a Batch Pool of nodes. In this blog post, I will run a simple job against this batch pool. A job is a collection of one or more tasks. It manages …
Continue reading Azure Batch for Internet Data Collection Part 3: Jobs and Tasks
Azure Batch Solution Configuration To build out the solution design in my previous blog article, these are the following steps and design decisions. Create a batch account To create an Azure Batch application, you can follow the steps outlined in the article Create a Batch account with the Azure portal Provisioned Batch account I previously …
Continue reading Azure Batch for Internet Data Collection Part 2: Application Package and Pool
Azure Batch Overview Azure Batch is a high-performance computing platform where you can deploy and run your application across of up to hundreds virtual machines or more. To read further, visit Azure Batch Technical Overview The pricing is based on the number and size of the virtual machines that you use and storage capacity. There …
Continue reading Azure Batch for Internet Data Collection Part 1: Lab Design
Roy Kim on Azure and Microsoft 365 