Category: AI

Resolving Errors In Azure AI Search Indexer Against Blob Storage Account

On By Roy Kim (MVP)In AI, AzureLeave a comment

When creating an indexer in Azure AI Search to read files such as JSON and PDFs, I encountered the following error: Operation:Web Api response status: 'Unauthorized', Web Api response details: '{"error":{"code":"PermissionDenied","message": "Principal does not have access to API/Operation."}}' Message:Could not execute skill because the Web Api request failed. Details:Web Api response status: 'Unauthorized', Web Api …

Continue reading Resolving Errors In Azure AI Search Indexer Against Blob Storage Account

Permissions with Azure AI Foundry: Safety And Security

On By Roy Kim (MVP)In AI, SecurityLeave a comment

As I was starting to try out Azure Foundry Safety and Security feature, I confronted with the error "Your account does not have access to this resource, please contact your resource owner to get access". And so I went to the Management Center, to check user permissions and yet I have owner permissions at the …

Continue reading Permissions with Azure AI Foundry: Safety And Security

Deep Dive Into Fine-Tuning An LM Using KAITO on AKS – Part 4: Evaluation

On By Roy Kim (MVP)In AI, Azure, Kubernetes3 Comments

In the previous article Part 3, I have shown deploy the fine-tuned model on Azure Kubernetes Service with the Kaito add-on. In this article, I will show manual evaluation with a series of prompts taken from the fine-tuning dataset. This blog post is part of a series.Part 1: Intro and overview of the KAITO fine-tuning …

Continue reading Deep Dive Into Fine-Tuning An LM Using KAITO on AKS – Part 4: Evaluation

Deep Dive Into Fine-Tuning An LM Using KAITO on AKS – Part 3: Deploying the FT Model

On By Roy Kim (MVP)In AI, Azure, Kubernetes4 Comments

Now that I have fine-tuned a model in Part 2, next is to deploy the fine tuned model into a new Kaito workspace. This blog post is part of a series.Part 1: Intro and overview of the KAITO fine-tuning workspace yamlPart 2: Executing the Training Kubernetes Training JobPart 3: Deploying the Fine-Tuned ModelPart 4: Evaluating …

Continue reading Deep Dive Into Fine-Tuning An LM Using KAITO on AKS – Part 3: Deploying the FT Model

Deep Dive Into Fine-Tuning An LM Using KAITO on AKS – Part 2: Execution

On By Roy Kim (MVP)In AI, Azure, Kubernetes3 Comments

I will continue from the Part 1 to execute the deployment of the fine-tuning workspace job. This blog post is part of a series.Part 1: Intro and overview of the KAITO fine-tuning workspace yamlPart 2: Executing the Training Kubernetes Training JobPart 3: Deploying the Fine-Tuned ModelPart 4: Evaluating the Fine-Tuned Model Let' start the fine …

Continue reading Deep Dive Into Fine-Tuning An LM Using KAITO on AKS – Part 2: Execution

Deep Dive Into Fine-Tuning An LM Using KAITO on AKS – Part 1: Intro

On By Roy Kim (MVP)In AI, Azure, Kubernetes4 Comments

I uncover the process and workings of fine-tuning a large language model on a dataset. Scenario for fine-tuning a model can be on corporate data such as a knowledge base, product information, human resources. I walk you through the process and share my detailed observations. What is Fine-tuning a large language model? Involves adjusting a …

Continue reading Deep Dive Into Fine-Tuning An LM Using KAITO on AKS – Part 1: Intro

Building a Chat App using Azure AI Foundry SDK and AI Search

On By Roy Kim (MVP)In AI, AzureLeave a comment

I have been exploring some in depth tutorials in building a chat application. It implements Retrieval Augmentation Generation (RAG) on a product database in Azure AI Search. The scenario is for a retail customer to ask product recommendations on camping gear. This solution employs Azure AI Foundry for LLM models and interfacing. My goal of …

Continue reading Building a Chat App using Azure AI Foundry SDK and AI Search

Exploring Azure AI Foundry: Hubs and Projects

On By Roy Kim (MVP)In AI, AzureLeave a comment

The Azure AI Foundry portal is a cohesive environment for developing AI solutions, enabling users to create Hubs and Projects that facilitate collaboration among data scientists, developers, and engineers. It integrates services like Azure Open AI, offering shared resources and role-based access management while streamlining AI services' deployment and management processes.

Effortlessly Setup Kaito v0.3.1 on Azure Kubernetes Service To Deploy A Large Language Model

On By Roy Kim (MVP)In AI, Azure, Kubernetes4 Comments

KAITO simplifies the deployment of large language models (LLMs) in Azure Kubernetes Service (AKS) environments with preset GPU configurations. This tool automates the setup process, including node provisioning and identity management, essential for data experiments while ensuring security compliance. It enhances efficiency, allowing engineers to focus on AI/ML model experimentation. #azure #kubernetes #AI #genAI #mvpbuzz