I uncover the process and workings of fine-tuning a large language model on a dataset. Scenario for fine-tuning a model can be on corporate data such as a knowledge base, product information, human resources. I walk you through the process and share my detailed observations. What is Fine-tuning a large language model? Involves adjusting a …
Continue reading Deep Dive Into Fine-Tuning An LM Using KAITO on AKS – Part 1: Intro
I have been exploring some in depth tutorials in building a chat application. It implements Retrieval Augmentation Generation (RAG) on a product database in Azure AI Search. The scenario is for a retail customer to ask product recommendations on camping gear. This solution employs Azure AI Foundry for LLM models and interfacing. My goal of …
Continue reading Building a Chat App using Azure AI Foundry SDK and AI Search
The blog discusses the Kubernetes AI Toolchain Operator (KAITO) setup on AKS, detailing the NVIDIA GPU VM instance types for node pools hosting AI inference models. It emphasizes cost efficiency and GPU specifications for deploying large models.
KAITO simplifies the deployment of large language models (LLMs) in Azure Kubernetes Service (AKS) environments with preset GPU configurations. This tool automates the setup process, including node provisioning and identity management, essential for data experiments while ensuring security compliance. It enhances efficiency, allowing engineers to focus on AI/ML model experimentation. #azure #kubernetes #AI #genAI #mvpbuzz
Roy Kim on Azure and AI 