I have been exploring some in depth tutorials in building a chat application. It implements Retrieval Augmentation Generation (RAG) on a product database in Azure AI Search. The scenario is for a retail customer to ask product recommendations on camping gear. This solution employs Azure AI Foundry for LLM models and interfacing. My goal of …
Continue reading Building a Chat App using Azure AI Foundry SDK and AI Search
The Azure AI Foundry portal is a cohesive environment for developing AI solutions, enabling users to create Hubs and Projects that facilitate collaboration among data scientists, developers, and engineers. It integrates services like Azure Open AI, offering shared resources and role-based access management while streamlining AI services' deployment and management processes.
The blog discusses the Kubernetes AI Toolchain Operator (KAITO) setup on AKS, detailing the NVIDIA GPU VM instance types for node pools hosting AI inference models. It emphasizes cost efficiency and GPU specifications for deploying large models.
KAITO simplifies the deployment of large language models (LLMs) in Azure Kubernetes Service (AKS) environments with preset GPU configurations. This tool automates the setup process, including node provisioning and identity management, essential for data experiments while ensuring security compliance. It enhances efficiency, allowing engineers to focus on AI/ML model experimentation. #azure #kubernetes #AI #genAI #mvpbuzz
I did an experiment of running a load test against 4 applications and while executing a Azure Kubernetes Cluster Upgrade to see the affects and any downtime. The applications hosted in my AKS cluster are AKS Helloworld - super simple application Voting App - simple application with Redis backend Bookinfo Istio demo - microservices architecture …
If you ever encounter the following error, I'll show you one way that helped me resolve my AKS cluster. The cluster is in a failed state. If you didn't do an operation, AKS may resolve the provisioning status automatically if your cluster applications continue to run. To further troubleshoot, you can refer to https://github.com/MicrosoftDocs/SupportArticles-docs/blob/main/support/azure/azure-kubernetes/cluster-node-virtual-machine-failed-state.md For …
I like to share in hoping to have helped the small minority that couldn't get kubelogin setup properly with the struggles that I have been having. My desktop environment WSL on Windows 10 Ubuntu 20.04 Here's my error ~/linux-scripts $ kubelogin convert-kubeconfigerror: unknown command "convert-kubeconfig" for "kubelogin" I should have paid attention that the kubelogin …
The process of upgrading an AKS cluster involves careful consideration due to its complexity, especially in production environments. Manual control plane and node pool upgrades are essential, requiring meticulous monitoring and careful planning. Consider the extensive documentation for detailed guidance.
GitHub Copilot is your AI programmer and I use it via an VS Code extension. I find this to be the most effective AI tool that I have come across so far. I have used this in scenarios when I am scripting with Azure PowerShell, Az CLI and Azure SDK for Python. Here are my …
Continue reading Scripting Azure CLI with 6 Features in GitHub Copilot
This post showcases practical scenarios of using Azure Log Analytics Workspace to monitor the AKS Demo Store application with Azure Open AI for product descriptions. The post covers configuring settings, querying metrics and logs, and managing data usage for cost efficiency.
Roy Kim on Azure and AI 