Please note this is a dynamically updated article. Newly added or updated sections will be highlighted in bold for your convenience. Regularly revisit this article to stay informed about the latest updates.
Latest updates:
25. September - Azure Prompt Flow
30. September - GPT 3.5 instruct
18. October - Fine-tuning
17. November - Ignite Conference
13. December - GPT 4 Vision update
Where to Start
Request GPT3 & 3.5 Models: Request Access to Azure OpenAI Service (microsoft.com)
Request GPT4 Models: Azure OpenAI GPT-4 Application (microsoft.com)
Request opt-out: Azure OpenAI Limited Access Review: Modified Content Filters and Abuse Monitoring (microsoft.com)
Data & Privacy
Data & Privacy Overview: Data, privacy, and security for Azure OpenAI Service - Azure AI services | Microsoft Learn
Encryption of data at rest: Azure OpenAI Service encryption of data at rest - Azure AI services | Microsoft Learn
Monitoring Models: Monitoring Azure OpenAI Service - Azure AI services | Microsoft Learn
Role-Based Access Control: Role-based access control for Azure OpenAI - Azure AI services | Microsoft Learn
Landing zone reference architecture: Azure OpenAI Landing Zone reference architecture (microsoft.com)
Security
Security filters cognitive search: Security filters for trimming results - Azure Cognitive Search | Microsoft Learn
Security filters Active Directory: Security filters to trim results using Active Directory - Azure Cognitive Search | Microsoft Learn
Virtual Network config: Configure Virtual Networks for Azure AI services - Azure AI services | Microsoft Learn
Managed identities config: How to configure Azure OpenAI Service with managed identities - Azure OpenAI | Microsoft Learn
Models & Pricing
GPT 4 Turbo / November API Microsoft Azure AI, data, and application innovations help turn your AI ambitions into reality | Microsoft Azure Blog (updated 17 November)
GPT4 Vision Quickstart: Use GPT-4 Turbo with Vision on your images and videos with the Azure Open AI Service - Azure OpenAI | Microsoft Learn (updated 13.December)
Azure Open Ai Models: Azure OpenAI Service models - Azure OpenAI | Microsoft Learn GPT 3.5 Instruct (updated 30 September)
Whisper Model: Announcing the Preview of OpenAI Whisper in Azure OpenAI service and Azure AI Speech - Microsoft Community Hub
Fine-Tuning: Fine Tuning: now available with Azure OpenAI Service - Microsoft Community Hub (updated 18. October)
Azure Open AI: Azure OpenAI Service - Pricing | Microsoft Azure
Guidance
Bring your own data: Use your own data with Azure OpenAI Service - Azure OpenAI | Microsoft Learn
Retrieval Augmented Generation (RAG) RAG and generative AI - Azure Cognitive Search | Microsoft Learn
Deploy Azure Open Ai Service: How-to: Create and deploy an Azure OpenAI Service resource - Azure OpenAI | Microsoft Learn
Embedding Tutorial: Azure OpenAI Service embeddings tutorial - Azure OpenAI | Microsoft Learn
GPT Model – How to work: How to work with the GPT-35-Turbo and GPT-4 models - Azure OpenAI Service | Microsoft Learn
Responsible AI
Responsible Ai Accelerator: microsoft/ResponsibleAIAccelerator: Repo to hold examples of responsible model assessment for a variety of different verticals such as healthcare and financial services (github.com)
Responsible AI Overview: Microsoft Responsible AI | Microsoft AI
Examples
Business Process Automation Azure/business-process-automation: Business process automation solution accelerator using Azure services (github.com)
MLOPs/LLMOPs microsoft/MLOps: MLOps examples (github.com)
Architectures
Platform / AI Studio: Announcing Azure AI Studio preview (microsoft.com) (updated 17. November)
Load Balancing: Using LangChain with Azure OpenAI to implement load balancing via fallbacks · Clemens Siebler's Blog
Load Balancing 2: Load Balancing Azure OpenAI using Application Gateway | Rafferty Uy
Azure Open AI Landing Zone: Azure OpenAI Landing Zone reference architecture (microsoft.com)
Azure Open AI APIM deployments: microsoft/AzureOpenAI-with-APIM: Deploy APIM. Auto-configure it to work with your Azure Open AI. (github.com)
Logging and Monitoring of Azure Open AIImplement logging and monitoring for Azure OpenAI large language models - Azure Architecture Center | Microsoft Learn
MVP Deployment
Bring your own data: Use your own data with Azure OpenAI Service - Azure OpenAI | Microsoft Learn
Guidance: guidance-ai/guidance: A guidance language for controlling large language models. (github.com)
human-AI toolbox: Microsoft HAX Toolkit
Cognitive Search – Semantic Search Quickstart: semantic search - Azure Cognitive Search | Microsoft Learn
Cognitive Search – Vector Search Quickstart vector search - Azure Cognitive Search | Microsoft Learn
Azure Open AI x Cognitive Search x Langchain Using Azure Search for vector search with Azure OpenAI and LangChain · Clemens Siebler's Blog
Front-end (Avatar Speech) Introducing Azure text to speech avatar public preview (microsoft.com) (updated 17. November)
Vector Database
Azure AI Search with Semantic ranker Introducing Azure text to speech avatar public preview (microsoft.com) (updated 17. November)
Prompt engineering
Prompt engineering techniques: Prompt engineering techniques with Azure OpenAI - Azure OpenAI Service | Microsoft Learn
System message framework: System message framework and template recommendations for Large Language Models(LLMs) - Azure OpenAI Service | Microsoft Learn
Azure Prompt Flow (updated 25 September)
What is Prompt Flow: What is Azure Machine Learning prompt flow (preview) - Azure Machine Learning | Microsoft Learn (updated 25 September)
Prompt Flow set-up: Create and manage runtimes in Prompt flow (preview) - Azure Machine Learning | Microsoft Learn (updated 25 September)
Operationalizing: Generative AI in Azure Machine Learning: Operationalizing app development for AI transformation - Microsoft Community Hub (updated 25 September)
LLM Inspiration and Research
What’s a token? OpenAI Platform