paulyuk

RAG

{
  "IsEncrypted": false,
  "Values": {
    "AzureWebJobsStorage": "UseDevelopmentStorage=true",
    "FUNCTIONS_WORKER_RUNTIME": "dotnet-isolated",
    "AZURE_OPENAI_ENDPOINT": "https://cog-c33gk4hhzykak.openai.azure.com/",
 "CHAT_MODEL_DEPLOYMENT_NAME": "chat",

paulyuk

Samples for Building and Deploying Cloud Native Intelligent Apps

.NET Conf 2024

by Scott Hunter @coolcsh and Paul Yuknewicz @paulyuk

Here are all the demos shown in our session with full repos, azd templates, and a few notes. Enjoy, and let us know what you think! -- Scott and Paul

Part 1 - Aspire 9 & Functions

paulyuk

Configuring scale

General command to set

az functionapp scale config set --resource-group <RESOURCE_GROUP> --name <APP_NAME> --trigger-type http --trigger-settings perInstanceConcurrency=10

e.g. set to 2 events per instance

paulyuk

apiVersion: dapr.io/v1alpha1
kind: Component
metadata:
  name: statestore
spec:
  type: state.redis
  version: v1
  metadata:
  # These settings will work out of the box if you use `helm install
  # bitnami/redis`.  If you have your own setup, replace

paulyuk

How to - Securing your Azure Function

Paul's secret mision "do this, and dont do that"

Using indentity

Using identity for AzureWebJobsStorage

Using identity for Bindings

Using identity for Deployment

Networking

Setting up vnet in your function app

paulyuk

Snippets for Functions Under the Hood at Scale

Configuring scale

General command to set

az functionapp scale config set --resource-group <RESOURCE_GROUP> --name <APP_NAME> --trigger-type http --trigger-settings perInstanceConcurrency=10

e.g. set to 2 events per instance

paulyuk

Converting a Function App to Managed Identity - 101

Overview

This shows how to take a simple Function App (e.g. the output of our client tools templates for a trigger or binding) or a simple sample and "modernize" it from using ConnectionStrings and secrets in favor of Managed Identity and RBAC.

Assumptions

• User-assigned managed identity is prefered. Beware if you do not select an identity to use in code (ClientId), it will default to system assigned.
• local development will make Connections to local emulators if they exist, and otherwise will make remote cloud connections to resource using identity based connections. Some resources like Service Bus, AI Cognitive, Open AI, and Datalake will

paulyuk

Slides

[https://paulyukstoragev2.blob.core.windows.net/flex-under-hood/functions-scale-under-hood.pptx]

Gist with CLI terminal commands

[https://gist.github.com/paulyuk/7609612ad5330e4e3aaf66b844b93075]

End to end sample we load tested (e2e with HTTP, EH & VNET)

[https://aka.ms/flexconsumption/samples]

AI RAG sample with concurrency=1

paulyuk

{
    "$schema": "https://schema.management.azure.com/schemas/2019-04-01/deploymentTemplate.json#",
    "contentVersion": "1.0.0.0",
    "parameters": {
        "sites_py_flex_beta_function2_name": {
            "defaultValue": "py-flex-beta-function2",
            "type": "String"
        },
        "serverfarms_py_flex_beta_function2FlexPlan_externalid": {
            "defaultValue": "/subscriptions/ca5ce512-88e1-44b1-97c6-22caf84fb2b0/resourceGroups/py-flex-beta-2/providers/Microsoft.Web/serverfarms/py-flex-beta-function2FlexPlan",

paulyuk

PowerShell

install latest - 7.3

winget search Microsoft.PowerShell
winget install --id Microsoft.Powershell

or alternatively:

OPTIONAL install PowerShell preview - 7.4