Skip to content

Instantly share code, notes, and snippets.

View yorek's full-sized avatar
:octocat:
Working from home

Davide Mauri yorek

:octocat:
Working from home
View GitHub Profile
@yorek
yorek / export-to-csv.py
Created April 25, 2025 17:36
Generate CSV file from SQL Table
# pandas==2.2.3
# SQLAlchemy==2.0.40
# pyodbc==5.2.0
import pandas as pd
from sqlalchemy import create_engine
from sqlalchemy.engine import URL
connection_string = (
r"DRIVER={ODBC Driver 18 for SQL Server};"
@yorek
yorek / azure-logic-app-vectorize-document.json
Created November 9, 2024 01:02
Vectorize a document and ingest it into Azure SQL using Azure Logic Apps
{
"definition": {
"$schema": "https://schema.management.azure.com/providers/Microsoft.Logic/schemas/2016-06-01/workflowdefinition.json#",
"actions": {
"Chunk_text": {
"type": "ChunkText",
"inputs": {
"chunkingStrategy": "TokenSize",
"text": "@body('Parse_a_document')?['text']",
"EncodingModel": "cl100k_base",
@yorek
yorek / azure-logic-app-rag-template.json
Created November 8, 2024 23:27
Azure Logic App + Azure SQL RAG Template
{
"definition": {
"$schema": "https://schema.management.azure.com/providers/Microsoft.Logic/schemas/2016-06-01/workflowdefinition.json#",
"actions": {
"Azure_OpenAI_-_Get_an_embedding": {
"type": "ServiceProvider",
"inputs": {
"parameters": {
"deploymentId": "@parameters('OpenAI_TextEmbedding_Deployment_Identifier_ingesttosql')",
"input": "@triggerBody()?['question']"
@yorek
yorek / read-vecs.cs
Last active January 23, 2024 16:48
Read FVECS and IVECS file and bulk load into MSSQL
private static void LoadFiles(string test)
{
LoadFile(LoadFVECS, $"c:\\Temp\\vector\\{test}\\{test}_base.fvecs", $"{test}_base", num:1000000, dim:128);
LoadFile(LoadFVECS, $"c:\\Temp\\vector\\{test}\\{test}_query.fvecs", $"{test}_query", num:10000, dim:128);
LoadFile(LoadIVECS, $"c:\\Temp\\vector\\{test}\\{test}_groundtruth.ivecs", $"{test}_groundtruth", num:10000, dim:100);
}
private static void LoadFile(Func<BinaryReader, int, string> FileLoader, string file, string tablename, int num, int dim)
{
Console.WriteLine($"Reading file {file}...");
@yorek
yorek / gist:d1664f8e5508c6c10c90f4f9a5b247b7
Created April 28, 2020 23:25
Azure SQL UDF and Persisted Columns
create or alter function dbo.CalculateSum(@a as int, @b as int)
returns int
with schemabinding
as
begin
return @a + @b
end
go
create table dbo.WithPersistedUDF
@yorek
yorek / compare-version-az-cli-bash
Created December 5, 2018 20:26
Check that AZ CLI is using a command with a minium version
export curVer=`printf "%03d%03d%03d" $(az --version | grep 'eventgrid' | awk '{gsub(/[()]/, "", $2); print $2}' | tail -1 | tr '.' ' ')`
export reqVer=`printf "%03d%03d%03d" $(echo '0.5.0' | tr '.' ' ')`
if [[ curVer -lt reqVer ]] ; then
echo "error" >&2
exit 1
fi
@yorek
yorek / apache-drill-azure-strorage.json
Last active February 26, 2021 08:20
Configuration sample to use Azure Blob Store with Apache Drill. More info on Medium Post:
{
"type": "file",
"connection": "wasbs://CONTAINER@ACCOUNT_NAME.blob.core.windows.net",
"config": null,
"workspaces": {
"root": {
"location": "/",
"writable": false,
"defaultInputFormat": null,
"allowAccessOutsideWorkspace": false
@yorek
yorek / import-csv-from-blob.sql
Created May 10, 2018 16:47
Bulk insert CSV data stored in a Blob Store
/*
Create the Database Master Key, if needed
*/
CREATE MASTER KEY ENCRYPTION BY PASSWORD = 'My-L0ng&Str0ng_P4ss0wrd!';
GO
/*
Create database scoped credentials to store the Shared Access Signature (SAS)
needed to access the Azure Blob Container. More info on Azure Blob SAS here:
@yorek
yorek / Security-Audit.ps1
Last active May 2, 2018 19:08
Get information needed to comply with a security audit
Login-AzureRmAccount
Select-AzureRmSubscription -Subscription <your-subscription-id>
$servers = Get-AzureRmSqlServer
foreach($s in $servers) {
$databases = Get-AzureRmSqlDatabase -ServerName $s.ServerName -ResourceGroupName $s.ResourceGroupName
foreach ($d in $databases)
{
@yorek
yorek / stackoverflow-dapper-50091943.sql
Created May 2, 2018 06:26
Create sample data using Continents, Countries and Cities
use tempdb
go
drop table if exists dbo.City;
drop table if exists dbo.Country;
drop table if exists dbo.Continent;
create table dbo.Continent
(
continent_id int not null primary key,