JerryNixon

# Databricks notebook source

# COMMAND ----------

%py

def recurse(path: str) -> [str]:
  def is_delta_path_valid(path: str) -> bool:
    try:
      return [] != [x for x in dbutils.fs.ls(path) if x.isDir() and x.name == "_delta_log/"]

JerryNixon

class Data(dict):
    __getattr__, __setattr__ = dict.get, dict.__setitem__

tables = [
  Data(
    path = "abfss://name@acct/path1",
    database = "my_db",
    table = "table1",
  ),
  Data(

JerryNixon

public class Program
{
    static void Main()
    {
        BenchmarkRunner.Run<Harness>();
    }
}

public class Harness
{

JerryNixon

public class Program
{
    static void Main()
    {
        BenchmarkRunner.Run<Harness>();
    }
}

public class Harness
{

JerryNixon

WITH tables AS
(
  SELECT 
      schemas.name AS schema_name
    , tables.name AS table_name
    , CONCAT(schemas.name, '.', tables.name) AS full_name
  FROM sys.tables
  JOIN sys.schemas 
    ON tables.schema_id = schemas.schema_id
  WHERE tables.type = 'U'

JerryNixon

JerryNixon

/*
This script implements a two-hop variant of Dijkstra’s algorithm using SQL Server graph features.
It creates a graph with 1500 nodes and edges, then finds the shortest two-edge paths
between 5 source and 5 destination nodes. Execution time is measured using a stopwatch.
*/

SET NOCOUNT ON
WHILE (@@TRANCOUNT > 0) ROLLBACK TRANSACTION
BEGIN TRANSACTION

JerryNixon

STOPWATCH is used to simply measure queries, especially long, complex ones. This is not a replacement for set statistics time on but it's a handy way to measure query behavior in a way that feels comfortable to C# developers, especially. STOPWATCH uses the system time to calculate elapsed durations.

Note: STOPWATCH uses SQL Server's session_context to persist the start time.

Example usage

EXEC STOPWATCH_START
SELECT * FROM USERS
EXEC STOPWATCH_READ

JerryNixon

CREATE SCHEMA assert;

GO

/*
	assert.Contain
	Ensure fragment is inside string.
	@fragment: String to search for
	@string: String to search in
	@msg: (optional) Append custom error message - default: NULL

JerryNixon

using System;
using System.Collections.Generic;
using System.Diagnostics;
using System.Linq;

public class Program
{
    public static void Main()
    {
        var count = 20000;