Skip to content

Instantly share code, notes, and snippets.

View milenkovicm's full-sized avatar
☘️

Marko Milenković milenkovicm

☘️
View GitHub Profile
// Please find the full, tested version in
// https://github.com/influxdata/influxdb_iox/blob/fe155e15fb2ad166aee66b0458e63c24a8128dd4/query/src/exec/task.rs#L101-L118
pub struct DedicatedExecutor {
state: Arc<Mutex<State>>,
}
/// Runs futures (and any `tasks` that are `tokio::task::spawned` by
/// them) on a separate Tokio Executor
struct State {
@dennyglee
dennyglee / using-dbrx-with-pyspark-ai.md
Created April 1, 2024 15:30
Using DBRX with PySpark AI

Using DBRX with PySpark AI

This markdown shows a quick example of how to use Databricks DBRX to generate and run a transform query against a sammple dataset.

Requirements

Install the following

  • Configure and install databricks-cli
  • pip install langchain langchain-community mlflow setuptools
@a-agmon
a-agmon / df_lambda.rs
Last active March 17, 2025 21:37
Rusty AWS Lambda with Data Fusion and Iceberg
use std::{sync::Arc, time::Instant};
use datafusion::{
arrow::{array::RecordBatch, json::ArrayWriter},
prelude::SessionContext,
};
use iceberg::{io::FileIO, table::StaticTable, TableIdent};
use iceberg_datafusion::IcebergTableProvider;
use lambda_runtime::{
run, service_fn,