Skip to content

Instantly share code, notes, and snippets.

View hokiegeek2's full-sized avatar

hokiegeek2

View GitHub Profile
@hokiegeek2
hokiegeek2 / golang-ubuntu-install.txt
Last active July 23, 2024 11:15
install latest golang on ubuntu
# instructions at https://go.dev/wiki/Ubuntu
sudo add-apt-repository ppa:longsleep/golang-backports
sudo apt update
sudo apt install golang-go
go version
go version go1.22.4 linux/amd64
@hokiegeek2
hokiegeek2 / argo-eventbus-values.yaml
Created June 17, 2024 10:23
Argo EventBus values.yaml
apiVersion: argoproj.io/v1alpha1
kind: EventBus
metadata:
name: default
spec:
nats:
native:
replicas: 3
auth: token
containerTemplate:
@hokiegeek2
hokiegeek2 / filtered-directory-watcher.yaml
Created May 3, 2024 07:47
Argo Events file event source that filters temp files
apiVersion: argoproj.io/v1alpha1
kind: EventSource
metadata:
name: file-upload-directory-watcher
labels:
directory: file-upload
spec:
replicas: 1
template:
container:
#!/bin/bash
#SBATCH --ntasks=3
#SBATCH --tasks-per-node=1
#SBTACH --cpus-per-task=1
#SBATCH --mem=1024
#SBATCH --job-name="arkouda mpi test"
#SBATCH --output=/tmp/arkouda-mpi.out
export CHPL_COMM=ofi
@hokiegeek2
hokiegeek2 / install-openmpi
Last active March 16, 2025 19:55
Install openmpi on Ubuntu 22.04
sudo apt-get update && sudo apt-get install infiniband-diags ibverbs-utils \
libibverbs-dev libfabric1 libfabric-dev libpsm2-dev -y
sudo apt-get install openmpi-bin openmpi-common libopenmpi-dev libgtk2.0-dev
sudo apt-get install librdmacm-dev libpsm2-dev
@hokiegeek2
hokiegeek2 / rdma-driver-installation
Last active March 12, 2025 11:22
Instructions for installing rdma drivers on Ubuntu 22.04
#
# Instructions for installing rdma-core at https://github.com/linux-rdma/rdma-core
#
# install required libraries
sudo apt-get install build-essential cmake gcc libudev-dev libnl-3-dev libnl-route-3-dev \
ninja-build pkg-config valgrind python3-dev cython3 python3-docutils pandoc \
infiniband-diags ibverbs-utils -y
# clone and build rdma-core project
@hokiegeek2
hokiegeek2 / scale-up-kafka-cluster
Created September 24, 2023 12:17
scaling up a kafka cluster
Scaling up Kafka utilizing the kraft consensus protocol requires removing the $KAFKA_HOME/data/__cluster_metadata-0/quorum-state as detailed in this Kafka [PR](https://github.com/strimzi/strimzi-kafka-operator/pull/8247). If the file is not removed, the following Java exception is thrown:
@hokiegeek2
hokiegeek2 / gist:7df9a9945b5cd46f84c685d45b79c179
Created August 29, 2023 16:05
arkouda-build-error-20230829
#0 172.0 /opt/arkouda//src/MultiTypeSymEntry.chpl:217: In initializer:
#0 172.0 /opt/arkouda//src/MultiTypeSymEntry.chpl:223: error: cannot assign expression of type [domain(1,int(64),one)] int(64) to field 'a' of type [BlockDom(1,int(64),one,unmanaged DefaultDist)] int(64)
#0 172.1 /opt/arkouda//src/KExtremeMsg.chpl:52: called as SymEntry.init(a: [domain(1,int(64),one)] int(64), max_bits: int(64))
#0 172.4 make: *** [Makefile:341: arkouda_server] Error 1
@hokiegeek2
hokiegeek2 / arkouda-proxy-server
Created August 27, 2023 14:07
arkouda tonic gRPC proxy server
use std::env;
use log::{info,debug};
use tonic::{transport::Server, Request, Response, Status};
use arkouda::arkouda_server::{Arkouda, ArkoudaServer};
use arkouda::{ArkoudaReply, ArkoudaRequest};
use serde::{Deserialize, Serialize};
@hokiegeek2
hokiegeek2 / arkouda-memory-mgmt
Last active June 23, 2023 21:43
arkouda-memory-mgmt
module MemoryReporting {
use IO;
use Memory.Diagnostics;
proc getMemory() throws {
var aFile = open('/proc/meminfo', ioMode.r);
var lines = aFile.reader().lines();
var line : string;
var memTotal:int;