Skip to content

Instantly share code, notes, and snippets.

View bryanpaget's full-sized avatar
🎯
Focusing

Bryan Paget bryanpaget

🎯
Focusing
View GitHub Profile
@bryanpaget
bryanpaget / r-test-ci-cd.yaml
Last active January 29, 2025 18:24
Testing the R man
test-r-packages:
needs: build-push
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@master
- name: Log in to the local Docker registry
run: echo "${{ secrets.REGISTRY_PASSWORD }}" | docker login ${{ env.LOCAL_REPO }} -u "${{ secrets.REGISTRY_USERNAME }}" --password-stdin
- name: Pull the built Docker image
@bryanpaget
bryanpaget / Grace Period Calculation Flow.md
Last active March 12, 2025 15:02
Mermaid Diagrams for Namespace Auditor Functions
flowchart TD
    A[Start] --> B[Parse Annotation Time]
    B --> C{Valid Time?}
    C -->|No| D[Clear Annotation]
    C -->|Yes| E[Calculate Remaining Time]
    E --> F{Time Remaining >0?}
    F -->|Yes| G[Requeue After Remainder]
    F -->|No| H[Delete Namespace]

Kubernetes RBAC, ServiceAccounts, Namespaces & Azure Integration

Mermaid Diagram

graph TD
  subgraph Azure
    SP[Service Principal] -->|Authenticates| AzureResources["Azure Resources (e.g., ACR, Key Vault)"]
  end

 subgraph Kubernetes_Cluster["Kubernetes Cluster"]
@bryanpaget
bryanpaget / modernizing.md
Last active April 24, 2025 17:59
Modernizing Excel Workflows with Automated Python/R Pipelines

🚀 Proposal: Modernizing Excel Workflows with Automated Python/R Pipelines

🎯 Goal:

Give teams the ability to convert Excel spreadsheets into reproducible Python or R scripts that:

  • Automate calculations and reports
  • Generate dashboards, PNGs, and Excel files
  • Fit into a scalable, secure, and auditable data pipeline

./CachedExtensionVSIXs/ms-python.debugpy-2025.6.0-linux-x64
./CachedExtensionVSIXs/ms-python.python-2024.8.1-universal
(base) jovyan@bryan-py-1-0:~/.local/share/code-server$ find . | grep -i cache
./CachedProfilesData
./CachedProfilesData/__default__profile__
./CachedProfilesData/__default__profile__/extensions.builtin.cache
./CachedProfilesData/__default__profile__/extensions.user.cache
./extensions/dvirtz.parquet-viewer-2.9.0-universal/node_modules/lodash/_listCacheClear.js
./extensions/dvirtz.parquet-viewer-2.9.0-universal/node_modules/lodash/_setCacheHas.js
./extensions/dvirtz.parquet-viewer-2.9.0-universal/node_modules/lodash/_mapCacheGet.js
@bryanpaget
bryanpaget / install-dev-tools.sh
Created April 29, 2025 14:39
Some Go dev tools
#!/bin/bash
# Shell Script for Go and Kubernetes Development Setup on Ubuntu
# Uses Snap packages where available
# Update package list and upgrade existing packages
echo "Updating system packages..."
sudo apt update && sudo apt upgrade -y
sudo snap refresh
@bryanpaget
bryanpaget / Experiments.md
Last active May 1, 2025 20:18
Experiments

Strategies:

Branch: bryan-set-default-py-interpreter

Change:

Added to Dockerfile:

ENV CS_DEFAULT_HOME=/home/jovyan/.local/share/code-server

1. Create Namespaces

Create the required namespaces if they don't exist:

kubectl create namespace qa
kubectl create namespace alan
kubectl create namespace test
kubectl create namespace production

2. Deploy Pods with Failing Liveness Probes

@bryanpaget
bryanpaget / open‑source-data-catalog.md
Last active May 20, 2025 14:16
This gist presents a turnkey blueprint for a self‑hosted, open‑source data catalog and governance platform designed to run on your existing AKS + Kubeflow cluster, leveraging best‑of‑breed projects like OpenMetadata, Apache Atlas, DataHub, and Amundsen for metadata management, lineage, and search.

Executive Summary

This proposal outlines a self‑hosted, open‑source data catalog solution—leveraging OpenMetadata, Apache Atlas, or DataHub—deployed on your existing AKS + Kubeflow environment. It layers in hardened security controls using Keycloak for identity, Vault for secrets, cert‑manager for TLS, OPA Gatekeeper for policy enforcement, Falco for runtime threat detection, and Kubernetes Network Policies for micro‑segmentation. All components are deployable via Helm charts, minimizing cost while maximizing compliance and operational efficiency.


1. Architecture Overview

1.1 Metadata Catalog Core

Requesting Your Linux Cloud VM

Follow these steps to request a Linux Cloud VM:

1. Access the VM Request Portal

Go to the VM Request Portal.

2. Search for Compute Services