Skip to content

Instantly share code, notes, and snippets.

View pixelandpen's full-sized avatar

Graham Faulkner pixelandpen

View GitHub Profile
@daefresh
daefresh / advanti_open_data_tools_2021.csv
Last active December 13, 2024 20:17
[Advanti's Top 150+ Open Data Tools on GitHub in 2021.] This is a hand-curated list of tools 🔨 that I refer to when designing data platforms ❤️. Connect with me on LinkedIn if you'd like this! https://www.linkedin.com/in/douglaseisenstein/
Repo Name Stars Last Commit Timestamp GitHub URL Project URL Project Description
airbyte 3829 Tue 31 Aug 2021 12:27:10 GMT https://github.com/airbytehq/airbyte https://airbyte.io Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses lakes and databases.
airflow 22946 Tue 31 Aug 2021 13:25:22 GMT https://github.com/apache/airflow https://airflow.apache.org/ Apache Airflow - A platform to programmatically author schedule and monitor workflows
amazoncaptcha 140 Sat 17 Jul 2021 02:06:48 GMT https://github.com/a-maliarov/amazoncaptcha Pure Python lightweight Pillow-based solver for Amazon's text captcha.
amundsen 2572 Fri 27 Aug 2021 04:50:38 GMT https://github.com/amundsen-io/amundsen https://www.amundsen.io/amundsen/ Amundsen is a metadata driven application for improving the productivity of data analysts data scientists and engineers when interacting with data.
arangodb 11554 Tue 31 Aug 2021 12:03:58 GMT https://github.com/arangodb/arangodb https://www.arangodb.com 🥑 Ar
//https://twitter.com/kentcdodds/status/1069637300458586115?lang=en
document.querySelectorAll('video').forEach(v => v.playbackRate = 1.5)
@unrevised6419
unrevised6419 / oss-tools.md
Last active August 8, 2024 00:19
Open source software tools
@cudevmaxwell
cudevmaxwell / CLAWandHyraxStatus2018-07-13.md
Last active July 25, 2018 18:07
CLAW and Hyrax - Status as of 2018-07-13

CLAW and Hyrax - Status as of 2018-07-13

by Kevin Bowrin

created 2018-07-13

CLAW and Hyrax are two of the leading 'next gen' institutional repository software projects. Both are not widely used in production yet and are under heavy development. How much functionality is complete as of today, July 13th 2018? I did some testing in the two project's Vagrant boxes to see. One big caveat is that I tried to make as few configuration changes as possible on both boxes. This is not a complete test of what is technically possible right now.

An aside: both projects provide tools to help provision production ready enviroments. The Hyrax project provides AWS CloudFormation templates. The CLAW project uses the same Ansible scripts for provisioning a production enviroment or a small test VM. That approach is very smart and will hopefully lead to fewer 'doesn't work on my machine' bugs stemming from configuration problems.

@alanorth
alanorth / orcid-authority-to-item.py
Last active November 6, 2018 07:33
Map ORCID identifiers from DSpace's Solr authority core to the matching items by creating new cg.creator.id metadata fields.
#!/usr/bin/env python
#
# orcid-authority-to-item.py 1.0.0
#
# Copyright 2018 Alan Orth.
#
# This program is free software: you can redistribute it and/or modify
# it under the terms of the GNU General Public License as published by
# the Free Software Foundation, either version 3 of the License, or
# (at your option) any later version.
@alanorth
alanorth / resolve-orcids.py
Last active November 6, 2018 07:42
Query the public ORCID API for names associated with ORCID identifiers, optionally from a DSpace authority Solr core.
#!/usr/bin/env python
#
# resolve-orcids.py 1.1.0
#
# Copyright 2018 Alan Orth.
#
# This program is free software: you can redistribute it and/or modify
# it under the terms of the GNU General Public License as published by
# the Free Software Foundation, either version 3 of the License, or
# (at your option) any later version.
# Copy this file to /etc/systemd/system/multi-user.target.wants/docker.service (but back up docker.service first!)
# then run:
# sudo systemctl daemon-reload
# sudo service docker restart
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target docker.socket
@alanorth
alanorth / mirage2-ubuntu16.04.md
Last active July 30, 2020 20:26
Preparing the Mirage 2 build environment on Ubuntu 16.04

Build Environment for Mirage 2 on Ubuntu 16.04

My earlier notes for 14.04 basically work fine on Ubuntu 16.04 but I've corrected and improved a few things in this version.

DSpace 5's Mirage 2 requires some extra setup if you want to tweak the base config and rebuild it. As Mirage 2 is based on the Bootstrap framework it needs a few NodeJS and Ruby packages to be available in the build environment.

We build and deploy DSpace from the tomcat7 system user (which is the default user for Tomcat on Ubuntu), and there are a few assumptions that must be met to allow the installation of NodeJS and Ruby:

  • The tomcat7 user must be able to write to its home folder — /usr/share/tomcat7 — so it can create the ~/.nvm, ~/.npm, ~/.rvm, ~/.gnupg and other directories during installation
  • The ~tomcat7/.profile file must exist and be writable before installing nvm and rvm, as this is the default config file for lo
@ipbastola
ipbastola / clean-up-boot-partition-ubuntu.md
Last active August 16, 2024 13:39
Safest way to clean up boot partition - Ubuntu 14.04LTS-x64, Ubuntu 16.04LTS-x64

Safest way to clean up boot partition - Ubuntu 14.04LTS-x64, Ubuntu 16.04LTS-x64

Reference

Case I: if /boot is not 100% full and apt is working

1. Check the current kernel version

$ uname -r 
@alirobe
alirobe / reclaimWindows10.ps1
Last active April 20, 2025 23:02
This Windows 10 Setup Script turns off a bunch of unnecessary Windows 10 telemetery, bloatware, & privacy things. Not guaranteed to catch everything. Review and tweak before running. Reboot after running. Scripts for reversing are included and commented. Fork of https://github.com/Disassembler0/Win10-Initial-Setup-Script (different defaults). N.…
###
###
### UPDATE: For Win 11, I recommend using this tool in place of this script:
### https://christitus.com/windows-tool/
### https://github.com/ChrisTitusTech/winutil
### https://www.youtube.com/watch?v=6UQZ5oQg8XA
### iwr -useb https://christitus.com/win | iex
###
### OR take a look at
### https://github.com/HotCakeX/Harden-Windows-Security