Skip to content

Instantly share code, notes, and snippets.

View seanorama's full-sized avatar

Sean Roberts seanorama

  • Cloudera (formerly Hortonworks, Rackspace)
  • London, UK
  • X @seano
View GitHub Profile
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD1hDrK/jelNglPH216YZV6PzzV71PffvujcVgVKMjYgFMk3QCxaOYmG4ZoXrorOVsWdAEjpFxPzGSdGu6FvtLdfUbwhlSUkHHeopa4JAyN1XGynZ3PqUoBzkyhqCdOxdRo1NuxYrptnFg3Vl91e2m8HG5wmIj7lN+/7C6iRI1/ibkQIgDW7vlooiGdCjp+MKZ0BG6fITrFYQKibaD0jnFDukD9QQ1UKSlVVgV4xH+ODcZ/7FW+nZV+xwArFnlOFhf9QClSIY/cg7hKDvfVT4VR+LO5F+bKmVoW84Si0f8wmj7NGZTUSOuNSe5PH+WY/IQ4pF81p00IACMtzuSFkce3
@seanorama
seanorama / zeppelin-active-directory.md
Last active March 1, 2020 15:12
Zeppelin: LDAP, Kerberos & Livy

Configure Zeppelin against Active Directory.

Requirements

  • HDP 2.6
  • LDAP bind details (guide is for Active Directory but can be altered for other LDAP servers).

Configuration from command-line

Securely store LDAP credentials on Zeppelin host(s):

#!/usr/bin/env bash
## Description: Install & Start *Apache Nifi*
## Author: Sean Roberts <[email protected]>
nifi_version=1.1.2
cd /opt
curl -ssLO http://mirrors.ukfast.co.uk/sites/ftp.apache.org/nifi/${nifi_version}/nifi-${nifi_version}-bin.tar.gz
tar -xzvf nifi-${nifi_version}-bin.tar.gz
@seanorama
seanorama / local-snippets.sh
Last active March 30, 2017 12:34
hortonworks-data-cloud-artifacts
#!/usr/bin/env bash
## Description:
## Various commands for working with Hortonworks Data Cloud (HDCloud) and it's clusters.
## Author: Sean Roberts <[email protected]>
########################################################################
## Set host & credentials of your controller
host=
user=
[
{
"core-site" : {
"fs.s3a.endpoint" : "s3.eu-central-1.amazonaws.com"
}
}
]
@seanorama
seanorama / brew-cask-upgrade-list.sh
Last active February 21, 2017 08:24 — forked from n0ts/brew-cask-upgrade.sh
brew cask upgrade
#!/usr/bin/env bash
for c in $(brew cask list); do
info=$(brew cask info ${c})
installed_ver=$(echo "$info" | cut -d$'\n' -f1 | tr -d ' ' | cut -d':' -f 2)
current_ver=$(echo "$info" | cut -d$'\n' -f3 | cut -d' ' -f 1 | rev | cut -d'/' -f 1 | rev)
if [ "$installed_ver" != "$current_ver" ]; then
echo "## ${c} is installed '$installed_ver', current is '$current_ver'"
echo brew cask reinstall ${c}
fi
' Purpose: Removed unused master slides
' Author: Sean Roberts <[email protected]>
' Instructions: Add Macro and Run.
' + I like to keep a blank presentation named "powerpoint-macros" to keep all macros attached to.
' + You can then open it and execute from the presentation you are editing, without adding the macro to your presenation.
Sub Delete_unused_master_slides()
Dim I As Integer
Dim J As Integer
Dim oPres As Presentation
Set oPres = ActivePresentation
@seanorama
seanorama / cask_upgradeable_list.sh
Last active December 2, 2016 09:32
Script upgrading outdated brew casks
#!/usr/bin/env bash
(set -x; brew update;)
(set -x; brew cleanup;)
(set -x; brew cask cleanup;)
red=`tput setaf 1`
green=`tput setaf 2`
reset=`tput sgr0`

Hortonworks Data Platform (HDP) Sandbox on AWS

This will deploy the HDP Sandbox on Amazon Web Services (AWS). Current instructions are for HDP 2.5 but should require minimal changes for newer versions.

  1. Boot an Amazon Linux instance with at least 16GB of RAM

  2. Execute the following. It will take a while

Deploying!