Skip to content

Instantly share code, notes, and snippets.

@tiagotele

tiagotele/install_hadoop.sh

Created May 17, 2023 13:31
Show Gist options
  • Save tiagotele/d719c863f3d81e932689604357df523b to your computer and use it in GitHub Desktop.
Save tiagotele/d719c863f3d81e932689604357df523b to your computer and use it in GitHub Desktop.
Download ZIP
Raw
install_hadoop.sh
#!/bin/bash
HADOOP_VERSION='3.3.1'
HADOOP_URL=https://dlcdn.apache.org/hadoop/common/hadoop-$HADOOP_VERSION/hadoop-$HADOOP_VERSION.tar.gz
echo "Downloading Hadoop jars..."
wget $HADOOP_URL -P /tmp
echo "Done!"
# Unpack Hadoop
echo "Creating folder /home/ec2-user/SageMaker/hadoop..."
mkdir -p /home/ec2-user/SageMaker/hadoop
echo "Untar hadoop bundle..."
tar -xvf /tmp/hadoop-$HADOOP_VERSION.tar.gz -C /home/ec2-user/SageMaker/hadoop --strip-components=1
echo "Done"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment