DaisukeMiyamoto

<powershell>
C:\ProgramData\Amazon\EC2-Windows\Launch\Scripts\InitializeDisks.ps1
</powershell>

DaisukeMiyamoto

Tutorial: AWS Batch setup for Neuron

Introduction

AWS Batch is a fully managed batch job scheduler service on AWS. It could easily manage large scale job queueing and execution. This tutorial shows a way to use Inferentia within a job on AWS Batch.

Steps Overview:

DaisukeMiyamoto

# Example neuron-container dockerfile. by midaisuk

# To build:
#    docker build -t neuron-container .

# Prepare application:
# before launch the docker image, you need to prepare some files based on the document and upload to S3 bucket.
# https://github.com/aws/aws-neuron-sdk/blob/master/docs/tensorflow-neuron/tutorial-compile-infer.md
# resnet50_neuron.zip
# infer_resnet50.py

DaisukeMiyamoto

numa settings of AWS instances

c5.18xlarge

$ numactl -H
available: 2 nodes (0-1)
node 0 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53
node 0 size: 70341 MB

DaisukeMiyamoto

LAMMPS on AWS ParallelCluster

set up parallelcluster

set up parallelcluster with following conditions

• OS: CentOS
• Scheduler: SGE

DaisukeMiyamoto

[aws]
aws_region_name = us-east-1

[global]
update_check = true
sanity_check = true
cluster_template = benchmark_efa

[aliases]
ssh = ssh {CFN_USER}@{MASTER_IP} {ARGS} -i ~/.ssh/<KEYNAME> -o StrictHostKeyChecking=no

DaisukeMiyamoto

Benchmark OSU

prepare OSU micro benchmarks

wget http://mvapich.cse.ohio-state.edu/download/mvapich/osu-micro-benchmarks-5.6.2.tar.gz
tar xvf osu-micro-benchmarks-5.6.2.tar.gz

DaisukeMiyamoto

####################################################################
# Create compute environment and job queue for AWS Batch with Boto3
# Daisuke Miyamoto
# 20200330
#

import boto3
import botocore.waiter
from botocore.exceptions import WaiterError
import time

DaisukeMiyamoto

---
AWSTemplateFormatVersion: 2010-09-09

Description: Creates an Amazon CloudWatch dashboard with Metric Math expressions to monitor an Amazon EFS file system. Customized for exclude IAM permissions.

Metadata:

  Authors:
    Description: Darryl Osborne ([email protected]) / Modified by midaisuk@
  License:

DaisukeMiyamoto

---
AWSTemplateFormatVersion: 2010-09-09

Description: Creates an Amazon CloudWatch dashboard with Metric Math expressions to monitor an Amazon EFS file system. It also includes a file system size custom metric to display the metered size of the file system.

Metadata:

  Authors:
    Description: Darryl Osborne ([email protected])
  License: