Aymen Alsaadi AymenFJA

Simple parallelization using mpi4py

For basic applications, MPI is as easy to use as any other message-passing system. The sample scripts below contain the complete communications skeleton for a data (or embarrassingly) parallel problem using the mpi4py package.

Within the code is a description of the few functions needed to write typical parallel applications.

mpi-submit.py - Parallel application with simple partitioning: unbalanced load.

mpi-submit2.py - Parallel application with master/slave scheme: dynamically balanced load.

List of Azure Regions

A list of all the region names and locations for Azure

Creating the list

You can recreate the list anytime using this command:

az account list-locations -o table

AWS Monitoring

Why monitoring is important?

Once our applications are deployed, our users don't care how we did it
Our users only care that the application is working or not
- Application latency: will it increase over time?
- Application outages: customer experience should not be degraded

Monitoring in AWS

deploy metrics server


kubectl apply -f https://github.com/kubernetes-sigs/metrics-server/releases/latest/download/components.yaml

edit metrics server deployment by adding command

	#!/usr/bin/python3
	# It is for Python3 but may work for modern 2.x versions as well.

	import os, signal, atexit

	# Signletone which is made as a class with static methods.
	# The "init()" method must be called before any child process are created.
	# "killAllChildrenOnce" or "killAllChildren" methods could be called
	# any time to kill all child processes.
	# Creates a new process group during initialization and uses it to send

	#Original Author https://raw.githubusercontent.com/kgoedecke/python-ecs-example/master/python_ecs_example/deployment.py
	import boto3
	import pprint
	import os

	# Credentials & Region
	access_key = os.environ["AWS_ACCESS_KEY_ID"]
	secret_key = os.environ["AWS_SECRET_ACCESS_KEY"]
	region = "us-east-1"

	sudo add-apt-repository ppa:mc3man/trusty-media
	sudo apt-get update
	sudo apt-get dist-upgrade
	sudo apt-get install ffmpeg