Michael Joseph michaeljoseph

Application To Platform: how we used Python to scale Yola

Abstract

This is the story of how Yola engineers transformed a website building application into a robust, distributed platform (for hosting and building websites).

By:

decomposing and augmenting our services layer into multiple Python-driven API services
in a series of small low-risk changes (which i’ll discuss in more detail) we organically built out the service layer.

Open Source At Yola

At [Yola], using and creating [free and open source software] has been part of our engineering DNA since we started on this crazy adventure 7 years (to the month!) ago.

The importance (and reliance) that we place on open source software is evident in one of our technology architecture goals:

Open Source solutions are preferable to proprietary ones

Keybase proof

I hereby claim:

I am michaeljoseph on github.
I am michaeljoseph (https://keybase.io/michaeljoseph) on keybase.
I have a public key ASDfckKzvHBZFlBmVBiksxqeQG0FDT77XlllKideIyqlSwo

To claim this, I am signing this object:

	# install git
	sudo apt-get install g++ curl libssl-dev apache2-utils
	sudo apt-get install git-core
	# download the Node source, compile and install it
	git clone https://github.com/joyent/node.git
	cd node
	./configure
	make
	sudo make install
	# install the Node package manager for later use

	(changes)➜ changes git:(master) changes changes -p changelog && changes changes -p release --commit-changelog
	What is the release version for "changes" [Default: 0.1.3]:
	INFO:changes.cli:Added content to CHANGELOG.md
	What is the release version for "changes" [Default: 0.1.3]:
	Counting objects: 9, done.
	Delta compression using up to 8 threads.
	Compressing objects: 100% (5/5), done.
	Writing objects: 100% (5/5), 554 bytes, done.
	Total 5 (delta 3), reused 0 (delta 0)
	To [email protected]:michaeljoseph/changes.git

	<!DOCTYPE html>
	<html>
	<head>
	<title>Title</title>
	<meta http-equiv="Content-Type" content="text/html; charset=UTF-8"/>
	<style type="text/css">
	/* Slideshow styles */
	</style>
	</head>
	<body>

	#!/usr/bin/env python

	from pprint import pprint

	from pyquery import PyQuery as pq
	import requests
	import scraperwiki

	DDL = {
	'create': """

	#!/usr/bin/env ruby -w

	# brew-services(1) - Easily start and stop formulas via launchctl
	# ===============================================================
	#
	# ## SYNOPSIS
	#
	# [<sudo>] `brew services` `list`<br>
	# [<sudo>] `brew services` `restart` <formula><br>
	# [<sudo>] `brew services` `start` <formula> [<plist>]<br>

	→ python parse_xml.py
	['__class__', '__contains__', '__copy__', '__deepcopy__', '__delattr__', '__delitem__', '__doc__', '__format__', '__getattribute__', '__getitem__', '__hash__', '__init__', '__iter__', '__len__', '__new__', '__nonzero__', '__reduce__', '__reduce_ex__', '__repr__', '__reversed__', '__setattr__', '__setitem__', '__sizeof__', '__str__', '__subclasshook__', '_init', 'addnext', 'addprevious', 'append', 'attrib', 'base', 'clear', 'extend', 'find', 'findall', 'findtext', 'get', 'getchildren', 'getiterator', 'getnext', 'getparent', 'getprevious', 'getroottree', 'index', 'insert', 'items', 'iter', 'iterancestors', 'iterchildren', 'iterdescendants', 'iterfind', 'itersiblings', 'itertext', 'keys', 'makeelement', 'nsmap', 'prefix', 'remove', 'replace', 'set', 'sourceline', 'tag', 'tail', 'text', 'values', 'xpath']
	http://badsite.com/baduri.jsp

	// Use Gists to store code you would like to remember later on
	console.log(window); // log the "window" object to the console