Leonid Shvechikov shvechikov

Concurrent HTTP Requests with Python3 and asyncio

http://geekgirl.io/concurrent-http-requests-with-python3-and-asyncio/

My friend who is a data scientist had wipped up a script that made lots (over 27K) of queries to the Google Places API. The problem was that it was synchronous and thus took over 2.5 hours to complete.

Given that I'm currently attending Hacker School and get to spend all day working on any coding problems that interests me, I decided to go about trying to optimise it.

I'm new to Python so had to do a bit of groundwork first to determine which course of action was best.

tmux cheatsheet

As configured in my dotfiles.

start new:

tmux

start new with session name:

	def print_matrix(matrix):
	for line in matrix:
	print(' '.join(map(str, line)))


	def empty(n, m):
	matrix = []
	for i in range(m):
	matrix.append(['.'] * n)
	return matrix

	#!/bin/python3

	def get_direction(n, m, x, y):
	if y == 0 and x != n - 1:
	return '>', n-x-1
	if y == m - 1 and x != 0:
	return '<', x
	if x == 0:
	return '^', y
	if x == n - 1:

	import logging
	from contextlib import contextmanager
	from timeit import default_timer

	time_logger = logging.getLogger(__package__ + ".timer")

	@contextmanager
	def timed_code(name=None):
	next_unit = iter(("s", "ms", "ns", "us")).next
	msg = "section %s took" % (name,) if name else "section took"

	"""
	This module is no more needed. It could be useful for implementing Django-level authentication.
	Now it works using DRF-level authentication -- dating.apps.mongo_auth.authentication.MongoTokenAuthentication.
	So it's here JFYI.
	"""


	# from django.contrib import auth
	from django.utils.functional import SimpleLazyObject
	from .models import User, AnonymousUser

	import requests
	from boto.s3.connection import S3Connection

	c = S3Connection(AWS_ACCESS_KEY, AWS_SECRET_KET)

	data = 'file content'
	filename = 'dir/name.txt'
	bucket_name = 'your-bucket-name'
	headers = {'Content-Type': 'text/plain'}

	def find_best_subarray(array):
	best_sum = 0
	best_start = 0
	best_end = 0

	cur_sum = 0
	cur_start = 0
	cur_end = 0

	for i, x in enumerate(array):

	def add_preview_for(*fields):
	"""
	This is a decorator for model classes that adds preview methods.

	So instead of manually adding preview methods:

	>>> class Student(models.Model):
	... photo = models.ImageField()
	... icon = models.ImageField()
	...

	jsoneditor.js:4923 []
	jsoneditor.js:4923 []
	jsoneditor.js:4923 []
	jsoneditor.js:4923 []
	jsoneditor.js:4923 []
	jsoneditor.js:4923 []
	jsoneditor.js:4923 []
	jsoneditor.js:4923 []
	jsoneditor.js:4923 []
	jsoneditor.js:4923 []