PyConAU 2012 - Rough Notes

gistfile1.md

Title: PyCon AU Notes

Lazy Testing

• WebTest
• WSGIProxy
• FunkLoad

Science and Engineering

IPython:

• R integration
• plotting
• in browser
• Pandas integration

Chaco & Traits

Cloud Services

• daemontools, supervisord
• upstart
• fabric
• mtime expiry high (config in nginx to recognise URLs via regex)

Python Lifesavers

• repl.it
• sikuli: OCR scripting!

Ryan Kelly

• replay console output playitagainsam

Kenneth Reitz

envoy (subprocesses) tablib (export tables) autoenv automatically set env (shell script)

HHGTP

MessagePack - serialisation format

Benno Rice

• wsgi_intercept
• mechanize
• parse (RJ)
• behave

Big Data in Python

• Stanford bigdata book
• Approximate membership queries (AMQ):
  • bloom filters
  • quotient filters
• log log counters
• 2-left hashing
• min sketch
• linear probabilistic counters

Noob's Guide to Message Queuing

• durable/persistent (delivery_mode=2)

• RabbitMQ Shovel plugin to push messages from one queue (local) to another (remote)

• plugins

  • STOMP
  • Federation (Shovel, but with more)
  • Management

• clients "define" the queue properties (Except in shovel)

• AMQP Clients

  • pika (pure python)
    • hardcoded timeout (2 seconds - can monkey patch)
  • kombu
    • can use virtual transports (e.g. redis, mongodb, sqlalchemy, etc)
    • nicer API
  • puka
    • opinionated client
    • better?
  • stompclient

• celery

  • RPC, tasks

• TcpCatcher

  • Artificial latency tool

Lightning

• python-datetime-tz
• diazo
• openstack.org