Dapangmao dapangmao

Context

To developing the application, we will constantly query the QA database running on the LOCTEST server.
The queries that are under testing are usually very complicated. The waiting time with the server ranges from seconds to 20 minutes or even longer.
The LOGTEST server may be down or gets extremely slower occasionally .
The database qa1_loctest_inventory is mostly used. The article here introduces how to copy the invertory database to a local Mac environment

The procedures

1. Dump file from LOCTEST

Dark traffic 是什么

或者head, 或者get url

程序员如何优雅的挣零花钱？

难啊
有点意思

- 在行 http://www.zaih.com : 这个是果壳旗下的，做得比较早，内容是全行业的，所以上边技术向的反而不多。

- 缘创派 http://q.ycpai.com/h5/lightPartner/expertList : 缘创派的轻合伙栏目，主要面向创业者，适合喜欢感受创业氛围的技术专家们。

- 极牛  http://geekniu.com  : 你可以认为这是一个程序员版本的「在行」，我浏览了下，虽然被约次数比在行要低不少，但专业性比较强，期望他们能尽快的推广开来吧。

技术本地化、反欺诈算法、数据分布……你想知道的Uber技术全在这里了

分布是王道, 毫无干货

Ultimate guide for scraping JavaScript rendered web pages

PyQt也能用来load JS
scrapinghub/splash也有方案, 为什么要用Lua?

Decorator

elegant way to implement closure
if you want to change the input of a function

curl vs wget

以前还真没注意他们的差别

Performance & Usage at Instagram

答案是educed the maximum number of summary comments.
他们真用python吗?

排队论在架构的应用：对服务延迟、稳定性的影响

timeout从poisson distribution

Minimal Scrapy

import os
import subprocess

from __future__ import print_function

	import matplotlib.pyplot as plt
	import numpy as np
	import matplotlib
	import datetime
	import time
	import mpld3
	import matplotlib.pylab as pylab
	pylab.rcParams['figure.figsize'] = 12, 5 # that's default image size for this interactive

	def create_plot():

	var mongodb = require('mongodb');

	var uri = 'mongodb://localhost:27017/example';
	mongodb.MongoClient.connect(uri, function(error, db) {
	if (error) {
	console.log(error);
	process.exit(1);
	}

	db.collection('sample').insert({ x: 1 }, function(error, result) {

	(function() {
	angular.module("loc8rApp", ["ngRoute", "ngSanitize", "ui.bootstrap"]);

	function e(e, t) {
	e.when("/", {
	templateUrl: "/home/home.view.html",
	controller: "homeCtrl",
	controllerAs: "vm"
	}).when("/about", {
	templateUrl: "/common/views/genericText.view.html",

	<!doctype html>
	<html ng-app="app">
	<head>
	<script src="http://ajax.googleapis.com/ajax/libs/angularjs/1.4.3/angular.js"></script>

	<script src="http://ajax.googleapis.com/ajax/libs/angularjs/1.4.3/angular-animate.js"></script>
	<!-- <script src="http://ui-grid.info/docs/grunt-scripts/csv.js"></script>
	<script src="http://ui-grid.info/docs/grunt-scripts/pdfmake.js"></script>
	<script src="http://ajax.googleapis.com/ajax/libs/angularjs/1.4.3/angular-touch.js"></script>
	<script src="http://ui-grid.info/docs/grunt-scripts/vfs_fonts.js"></script> -->