ResolveWang’s gists

ResolveWang / gist:d3c9e6503620b31c0809a12ef9801fd5

Created March 6, 2017 12:09

UserAgent.py

	""" User-Agents """
	mobile_agents = [
	"Mozilla/5.0 (Linux; U; Android 2.3.6; en-us; Nexus S Build/GRK39F) AppleWebKit/533.1 (KHTML, like Gecko) Version/4.0 Mobile Safari/533.1",
	"Avant Browser/1.2.789rel1 (http://www.avantbrowser.com)",
	"Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US) AppleWebKit/532.5 (KHTML, like Gecko) Chrome/4.0.249.0 Safari/532.5",
	"Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US) AppleWebKit/532.9 (KHTML, like Gecko) Chrome/5.0.310.0 Safari/532.9",
	"Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/534.7 (KHTML, like Gecko) Chrome/7.0.514.0 Safari/534.7",
	"Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US) AppleWebKit/534.14 (KHTML, like Gecko) Chrome/9.0.601.0 Safari/534.14",
	"Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US) AppleWebKit/534.14 (KHTML, like Gecko) Chrome/10.0.601.0 Safari/534.14",
	"Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US) AppleWebKit/534.20 (KHTML, like Gecko) Chrome/11.0.672.2 Safari/534.20",

ResolveWang / resume.py

Created December 8, 2016 03:20 — forked from dongweiming/resume.py

Python版本简历

	#/usr/bin/env python
	# coding=utf-8

	import random
	import re


	def color(messages):
	color = '\x1B[%d;%dm' % (1,random.randint(30,37))
	return '%s %s\x1B[0m' % (color,messages)

ResolveWang / sqlalchemy中将查询对象转化为字典

Created November 28, 2016 05:29

	def to_dict(ins):
	table_columns = ins.__table__.c
	l = [column.key for column in table_columns]
	d = {}
	for k, v in ins.__dict__.items():
	if k in l:
	d[k] = str(v) if v is not None else ''
	return d

ResolveWang / install_scrapy_in_centos_6_5.sh

Created November 26, 2016 04:36 — forked from Shellbye/install_scrapy_in_centos_6_5.sh

Install scrapy in CentOS 6.5 in virtualenv, and install mysql to store the data crawled. After the installation, the `spider` dir will contains all the downloaded files and the `spider_env` is the virtualenv dir

	#!/usr/bin/env bash

	mkdir spider
	cd spider/
	yum update -y
	# install pip on centos6
	rpm -ivh http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm
	yum install -y python-pip
	# install wget
	yum install -y wget

ResolveWang / 原始方式

Last active November 3, 2016 01:48

python日志demo

	# 最原始的方式
	#!/usr/local/bin/python
	# -- coding: utf-8 --

	import logging

	# create logger
	logger = logging.getLogger('simple_example')

	# Set default log level

ResolveWang / 利用反射获取简单对象的属性和值

Last active November 3, 2016 01:38

Java中利用反射来显示对象所有属性和值

	package cn.resolvewang;

	import com.sun.deploy.util.ArrayUtil;

	import java.lang.reflect.AccessibleObject;
	import java.lang.reflect.Field;
	import java.lang.reflect.Modifier;
	import java.util.ArrayList;
	import java.util.List;

ResolveWang / python多线程控制超时

Created September 27, 2016 12:17

	from time import sleep, time
	import sys, threading


	class KThread(threading.Thread):
	"""A subclass of threading.Thread, with a kill()

	method.

ResolveWang / python获取系统环境变量

Created September 26, 2016 05:25

	os.getenv('java')

	# or

	os.environ.get('java')

ResolveWang / httpclient+shadowsocks客户端实现科学上网

Last active October 17, 2021 12:57

	import org.apache.http.HttpHost;
	import org.apache.http.client.methods.CloseableHttpResponse;
	import org.apache.http.client.methods.HttpGet;
	import org.apache.http.client.protocol.HttpClientContext;
	import org.apache.http.config.Registry;
	import org.apache.http.config.RegistryBuilder;
	import org.apache.http.conn.DnsResolver;
	import org.apache.http.conn.socket.ConnectionSocketFactory;
	import org.apache.http.conn.socket.PlainConnectionSocketFactory;
	import org.apache.http.conn.ssl.SSLConnectionSocketFactory;

ResolveWang / 数据库超时处理

Created September 6, 2016 09:29

	t = threading.Timer(timeout,conn.cancel)
	t.start()
	cursor = conn.cursor()
	cursor.execute(query)
	res = cursor.fetchall()
	t.cancel()

resolvewang ResolveWang