zubairalam

sudo apt-get install python-dev libffi-dev libssl-dev libxml2-dev libxslt1-dev
pip install scrapy 

zubairalam

from selenium import selenium
from scrapy.spider import BaseSpider
from scrapy.http import Request
import time
import lxml.html

class SeleniumSprider(BaseSpider):
    name = "selenium"
    allowed_domains = ['selenium.com']
    start_urls = ["http://localhost"]

zubairalam

// Use Gists to store code you would like to remember later on
console.log(window); // log the "window" object to the console

zubairalam

sudo apt-get install python3-pip
virtualenv --no-site-packages --distribute -p /usr/bin/python3.3 ~/.virtualenvs/pywork3

zubairalam

Tutorial: Meteor in Windows using Vagrant

BEFORE YOU CONTINUE:

• Now, Meteor runs in any Windows without any line of this tutorial. Just download the Meteor binary! Yay!!
• mrt is no longer used with Meteor 1.0

These days some people were discussing at meteor-talk group about running Meteor at Windows and I’ve recommended them using Vagrant. It’s a very developer-friendly piece of software that creates a virtual machine (VM) which let you run any operating system wanted and connect to it without big efforts of configuration (just make the initial installation and you have it working).

Many packages (I've tested) for running Meteor+Vagrant fails because Meteor writes its mongodb file and also other files inside local build folder into a shared folder between the Windows host and the Linux guest, and it simply does not work. So I've put my brain to work and found a solution: do symlinks inside the VM (but do not use ln. Use mount so git can follow it). It’s covered on

zubairalam

// Desired unique index: 
// db.categories.ensureIndex({ category_url: 1, category_page_url: 1 }, { unique: true})
 
db.categories.aggregate([
  { $group: { 
    _id: { category_url: "$category_url", category_page_url: "$category_page_url" }, 
    uniqueIds: { $addToSet: "$_id" },
    count: { $sum: 1 } 
  }}, 
  { $match: { 

zubairalam

// requires
var utils = require('utils');
var casper = require('casper').create()
var casper = require('casper').create({
    verbose: true,
    logLevel: "debug"
});

// setup globals 
var email = casper.cli.options['email'] || 'REPLACE THIS EMAIL';

zubairalam

// Desired unique index: 
// db.collection.ensureIndex({ firstField: 1, secondField: 1 }, { unique: true})

db.collection.aggregate([
  { $group: { 
    _id: { firstField: "$firstField", secondField: "$secondField" }, 
    uniqueIds: { $addToSet: "$_id" },
    count: { $sum: 1 } 
  }}, 
  { $match: { 

zubairalam

@csrf_exempt
def upload_video_file(request):
    folder = 'tmp_dir2/' #request.path.replace("/", "_")
    uploaded_filename = request.FILES['file'].name
    BASE_PATH = '/home/'
    # create the folder if it doesn't exist.
    try:
        os.mkdir(os.path.join(BASE_PATH, folder))
    except:
        pass

zubairalam

to kill any process running on 8000 port
sudo fuser -k 8000/tcp