One Paragraph of project description goes here
These instructions will get you a copy of the project up and running on your local machine for development and testing purposes. See deployment for notes on how to deploy the project on a live system.
Keystone comes completely set up to install on Heroku in a couple of steps.
1. Sign up for a Heroku account and install the Heroku Toolbelt.
Log in with it and you're ready to begin. Heroku uses git to deploy a new site, so with that in mind:
2. Create a new repository on Github and then clone it.
| from scrapy.selector import Selector | |
| selector = Selector(text=""" | |
| <div itemscope itemtype ="http://schema.org/Movie"> | |
| <h1 itemprop="name">Avatar</h1> | |
| <span>Director: <span itemprop="director">James Cameron</span> (born August 16, 1954)</span> | |
| <span itemprop="genre">Science fiction</span> | |
| <a href="../movies/avatar-theatrical-trailer.html" itemprop="trailer">Trailer</a> | |
| </div>""", type="html") |
| #!/usr/bin/env python | |
| # | |
| # AccessDump.py | |
| # A simple script to dump the contents of a Microsoft Access Database. | |
| # It depends upon the mdbtools suite: | |
| # http://sourceforge.net/projects/mdbtools/ | |
| import sys, subprocess, os | |
| DATABASE = sys.argv[1] |
| 'Put this function in new/existing MS-Access module. | |
| ' | |
| ' Version History: | |
| ' 2012-03-16 - First version http://en.latindevelopers.com/ivancp/2012/ms-access-to-mysql-with-relationships/ | |
| ' | |
| ' 2014-02-09 - Seamus Casey | |
| ' a modification to Ivan's handy Access to MySQL relationship/constraint generator | |
| ' | |
| ' changes include: | |
| ' 1) skip Access system tables (TableDefAttributeEnum.dbSystemObjec) |
| # delete local tag '12345' | |
| git tag -d 12345 | |
| # delete remote tag '12345' (eg, GitHub version too) | |
| git push origin :refs/tags/12345 | |
| # alternative approach | |
| git push --delete origin tagName | |
| git tag -d tagName |
| import MySQLdb.cursors | |
| from twisted.enterprise import adbapi | |
| from scrapy.xlib.pydispatch import dispatcher | |
| from scrapy import signals | |
| from scrapy.utils.project import get_project_settings | |
| from scrapy import log | |
| SETTINGS = get_project_settings() |
| db.collection.find({ field : { $exists : true } }).forEach( function (x) { | |
| var temp = {} | |
| var count = 0 | |
| for (var i in x.field) { | |
| if (typeof x.field[i] == "string") { | |
| // make sure index is a string | |
| temp[x.field[i]] = x.date; | |
| count++; | |
| } |
| If you've got local source code you want to add to a new remote new git repository without 'cloning' the remote first, do the following (I often do this - you create your remote empty repository in bitbucket/github, then push up your source) | |
| 1. Create the remote repository, and get the URL such as git://github.com/youruser/somename.git | |
| 2. If your local GIT repo is already set up, skips steps 2 and 3 | |
| 3. Locally, at the root directory of your source, git init | |
| 4. Locally, add and commit what you want in your initial repo (for everything, | |
| git add . |
| # -*- coding: utf-8 -*- | |
| """ | |
| LICENSE: BSD (same as pandas) | |
| example use of pandas with oracle mysql postgresql sqlite | |
| - updated 9/18/2012 with better column name handling; couple of bug fixes. | |
| - used ~20 times for various ETL jobs. Mostly MySQL, but some Oracle. | |
| to do: | |
| save/restore index (how to check table existence? just do select count(*)?), | |
| finish odbc, |