Andrew Briz brizandrew

Using Node.js With Django

When writing django apps it's easy to ignore the organization of your front end code. Often, these backend coders will just write a static js and css file, stick it in the static directory, and call it a day.

You can also build them as two completely independent parts. With a complex gulp build routine independent of the django app. But if you don't know gulp, node, or those kinds of systems it can be a daunting process to get started with.

Enter django-compressor-toolkit (the name doesn't quite roll off the tongue).

Setting Up Django-Compressor-Toolkit

Using django-compressor and django-compressor-toolkit you can write Javascript ES6 code with all its fancy import/export logic or style your pages with sass instead of css, and leave your deploy routine largely untouched.

Setting Up Celery

Boilerplate Code

Install celery and redis

$ pipenv install celery redis

Configure the celery.py file in your exampleapp folder with your app name.

	/*
	Basic web scraping example with node
	Includes scape and SQL insert
	Variant of guide found here: https://scotch.io/tutorials/scraping-the-web-with-node-js
	Scrapes the title of Anchorman 2 and places it into SQL table
	*/

	var express = require('express');
	var fs = require('fs');
	var request = require('request');

	def saveToCSV(arrayDict):
	filename = 'name.csv' #call your file something
	with open(filename, 'w') as output_file:
	fieldnames = [ 'key1', # fill this array with the names of your keys in your dict
	'key2',
	...
	'keyn'
	]
	writer = csv.DictWriter(output_file, fieldnames=fieldnames)
	writer.writeheader()

	// This code snippet requires jQuery to be loaded onto the page.

	/**
	* Wraps jQuery's ajax implementation inside an ES6 Promise structure.
	* Source: https://stackoverflow.com/questions/35135110/jquery-ajax-with-es6-promises
	* @function ajax
	* @param {object} options - The config to pass to the ajax call.
	* @return {object} - A Promise object to complete an ajax call.
	*/
	function ajax(options) {

	/**
	* Renders a template string based on positional and keyword arguments.
	* Source: https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Template_literals
	* @example
	* // returns 'YAY!'
	* let t1Closure = template`${0}${1}${0}!`;
	* t1Closure('Y', 'A');
	* @example
	* // returns 'Hello World!'
	* let t2Closure = template`${0} ${'foo'}!`;

	function get(url){
	var dataString = 'url='+url;
	$.ajax({
	url: "get.php",
	type: "POST",
	data: dataString,
	success: function(html) {
	// Stuff...
	// HTML = the page
	},

	#!/usr/bin/env python
	# -- coding: utf-8 --

	from flask import Flask, request
	from urllib import unquote_plus
	import json
	import re


	app = Flask(__name__)

	# Source: https://wiki.python.org/moin/SortingListsOfDictionaries
	def sortDictList(arr, sort_key):
	output = [(dict_[sort_key], dict_) for dict_ in arr]
	output.sort()
	return [dict_ for (key, dict_) in output]