ctrngk ctrngk

List all the broken links on your website

Requirements:

python3 and scrapy (pip install scrapy)

Usage

scrapy runspider -o items.csv -a site="https://yoursite.org" 1spider.py
python3 2format_results.py

A step-by-step guide how to use Python with Tor and Privoxy

Tested on Ubuntu 16.04 Docker container. The Dockerfile is a single line FROM ubuntu:16.04.

NOTE: stopping services didn't work for me for some reason. That's why there is pidof <service name> | xargs kill after each failed service <service name> stop to kill it.

References

Each of these commands will run an ad hoc http static server in your current (or specified) directory, available at http://localhost:8000. Use this power wisely.

Discussion on reddit.

Python 2.x

$ python -m SimpleHTTPServer 8000

Django request flow

-------------------------------                         ------------------ Django --------------------
| Browser: GET /udo/contact/2 |    === wsgi/fcgi ===>   | 1. Asks OS for DJANGO_SETTINGS_MODULE      |
-------------------------------                         | 2. Build Request (from wsgi/fcgi callback) |
                                                        | 3. Get settings.ROOT_URLCONF module        |
                                                        | 4. Resolve URL/view from request.path      | # url(r'^udo/contact/(?P<id>\w+)', view, name='url-identifier')
                                                        | 5. Apply request middlewares               | # settings.MIDDLEWARE_CLASSES

A simple unix/linux daemon in Python

Source: http://www.jejik.com/articles/2007/02/a_simple_unix_linux_daemon_in_python/

Access: http://web.archive.org/web/20131025230048/http://www.jejik.com/articles/2007/02/a_simple_unix_linux_daemon_in_python/

by Sander Marechal

I've written a simple Python class for creating daemons on unix/linux systems. It was pieced together for various other examples, mostly corrections to various Python Cookbook articles and a couple of examples posted to the Python mailing lists. It has support for a pidfile to keep track of the process. I hope it's useful to someone.

	#!/usr/bin/env python

	import sqlite3

	class dbopen(object):
	"""
	Simple CM for sqlite3 databases. Commits everything at exit.
	"""
	def __init__(self, path):
	self.path = path

	# Next time you need to install something with python setup.py -- which should be never but things happen.

	python setup.py install --record files.txt

	# This will cause all the installed files to be printed to that directory.
	# Then when you want to uninstall it simply run; be careful with the 'sudo'

	cat files.txt \| xargs sudo rm -rf

	# Template: A.html
	<html>
	<head></head>
	<body>
	{% block hello %}
	HELLO
	{% endblock %}
	</body>
	</html>

	#!/bin/sh

	# This is a skeleton of a bash daemon. To use for yourself, just set the
	# daemonName variable and then enter in the commands to run in the doCommands
	# function. Modify the variables just below to fit your preference.

	daemonName="DAEMON-NAME"

	pidDir="."
	pidFile="$pidDir/$daemonName.pid"

	# create pipe, tail it, and read from stdin in a program
	mkfifo namedPipe; tail -f namedPipe \| while true; do read msg; echo $msg; done;

	# now send messages from another shell
	echo "start" > namedPipe
	echo "stop" > namedPipe