This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
<!DOCTYPE html> | |
<html> | |
<head> | |
<meta charset="UTF-8"> | |
<title>title</title> | |
<link rel="stylesheet" href="http://basehold.it/36"> | |
<style> |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/bin/bash | |
# dump-all-databases.sh | |
# | |
# | |
# Backup each MySQL database on a MySQL server into a separate file. | |
# Optionally files can be gzipped (dbname.sql.gz) | |
# | |
# Usage: dump_all_databases [ -u username -o output_dir -h hostname -x exclude -z ] | |
# | |
# -u username to connect MySQL server |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
== Database Structure | |
Table: crawler_<site>_urls | |
url (str) primary | |
accessed (date) | |
content-type (str) | |
content-length (int) | |
status (str) | |
etag (if set, the crawler can use the etag in it's requests | |
to reduce unnecessary checks) |