Skip to content

Instantly share code, notes, and snippets.

@N0taN3rd
N0taN3rd / archivedNewsData.html
Last active September 12, 2017 22:55
Internet Archive Incorrectly Wrapping Valid HTML
<html>
<head>
<script type="text/javascript" src="/static/js/analytics.js?v=1504952612.0" charset="utf-8"></script>
<script type="text/javascript">archive_analytics.values.service = 'wb';
archive_analytics.values.server_name = 'wwwb-app42.us.archive.org';
archive_analytics.values.server_ms = 557;</script>
<script type="text/javascript" src="/static/js/wbhack.js?v=1504952612.0" charset="utf-8"></script>
<script type="text/javascript">
{
"curURL": "https://bluelivesmatter.blue/jefferson-judge-joseph-bruzzese-jr-shot/",
"domInfo": {
"whoIsClickableCount": {
"#document": 20,
"html": 4,
"div": 177,
"a": 625,
"span": 5,
"input": 437,
@N0taN3rd
N0taN3rd / bbc.co.uk.json
Created August 24, 2017 17:58
NO a priori knowledge needed to detect anything about a web page
{
"curURL": "http://www.bbc.com/",
"domInfo": {
"listenerCount": {
"error": 3,
"load": 11,
"click": 62,
"touchend": 21,
"mousedown": 11,
"input": 1,
@N0taN3rd
N0taN3rd / README.md
Last active August 19, 2018 13:37
Demo Puppetter And Node.js Chrome Headless Control For Alexander Nwala

Requires

Node.js download

Usage

  1. npm install
  2. npm run go

Other Info

Comments in js file and have fun!

@N0taN3rd
N0taN3rd / yt.IA.20170727020348.html
Last active April 13, 2020 17:20
Youtube switched over to Polymer (web components) and Heritrix has issues with knowing about HTML5 elements and web components
<!DOCTYPE html><html lang="en" data-cast-api-enabled="true"><head><script type="text/javascript" src="/static/js/analytics.js?v=1500596387.0" charset="utf-8"></script>
<script type="text/javascript">archive_analytics.values.service='wb';archive_analytics.values.server_name='wwwb-app16.us.archive.org';archive_analytics.values.server_ms=1692;</script><script type="text/javascript" src="/static/js/wbhack.js?v=1500596387.0" charset="utf-8"></script>
<script type="text/javascript">
__wbhack.init('https://web.archive.org/web');
</script>
<link rel="stylesheet" type="text/css" href="/static/css/banner-styles.css?v=1500596387.0" />
<link rel="stylesheet" type="text/css" href="/static/css/iconochive.css?v=1500596387.0" />
@N0taN3rd
N0taN3rd / conter.js
Created July 24, 2017 01:01
JS Class __proto__ Proxy
function sortAscending ([ k1, v1 ], [ k2, v2 ]) {
if (v1 < v2) {
return -1
}
if (v1 > v2) {
return 1
}
return 0
}
@N0taN3rd
N0taN3rd / ncdxjExample.js
Last active July 23, 2017 08:06
2017-07-25: Swimming In A Ocean Of JavaScript. Using Nodejs, Electron And Chrome To Preserve The Web
const CDXJ = require('cdxj')
// To read the cdxj file entirely
// and receive an array of cdxj entries
async function getMeSomeCDXJ () {
let cdxj = await CDXJ.readCDXJ('<path-to-cdxj-file>')
cdxj.forEach(cdxjEntry => {
console.log(`surt: ${cdxjEntry.surt}`)
console.log(`datetime: ${cdxjEntry.dt}`)
console.log(`json data: ${cdxjEntry.json}`)
@N0taN3rd
N0taN3rd / dumpProcessEnv.js
Last active July 15, 2017 21:43
Terminus vs Gnome-shell Node print process.env keys for https://github.com/Eugeny/terminus/issues/124
Object.keys(process.env).forEach(envKey => {
console.log(envKey)
})
@N0taN3rd
N0taN3rd / doSummary.py
Created June 24, 2017 22:45
summarize text
from bs4 import BeautifulSoup
# https://pypi.python.org/pypi/sumy
from sumy.parsers.html import HtmlParser
from sumy.parsers.plaintext import PlaintextParser
from sumy.nlp.tokenizers import Tokenizer
from sumy.summarizers.lsa import LsaSummarizer as Summarizer
from sumy.nlp.stemmers import Stemmer
from sumy.utils import get_stop_words
# USE PYTHON3
/* eslint-disable */
'use strict';
function showNotification(title, body, icon, tag, url) {
var notificationOptions = {
body: body,
icon: icon,
data: { url: url },
tag: tag
}