jdlrobson

#!/usr/bin/env python

'''
Copyright [2017] [Jon Robson]

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

jdlrobson

var fetch = require('node-fetch');

function trending() {
    console.log('Q:Anything trending?');
    fetch('https://en.wikipedia.org/api/rest_v1/feed/trending/edits' )
        .then( (d) => d.json() )
        .then( (j) => {
            var nope = true;
            j.pages.forEach((p) => {
                if ( p.trendiness > 0 ) {

jdlrobson

/*
sudo service eventlogging-service-eventbus status
sudo service eventlogging-service-eventbus start
tail -f /vagrant/logs/eventbus.log
npm install node-fetch
node simulate.js
if doesnt work verify the event was received: 
sudo tail -f /var/log/upstart/eventlogging-service-eventbus.log
wget -O - http://0.0.0.0:6927/en.wikipedia.org/v1/feed/trending-edits | tail
*/

jdlrobson

[[File:Flag of Iceland.svg]]

Images are nichhe!!!sssssssddzzsssxhs
[[Foo]] [[Yuk]]
hjhhsaasa
[[Bar]] [[f]]

== Yo ==
[[File:Bolungarvik 02.jpg|thumb|left|''Ósvör'', a replica of an old fishing outpost outside [[Bolungarvík]]]]

jdlrobson

You can easily set up an instance of Weekipedia for this purpose on heroku.

Configure your instance of Weekipedia like so:

export DEV_DUMMY_USER=
export HOST_SUFFIX=.beta.wmflabs.org
export SERVER_SIDE_RENDERING=1
export SITE_PRIVACY_URL=//wikimediafoundation.org/wiki/Privacy_policy
export SITE_EXPAND_ARTICLE=1
export SITE_EXPAND_SECTIONS=0

jdlrobson

Usage:
> node index.js 'meta.wikimedia.org' 1
> node index.js 'wikipedia.org'

jdlrobson

{
  "ResourceModules": {
    "joaquin.js": {
       "scripts": "joaquin.js"
    },
    "jon.js": {
       "scripts": "jon.js"
    },
    "baha.js": {
       "scripts": "baha.js"

jdlrobson

import numpy as np
import csv
import json
import sys
import datetime

def get_data( filename, from_ts, to_ts, metric, wiki=None, http2=None, anon=None, lazy = None ):
    sample = []
    f = open( filename )
    delim = '\t'

jdlrobson

<?php
require_once( '../../includes/libs/ReplacementArray.php' );
require_once( '../../includes/HtmlFormatter.php' );
function wfIsWindows () { return false; };

require_once( 'includes/MobileFormatter.php' );
const NUMBER_RUNS = 100;


$filenames = array(

jdlrobson

var fetch = require('node-fetch');
var io = require( 'socket.io-client' );
var titles = {};
var pageImages = {};
var alternativePageImageAvailable = {};
var interval;
var socket = io.connect('stream.wikimedia.org/rc');
var param = require('node-jquery-param');
var args = process.argv.slice(2);
var fs = require('fs');