Skip to content

Instantly share code, notes, and snippets.

View pjanik's full-sized avatar

Piotr Janik pjanik

  • Kraków, Poland
View GitHub Profile
Stats: {
"shared": [
{
"id": 36358,
"sizeInMB": 24.885725021362305,
"updatedAt": "2018-03-18T02:29:44.636Z",
"createdAt": "2018-03-18T02:05:35.879Z"
},
{
"id": 75872,
36010 shared documents to process
Reading doc store data. Every printed . means that 10 docs have been processed.
.....................................................................................................1000 documents have been processed.
....................................................................................................2000 documents have been processed.
....................................................................................................3000 documents have been processed.
....................................................................................................4000 documents have been processed.
....................................................................................................5000 documents have been processed.
....................................................................................................6000 documents have been processed.
.............................................................................................
36138 shared documents to process
Reading doc store data. Every printed . means that 10 docs have been processed.
.....................................................................................................1000 documents have been processed.
....................................................................................................2000 documents have been processed.
....................................................................................................3000 documents have been processed.
....................................................................................................4000 documents have been processed.
....................................................................................................5000 documents have been processed.
....................................................................................................6000 documents have been processed.
.............................................................................................
BASE_URL = "https://authoring.concord.org"
# disable SQL logger
old_logger = ActiveRecord::Base.logger
ActiveRecord::Base.logger = nil
def parse_json(text)
begin
return !text || text.length == 0 ? {} : JSON.parse(text)
rescue
Answer conversion started
Progress: .....................................................r0..........................................................b1b1b1b1.b1b1b1b1..b1b1b1b1b1.b1b1b1b1b1..........................................................................................r0r0r0r1r1r1r0r2r2r2.r1r3r3r3.r2r4r4r4r3r5r5...r5.r4..r6.r6r6r7r7r5r7r8r8.r6r8r9r9r7r9.xxr8xr9x...........r0r0r0r0r0r0r0.r0r1r1r1r1r1r1r1r2r2r2r0r2r2r2r3r3r3r2r3r3r3r4r4r4r3r4r4r4r5r5r5r4r5r5r5r6r6r6r6r6r6r7r5r7r7r7r7r8r6r7r8r8r9r8r7r8r9xr9r9x.x......r0...............
Elapsed time: 15409.13
Memory used: 276.20 MB
Successfully processed 250 resources, 0.02 resources per second
7 resources processing failed and will require reprocessing
Processed 7241 questions, 0.47 questions per second
Copied 46229231 answers, 3000.12 answers per second
0 answers processing failed
0 answers were malformed and ignored