Foo jimmytuc

Using Python 3 + Google Cloud Vision API's OCR to extract text from photos and scanned documents

Just a quickie test in Python 3 (using Requests) to see if Google Cloud Vision can be used to effectively OCR a scanned data table and preserve its structure, in the way that products such as ABBYY FineReader can OCR an image and provide Excel-ready output.

The short answer: No. While Cloud Vision provides bounding polygon coordinates in its output, it doesn't provide it at the word or region level, which would be needed to then calculate the data delimiters.

On the other hand, the OCR quality is pretty good, if you just need to identify text anywhere in an image, without regards to its physical coordinates. I've included two examples:

####### 1. A low-resolution photo of road signs

Docker - How to cleanup (unused) resources

Once in a while, you may need to cleanup resources (containers, volumes, images, networks) ...

delete volumes

// see: https://github.com/chadoe/docker-cleanup-volumes

$ docker volume rm $(docker volume ls -qf dangling=true)

$ docker volume ls -qf dangling=true | xargs -r docker volume rm

Concurrency in JavaScript

Javascript is a programming language with a peculiar twist. Its event driven model means that nothing blocks and everything runs concurrently. This is not to be confused with the same type of concurrency as running in parallel on multiple cores. Javascript is single threaded so each program runs on a single core yet every line of code executes without waiting for anything to return. This sounds weird but it's true. If you want to have any type of sequential ordering you can use events, callbacks, or as of late promises.

Collection of sample Elasticsearch queries

Use the Python client elasticsearch.

Connect to cluster (the client)

from elasticsearch import Elasticsearch

es_client = Elasticsearch() # local

	// Copyright Stephen Feather and other contributors.
	//
	// Permission is hereby granted, free of charge, to any person obtaining a
	// copy of this software and associated documentation files (the
	// "Software"), to deal in the Software without restriction, including
	// without limitation the rights to use, copy, modify, merge, publish,
	// distribute, sublicense, and/or sell copies of the Software, and to permit
	// persons to whom the Software is furnished to do so, subject to the
	// following conditions:
	//

	function p_str_replace($argFind, $agrReplace, $theString) {
	$needle_replace = $theString; // handle the string need to be replace
	array_walk($argFind, function($val, $key) use(&$needle_replace, $agrReplace) {
	$needle_replace = call_user_func_array('str_replace', array($val, $agrReplace[$key], $needle_replace));
	});
	return $needle_replace;
	}

	// testing purpose
	$the_str = array(

	<?php

	/**


	This Scheduler will run once every minute unlike the Heroku scheduler which only runs every 10 mintues.

	To use this scheduler with Laravel 5.4+ add this file to /app/Console/Commands/RunScheduler.php
	Register this file in app/Console/Kernel.php

	#/usr/bin/python3
	import multiprocessing as mp
	import os


	def process_each_chunk(file, chunk_start, chunk_size):
	with open(file) as f:
	f.seek(chunk_start)
	lines = f.read(chunk_size).splitlines()
	for line in lines:

	# import python core modules
	import datetime
	import logging

	# import external modules
	import pandas as pd
	import requests

	# import luigi modules
	import luigi

	for (var i = 0; i < 1024 * 1024; i++) {
	process.nextTick(function () { Math.sqrt(i) } )
	}