Anjesh anjesh

Building pgModeler in MacOS with Homebrew

The official installation instructions for pgModeler recommends installing Xcode and the Enterprise DB distribution of Postgres to fulfill its build requirements. Luckily, Homebrew's got us covered!

Checkout the source

git clone https://github.com/pgmodeler/pgmodeler.git

Load the following page https://bolpatra.gov.np/egp/searchBidDashboardHomePage?bidSearchTO.title=&bidSearchTO.ifbNO=&bidSearchTO.procurementCategory=-1&bidSearchTO.procurementMethod=-1&bidSearchTO.publicEntityTitle=&bidSearchTO.publicEntity=0&parentPE=0&null_widget=&bidSearchTO.childPEId=-1&bidSearchTO.NoticePubDateText=&bidSearchTO.lastBidSubmissionDateText=&currentPageIndexInput=1&pageSizeInput=5000&pageActionInput=goto&tenderId=&currentPageIndex=1&pageSize=200&pageAction=&totalRecords=4522&startIndex=0&numberOfPages=453&isNextAvailable=true&isPreviousAvailable=false&_=1526965284059 in the browser.
- As of the attempt date, there are less than 5000 records, later you just need to update pageSizeInput=5000 value so that you scrape all the values in one click
Open your browser console
Run the script scrape.js below in the console, you will get JSON download

Download mysql source
Ran the following cmake command based on the documentation

cmake \
  -DCMAKE_INSTALL_PREFIX=/usr/local/mac-dev-env/mysql-5.7.18 \
  -DCMAKE_CXX_FLAGS="-stdlib=libstdc++" \
  -DDEFAULT_CHARSET=utf8 \
  -DDEFAULT_COLLATION=utf8_general_ci \

	#' @name logger.setup
	#' @export
	#' @title Set Up Python-Style Logging
	#' @param traceLog file name or full path where \code{logger.trace()} messages will be sent
	#' @param debugLog file name or full path where \code{logger.debug()} messages will be sent
	#' @param infoLog file name or full path where \code{logger.info()} messages will be sent
	#' @param warnLog file name or full path where \code{logger.warn()} messages will be sent
	#' @param errorLog file name or full path where \code{logger.error()} messages will be sent
	#' @param fatalLog file name or full path where \code{logger.fatal()} messages will be sent
	#' @return No return value.

	<?php
	# adapted from http://usefulangle.com/post/34/aws-s3-upload-api-php-curl and works with Mturk

	$headerBlacklist = [
	'cache-control' => true,
	'content-type' => true,
	'content-length' => true,
	'expect' => true,
	'max-forwards' => true,
	'pragma' => true,

	<?xml version="1.0" encoding="UTF-8"?>
	<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
	<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
	<head>
	<meta content="text/html; charset=UTF-8" http-equiv="content-type" />
	<title>RC Bulk Publishing Tool</title>
	</head>
	<body>
	<table cellpadding="1" cellspacing="1" border="1">
	<thead>

	{
	"Name": "rc-auto-publishing",
	"CreationDate": "2019-2-11",
	"Commands": [
	{
	"Command": "csvRead",
	"Target": "rc-contracts.csv",
	"Value": ""
	},
	{

	## download data
	mkdir -p data
	curl http://ppip.gov.np/excel-download/2013 -o data/2013.xlsx
	curl http://ppip.gov.np/excel-download/2014 -o data/2014.xlsx
	curl http://ppip.gov.np/excel-download/2015 -o data/2015.xlsx
	curl http://ppip.gov.np/excel-download/2016 -o data/2016.xlsx
	curl http://ppip.gov.np/excel-download/2017 -o data/2017.xlsx

	## prepare individual sheets from all the excel files
	mkdir -p out