Matthias Vandermaesen netsensei

Installing the Datahub::Factory::Arthub modules

Introduction

The Datahub::Factory is a Catmandu based toolkit which allows easy and efficient setup and management of ETL pipelines. A pipeline transforms and transports data between two systems. The set of primary use cases for which this toolkit was conceived is situated within the GLAM (Galleries, Libraries, Archives & Museums) domain.

Out of the box, the Datahub::Factory is a generic, extensible toolkit. While you can use the

Catmandu development

Okay. So you want to build your own Catmandu module? This is a bit of documentation that should help you bootstrap your development environment.

Prerequisites

PERL

Catmandu depends on Perl. You can start out working with system Perl that came with your OS. But since you want to do active development, it's recommended to go with an alternate installation and leave the default alone. This is especially true if you work on OSX or Windows!

	#!perl

	use JSON;
	use Catmandu;
	use Try::Tiny::ByClass;
	use Data::Dumper;


	sub prepare {
	my $store = Catmandu->store(

	[
	{
	"https://www.rijksmuseum.nl/en/collection/BK-AM-33-C": {
	"a": "edm_ProvidedCHO",
	"dc_coverage": [
	"fourth quarter 15th century@en",
	"vierde kwart 15e eeuw@nl"
	],
	"dc_creator": [
	"<urn:rijksmuseum%3Apeople%3ARM0001.PEOPLE.107435>",

	[
	{
	"https://www.rijksmuseum.nl/en/collection/BK-AM-33-C": {
	"a": "edm_ProvidedCHO"
	}
	},
	{
	"https://www.rijksmuseum.nl/en/collection/BK-AM-33-C": {
	"dc_coverage": "fourth quarter 15th century@en"
	}

	collection:BK-AM-33-C
	a edm:ProvidedCHO ;
	dc:coverage "fourth quarter 15th century"@en ,
	"vierde kwart 15e eeuw"@nl ;
	dc:creator <urn:rijksmuseum%3Apeople%3ARM0001.PEOPLE.107435> ,
	<urn:rijksmuseum%3Apeople%3ARM0001.PEOPLE.107436> ,
	<urn:rijksmuseum%3Apeople%3ARM0001.PEOPLE.98030> ,
	"toegeschreven aan Borman, Jan (II)"@nl ,
	"toegeschreven aan Thienen, Renier van"@nl ,
	"verworpen toeschrijving Delemer, Jean"@nl ;

	PREFIX wd: <http://www.wikidata.org/entity/>
	PREFIX wdt: <http://www.wikidata.org/prop/direct/>
	PREFIX wikibase: <http://wikiba.se/ontology#>
	PREFIX p: <http://www.wikidata.org/prop/>
	PREFIX v: <http://www.wikidata.org/prop/statement/>
	PREFIX q: <http://www.wikidata.org/prop/qualifier/>
	PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>

	SELECT ?s ?sLabel ?lLabel ?geo {
	?s wdt:P31 wd:Q1565828 .

	First install ZeroMQ itself.

	1. sudo apt-get update
	2. sudo apt-get install pkg-config
	3. sudo apt-get install libzmq3-dev

	Now install the PHP language binding. We assume PHP is running as PHP-FPM.

	1. sudo pecl install zmq-beta

	<?xml version="1.0" encoding="utf-8"?>
	<xsl:stylesheet version="1.0" xmlns:xsl="http://www.w3.org/1999/XSL/Transform">
	<xsl:output method="text" />

	<xsl:variable name="delimiter" select="','" />

	<!-- define an array containing the fields we are interested in -->
	<xsl:variable name="fieldArray">
	<field>service_id</field>
	<field>account</field>