Skip to content

Instantly share code, notes, and snippets.

@michimau

michimau/alec log

Last active May 18, 2020 13:57
Show Gist options
  • Save michimau/df773d25f75f4650c7fc677f54b2a825 to your computer and use it in GitHub Desktop.
Save michimau/df773d25f75f4650c7fc677f54b2a825 to your computer and use it in GitHub Desktop.
Download ZIP
alec log
Raw
alec log
5/18/2020 3:56:58 PM[2020-05-18 13:56:58.418] - DEBUG --- eionet.cr.harvest.scheduled.UrgentHarvestQueue : Pull harvest added to the urgent queue, url = http://www.eea.europa.eu/data-and-maps/data/lcp-9 - (UrgentHarvestQueue.java:108)
5/18/2020 3:57:05 PM[2020-05-18 13:57:05.987] - DEBUG --- eionet.cr.harvest.BaseHarvest : - (BaseHarvest.java:289)
5/18/2020 3:57:05 PM[2020-05-18 13:57:05.987] - INFO --- eionet.cr.harvest.BaseHarvest : Starting harvest [http://www.eea.europa.eu/data-and-maps/data/lcp-9] - (BaseHarvest.java:290)
5/18/2020 3:57:06 PM[2020-05-18 13:57:06.014] - DEBUG --- eionet.cr.harvest.PullHarvest : Connecting http://www.eea.europa.eu/data-and-maps/data/lcp-9 [http://www.eea.europa.eu/data-and-maps/data/lcp-9] - (PullHarvest.java:321)
5/18/2020 3:57:06 PM[2020-05-18 13:57:06.019] - DEBUG --- eionet.cr.harvest.BaseHarvest : Timeout set to the maximum 129600000 ms, last harvest duration could not be detected [http://www.eea.europa.eu/data-and-maps/data/lcp-9] - (BaseHarvest.java:1146)
5/18/2020 3:57:06 PM[2020-05-18 13:57:06.092] - DEBUG --- eionet.cr.harvest.PullHarvest : Received code 301 from http://www.eea.europa.eu/data-and-maps/data/lcp-9 [http://www.eea.europa.eu/data-and-maps/data/lcp-9] - (PullHarvest.java:327)
5/18/2020 3:57:06 PM[2020-05-18 13:57:06.092] - DEBUG --- eionet.cr.harvest.PullHarvest : http://www.eea.europa.eu/data-and-maps/data/lcp-9 redirects to https://www.eea.europa.eu/data-and-maps/data/lcp-9 [http://www.eea.europa.eu/data-and-maps/data/lcp-9] - (PullHarvest.java:353)
5/18/2020 3:57:06 PM[2020-05-18 13:57:06.092] - DEBUG --- eionet.cr.harvest.PullHarvest : Connecting https://www.eea.europa.eu/data-and-maps/data/lcp-9 [http://www.eea.europa.eu/data-and-maps/data/lcp-9] - (PullHarvest.java:321)
5/18/2020 3:57:06 PM[2020-05-18 13:57:06.250] - DEBUG --- eionet.cr.harvest.PullHarvest : Received code 303 from https://www.eea.europa.eu/data-and-maps/data/lcp-9 [http://www.eea.europa.eu/data-and-maps/data/lcp-9] - (PullHarvest.java:327)
5/18/2020 3:57:06 PM[2020-05-18 13:57:06.250] - DEBUG --- eionet.cr.harvest.PullHarvest : https://www.eea.europa.eu/data-and-maps/data/lcp-9 redirects to http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf [http://www.eea.europa.eu/data-and-maps/data/lcp-9] - (PullHarvest.java:353)
5/18/2020 3:57:06 PM[2020-05-18 13:57:06.251] - DEBUG --- eionet.cr.harvest.PullHarvest : Connecting http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf [http://www.eea.europa.eu/data-and-maps/data/lcp-9] - (PullHarvest.java:321)
5/18/2020 3:57:06 PM[2020-05-18 13:57:06.926] - DEBUG --- eionet.cr.harvest.PullHarvest : Received code 200 from http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf [http://www.eea.europa.eu/data-and-maps/data/lcp-9] - (PullHarvest.java:327)
5/18/2020 3:57:06 PM[2020-05-18 13:57:06.926] - DEBUG --- eionet.cr.harvest.BaseHarvest : Switching context to http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf [http://www.eea.europa.eu/data-and-maps/data/lcp-9] - (BaseHarvest.java:815)
5/18/2020 3:57:06 PM[2020-05-18 13:57:06.930] - DEBUG --- eionet.cr.harvest.BaseHarvest : - (BaseHarvest.java:289)
5/18/2020 3:57:06 PM[2020-05-18 13:57:06.930] - INFO --- eionet.cr.harvest.BaseHarvest : Starting harvest [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (BaseHarvest.java:290)
5/18/2020 3:57:06 PM[2020-05-18 13:57:06.953] - DEBUG --- eionet.cr.harvest.PullHarvest : Downloading file [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (PullHarvest.java:723)
5/18/2020 3:57:06 PM[2020-05-18 13:57:06.993] - DEBUG --- eionet.cr.harvest.BaseHarvest : File is in RDF or web feed format [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (BaseHarvest.java:1217)
5/18/2020 3:57:06 PM[2020-05-18 13:57:06.993] - DEBUG --- eionet.cr.harvest.BaseHarvest : Loading file into triple store, loader class is RDFFormatLoader [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (BaseHarvest.java:1219)
5/18/2020 3:57:06 PM[2020-05-18 13:57:06.994] - DEBUG --- eionet.cr.harvest.BaseHarvest : Running "Pre-purge" scripts... [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (BaseHarvest.java:416)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.093] - DEBUG --- eionet.cr.harvest.BaseHarvest : No active "Pre-purge" scripts were found for this source [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (BaseHarvest.java:447)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.093] - DEBUG --- eionet.cr.dao.virtuoso.VirtuosoHarvestSourceDAO : Starting content loading ... [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (VirtuosoHarvestSourceDAO.java:1612)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.097] - DEBUG --- eionet.cr.dao.virtuoso.VirtuosoHarvestSourceDAO : Current triples count = 682, file size = 53403, direct loading flag = FALSE [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (VirtuosoHarvestSourceDAO.java:1642)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.120] - DEBUG --- eionet.cr.dao.virtuoso.VirtuosoHarvestSourceDAO : Going to load triples into TEMP graph [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (VirtuosoHarvestSourceDAO.java:1678)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.122] - DEBUG --- eionet.cr.dao.virtuoso.VirtuosoHarvestSourceDAO : Executing file loading command: DB.DBA.RDF_LOAD_RDFXML_MT(file_open('/var/tmp/eionet.cr.tempfile-1589810226953-4ba1159c-f38d-4dd3-83d9-88bb0bdd55f3'), 'http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf', 'http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf_tempharvest', 1, 8, 1) - (VirtuosoHarvestSourceDAO.java:2020)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.379] - DEBUG --- eionet.cr.dao.virtuoso.VirtuosoHarvestSourceDAO : TEMP graph not empty [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf_tempharvest] - (VirtuosoHarvestSourceDAO.java:1715)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.379] - DEBUG --- eionet.cr.dao.virtuoso.VirtuosoHarvestSourceDAO : XOR-ing <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf_tempharvest with <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf> - (VirtuosoHarvestSourceDAO.java:1720)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.379] - DEBUG --- eionet.cr.dao.virtuoso.VirtuosoHarvestSourceDAO : Executing 1st XOR query [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (VirtuosoHarvestSourceDAO.java:1911)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.438] - DEBUG --- eionet.cr.dao.virtuoso.VirtuosoHarvestSourceDAO : Executing 2nd XOR query [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (VirtuosoHarvestSourceDAO.java:1919)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.472] - DEBUG --- eionet.cr.dao.virtuoso.VirtuosoHarvestSourceDAO : Clearing TEMP graph [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf_tempharvest] - (VirtuosoHarvestSourceDAO.java:1957)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.536] - DEBUG --- eionet.cr.util.FileDeletionJob : File successfully deleted: /var/tmp/eionet.cr.tempfile-1589810226953-4ba1159c-f38d-4dd3-83d9-88bb0bdd55f3 - (FileDeletionJob.java:140)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.536] - DEBUG --- eionet.cr.harvest.PullHarvest : 620 triples loaded [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (PullHarvest.java:380)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.537] - DEBUG --- eionet.cr.harvest.BaseHarvest : Running "Post-import" scripts... [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (BaseHarvest.java:416)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.541] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing all-source "Post-import" script titled "Delete Yago classes" - (BaseHarvest.java:494)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.541] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing parsedQuery: DELETE FROM <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf>
5/18/2020 3:57:07 PM{ ?s a ?o }
5/18/2020 3:57:07 PMFROM <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf>
5/18/2020 3:57:07 PMWHERE {
5/18/2020 3:57:07 PM ?s a ?o
5/18/2020 3:57:07 PM FILTER(REGEX(?o,'^http://dbpedia.org/class/yago/'))
5/18/2020 3:57:07 PM} - (BaseHarvest.java:497)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.641] - DEBUG --- eionet.cr.harvest.BaseHarvest : Script's update count was 0 - (BaseHarvest.java:572)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.642] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing all-source "Post-import" script titled "Create labels from foaf:name if there is none" - (BaseHarvest.java:494)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.642] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing parsedQuery: PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>
5/18/2020 3:57:07 PMPREFIX foaf: <http://xmlns.com/foaf/0.1/>
5/18/2020 3:57:07 PM
5/18/2020 3:57:07 PMINSERT INTO <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf>
5/18/2020 3:57:07 PM{ ?s rdfs:label `STR(?o)` }
5/18/2020 3:57:07 PMFROM <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf>
5/18/2020 3:57:07 PMWHERE {
5/18/2020 3:57:07 PM ?s foaf:name ?o FILTER(LANG(?o) IN ('en','') )
5/18/2020 3:57:07 PM OPTIONAL {?s rdfs:label ?currlabel } FILTER(!BOUND(?currlabel))
5/18/2020 3:57:07 PM} - (BaseHarvest.java:497)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.645] - DEBUG --- eionet.cr.harvest.BaseHarvest : Script's update count was 0 - (BaseHarvest.java:572)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.645] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing all-source "Post-import" script titled "Inherit topics from parent content if none" - (BaseHarvest.java:494)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.645] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing parsedQuery: # Owner/Maintainer: Antonio De Marinis
5/18/2020 3:57:07 PM# to suggest changes/report issues, please contact owner.
5/18/2020 3:57:07 PM
5/18/2020 3:57:07 PMPREFIX pt: <http://www.eea.europa.eu/portal_types#>
5/18/2020 3:57:07 PMPREFIX dct: <http://purl.org/dc/terms/>
5/18/2020 3:57:07 PM
5/18/2020 3:57:07 PMINSERT INTO <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf>
5/18/2020 3:57:07 PM{
5/18/2020 3:57:07 PM ?s pt:topic ?topic.
5/18/2020 3:57:07 PM}
5/18/2020 3:57:07 PMFROM
5/18/2020 3:57:07 PM <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf>
5/18/2020 3:57:07 PMWHERE {
5/18/2020 3:57:07 PM ?s dct:isPartOf ?parent.
5/18/2020 3:57:07 PM OPTIONAL {?s pt:topic ?mytopic } FILTER(!BOUND(?mytopic)).
5/18/2020 3:57:07 PM GRAPH ?g
5/18/2020 3:57:07 PM {
5/18/2020 3:57:07 PM ?parent pt:topic ?topic
5/18/2020 3:57:07 PM }
5/18/2020 3:57:07 PM filter regex(str(<http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf>), "http://www.eea.europa.eu")
5/18/2020 3:57:07 PM} - (BaseHarvest.java:497)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.650] - DEBUG --- eionet.cr.harvest.BaseHarvest : Script's update count was 0 - (BaseHarvest.java:572)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.732] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing type-specific "Post-import" script titled "Create links to country vocabulary" - (BaseHarvest.java:494)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.732] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing parsedQuery: PREFIX cr: <http://cr.eionet.europa.eu/ontologies/contreg.rdf#>
5/18/2020 3:57:07 PMPREFIX dct: <http://purl.org/dc/terms/>
5/18/2020 3:57:07 PMPREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>
5/18/2020 3:57:07 PMPREFIX data: <http://www.eea.europa.eu/portal_types/Data#>
5/18/2020 3:57:07 PMINSERT INTO <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf> {
5/18/2020 3:57:07 PM ?s dct:spatial `IRI( bif:concat('http://rdfdata.eionet.europa.eu/eea/countries/', bif:upper(?countrycode)))`
5/18/2020 3:57:07 PM}
5/18/2020 3:57:07 PMFROM <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf>
5/18/2020 3:57:07 PMWHERE {
5/18/2020 3:57:07 PM ?s data:geographicCoverage ?countrycode
5/18/2020 3:57:07 PM} - (BaseHarvest.java:497)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.734] - DEBUG --- eionet.cr.harvest.BaseHarvest : Script's update count was 0 - (BaseHarvest.java:572)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.734] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing type-specific "Post-import" script titled "Create tags from themes and subjects" - (BaseHarvest.java:494)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.735] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing parsedQuery: PREFIX pt: <http://www.eea.europa.eu/portal_types/Data#>
5/18/2020 3:57:07 PMPREFIX cr: <http://cr.eionet.europa.eu/ontologies/contreg.rdf#>
5/18/2020 3:57:07 PMPREFIX dct: <http://purl.org/dc/terms/>
5/18/2020 3:57:07 PMPREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>
5/18/2020 3:57:07 PM
5/18/2020 3:57:07 PMINSERT INTO <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf> {
5/18/2020 3:57:07 PM ?s cr:tag `bif:lower(?tag)` }
5/18/2020 3:57:07 PMFROM <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf>
5/18/2020 3:57:07 PMWHERE {
5/18/2020 3:57:07 PM?s a <http://www.eea.europa.eu/portal_types/Data#Data>;
5/18/2020 3:57:07 PM ?pred ?tag
5/18/2020 3:57:07 PM FILTER(isLiteral(?tag) && ?pred IN (pt:themes, dct:subject))
5/18/2020 3:57:07 PM} - (BaseHarvest.java:497)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.739] - DEBUG --- eionet.cr.harvest.BaseHarvest : Script's update count was 9 - (BaseHarvest.java:572)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.739] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing type-specific "Post-import" script titled "Create label from title" - (BaseHarvest.java:494)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.739] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing parsedQuery: PREFIX dct: <http://purl.org/dc/terms/>
5/18/2020 3:57:07 PMPREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>
5/18/2020 3:57:07 PM
5/18/2020 3:57:07 PMINSERT INTO <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf>
5/18/2020 3:57:07 PM{ ?s rdfs:label ?title }
5/18/2020 3:57:07 PMFROM <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf>
5/18/2020 3:57:07 PMWHERE {
5/18/2020 3:57:07 PM ?s a <http://www.eea.europa.eu/portal_types/Data#Data>;
5/18/2020 3:57:07 PM dct:title ?title
5/18/2020 3:57:07 PM} - (BaseHarvest.java:497)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.749] - DEBUG --- eionet.cr.harvest.BaseHarvest : Script's update count was 1 - (BaseHarvest.java:572)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.750] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing type-specific "Post-import" script titled "Links to vocabularies via dct:subject literals" - (BaseHarvest.java:494)
5/18/2020 3:57:07 PM[2020-05-18 13:57:07.750] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing parsedQuery: #FROM <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf>
5/18/2020 3:57:07 PM#FROM <http://rdfdata.eionet.europa.eu/eea/determinants.rdf>
5/18/2020 3:57:07 PM#FROM <http://www.eionet.europa.eu/gemet/gemet.rdf.gz>
5/18/2020 3:57:07 PM#FROM <http://rdfdata.eionet.europa.eu/eurovoc/eurovoc_skos.rdf.gz>
5/18/2020 3:57:07 PMPREFIX dct: <http://purl.org/dc/terms/>
5/18/2020 3:57:07 PMPREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>
5/18/2020 3:57:07 PMPREFIX cr: <http://cr.eionet.europa.eu/ontologies/contreg.rdf#>
5/18/2020 3:57:07 PMPREFIX skos: <http://www.w3.org/2004/02/skos/core#>
5/18/2020 3:57:07 PMPREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>
5/18/2020 3:57:07 PM
5/18/2020 3:57:07 PMINSERT INTO <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf>
5/18/2020 3:57:07 PM{ ?subjecturi dct:subject ?component }
5/18/2020 3:57:07 PM
5/18/2020 3:57:07 PMWHERE {
5/18/2020 3:57:07 PM GRAPH <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf> {
5/18/2020 3:57:07 PM ?subjecturi dct:subject ?subject FILTER(isLiteral(?subject))
5/18/2020 3:57:07 PM }
5/18/2020 3:57:07 PM GRAPH <http://rdfdata.eionet.europa.eu/eurovoc/eurovoc_skos.rdf.gz> {
5/18/2020 3:57:07 PM ?component a skos:Concept .
5/18/2020 3:57:07 PM {
5/18/2020 3:57:07 PM ?component skos:notation ?label
5/18/2020 3:57:07 PM } UNION {
5/18/2020 3:57:07 PM ?component skos:prefLabel ?label
5/18/2020 3:57:07 PM } UNION {
5/18/2020 3:57:07 PM ?component skos:altLabel ?label
5/18/2020 3:57:07 PM } UNION {
5/18/2020 3:57:07 PM ?component skos:hiddenLabel ?label
5/18/2020 3:57:07 PM }
5/18/2020 3:57:07 PM }
5/18/2020 3:57:07 PM FILTER (LANG(?label) IN ("","en") && bif:lower(?label) = bif:lower(?subject))
5/18/2020 3:57:07 PM} - (BaseHarvest.java:497)
5/18/2020 3:57:16 PM[2020-05-18 13:57:16.944] - DEBUG --- eionet.cr.harvest.BaseHarvest : Script's update count was 1 - (BaseHarvest.java:572)
5/18/2020 3:57:16 PM[2020-05-18 13:57:16.945] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing type-specific "Post-import" script titled "Make it an AMP output" - (BaseHarvest.java:494)
5/18/2020 3:57:16 PM[2020-05-18 13:57:16.945] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing parsedQuery: PREFIX amp: <http://rdfdata.eionet.europa.eu/amp/ontology/>
5/18/2020 3:57:16 PM
5/18/2020 3:57:16 PMINSERT INTO <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf> {
5/18/2020 3:57:16 PM ?s a amp:Output .
5/18/2020 3:57:16 PM ?s amp:managementPlan ?plan
5/18/2020 3:57:16 PM}
5/18/2020 3:57:16 PMFROM <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf>
5/18/2020 3:57:16 PMWHERE {
5/18/2020 3:57:16 PM ?s a <http://www.eea.europa.eu/portal_types/Data#Data>
5/18/2020 3:57:16 PM OPTIONAL { ?s <http://www.eea.europa.eu/portal_types/Data#eeaManagementPlan> ?plan }
5/18/2020 3:57:16 PM} - (BaseHarvest.java:497)
5/18/2020 3:57:16 PM[2020-05-18 13:57:16.952] - DEBUG --- eionet.cr.harvest.BaseHarvest : Script's update count was 2 - (BaseHarvest.java:572)
5/18/2020 3:57:16 PM[2020-05-18 13:57:16.952] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing type-specific "Post-import" script titled "Create links to rod obligations" - (BaseHarvest.java:494)
5/18/2020 3:57:16 PM[2020-05-18 13:57:16.953] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing parsedQuery: PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>
5/18/2020 3:57:16 PMPREFIX data: <http://www.eea.europa.eu/portal_types/Data#>
5/18/2020 3:57:16 PMPREFIX Organisation: <http://www.eea.europa.eu/portal_types/Organisation#>
5/18/2020 3:57:16 PMPREFIX rdf-syntax: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
5/18/2020 3:57:16 PMPREFIX pt: <http://www.eea.europa.eu/portal_types/Obligations#>
5/18/2020 3:57:16 PM
5/18/2020 3:57:16 PMINSERT INTO <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf> {
5/18/2020 3:57:16 PM ?s pt:Obligations `IRI( bif:concat('http://rod.eionet.europa.eu/obligations/', ?reportingObligations))`
5/18/2020 3:57:16 PM}
5/18/2020 3:57:16 PMFROM <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf>
5/18/2020 3:57:16 PMWHERE {
5/18/2020 3:57:16 PM ?s data:reportingObligations ?reportingObligations .
5/18/2020 3:57:16 PM} - (BaseHarvest.java:497)
5/18/2020 3:57:16 PM[2020-05-18 13:57:16.958] - DEBUG --- eionet.cr.harvest.BaseHarvest : Script's update count was 1 - (BaseHarvest.java:572)
5/18/2020 3:57:16 PM[2020-05-18 13:57:16.958] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing type-specific "Post-import" script titled "Make it a DCAT dataset and link to distribution" - (BaseHarvest.java:494)
5/18/2020 3:57:16 PM[2020-05-18 13:57:16.959] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing parsedQuery: PREFIX a: <http://www.eea.europa.eu/portal_types/Data#>
5/18/2020 3:57:16 PMPREFIX dcat: <http://www.w3.org/ns/dcat#>
5/18/2020 3:57:16 PMPREFIX dct: <http://purl.org/dc/terms/>
5/18/2020 3:57:16 PMPREFIX datafile: <http://www.eea.europa.eu/portal_types/DataFile#>
5/18/2020 3:57:16 PM
5/18/2020 3:57:16 PMINSERT INTO <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf> {
5/18/2020 3:57:16 PM ?dataset a dcat:Dataset;
5/18/2020 3:57:16 PM dcat:distribution ?datafile
5/18/2020 3:57:16 PM}
5/18/2020 3:57:16 PMWHERE {
5/18/2020 3:57:16 PM GRAPH <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf> {
5/18/2020 3:57:16 PM ?dataset a <http://www.eea.europa.eu/portal_types/Data#Data>;
5/18/2020 3:57:16 PM dct:hasPart ?datatable .
5/18/2020 3:57:16 PM }
5/18/2020 3:57:16 PM ?datatable dct:hasPart ?datafile .
5/18/2020 3:57:16 PM ?datafile a datafile:DataFile
5/18/2020 3:57:16 PM} - (BaseHarvest.java:497)
5/18/2020 3:57:16 PM[2020-05-18 13:57:16.987] - DEBUG --- eionet.cr.harvest.BaseHarvest : Script's update count was 8 - (BaseHarvest.java:572)
5/18/2020 3:57:16 PM[2020-05-18 13:57:16.987] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing type-specific "Post-import" script titled "Links to themes vocabulary" - (BaseHarvest.java:494)
5/18/2020 3:57:16 PM[2020-05-18 13:57:16.987] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing parsedQuery: PREFIX type: <http://www.eea.europa.eu/portal_types/Data#>
5/18/2020 3:57:16 PMPREFIX pt: <http://www.eea.europa.eu/portal_types#>
5/18/2020 3:57:16 PM
5/18/2020 3:57:16 PMINSERT INTO <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf>
5/18/2020 3:57:16 PM{
5/18/2020 3:57:16 PM ?s pt:topic `IRI(bif:sprintf('http://www.eea.europa.eu/portal_vocabularies/themes/%s',str(?theme)))`
5/18/2020 3:57:16 PM}
5/18/2020 3:57:16 PMFROM <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf>
5/18/2020 3:57:16 PMWHERE {
5/18/2020 3:57:16 PM ?s type:themes ?theme
5/18/2020 3:57:16 PM} - (BaseHarvest.java:497)
5/18/2020 3:57:16 PM[2020-05-18 13:57:16.993] - DEBUG --- eionet.cr.harvest.BaseHarvest : Script's update count was 3 - (BaseHarvest.java:572)
5/18/2020 3:57:16 PM[2020-05-18 13:57:16.993] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing type-specific "Post-import" script titled "Add organisation to itself and related items" - (BaseHarvest.java:494)
5/18/2020 3:57:16 PM[2020-05-18 13:57:16.993] - DEBUG --- eionet.cr.harvest.BaseHarvest : Executing parsedQuery: # Owner/Maintainer: Antonio De Marinis
5/18/2020 3:57:16 PM# to suggest changes/report issues, please contact owner.
5/18/2020 3:57:16 PM
5/18/2020 3:57:16 PMPREFIX type: <http://www.eea.europa.eu/portal_types/Data#>
5/18/2020 3:57:16 PMPREFIX org: <http://www.eea.europa.eu/portal_types/Organisation#>
5/18/2020 3:57:16 PMPREFIX pt: <http://www.eea.europa.eu/portal_types#>
5/18/2020 3:57:16 PMPREFIX dct: <http://purl.org/dc/terms/>
5/18/2020 3:57:16 PM
5/18/2020 3:57:16 PMINSERT INTO <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf>
5/18/2020 3:57:16 PM{
5/18/2020 3:57:16 PM ?s pt:dataProvider ?org.
5/18/2020 3:57:16 PM ?s pt:dataProcessor ?org2.
5/18/2020 3:57:16 PM ?rel pt:dataProvider ?org.
5/18/2020 3:57:16 PM ?rel pt:dataProcessor ?org2.
5/18/2020 3:57:16 PM ?brel pt:dataProvider ?org.
5/18/2020 3:57:16 PM ?brel pt:dataProcessor ?org2.
5/18/2020 3:57:16 PM}
5/18/2020 3:57:16 PMFROM <http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf>
5/18/2020 3:57:16 PMWHERE {
5/18/2020 3:57:16 PM ?s a <http://www.eea.europa.eu/portal_types/Data#Data>;
5/18/2020 3:57:16 PM type:dataOwner ?purl.
5/18/2020 3:57:16 PM OPTIONAL { ?s type:relatedItems ?rel. }
5/18/2020 3:57:16 PM
5/18/2020 3:57:16 PM GRAPH ?g {
5/18/2020 3:57:16 PM ?org a org:Organisation.
5/18/2020 3:57:16 PM ?org org:organisationUrl ?purl2.
5/18/2020 3:57:16 PM } FILTER regex(?purl,?purl2,'i')
5/18/2020 3:57:16 PM
5/18/2020 3:57:16 PM OPTIONAL {
5/18/2020 3:57:16 PM ?s type:processor ?proc.
5/18/2020 3:57:16 PM GRAPH ?f {
5/18/2020 3:57:16 PM ?org2 a org:Organisation.
5/18/2020 3:57:16 PM ?org2 org:organisationUrl ?purl3.
5/18/2020 3:57:16 PM } FILTER regex(?proc,?purl3,'i')
5/18/2020 3:57:16 PM
5/18/2020 3:57:16 PM }
5/18/2020 3:57:17 PM
5/18/2020 3:57:17 PM OPTIONAL {
5/18/2020 3:57:17 PM GRAPH ?h {
5/18/2020 3:57:17 PM ?brel dct:references ?s.
5/18/2020 3:57:17 PM }
5/18/2020 3:57:17 PM }
5/18/2020 3:57:17 PM
5/18/2020 3:57:17 PM} - (BaseHarvest.java:497)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.054] - DEBUG --- eionet.cr.harvest.BaseHarvest : Script's update count was 108 - (BaseHarvest.java:572)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.055] - DEBUG --- eionet.cr.harvest.BaseHarvest : Running "Push" scripts... [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (BaseHarvest.java:416)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.144] - DEBUG --- eionet.cr.harvest.BaseHarvest : No active "Push" scripts were found for this source [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (BaseHarvest.java:447)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.144] - DEBUG --- eionet.cr.harvest.BaseHarvest : Updating harvest source record [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (BaseHarvest.java:699)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.147] - DEBUG --- eionet.cr.harvest.BaseHarvest : Updating harvest record, saving harvest messages [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (BaseHarvest.java:686)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.175] - DEBUG --- eionet.cr.harvest.BaseHarvest : Saving 6 triples of harvest source metadata, cleaning all previous metadata first [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (BaseHarvest.java:666)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.193] - DEBUG --- eionet.cr.harvest.BaseHarvest : Inferring new harvest sources [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (BaseHarvest.java:896)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.209] - DEBUG --- eionet.cr.harvest.BaseHarvest : 0 new harvest sources found and inserted [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (BaseHarvest.java:900)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.209] - DEBUG --- eionet.cr.harvest.BaseHarvest : Deleting old harvests history of the harvested source ... [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (BaseHarvest.java:581)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.291] - DEBUG --- eionet.cr.harvest.BaseHarvest : Checking sources that need removal [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (BaseHarvest.java:608)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.291] - INFO --- eionet.cr.harvest.BaseHarvest : Harvest finished [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (BaseHarvest.java:384)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.291] - DEBUG --- eionet.cr.harvest.BaseHarvest : - (BaseHarvest.java:385)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.292] - DEBUG --- eionet.cr.harvest.PullHarvest : Clearing these sources: [http://www.eea.europa.eu/data-and-maps/data/lcp-9, https://www.eea.europa.eu/data-and-maps/data/lcp-9] - (PullHarvest.java:1180)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.293] - DEBUG --- eionet.cr.dao.virtuoso.VirtuosoHarvestSourceDAO : Deleting this resource from harvester graph - (VirtuosoHarvestSourceDAO.java:680)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.293] - DEBUG --- eionet.cr.dao.virtuoso.VirtuosoHarvestSourceDAO : Deleting this resource from harvester graph - (VirtuosoHarvestSourceDAO.java:680)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.308] - DEBUG --- eionet.cr.dao.virtuoso.VirtuosoHarvestSourceDAO : Deleting requested sources from harvest scripts table. - (VirtuosoHarvestSourceDAO.java:603)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.308] - DEBUG --- eionet.cr.dao.virtuoso.VirtuosoHarvestSourceDAO : Deleting requested sources from harvest source table. - (VirtuosoHarvestSourceDAO.java:605)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.386] - DEBUG --- eionet.cr.dao.virtuoso.VirtuosoHarvestSourceDAO : Deleting requested sources from urgent harvest queue. - (VirtuosoHarvestSourceDAO.java:607)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.388] - DEBUG --- eionet.cr.dao.virtuoso.VirtuosoHarvestSourceDAO : Clearing graphs: [http://www.eea.europa.eu/data-and-maps/data/lcp-9, https://www.eea.europa.eu/data-and-maps/data/lcp-9] - (VirtuosoHarvestSourceDAO.java:717)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.390] - DEBUG --- eionet.cr.harvest.PullHarvest : Saving redirection metadata: [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (PullHarvest.java:1189)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.399] - DEBUG --- eionet.cr.harvest.PullHarvest : Saving redirection metadata: [http://www.eea.europa.eu/data-and-maps/data/lcp-9/@@rdf] - (PullHarvest.java:1189)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.407] - DEBUG --- eionet.cr.harvest.PullHarvest : Clearing the graph of http://www.eea.europa.eu/data-and-maps/data/lcp-9 - (PullHarvest.java:1203)
5/18/2020 3:57:17 PM[2020-05-18 13:57:17.408] - DEBUG --- eionet.cr.harvest.PullHarvest : Clearing the graph of https://www.eea.europa.eu/data-and-maps/data/lcp-9 - (PullHarvest.java:1203)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment