Alfredo Serafini seralf

Warning : this document is out of date and is not being updated

Please direct comments to https://github.com/w3c/data-shapes/issues

SHACL Rules

SHACL rules infer new triples. The input is a data graph and a shape graph with rules, the output is a graph of inferred triples that do not occur in the data graph.

https://cs.emis.de/LNI/Proceedings/Proceedings241/383.pdf

Table: students: {[id, name, major, year, . . . ]}
Table exams: {[sid, course, curriculum, date, . . . ]}

    select s.name,e.course
    from   students s,exams e 
    where  s.id=e.sid and
 e.grade=(select min(e2.grade)

Warning : this document is out of date and is not being updated

The contents formed the basis of shacl12-inf-rules

Please direct comments to https://github.com/w3c/data-shapes/issues

SHACL Rules

One of the major challenges you may face is converting "normal" SQL to T-SQL which is Microsoft's dialect of SQL. I couldn't find any easy way to do this, however in doing some other work I found that Apache Calcite can actually perform this function quite simply. So... here's some code that does exactly that!

import org.apache.calcite.config.Lex;
import org.apache.calcite.sql.SqlDialect;
import org.apache.calcite.sql.SqlNode;
import org.apache.calcite.sql.parser.SqlParseException;

lakeFS with MinIO

lakeFS gives Git-like capabilities over your MinIO storage, allowing you to coordinate with colleagues when working on your data.

In the following example, we will use lakeFS to create a branch on your storage, commit changes to it, and then merge it to the master branch.

Prerequisites

Install MinIO Server from here.
Install mc from here.
Install docker-compose from here.

Python is not a great programming language.

It's great for beginners. Then it turns into a mess.

	import java.io.File;
	import java.nio.file.Files;
	import java.nio.file.Path;
	import java.nio.file.Paths;
	import java.util.ArrayList;
	import java.util.List;
	import java.util.stream.Collectors;

	import org.eclipse.rdf4j.common.exception.RDF4JException;
	import org.eclipse.rdf4j.common.transaction.IsolationLevels;

	import sys
	import os.path as path
	from rdflib import Namespace, XSD, RDF, RDFS, OWL
	from rdflib.term import Variable, URIRef, BNode, Literal
	from rdflib.plugins.sparql.parser import parseQuery
	from rdflib.plugins.sparql.parserutils import prettify_parsetree
	from rdflib.plugins.sparql import prepareQuery
	from rdflib.paths import Path
	import pprint
	import pygraphviz as pgv

	import math
	import torch
	import torch.nn as nn
	from torch.nn import functional as F


	class RelativePositionBias(nn.Module):
	def __init__(self, bidirectional=True, num_buckets=32, max_distance=128, n_heads=2):
	super(RelativePositionBias, self).__init__()
	self.bidirectional = bidirectional

	Annotator,Description,Version,Annotator Approach,Annotator Model
	Tokenizer*,Identifies tokens with tokenization open standards,Opensource,-,+
	Normalizer*,Removes all dirty characters from text,Opensource,-,+
	Stemmer*,Returns hard'-stems out of words with the objective of retrieving the meaningful part of the word,Opensource,+,-
	Lemmatizer*,Retrieves lemmas out of words with the objective of returning a base dictionary word,Opensource,-,+
	RegexMatcher*,Uses a reference file to match a set of regular expressions and put them inside a provided key.,Opensource,+,+
	TextMatcher*,Annotator to match entire phrases (by token) provided in a file against a Document,Opensource,+,+
	Chunker*,Matches a pattern of part'-of'-speech tags in order to return meaningful phrases from document,Opensource,+,-
	DateMatcher*,Reads from different forms of date and time expressions and converts them to a provided date format,Opensource,+,-
	SentenceDetector*,Finds sentence bounds in raw text. Applies rules from Pragmatic Segmenter,Opensou