Daniel Kapitan dkapitan

Aim: A manageble and transparent OSX setup for all things data at NL Healthcare. This OSX configuration also aims to mimic the server environment (CentOS 7) as much as possible, for maximum portability of the data analytics stack.

Main stack:

OSX (Yosemite at time of writing, El Capitan has just been released)
Python 3.4 via conda package manager. Anaconda distribution by Continuum Analytics is our standard base-Python stack. jupyter notebook is our preferred analytics environment for interactive computing in various languages
PostgreSQL 9.3, using MacPorts as the preferred package manager. In case an app is not available in MacPorts, we will use homebrew as a fall-back package manager
Optional interactive computing languages: R, julia or any of the [supported languages](ht

	DECLARE @column_list nvarchar(2000) = (
	SELECT
	substring(
	(
	SELECT ', ' + column_name
	FROM dbo.get_columns_types(@database, @schema, @table)
	FOR XML PATH ('')
	), 2, 2000)
	)

	"""
	SQL Server supports Geometry datatypes for GIS analytics. GIS data is often stored in ESRI .shp format
	The GDAL/ogr library provides ample tools to work with shapefiles, and export them in wkt for importing in SQL Server

	See:
	http://gdal.org/python/
	http://en.wikipedia.org/wiki/Well-known_text
	http://en.wikibooks.org/wiki/Geospatial_Data_in_SQL_Server#Import_Functions

	"""

	-- let op: system accounts medinova\shannon_mssql en medinova\Shannon_SQLAgent moeten toegang hebben tot de directory waar naar toe wordt geschreven


	declare @sql varchar(8000)
	select @sql = 'bcp "select * from clinics01.dbo.DIM_DAG" queryout D:\etl\exports\valuecare\conversie\test.csv -c -t, -T -S' + @@servername
	exec master..xp_cmdshell @sql

	import re
	text = '"this is my string between quotes";column1;"bs";col2'
	print(re.findall(r'"(.*?)"', text))
	## --> ['this is my string between quotes', 'bs']

	-- use EXECUTE .. USING for dynamic SQL
	-- NB: DbVis needs --/ and / around do-block
	do $$
	begin
	execute 'drop table if exists tmp';
	execute
	'create temporary table tmp as
	select * from vektis_agb.fagbx20_s01
	where zorgverlenersnummer = $1'
	using '000004';

	import re
	first_cap_re = re.compile('(.)([A-Z][a-z]+)')
	all_cap_re = re.compile('([a-z0-9])([A-Z])')
	def convert(name):
	s1 = first_cap_re.sub(r'\1_\2', name)
	return all_cap_re.sub(r'\1_\2', s1).lower()

	def bsnproef(nummer):
	"""
	Checks validity of Dutch Social Security (BSN) based on '11-proef'
	:param nummer: number to be checked, can be string or int
	:return: True if passed BSN proef, False otherwise
	"""
	bsnfactoren = [9, 8, 7, 6, 5, 4, 3, 2, -1]
	try:
	check = sum([int(a)*b for a, b in zip(str(nummer), bsnfactoren)]) % 11
	if check == 0:

	#!/bin/sh

	rsync -avP --exclude '.@__thumb' -e ssh admin@dannas:/share/HiFi/ /Volumes/Seagate\ Backup\ Plus\ Drive/HiFi/
	rsync -avP --exclude '.@__thumb' -e ssh admin@dannas:/share/Videos/ /Volumes/Seagate\ Backup\ Plus\ Drive/Videos/