Gui Braccialli gbraccialli
gbraccialli
/ ad01.field.hortonworks.com.cer
Created
September 8, 2016 18:10
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| -----BEGIN CERTIFICATE----- | |
| MIIDuTCCAqGgAwIBAgIQXH4Jnu9LpKZPr9MyE3azzDANBgkqhkiG9w0BAQUFADBj | |
| MRMwEQYKCZImiZPyLGQBGRYDY29tMRswGQYKCZImiZPyLGQBGRYLaG9ydG9ud29y | |
| a3MxFTATBgoJkiaJk/IsZAEZFgVmaWVsZDEYMBYGA1UEAxMPZmllbGQtQUQwMS1D | |
| QS0yMB4XDTE2MDkwODE1MDMxMloXDTIxMDkwODE1MTMxMVowYzETMBEGCgmSJomT | |
| 8ixkARkWA2NvbTEbMBkGCgmSJomT8ixkARkWC2hvcnRvbndvcmtzMRUwEwYKCZIm | |
| iZPyLGQBGRYFZmllbGQxGDAWBgNVBAMTD2ZpZWxkLUFEMDEtQ0EtMjCCASIwDQYJ | |
| KoZIhvcNAQEBBQADggEPADCCAQoCggEBANLFhW6qOvUg8gqYPHfXCRdPDAAElUpg | |
| lxcnIY6XJs7/EEnjKszODEcbMBIW7clhN63Kkef6roGkwDzoMMlc7HVlklCb4yl7 | |
| c/yJFHV5471ZYGB+4NOtRszLq1PDvZZN341qOEufDJbkkVLdwb9fuaxu66UUWZZw |
gbraccialli
/ ssh_custom_key
Created
September 12, 2016 12:21
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| cat >> ~/.ssh/config << EOF | |
| # YOURDOMAIN Section | |
| Host *.yourdomain | |
| IdentityFile ~/.ssh/yourdomain.pem | |
| CheckHostIP=no | |
| StrictHostKeyChecking=no | |
| User centos | |
| UserKnownHostsFile=/dev/null | |
| ## Automatically restore a connection if reconnected within 5 minutes (in case the VPN drops) | |
| TCPKeepAlive no |
gbraccialli
/ hadoop_disk_format.sh
Created
September 22, 2016 15:02
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| vi /etc/mke2fs.conf | |
| #add to /etc/mke2fs.conf : | |
| hadoop = { | |
| features = has_journal,extent,huge_file,flex_bg,uninit_bg,dir_nlink,extra_isize | |
| inode_ratio = 131072 | |
| blocksize = -1 | |
| reserved_ratio = 0 | |
| default_mntopts = acl,user_xaddr | |
| } | |
| ##for all 12 disks |
gbraccialli
/ spark_tests.sh
Last active
December 1, 2016 18:07
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| cd /usr/hdp/current/spark-client | |
| bin/spark-sql --master yarn-client --num-executors 6 --driver-memory 4096m --executor-memory 4096m --executor-cores 6 --queue=spark | |
| bin/spark-submit --class org.apache.spark.examples.SparkPi --master yarn-cluster --num-executors 3 --driver-memory 512m --executor-memory 512m --executor-cores 1 lib/spark-examples*.jar 10 | |
| spark-shell --master yarn-client | |
| val textFile = sc.textFile("/yourfile.txt") | |
| textFile.count() |
gbraccialli
/ uk_map.html
Last active
October 26, 2016 00:43
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <html> | |
| <link rel="stylesheet" href="https://unpkg.com/[email protected]/dist/leaflet.css" /> | |
| <script src="https://unpkg.com/[email protected]/dist/leaflet.js"></script> | |
| <div id="mapid" style="height:500px;"></div> | |
| <script type="text/javascript"> | |
| var Leaflet = L.noConflict(); | |
| var map = Leaflet.map('mapid', {center: [54,0], zoom: 6}); | |
| var tiles = Leaflet.tileLayer("http://{s}.tile.osm.org/{z}/{x}/{y}.png").addTo(map); | |
| var states = [ | |
| { "type": "Feature", "properties": { "NAME": "KA", "COLOUR": "B" }, "geometry": { "type": "Polygon", "coordinates": [ [ [ -4.609751569785551, 55.134814258852373 ], [ -4.619158033912728, 55.118950394741482 ], [ -4.646656921518789, 55.111650098550562 ], [ -4.662610956454994, 55.077677129473237 ], [ -4.631616136087584, 55.058173954859406 ], [ -4.631011485053943, 55.057150768873129 ], [ -4.640944392622358, 55.050410454945265 ], [ -4.687310485571057, 55.041480133219103 ], [ -4.688618059767485, 55.040356303075868 ], [ -4.759484244330364, 55.026615954148483 ], [ -4.76525010 |
gbraccialli
/ knox_test.sh
Created
October 11, 2016 16:51
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| curl -ik -u guest:guest-password https://localhost:8443/gateway/default/webhdfs/v1/?op=LISTSTATUS | |
| jdbc:hive2://localhost:8443/;transportMode=http;httpPath=gateway/default/hive;ssl=true;sslTrustStore=/tmp/knox.jks;trustStorePassword=knox1234 |
gbraccialli
/ sssd.sh
Last active
November 4, 2016 18:34
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| sudo yum -y --enablerepo=extras install epel-release | |
| sudo yum install -y -q curl sssd oddjob-mkhomedir authconfig sssd-krb5 sssd-ad sssd-tools | |
| sudo yum install -y -q adcli | |
| sudo yum install -y -q ntp ntpdate openssl openssh-clients | |
| sudo yum install -y -q openldap-clients | |
| sudo yum install -y -q krb5-workstation | |
| sudo tee /etc/krb5.conf > /dev/null <<EOF | |
| [libdefaults] | |
| renew_lifetime = 7d |
gbraccialli
/ xml_structure_count.py
Last active
November 11, 2016 11:18
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import xml.etree.ElementTree as xml, sys | |
| file = sys.argv[1] | |
| tree = xml.parse(file) | |
| #from lxml import etree | |
| #import sys | |
| #parser = etree.XMLParser(recover=True) | |
| #tree = etree.parse(file,parser=parser) |
gbraccialli
/ jira_rest_api
Created
December 7, 2016 11:17
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| https://xxxxx.atlassian.net/rest/api/2/search?jql=project=JL02&fields=worklog |
gbraccialli
/ hive_bloom_filter.sql
Last active
December 7, 2016 23:24
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ... | |
| STORED AS ORC | |
| TBLPROPERTIES | |
| ( | |
| 'orc.create.index'='true', | |
| 'orc.bloom.filter.columns'='field1,field2' | |
| ); | |