Class: org.apache.flink.types.LongValue
- copyNormalizedKey()
- getValue()
- copyTo()
Robert Metzger rmetzger
rmetzger
/ gist:bcb57a01aa15d9a64cc3
Created
August 30, 2015 12:17
Run Apache Flink on a Kerberos secured YARN cluster on CDH 5.3.0
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [cloudera@quickstart build-target]$ klist | |
| Ticket cache: FILE:/tmp/krb5cc_501 | |
| Default principal: hdfs@CLOUDERA | |
| Valid starting Expires Service principal | |
| 08/30/15 05:15:22 08/31/15 05:15:22 krbtgt/CLOUDERA@CLOUDERA | |
| renew until 09/06/15 05:15:22 | |
| [cloudera@quickstart build-target]$ export HADOOP_CONF_DIR=/usr/lib/hadoop/etc/hadoop/ | |
| [cloudera@quickstart build-target]$ ./bin/yarn-session.sh -n 1 | |
| 05:15:37,483 INFO org.apache.hadoop.yarn.client.RMProxy - Connecting to ResourceManager at quickstart.cloudera/127.0.0.1:8032 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/sh | |
| for file in `find . | grep "\.jar" `; do | |
| echo "file $file" | |
| COUNT=`jar tf $file | grep '^com/google/common' | wc -l` | |
| if [ $COUNT != "0" ]; then | |
| echo "FOUND IN FILE $file" | |
| fi | |
| done |
rmetzger
/ keybase.md
Created
May 9, 2018 10:08
I hereby claim:
- I am rmetzger on github.
- I am rmetzger (https://keybase.io/rmetzger) on keybase.
- I have a public key whose fingerprint is 7DAB 190F 0C67 8B62 D8C7 85BC AD3A 4CED 0F4D 0307
To claim this, I am signing this object:
rmetzger
/ gist:db6a88137047323a0d140fefbe726d79
Last active
February 20, 2019 15:20
Build Flink on Docker
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ docker run -it ubuntu /bin/bash | |
| % apt-get update | |
| % apt-get install maven openjdk-8-jdk git | |
| % git clone https://github.com/apache/flink.git | |
| % cd flink | |
| % mvn clean package -DskipTests |
rmetzger
/ gist:f394b124c822baa1bab4a611239899b9
Last active
April 18, 2019 07:37
Bootstrap Ubuntu 18.04 for building Flink (Google Cloud)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| sudo -s | |
| apt update | |
| apt install maven openjdk-8-jdk git | |
| apt remove openjdk-11-jre-headless | |
| exit | |
| git clone https://github.com/apache/flink.git | |
| cd flink | |
| export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk-amd64/ | |
| mvn clean install |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [INFO] ------------------------------------------------------------------------ | |
| [INFO] Reactor Build Order: | |
| [INFO] | |
| [INFO] force-shading [jar] | |
| [INFO] flink [pom] | |
| [INFO] flink-annotations [jar] | |
| [INFO] flink-shaded-hadoop [pom] | |
| [INFO] flink-shaded-hadoop2 [jar] | |
| [INFO] flink-shaded-hadoop2-uber [jar] | |
| [INFO] flink-shaded-yarn-tests [jar] |
rmetzger
/ gist:f145f7308c5f22dcd8a5cd98d3fc1f58
Last active
April 24, 2019 13:46
Flink d4a94581b40e96517c8049588b62585dea55d816 web dashboard notice file
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Components: | |
| @angular/animations 7.2.10 : MIT License | |
| @angular/cdk 7.3.6 : MIT License | |
| @angular/common 7.2.10 : MIT License | |
| @angular/compiler 7.2.10 : MIT License | |
| @angular/core 7.2.10 : MIT License | |
| @angular/forms 7.2.10 : MIT License | |
| @angular/platform-browser 7.2.10 : MIT License | |
| @angular/platform-browser-dynamic 7.2.10 : MIT License |
rmetzger
/ gist:7c123a6d94aa31ad19cc8f9b57b893a4
Created
April 24, 2019 15:25
Flink UI deps for d1e5eae6c71d256a40592f0082f63577a120192a
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| @angular/animations 7.2.10 : MIT License | |
| @angular/cdk 7.3.6 : MIT License | |
| @angular/common 7.2.10 : MIT License | |
| @angular/compiler 7.2.10 : MIT License | |
| @angular/core 7.2.10 : MIT License | |
| @angular/forms 7.2.10 : MIT License | |
| @angular/platform-browser 7.2.10 : MIT License | |
| @angular/platform-browser-dynamic 7.2.10 : MIT License | |
| @angular/router 7.2.10 : MIT License | |
| @ant-design/icons-angular 2.0.2 : MIT License |
rmetzger
/ gist:939662235c797bc790a59a92ed2ff9f1
Created
April 26, 2019 14:28
Flink frontend-maven-plugin
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [INFO] Installing node version v10.9.0 | |
| [INFO] Downloading https://nodejs.org/dist/v10.9.0/node-v10.9.0-linux-x64.tar.gz to /root/.m2/repository/com/github/eirslett/node/10.9.0/node-10.9.0-linux-x64.tar.gz | |
| [INFO] No proxies configured | |
| [INFO] No proxy was configured, downloading directly | |
| [INFO] Unpacking /root/.m2/repository/com/github/eirslett/node/10.9.0/node-10.9.0-linux-x64.tar.gz into /flink/flink-runtime-web/web-dashboard/node/tmp | |
| [INFO] Copying node binary from /flink/flink-runtime-web/web-dashboard/node/tmp/node-v10.9.0-linux-x64/bin/node to /flink/flink-runtime-web/web-dashboard/node/node | |
| [INFO] Extracting NPM | |
| [INFO] Installed node locally. | |
| [INFO] | |
| [INFO] --- frontend-maven-plugin:1.6:npm (npm install) @ flink-runtime-web_2.11 --- |