Skip to content

Instantly share code, notes, and snippets.

View agibsonccc's full-sized avatar

Adam Gibson agibsonccc

View GitHub Profile
/usr/java/jdk1.8.0_73/bin/java -Didea.launcher.port=7534 -Didea.launcher.bin.path=/home/agibsonccc/ides/idea-IU-143.2287.1/bin -Dfile.encoding=UTF-8 -classpath /usr/java/jdk1.8.0_73/jre/lib/charsets.jar:/usr/java/jdk1.8.0_73/jre/lib/deploy.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/cldrdata.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/dnsns.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/jaccess.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/jfxrt.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/localedata.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/nashorn.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/sunec.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/sunjce_provider.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/sunpkcs11.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/zipfs.jar:/usr/java/jdk1.8.0_73/jre/lib/javaws.jar:/usr/java/jdk1.8.0_73/jre/lib/jce.jar:/usr/java/jdk1.8.0_73/jre/lib/jfr.jar:/usr/java/jdk1.8.0_73/jre/lib/jfxswt.jar:/usr/java/jdk1.8.0_73/jre/lib/jsse.jar:/usr/java/jdk1.8.0_73/jre/lib/management-agent.jar:/usr/java/jdk1.8.0_73/jre/lib/plugin.jar:/usr/java/jdk1.8.0_73/jre
/usr/java/jdk1.8.0_73/bin/java -Didea.launcher.port=7534 -Didea.launcher.bin.path=/home/agibsonccc/ides/idea-IU-143.2287.1/bin -Dfile.encoding=UTF-8 -classpath /usr/java/jdk1.8.0_73/jre/lib/charsets.jar:/usr/java/jdk1.8.0_73/jre/lib/deploy.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/cldrdata.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/dnsns.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/jaccess.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/jfxrt.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/localedata.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/nashorn.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/sunec.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/sunjce_provider.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/sunpkcs11.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/zipfs.jar:/usr/java/jdk1.8.0_73/jre/lib/javaws.jar:/usr/java/jdk1.8.0_73/jre/lib/jce.jar:/usr/java/jdk1.8.0_73/jre/lib/jfr.jar:/usr/java/jdk1.8.0_73/jre/lib/jfxswt.jar:/usr/java/jdk1.8.0_73/jre/lib/jsse.jar:/usr/java/jdk1.8.0_73/jre/lib/management-agent.jar:/usr/java/jdk1.8.0_73/jre/lib/plugin.jar:/usr/java/jdk1.8.0_73/jre
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x00007fdd3c52a2b8, pid=22220, tid=140586182133504
#
# JRE version: Java(TM) SE Runtime Environment (8.0_66-b17) (build 1.8.0_66-b17)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.66-b17 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# C [libnd4j.so+0x5c2b8] shape::tadOffset(int, int*, int*, int)+0x38
#
@agibsonccc
agibsonccc / pynb
Created March 2, 2016 17:47
Recco
{"metadata":{"name":"Deepwalk Recommender","user_save_timestamp":"1969-12-31T19:00:00.000Z","auto_save_timestamp":"1969-12-31T19:00:00.000Z","language_info":{"name":"scala","file_extension":"scala","codemirror_mode":"text/x-scala"},"trusted":true,"customLocalRepo":null,"customRepos":null,"customDeps":null,"customImports":null,"customArgs":null,"customSparkConf":null},"cells":[{"metadata":{},"cell_type":"markdown","source":"## Deepwalk Recommender - Test Notebook"},{"metadata":{},"cell_type":"markdown","source":"Michael Ulin, Marvin Bertin, David Ott"},{"metadata":{},"cell_type":"markdown","source":"Requirements:\n- Java 8\n- DL4J Deepwalk Jar\n- OpenBLAS or MKL"},{"metadata":{},"cell_type":"markdown","source":"#### Import Dependencies and add dl4j jar"},{"metadata":{"trusted":true,"input_collapsed":false,"collapsed":false},"cell_type":"code","source":":cp\nfile:/mnt/temp/dl4j_deepwalk-3.0.jar","outputs":[{"name":"stdout","output_type":"stream","text":"warning: there were 4 feature warning(s); re-run with -fea
INFO] --- maven-javadoc-plugin:2.10.1:jar (attach-javadocs) @ nd4j-native ---
^C^C^C[agibsonccc@localhost nd4j-native-parent]$ mvn -X -e clean install -DskipTests
Apache Maven 3.2.3 (33f8c3e1027c3ddde99d3cdebad2656a31e8fdf4; 2014-08-11T13:58:10-07:00)
Maven home: /opt/mvn
Java version: 1.8.0_31, vendor: Oracle Corporation
Java home: /usr/java/jdk1.8.0_31/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "4.1.13-100.fc21.x86_64", arch: "amd64", family: "unix"
[INFO] Error stacktraces are turned on.
[DEBUG] Reading global settings from /opt/mvn/conf/settings.xml
[agibsonccc@localhost nd4j]$ cd ..
[agibsonccc@localhost code]$ rm -rf dl4j-0.4-examples/
git clone ht[agibsonccc@localhost code]$ git clone [email protected]:deeplearning4j/dl4j-0.4-examples.git
Cloning into 'dl4j-0.4-examples'...
remote: Counting objects: 2300, done.
remote: Compressing objects: 100% (88/88), done.
remote: Total 2300 (delta 21), reused 0 (delta 0), pack-reused 2187
Receiving objects: 100% (2300/2300), 2.04 MiB | 3.55 MiB/s, done.
Resolving deltas: 100% (790/790), done.
Checking connectivity... done.
/*
============================================================================
Name : reduceepxeriments.cu
Author : Adam Gibson
Version :
Copyright : Your copyright notice
Description : CUDA compute reciprocals
============================================================================
*/
// Your sbt build file. Guides on how to write one can be found at
// http://www.scala-sbt.org/0.13/docs/index.html
name := "dl4j-spark-ml"
organization := "deeplearning4j"
version := "0.4-rc4.2-SNAPSHOT"
// Scala
scalaVersion := "2.10.4"
crossPaths := false // suppress the scala version number suffix on artifacts
<!--
~ Copyright 2015 Skymind,Inc.
~
~ Licensed under the Apache License, Version 2.0 (the "License");
~ you may not use this file except in compliance with the License.
~ You may obtain a copy of the License at
~
~ http://www.apache.org/licenses/LICENSE-2.0
~
~ Unless required by applicable law or agreed to in writing, software
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
<modelVersion>4.0.0</modelVersion>
<groupId>org.deeplearning4j</groupId>
<artifactId>dl4j-spark-ml-examples</artifactId>
<version>1.0-SNAPSHOT</version>
<packaging>jar</packaging>
<name>spark-ml-examples</name>