rohanar
rohanar
/ ParagraphVectorLearningTest2.java
Created
February 18, 2016 11:47
ParagraphVectors test for stopwords usage
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package org.deeplearning4j.examples.paragraphvectors; | |
| import java.io.IOException; | |
| import java.util.ArrayList; | |
| import java.util.Collection; | |
| import java.util.HashMap; | |
| import java.util.List; | |
| import java.util.Map; | |
| import org.apache.commons.lang.time.StopWatch; |
rohanar
/ SolrDocLabelAwareIterator2.java
Created
February 9, 2016 10:54
LabelAwareIterator for ParagraphVector Learning Test code
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package org.synthesis.java.extension; | |
| import java.util.ArrayList; | |
| import java.util.Iterator; | |
| import java.util.List; | |
| import java.util.Map; | |
| import lombok.NonNull; | |
| import org.deeplearning4j.text.documentiterator.LabelAwareIterator; |
rohanar
/ ParagraphVectorLearningTest.java
Created
February 9, 2016 10:52
ParagraphVectors learning Test code
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package org.deeplearning4j.examples.paragraphvectors; | |
| import java.io.IOException; | |
| import java.util.HashMap; | |
| import java.util.Map; | |
| import org.apache.commons.lang.time.StopWatch; | |
| import org.deeplearning4j.models.embeddings.loader.WordVectorSerializer; | |
| import org.deeplearning4j.models.paragraphvectors.ParagraphVectors; | |
| import org.deeplearning4j.models.word2vec.wordstore.inmemory.InMemoryLookupCache; |
rohanar
/ ParagraphVectorsClassifierExample.java
Created
February 8, 2016 11:01
ParahraphVectors deserializing issue
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package org.deeplearning4j.examples.paragraphvectors; | |
| import org.canova.api.util.ClassPathResource; | |
| import org.deeplearning4j.berkeley.Pair; | |
| import org.deeplearning4j.clustering.kmeans.KMeansClustering; | |
| import org.deeplearning4j.examples.paragraphvectors.tools.FileLabelAwareIterator; | |
| import org.deeplearning4j.examples.paragraphvectors.tools.LabelSeeker; | |
| import org.deeplearning4j.examples.paragraphvectors.tools.MeansBuilder; | |
| import org.deeplearning4j.models.embeddings.inmemory.InMemoryLookupTable; | |
| import org.deeplearning4j.models.embeddings.learning.impl.elements.SkipGram; |
rohanar
/ ParagraphVectorSerializer.java
Created
February 5, 2016 15:59
A modified WordVectorSerializer (of AlexBlack's) for serializing ParagraphVectors
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package org.synthesis.java.extension; | |
| import com.fasterxml.jackson.databind.DeserializationFeature; | |
| import com.fasterxml.jackson.databind.MapperFeature; | |
| import com.fasterxml.jackson.databind.ObjectMapper; | |
| import com.fasterxml.jackson.databind.SerializationFeature; | |
| import lombok.NonNull; | |
| import org.apache.commons.compress.compressors.gzip.GzipUtils; | |
| import org.apache.commons.io.IOUtils; | |
| import org.apache.commons.io.LineIterator; | |
| import org.deeplearning4j.berkeley.Pair; |
rohanar
/ ParagraphVectorsTextKMeansExample.java
Last active
April 17, 2020 14:21
KMeansClustering Example
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package org.deeplearning4j.examples.paragraphvectors; | |
| import org.apache.commons.lang.time.StopWatch; | |
| import org.deeplearning4j.clustering.cluster.Cluster; | |
| import org.deeplearning4j.clustering.cluster.ClusterSet; | |
| import org.deeplearning4j.clustering.cluster.Point; | |
| import org.deeplearning4j.clustering.cluster.PointClassification; | |
| import org.deeplearning4j.clustering.kmeans.KMeansClustering; | |
| import org.deeplearning4j.models.embeddings.loader.WordVectorSerializer; | |
| import org.deeplearning4j.models.paragraphvectors.ParagraphVectors; |
rohanar
/ ParagraphVectorsClassifierExample.java
Created
January 29, 2016 15:32
ParagraphVectorSerialiser
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package org.deeplearning4j.examples.paragraphvectors; | |
| import org.canova.api.util.ClassPathResource; | |
| import org.deeplearning4j.berkeley.Pair; | |
| import org.deeplearning4j.clustering.kmeans.KMeansClustering; | |
| import org.deeplearning4j.examples.paragraphvectors.tools.FileLabelAwareIterator; | |
| import org.deeplearning4j.examples.paragraphvectors.tools.LabelSeeker; | |
| import org.deeplearning4j.examples.paragraphvectors.tools.MeansBuilder; | |
| import org.deeplearning4j.models.embeddings.inmemory.InMemoryLookupTable; | |
| import org.deeplearning4j.models.embeddings.learning.impl.elements.SkipGram; |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Can you please tell me what maven dependencies you need. I have trying the following: | |
| 1. mahout-mr-0.10.0 | |
| 2.spark-core-2.11-1.3.0 | |
| 3.mahout-spark-2.10-0.10.0 | |
| 4.mahout-math-0.10.0 | |
| still there are missing classes.... |