Hystrix is a latency and fault tolerance library designed to isolate points of access to remote systems, services and 3rd party libraries, stop cascading failure and enable resilience in complex distributed systems where failure is inevitable.
Genie is a completely open source federated job orchestration engine developed by Netflix. Genie provides REST-ful APIs to run a variety of big data jobs like Hadoop, Pig, Hive, Spark, Presto, Sqoop and more. It also provides APIs for managing the metadata of many distributed processing clusters and the commands and applications which run on them.
Conductor is an orchestration engine that runs in the cloud.
Framework to build batch, streaming and api services to deploy machine learning models using Spark and Akka compute
A simple docker client for the JVM
Docker garbage collection of containers and images
A machine learning package built for humans.
Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk
Photon Machine Learning (Photon ML) is a machine learning library based upon Apache Spark originally developed by the LinkedIn Machine Learning Algorithms team.
Superset is a data exploration platform designed to be visual, intuitive and interactive.
The Knowledge Repository project is focused on facilitating the sharing of knowledge between data scientists and other technical roles using data formats and tools that make sense in these professions. It provides various data stores (and utilities to manage them) for "knowledge posts", with a particular focus on notebooks (R Markdown and Jupyter / iPython Notebook) to better promote reproducible research.
It's designed to be flexible, scalable and efficient, while providing handy analytical abilities to help modelers / data scientists make predictions easily and quickly.
A scalable time series database based on Bigtable, Cassandra, and Elasticsearch.
Simple constant key/value storage library, for read-heavy systems with infrequent large bulk inserts.
Quiver is a Scala library that provides support for modeling multi-graphs which is a network of nodes connected by (possibly multiple) directed edges between nodes.
Knobs is a configuration library for Scala. It is based on the Data.Configurator library for Haskell, but is extended in a number of ways to make it more useful. (e.g. Zookeeper config loading)