Skip to content

Instantly share code, notes, and snippets.

@ChromoX
Last active November 17, 2016 06:28
Show Gist options
  • Save ChromoX/76974f6c3b6dd964b61905c0f317ad44 to your computer and use it in GitHub Desktop.
Save ChromoX/76974f6c3b6dd964b61905c0f317ad44 to your computer and use it in GitHub Desktop.
{:onyx/name :read-ticker-messages
:onyx/plugin :onyx.plugin.kafka/read-messages
:onyx/type :input
:onyx/medium :kafka
:kafka/topic "tick"
:kafka/group-id "onyx-consumer"
:kafka/receive-buffer-bytes 65536
:kafka/zookeeper "127.0.0.1:2181"
:kafka/offset-reset :earliest
:kafka/force-reset? true
:kafka/commit-interval 500
:kafka/deserializer-fn :onyx.tasks.kafka/deserialize-message-json
:kafka/wrap-with-metadata? false
;; :kafka/start-offsets {p1 offset1, p2, offset2}
:onyx/min-peers 1
:onyx/max-peers 1
:onyx/batch-size batch-size
:onyx/batch-timeout batch-timeout
:onyx/doc "Reads Tick Messages from Kafka"}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment