pavan538 / how_to_reset_kafka_consumer_group_offset.md

Created January 11, 2019 09:20 — forked from marwei/how_to_reset_kafka_consumer_group_offset.md

How to Reset Kafka Consumer Group Offset

Kafka 0.11.0.0 (Confluent 3.3.0) added support to manipulate offsets for a consumer group via cli kafka-consumer-groups command.

List the topics to which the group is subscribed

kafka-consumer-groups --bootstrap-server <kafkahost:port> --group <group_id> --describe

Note the values under "CURRENT-OFFSET" and "LOG-END-OFFSET". "CURRENT-OFFSET" is the offset where this consumer group is currently at in each of the partitions.

Reset the consumer offset for a topic (preview)

pavan538 / create_index.sh

Created January 9, 2019 13:20 — forked from bonzanini/create_index.sh

Elasticsearch/Python test

	curl -XPOST http://localhost:9200/test/articles/1 -d '{
	"content": "The quick brown fox"
	}'
	curl -XPOST http://localhost:9200/test/articles/2 -d '{
	"content": "What does the fox say?"
	}'
	curl -XPOST http://localhost:9200/test/articles/3 -d '{
	"content": "The quick brown fox jumped over the lazy dog"
	}'
	curl -XPOST http://localhost:9200/test/articles/4 -d '{

pavan538 / metatags.html

Created December 26, 2018 13:18 — forked from MicBrain/metatags.html

The list of useful meta tags used in HTML5 documents.

	<html>
	<head>

	<!--Recommended Meta Tags-->
	<meta charset="utf-8">
	<meta name="language" content="english">
	<meta http-equiv="content-type" content="text/html">
	<meta name="author" content=”Rafayel Mkrtchyan”>
	<meta name="designer" content=”Rafayel Mkrtchyan”>
	<meta name="publisher" content=”Rafayel Mkrtchyan”>

pavan538 / somegist.py

Created December 16, 2018 13:31 — forked from dhesson/somegist.py

Code fragment for a MongoEngine query result item to serializable JSON dictionary.

	data = o.to_mongo()
	o_id = data.pop('_id', None)
	if o_id:
	data['id'] = str(o_id)
	data.pop('_cls', None)
	return data

pavan538 / tfpdf.py

Created October 19, 2018 16:21 — forked from bllchmbrs/tfpdf.py

TF IDF Explained in Python Along with Scikit-Learn Implementation

	from __future__ import division
	import string
	import math

	tokenize = lambda doc: doc.lower().split(" ")

	document_0 = "China has a strong economy that is growing at a rapid pace. However politically it differs greatly from the US Economy."
	document_1 = "At last, China seems serious about confronting an endemic problem: domestic violence and corruption."
	document_2 = "Japan's prime minister, Shinzo Abe, is working towards healing the economic turmoil in his own country for his view on the future of his people."
	document_3 = "Vladimir Putin is working hard to fix the economy in Russia as the Ruble has tumbled."

pavan538 / benchmark-commands.txt

Created September 6, 2018 09:44 — forked from jkreps/benchmark-commands.txt

Kafka Benchmark Commands

	Producer

	Setup
	bin/kafka-topics.sh --zookeeper esv4-hcl197.grid.linkedin.com:2181 --create --topic test-rep-one --partitions 6 --replication-factor 1
	bin/kafka-topics.sh --zookeeper esv4-hcl197.grid.linkedin.com:2181 --create --topic test --partitions 6 --replication-factor 3

	Single thread, no replication

	bin/kafka-run-class.sh org.apache.kafka.clients.tools.ProducerPerformance test7 50000000 100 -1 acks=1 bootstrap.servers=esv4-hcl198.grid.linkedin.com:9092 buffer.memory=67108864 batch.size=8196

pavan538 / contents.rst

Created July 6, 2018 10:24 — forked from amitsingh-n/contents.rst

	// imports a couple of java tasks
	apply plugin: "java"

	// List available tasks in the shell
	> gradle tasks

	// A Closure that configures the sourceSets Task
	// Sets the main folder as Source folder (where the compiler is looking up the .java files)
	sourceSets {
	main.java.srcDir "src/main"

	-Dcom.sun.management.jmxremote
	-Dcom.sun.management.jmxremote.port=8086
	-Dcom.sun.management.jmxremote.ssl=false
	-Dcom.sun.management.jmxremote.authenticate=false

Pavan Kumar pavan538

Contents