.. toctree:: :caption: Table of Contents :name: mastertoc :maxdepth: 2
Components
| -Dcom.sun.management.jmxremote | |
| -Dcom.sun.management.jmxremote.port=8086 | |
| -Dcom.sun.management.jmxremote.ssl=false | |
| -Dcom.sun.management.jmxremote.authenticate=false |
| // imports a couple of java tasks | |
| apply plugin: "java" | |
| // List available tasks in the shell | |
| > gradle tasks | |
| // A Closure that configures the sourceSets Task | |
| // Sets the main folder as Source folder (where the compiler is looking up the .java files) | |
| sourceSets { | |
| main.java.srcDir "src/main" |
| Producer | |
| Setup | |
| bin/kafka-topics.sh --zookeeper esv4-hcl197.grid.linkedin.com:2181 --create --topic test-rep-one --partitions 6 --replication-factor 1 | |
| bin/kafka-topics.sh --zookeeper esv4-hcl197.grid.linkedin.com:2181 --create --topic test --partitions 6 --replication-factor 3 | |
| Single thread, no replication | |
| bin/kafka-run-class.sh org.apache.kafka.clients.tools.ProducerPerformance test7 50000000 100 -1 acks=1 bootstrap.servers=esv4-hcl198.grid.linkedin.com:9092 buffer.memory=67108864 batch.size=8196 |
| from __future__ import division | |
| import string | |
| import math | |
| tokenize = lambda doc: doc.lower().split(" ") | |
| document_0 = "China has a strong economy that is growing at a rapid pace. However politically it differs greatly from the US Economy." | |
| document_1 = "At last, China seems serious about confronting an endemic problem: domestic violence and corruption." | |
| document_2 = "Japan's prime minister, Shinzo Abe, is working towards healing the economic turmoil in his own country for his view on the future of his people." | |
| document_3 = "Vladimir Putin is working hard to fix the economy in Russia as the Ruble has tumbled." |
| data = o.to_mongo() | |
| o_id = data.pop('_id', None) | |
| if o_id: | |
| data['id'] = str(o_id) | |
| data.pop('_cls', None) | |
| return data |
| curl -XPOST http://localhost:9200/test/articles/1 -d '{ | |
| "content": "The quick brown fox" | |
| }' | |
| curl -XPOST http://localhost:9200/test/articles/2 -d '{ | |
| "content": "What does the fox say?" | |
| }' | |
| curl -XPOST http://localhost:9200/test/articles/3 -d '{ | |
| "content": "The quick brown fox jumped over the lazy dog" | |
| }' | |
| curl -XPOST http://localhost:9200/test/articles/4 -d '{ |
Kafka 0.11.0.0 (Confluent 3.3.0) added support to manipulate offsets for a consumer group via cli kafka-consumer-groups command.
kafka-consumer-groups --bootstrap-server <kafkahost:port> --group <group_id> --describeNote the values under "CURRENT-OFFSET" and "LOG-END-OFFSET". "CURRENT-OFFSET" is the offset where this consumer group is currently at in each of the partitions.
| ## installation openldap with backend mysql | |
| sudo apt update && sudo apt upgrade -y && sudo reboot | |
| sudo apt install mysql-server unixodbc make gcc libmysqlclient-dev unixodbc-dev groff ldap-utils | |
| ## mysql login as root | |
| sudo mysql -u root | |
| CREATE DATABASE ldap | |
| CREATE USER 'ldap'@'%' IDENTIFIED BY 'S3cureP4ssw0rd$'; | |
| GRANT ALL PRIVILEGES ON ldap.* TO 'ldap'@'%'; |