djptek’s gists

djptek / ENG II QS 21-N

Last active November 21, 2018 11:48

Temas a mirar. • Eng1 ejemplo de author.company • Ver si es mas eficiente null values para aggs o no afecta. • Ver si en los metadatos de los mappings se pueden definir objetos, mappings. • Queries con range complejas, con intervalos variables.


	#########
	# 2018-11-21
	#
	########
	# Ver si en los metadatos de los mappings se pueden definir objetos, mappings.

	PUT test_object_in_meta/_doc/1
	{
	"_meta": {

djptek / Nested Addresses - Do not need nested type

Last active November 14, 2018 12:42

Nested Addresses - Do not need nested type

	# Example: for example i have a person with nested- adresses. and query name of person with city and zip of the adress in one query?

	PUT clients/_doc/1
	{
	"client": "dp",
	"address": {
	"city": "north",
	"zip": "1234"
	}
	}

djptek / single_shard_template.txt

Created November 13, 2018 08:12

Template to set number of shards to 1

	# start with a clean install
	DELETE test_index
	DELETE _template/my_global_template

	#create an index
	PUT test_index
	GET test_index/_settings

	# if ES < 7.0 this will have 5 primary shards

djptek / looking into TERMS aggs vs index false

Created November 7, 2018 12:04

looking into TERMS aggs vs index false

	# looking into TERMS aggs vs index false
	# start clean
	DELETE test

	# define an index with two fields, with index
	# set to true & false
	PUT test
	{
	"mappings": {
	"_doc": {

djptek / 181840_v2.txt

Created October 24, 2018 11:12

Query Elasticsearch with curl, parse to NDJSON and then ingest via Logstash

	##### Simulate scenario by indexing some example docs to local Elasticsearch

	POST index-2018-08-09/logs_2
	{
	"datetime_log": "2018-08-09T00:34:36.051+02:00",
	"datetime_receive": "2018-08-09T00:34:36.051+02:00",
	"group": "DEFAUT",
	"ip_host": "22.33.44.55",
	"ip_host_pkt": "22.33.44.55",
	"source_msg": "22.33.44.55: -Trashback= XXXXXXXXX XXXXXXXXXX XXXXXXXXX 8002DAD8 YYYYYYYY ZZZZZZZZZ UUUUUUUU IIIIIIIIII",

djptek / 181840.txt

Last active October 23, 2018 12:54

Painless Pipeline example to remove and rename fields

	# Add a test document to the index

	PUT index-2018-08-09/logs_2/AWUbrXRdjZ-987654akh
	{
	"datetime_log": "2018-08-09T00:34:36.051+02:00",
	"datetime_receive": "2018-08-09T00:34:36.051+02:00",
	"group": "DEFAUT",
	"ip_host": "22.33.44.55",
	"ip_host_pkt": "22.33.44.55",
	"source_msg": "22.33.44.55: -Trashback= XXXXXXXXX XXXXXXXXXX XXXXXXXXX 8002DAD8 YYYYYYYY ZZZZZZZZZ UUUUUUUU IIIIIIIIII",

djptek / translog.txt

Created October 3, 2018 13:14

translog size

	# translog size
	http://0.0.0.0:9200/_all/_stats?filter_path=_all.primaries.translog

djptek / es_settings.txt

Created October 3, 2018 13:13

Elasticsearch default settings

	# cluster settings
	http://0.0.0.0:9200/_cluster/settings?pretty=true&include_defaults=true

	# index settings
	http://0.0.0.0:9200/_all/_settings

	# nodes settings
	http://0.0.0.0:9200/_nodes/_all?pretty=true

	# nodes os

djptek / _reindex_merge.txt

Created October 3, 2018 13:07

_reindex merge using wildcard

	DELETE my_*

	PUT _template/template_1
	{
	"index_patterns": ["*"],
	"order": 1,
	"settings": {
	"number_of_shards": 1,
	"number_of_replicas": 0
	}

djptek / dutch_stemmers.txt

Created October 3, 2018 13:06

Comparing Dutch Stemmers

	# take a look at the difference between these 2 examples, you can cut and paste them into Kibana
	# Standard Dutch
	POST _analyze
	{
	"tokenizer": "standard",
	"filter": [
	"standard",
	"lowercase",
	{
	"type": "stemmer",

Dominic Page djptek