Skip to content

Instantly share code, notes, and snippets.

@EmmanuelDemey
Last active January 31, 2020 21:45
Show Gist options
  • Save EmmanuelDemey/68c79fc401b474a936df4c07a6244b22 to your computer and use it in GitHub Desktop.
Save EmmanuelDemey/68c79fc401b474a936df4c07a6244b22 to your computer and use it in GitHub Desktop.

🎉 Elastic Weekly #5 🎉

Elasticsearch

This Week in Elasticsearch and Apache Lucene - 2020-01-25

  • Index Lifecycle Management
  • Snapshot resilience and BWC
  • TLS and Authentication Examples for the High Level Rest Client

https://www.elastic.co/fr/blog/this-week-in-elasticsearch-and-apache-lucene-2020-01-25

Using Curator to manage Elasticsearch cluster storage

Lately I have been testing and implementing Elastic’s Curator tool to manage storage space in an Elastic cluster. Curator is an awesome tool to automate the tedious task of manually managing old indices in Elasticsearch.

https://medium.com/@k3nd0r.cyber/using-curator-to-manage-elasticsearch-cluster-storage-d9e2c8eade58

Big Microsoft data breach – 250 million records exposed

Microsoft has today announced a data breach that affected one of its customer databases.

The blog article, entitled Access Misconfiguration for Customer Support Databases, admits that between 05 December 2019 and 31 December 2019, a database used for “support case analytics” was effectively visible from the cloud to the world.

https://nakedsecurity.sophos.com/2020/01/22/big-microsoft-data-breach-250-million-records-exposed/

Getting AWS logs from S3 using Filebeat and the Elastic Stack

Logs from a variety of different AWS services can be stored in S3 buckets, like S3 server access logs, ELB access logs, CloudWatch logs, and VPC flow logs. S3 server access logs, for example, provide detailed records for the requests that are made to a bucket. This is very useful information, but unfortunately, AWS creates multiple .txt files for multiple operations, making it difficult to see exactly what operations are recorded in the log files without opening every single .txt file separately. Additionally, S3 server access logs are recorded in a complex format, making it very hard for users to just open the .txt file and find the information they need.

https://www.elastic.co/fr/blog/getting-aws-logs-from-s3-using-filebeat-and-the-elastic-stack?blade=tw&hulk=social

Using the Elastic APM Java Agent on Kubernetes

Elasticsearch and the rest of the Elastic Stack are commonly used for log and metric aggregation in various environments, including Kubernetes. In addition, the Elastic Stack is frequently being used for uptime tracking, with Heartbeat, as well as Application Performance Monitoring (APM), with agents supporting common programming languages, including Java.

https://www.elastic.co/fr/blog/using-elastic-apm-java-agent-on-kubernetes-k8s?blade=tw&hulk=social

Elasticsearch 7.x Cheatsheet

All the API endpoints and pro-tips you always forgot about in one place! Built by developers for developers. Hosted on GitHub, contributions welcome.

https://elasticsearch-cheatsheet.jolicode.com/

Live Kubernetes Debugging with the Elastic Stack

Your Kubernetes app is down. Your users start ranting on Twitter. Your boss is standing right behind you. What do you do?

This talk walks you through a live debugging session without panicking:

  • Where does your monitoring point you?
  • Is there anything helpful in the logs?
  • Can you get more details from your application’s traces?
  • What do your health checks say?
  • What the heck is even deployed?

We are using the Elastic Stack in this demo with a special focus on its Kubernetes integration with metadata enrichment and autodiscovery in combination with APM / tracing, metrics, logs, and health checks.

https://xeraa.net/talks/live-kubernetes-debugging-elastic-stack/

Automate all the things: Terraform + Ansible + Elastic Cloud Enterprise

A sequel to our first post, Automating the installation of Elastic Cloud Enterprise with Ansible, this blog shows how to extend automation to cloud provisioning with Terraform. In the first post, we detailed how to deploy and configure Elastic Cloud Enterprise (ECE) across three availability zones in AWS using Ansible. However, the provisioning of the underlying EC2 instances and configuration of the security groups was all manual.

https://www.elastic.co/fr/blog/automate-all-the-things-terraform-ansible-elastic-cloud-enterprise-ece?blade=tw&hulk=social

Twitter

@k3nd0r @xeraa

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment