ElasticSearch, Logstash & Kibana for Jenkins Logs

jenkins-elkstack.md

Jenkins Logs in ElasticSearch

• http://lifuzu.com/blog/2016/03/21/feeding-build-logs-into-elasticsearch-with-logstash-on-jenkins/

• Docker image for Jenkins: https://hub.docker.com/_/jenkins/

  docker run -p 8080:8080 -p 50000:50000 jenkins

  Check for Jenkins on http://localhost:8080

  After setting up Jenkins with the install tool, you have to delete the Jenkins cookies, see https://issues.jenkins-ci.org/browse/JENKINS-12875

  For the problem concerning Problem accessing /configureTools/descriptorByName/LogstashInstallation/checkHost. Reason: Not Found see https://issues.jenkins-ci.org/browse/JENKINS-36227

• ELK Docker image: https://elk-docker.readthedocs.io/

  docker pull sebp/elk docker run -p 5601:5601 -p 9200:9200 -p 9300:9300 -p 5044:5044 -it --name elk sebp/elk

  Check Kibana Frontend at http://localhost:5601/

• Install logstash plugin

• In "Manage Jenkins" go to "Global Tool Configuration " --> "Logstash Plugin"

  • As Indexer Type, chose "ELASTICSEARCH"

  • As hostname, use the IP of the Docker Host (http://172.17.0.1 - find it out with docker exec gocd_agent /sbin/ip route|awk '/default/ { print $3}')

  As port, use 9200 (the ElasticSearch REST port)

try with URI as https://<elasticsearch_Host>:<elasticsearch_port>/logstash/jenkins

I was having the same error as above. I tried using https://<elasticsearch_Host>:<elasticsearch_port>/logstash/jenkins and now I get this error:

java.io.IOException: CreateProcess error=2, The system cannot find the file specified
at java.lang.ProcessImpl.create(Native Method)
at java.lang.ProcessImpl.(ProcessImpl.java:386)
at java.lang.ProcessImpl.start(ProcessImpl.java:137)
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029)
Also: hudson.remoting.Channel$CallSiteStackTrace: Remote call to J

Just to close this thread, posting the solution,

You need to add /my_index/my_doc to the url like below

http://x.x.x.x:9200/my_index/my_doc

/my_index/my_doc is created on the first POST and you can find that in Kabana to create an index/dashboard

You can replace /my_index/my_doc with your own index/type.

/my_index/my_doc is "index" and "type"

Getting connection refused from jenkins -> elasticsearch. Any idea why?

Because I know people are still out there experiencing this--the problems is likely that your elasticsearch process probably is only listening for incoming requests targeting localhost. Check out the network settings in elasticsearch.yml. You probably need to bind using a different network.host

Hi, I am facing one issue in Kibana:
All the logs are coming to ElasticSearch. However, the index field names containing dots are getting empty values in Kibana.

Please help me. What should I do now?
@Indigenuity @pradeeps please help me.

@NaincyKumariKnoldus the image is not visible