Skip to content

Instantly share code, notes, and snippets.

@harshityadav95
Created May 31, 2018 12:53
Show Gist options
  • Save harshityadav95/70a0142bb92e03262b02ab1866c8868e to your computer and use it in GitHub Desktop.
Save harshityadav95/70a0142bb92e03262b02ab1866c8868e to your computer and use it in GitHub Desktop.
Filebeat Error
c:\Program Files (x86)\ELK\filebeat>filebeat -e --modules=apache2 --setup -M "apache2.access.var.paths=[‪D:\EKL\examples-master\examples-master\Common Data Formats\apache_logs\apache_logs]"
2018-05-31T16:50:35.105+0530 INFO instance/beat.go:468 Home path: [c:\Program Files (x86)\ELK\filebeat] Config path: [c:\Program Files (x86)\ELK\filebeat] Data path: [c:\Program Files (x86)\ELK\filebeat\data] Logs path: [c:\Program Files (x86)\ELK\filebeat\logs]
2018-05-31T16:50:35.106+0530 INFO instance/beat.go:475 Beat UUID: 4f256bbb-e649-4518-a5ae-63f0e7b349c3
2018-05-31T16:50:35.106+0530 INFO instance/beat.go:213 Setup Beat: filebeat; Version: 6.2.4
2018-05-31T16:50:35.107+0530 INFO elasticsearch/client.go:145 Elasticsearch url: http://localhost:9200
2018-05-31T16:50:35.107+0530 INFO pipeline/module.go:76 Beat name: HarshitWin10
2018-05-31T16:50:35.110+0530 INFO beater/filebeat.go:62 Enabled modules/filesets: apache2 (access, error)
2018-05-31T16:50:35.111+0530 INFO [monitoring] log/log.go:97 Starting metrics logging every 30s
2018-05-31T16:50:35.111+0530 INFO elasticsearch/client.go:145 Elasticsearch url: http://localhost:9200
2018-05-31T16:50:35.120+0530 INFO elasticsearch/client.go:690 Connected to Elasticsearch version 6.2.4
2018-05-31T16:50:35.120+0530 INFO kibana/client.go:69 Kibana url: http://localhost:5601
2018-05-31T16:51:02.457+0530 INFO instance/beat.go:583 Kibana dashboards successfully loaded.
2018-05-31T16:51:02.457+0530 INFO elasticsearch/client.go:145 Elasticsearch url: http://localhost:9200
2018-05-31T16:51:02.459+0530 INFO elasticsearch/client.go:690 Connected to Elasticsearch version 6.2.4
2018-05-31T16:51:02.460+0530 WARN fileset/modules.go:459 Xpack Machine Learning is not enabled
2018-05-31T16:51:02.463+0530 WARN fileset/modules.go:459 Xpack Machine Learning is not enabled
2018-05-31T16:51:02.463+0530 INFO instance/beat.go:301 filebeat start running.
2018-05-31T16:51:02.464+0530 INFO registrar/registrar.go:110 Loading registrar data from c:\Program Files (x86)\ELK\filebeat\data\registry
2018-05-31T16:51:02.464+0530 INFO registrar/registrar.go:121 States Loaded from registrar: 0
2018-05-31T16:51:02.464+0530 INFO crawler/crawler.go:48 Loading Prospectors: 3
2018-05-31T16:51:02.465+0530 INFO log/prospector.go:111 Configured paths: [c:\Program Files (x86)\ELK\filebeat\‪D:\EKL\examples-master\examples-master\Common Data Formats\apache_logs\apache_logs]
2018-05-31T16:51:02.465+0530 INFO log/prospector.go:111 Configured paths: [C:\tools\Apache\httpd-2.*\Apache24\logs\error.log* C:\Program Files\Apache Software Foundation\Apache2.*\logs\error.log*]
2018-05-31T16:51:02.469+0530 INFO log/prospector.go:111 Configured paths: [C:\tools\Apache\httpd-2.*\Apache24\logs\access.log* C:\Program Files\Apache Software Foundation\Apache2.*\logs\access.log*]
2018-05-31T16:51:02.469+0530 INFO log/prospector.go:111 Configured paths: [C:\tools\Apache\httpd-2.*\Apache24\logs\error.log* C:\Program Files\Apache Software Foundation\Apache2.*\logs\error.log*]
2018-05-31T16:51:02.470+0530 INFO crawler/crawler.go:82 Loading and starting Prospectors completed. Enabled prospectors: 2
2018-05-31T16:51:02.470+0530 INFO cfgfile/reload.go:127 Config reloader started
2018-05-31T16:51:02.472+0530 INFO log/prospector.go:111 Configured paths: [C:\tools\Apache\httpd-2.*\Apache24\logs\access.log* C:\Program Files\Apache Software Foundation\Apache2.*\logs\access.log*]
2018-05-31T16:51:02.473+0530 INFO log/prospector.go:111 Configured paths: [C:\tools\Apache\httpd-2.*\Apache24\logs\error.log* C:\Program Files\Apache Software Foundation\Apache2.*\logs\error.log*]
2018-05-31T16:51:02.473+0530 INFO cfgfile/reload.go:258 Starting 1 runners ...
2018-05-31T16:51:02.473+0530 INFO elasticsearch/client.go:145 Elasticsearch url: http://localhost:9200
2018-05-31T16:51:02.476+0530 INFO elasticsearch/client.go:690 Connected to Elasticsearch version 6.2.4
2018-05-31T16:51:02.494+0530 ERROR fileset/factory.go:93 Error loading pipeline: Error loading pipeline for fileset apache2/access: This module requires the following Elasticsearch plugins: ingest-user-agent, ingest-geoip. You can install them by running the following commands on all the Elasticsearch nodes:
sudo bin/elasticsearch-plugin install ingest-user-agent
sudo bin/elasticsearch-plugin install ingest-geoip
2018-05-31T16:51:02.494+0530 INFO cfgfile/reload.go:219 Loading of config files completed.
2018-05-31T16:51:05.279+0530 INFO [monitoring] log/log.go:124 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":109,"time":109},"total":{"ticks":218,"time":218,"value":218},"user":{"ticks":109,"time":109}},"info":{"ephemeral_id":"46791b8c-f15c-437c-b98f-f9c5754e4d51","uptime":{"ms":30048}},"memstats":{"gc_next":4194304,"memory_alloc":2292000,"memory_total":10668496,"rss":20762624}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":1,"starts":1},"reloads":1},"output":{"type":"elasticsearch"},"pipeline":{"clients":6,"events":{"active":0}}},"registrar":{"states":{"current":0}},"system":{"cpu":{"cores":4}}}}}
2018-05-31T16:51:35.113+0530 INFO [monitoring] log/log.go:124 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":109,"time":109},"total":{"ticks":218,"time":218,"value":218},"user":{"ticks":109,"time":109}},"info":{"ephemeral_id":"46791b8c-f15c-437c-b98f-f9c5754e4d51","uptime":{"ms":60049}},"memstats":{"gc_next":4194304,"memory_alloc":2366296,"memory_total":10742792,"rss":2314240}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":1}},"pipeline":{"clients":6,"events":{"active":0}}},"registrar":{"states":{"current":0}}}}}
2018-05-31T16:52:05.112+0530 INFO [monitoring] log/log.go:124 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":109,"time":109},"total":{"ticks":218,"time":218,"value":218},"user":{"ticks":109,"time":109}},"info":{"ephemeral_id":"46791b8c-f15c-437c-b98f-f9c5754e4d51","uptime":{"ms":90048}},"memstats":{"gc_next":4194304,"memory_alloc":2416104,"memory_total":10792600,"rss":-98304}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":1}},"pipeline":{"clients":6,"events":{"active":0}}},"registrar":{"states":{"current":0}}}}}
2018-05-31T16:52:35.111+0530 INFO [monitoring] log/log.go:124 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":109,"time":109},"total":{"ticks":218,"time":218,"value":218},"user":{"ticks":109,"time":109}},"info":{"ephemeral_id":"46791b8c-f15c-437c-b98f-f9c5754e4d51","uptime":{"ms":120048}},"m
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment