Skip to content

Instantly share code, notes, and snippets.

@untergeek
Last active August 29, 2015 14:01
Show Gist options
  • Save untergeek/86bd32c9a12648822fc9 to your computer and use it in GitHub Desktop.
Save untergeek/86bd32c9a12648822fc9 to your computer and use it in GitHub Desktop.
curator snapshot functionality...
$ ./curator.py --host blackbox --timeout 3600 --repository CuratorTest --create-repo --location "/Volumes/Repositories/CuratorTest" --snap-older 2
2014-05-21T19:16:29.800 INFO main:580 Job starting...
2014-05-21T19:16:29.800 INFO _new_conn:257 Starting new HTTP connection (1): blackbox
2014-05-21T19:16:29.806 INFO log_request_success:49 GET http://blackbox:9200/ [status:200 request:0.005s]
2014-05-21T19:16:29.806 INFO main:609 Creating repository CuratorTest...
2014-05-21T19:16:29.809 WARNING log_request_fail:68 GET /_snapshot/CuratorTest [status:404 request:0.003s]
2014-05-21T19:16:29.809 INFO log_request_fail:70 > None
2014-05-21T19:16:29.809 INFO _get_repository:376 Repository CuratorTest not found
2014-05-21T19:16:29.857 INFO log_request_success:49 PUT http://blackbox:9200/_snapshot/CuratorTest [status:200 request:0.047s]
2014-05-21T19:16:29.857 INFO _create_repository:393 Repository CuratorTest creation initiated...
2014-05-21T19:16:31.858 INFO log_request_success:49 GET http://blackbox:9200/_snapshot/CuratorTest [status:200 request:0.001s]
2014-05-21T19:16:31.858 INFO _create_repository:397 Repository CuratorTest created successfully.
2014-05-21T19:16:31.859 INFO main:643 Adding snapshot of indices older than 2 days to repository CuratorTest...
2014-05-21T19:16:31.869 INFO log_request_success:49 GET http://blackbox:9200/logstash-*/_settings?expand_wildcards=closed [status:200 request:0.002s]
2014-05-21T19:16:31.873 INFO index_loop:502 Attempting to create snapshot for index logstash-2014.05.15 because it is 6 days, 0:00:00 older than cutoff.
2014-05-21T19:16:31.876 INFO log_request_success:49 GET http://blackbox:9200/_snapshot/CuratorTest/_all [status:200 request:0.002s]
2014-05-21T19:16:31.878 INFO log_request_success:49 GET http://blackbox:9200/_snapshot/CuratorTest/_all [status:200 request:0.002s]
2014-05-21T19:16:41.714 INFO log_request_success:49 PUT http://blackbox:9200/_snapshot/CuratorTest/logstash-2014.05.15?wait_for_completion=true [status:200 request:9.836s]
2014-05-21T19:16:41.714 INFO index_loop:512 logstash-2014.05.15: Successfully created snapshot.
2014-05-21T19:16:41.714 INFO index_loop:502 Attempting to create snapshot for index logstash-2014.05.16 because it is 5 days, 0:00:00 older than cutoff.
2014-05-21T19:16:41.723 INFO log_request_success:49 GET http://blackbox:9200/_snapshot/CuratorTest/_all [status:200 request:0.008s]
2014-05-21T19:16:41.730 INFO log_request_success:49 GET http://blackbox:9200/_snapshot/CuratorTest/_all [status:200 request:0.007s]
2014-05-21T19:19:37.860 INFO log_request_success:49 PUT http://blackbox:9200/_snapshot/CuratorTest/logstash-2014.05.16?wait_for_completion=true [status:200 request:176.130s]
2014-05-21T19:19:37.861 INFO index_loop:512 logstash-2014.05.16: Successfully created snapshot.
2014-05-21T19:19:37.861 INFO index_loop:502 Attempting to create snapshot for index logstash-2014.05.17 because it is 4 days, 0:00:00 older than cutoff.
2014-05-21T19:19:37.882 INFO log_request_success:49 GET http://blackbox:9200/_snapshot/CuratorTest/_all [status:200 request:0.021s]
2014-05-21T19:19:37.892 INFO log_request_success:49 GET http://blackbox:9200/_snapshot/CuratorTest/_all [status:200 request:0.010s]
2014-05-21T19:22:36.068 INFO log_request_success:49 PUT http://blackbox:9200/_snapshot/CuratorTest/logstash-2014.05.17?wait_for_completion=true [status:200 request:178.174s]
2014-05-21T19:22:36.068 INFO index_loop:512 logstash-2014.05.17: Successfully created snapshot.
2014-05-21T19:22:36.068 INFO index_loop:502 Attempting to create snapshot for index logstash-2014.05.18 because it is 3 days, 0:00:00 older than cutoff.
2014-05-21T19:22:36.094 INFO log_request_success:49 GET http://blackbox:9200/_snapshot/CuratorTest/_all [status:200 request:0.025s]
2014-05-21T19:22:36.106 INFO log_request_success:49 GET http://blackbox:9200/_snapshot/CuratorTest/_all [status:200 request:0.012s]
2014-05-21T19:25:39.984 INFO log_request_success:49 PUT http://blackbox:9200/_snapshot/CuratorTest/logstash-2014.05.18?wait_for_completion=true [status:200 request:183.877s]
2014-05-21T19:25:39.984 INFO index_loop:512 logstash-2014.05.18: Successfully created snapshot.
2014-05-21T19:25:39.985 INFO index_loop:502 Attempting to create snapshot for index logstash-2014.05.19 because it is 2 days, 0:00:00 older than cutoff.
2014-05-21T19:25:40.003 INFO log_request_success:49 GET http://blackbox:9200/_snapshot/CuratorTest/_all [status:200 request:0.018s]
2014-05-21T19:25:40.018 INFO log_request_success:49 GET http://blackbox:9200/_snapshot/CuratorTest/_all [status:200 request:0.015s]
2014-05-21T19:28:41.455 INFO log_request_success:49 PUT http://blackbox:9200/_snapshot/CuratorTest/logstash-2014.05.19?wait_for_completion=true [status:200 request:181.436s]
2014-05-21T19:28:41.455 INFO index_loop:512 logstash-2014.05.19: Successfully created snapshot.
2014-05-21T19:28:41.455 INFO index_loop:502 Attempting to create snapshot for index logstash-2014.05.20 because it is 1 day, 0:00:00 older than cutoff.
2014-05-21T19:28:41.492 INFO log_request_success:49 GET http://blackbox:9200/_snapshot/CuratorTest/_all [status:200 request:0.036s]
2014-05-21T19:28:41.510 INFO log_request_success:49 GET http://blackbox:9200/_snapshot/CuratorTest/_all [status:200 request:0.018s]
2014-05-21T19:32:06.172 INFO log_request_success:49 PUT http://blackbox:9200/_snapshot/CuratorTest/logstash-2014.05.20?wait_for_completion=true [status:200 request:204.661s]
2014-05-21T19:32:06.173 INFO index_loop:512 logstash-2014.05.20: Successfully created snapshot.
2014-05-21T19:32:06.173 INFO find_expired_data:327 logstash-2014.05.21 is 0:00:00 above the cutoff.
2014-05-21T19:32:06.173 INFO find_expired_data:327 logstash-2014.05.22 is 1 day, 0:00:00 above the cutoff.
2014-05-21T19:32:06.173 INFO index_loop:517 CREATE SNAPSHOT index operations completed.
2014-05-21T19:32:06.174 INFO main:649 Done in 0:15:36.380978.
snapshot repository state indices started completed
logstash-2014.05.15 CuratorTest SUCCESS ["logstash-2014.05.15"] 5/21/14 7:17 PM 5/21/14 7:17 PM
logstash-2014.05.16 CuratorTest SUCCESS ["logstash-2014.05.16"] 5/21/14 7:17 PM 5/21/14 7:20 PM
logstash-2014.05.17 CuratorTest SUCCESS ["logstash-2014.05.17"] 5/21/14 7:20 PM 5/21/14 7:23 PM
logstash-2014.05.18 CuratorTest SUCCESS ["logstash-2014.05.18"] 5/21/14 7:23 PM 5/21/14 7:26 PM
logstash-2014.05.19 CuratorTest SUCCESS ["logstash-2014.05.19"] 5/21/14 7:26 PM 5/21/14 7:29 PM
logstash-2014.05.20 CuratorTest SUCCESS ["logstash-2014.05.20"] 5/21/14 7:29 PM 5/21/14 7:32 PM
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment