Created
March 8, 2015 04:27
-
-
Save bprashanth/1b23eb9464c3b2494311 to your computer and use it in GitHub Desktop.
etcd oom
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 248 2015/03/08 00:08:28 netutil: Resolving etcdtest:2380 to 10.240.188.68:2380 | |
| 249 2015/03/08 00:08:28 etcd: listening for peers on http://localhost:2380 | |
| 250 2015/03/08 00:08:28 etcd: listening for peers on http://localhost:7001 | |
| 251 2015/03/08 00:08:28 etcd: listening for client requests on http://0.0.0.0:4001 | |
| 252 2015/03/08 00:08:28 datadir is valid for the 2.0.1 format | |
| 253 2015/03/08 00:08:38 etcdserver: recovered store from snapshot at index 20002 | |
| 254 2015/03/08 00:08:38 etcdserver: name = etcdtest | |
| 255 2015/03/08 00:08:38 etcdserver: data dir = /var/etcd/data | |
| 256 2015/03/08 00:08:38 etcdserver: member dir = /var/etcd/data/member | |
| 257 2015/03/08 00:08:38 etcdserver: heartbeat = 100ms | |
| 258 2015/03/08 00:08:38 etcdserver: election = 1000ms | |
| 259 2015/03/08 00:08:38 etcdserver: snapshot count = 10000 | |
| 260 2015/03/08 00:08:38 etcdserver: advertise client URLs = http://10.240.188.68:4001 | |
| 261 2015/03/08 00:08:38 etcdserver: loaded cluster information from store: etcdtest=http://etcdtest:2380 | |
| 262 2015/03/08 00:08:49 etcdserver: restart member ed305fcf5035acc7 in cluster 919fe6c5000f97e3 at commit index 30003 | |
| 263 2015/03/08 00:08:49 raft: ed305fcf5035acc7 became follower at term 2 | |
| 264 2015/03/08 00:08:49 raft: newRaft ed305fcf5035acc7 [peers: [ed305fcf5035acc7], term: 2, commit: 30003, applied: 20002, lastindex: 30003, lastterm: 2] | |
| 265 2015/03/08 00:08:49 etcdserver: start to snapshot (applied: 30003, lastsnap: 20002) | |
| 266 2015/03/08 00:08:52 etcdserver: compacted log at index 30003 | |
| 267 2015/03/08 00:22:27 netutil: Resolving etcdtest:2380 to 10.240.188.68:2380 | |
| 268 2015/03/08 00:22:27 etcd: listening for peers on http://localhost:2380 | |
| 269 2015/03/08 00:22:27 etcd: listening for peers on http://localhost:7001 | |
| 270 2015/03/08 00:22:27 etcd: listening for client requests on http://0.0.0.0:4001 | |
| 271 2015/03/08 00:22:27 datadir is valid for the 2.0.1 format | |
| 272 2015/03/08 00:22:28 snap: corrupted snapshot file /var/etcd/data/member/snap/0000000000000002-0000000000007533.snap: unexpected EOF | |
| 273 2015/03/08 00:22:37 etcdserver: recovered store from snapshot at index 20002 | |
| 274 2015/03/08 00:22:37 etcdserver: name = etcdtest | |
| 275 2015/03/08 00:22:37 etcdserver: data dir = /var/etcd/data | |
| 276 2015/03/08 00:22:37 etcdserver: member dir = /var/etcd/data/member | |
| 277 2015/03/08 00:22:37 etcdserver: heartbeat = 100ms | |
| 278 2015/03/08 00:22:37 etcdserver: election = 1000ms | |
| 279 2015/03/08 00:22:37 etcdserver: snapshot count = 10000 | |
| 280 2015/03/08 00:22:37 etcdserver: advertise client URLs = http://10.240.188.68:4001 | |
| 281 2015/03/08 00:22:37 etcdserver: loaded cluster information from store: etcdtest=http://etcdtest:2380 | |
| 282 2015/03/08 00:22:51 etcdserver: restart member ed305fcf5035acc7 in cluster 919fe6c5000f97e3 at commit index 30003 | |
| 283 2015/03/08 00:22:51 raft: ed305fcf5035acc7 became follower at term 2 | |
| 284 2015/03/08 00:22:51 raft: newRaft ed305fcf5035acc7 [peers: [ed305fcf5035acc7], term: 2, commit: 30003, applied: 20002, lastindex: 30003, lastterm: 2] | |
| 285 2015/03/08 00:22:52 etcdserver: start to snapshot (applied: 30003, lastsnap: 20002) | |
| 286 2015/03/08 00:22:54 etcdserver: compacted log at index 30003 | |
| 287 2015/03/08 00:22:56 etcdserver: publish error: etcdserver: request timed out | |
| 288 2015/03/08 00:23:01 etcdserver: publish error: etcdserver: request timed out | |
| 289 2015/03/08 00:23:03 etcdserver: saved snapshot at index 30003 | |
| 290 2015/03/08 00:23:04 raft: ed305fcf5035acc7 is starting a new election at term 2 | |
| 291 2015/03/08 00:23:04 raft: ed305fcf5035acc7 became candidate at term 3 | |
| 292 2015/03/08 00:23:04 raft: ed305fcf5035acc7 received vote from ed305fcf5035acc7 at term 3 | |
| 293 2015/03/08 00:23:04 raft: ed305fcf5035acc7 became leader at term 3 | |
| 294 2015/03/08 00:23:04 raft.node: ed305fcf5035acc7 elected leader ed305fcf5035acc7 at term 3 | |
| 295 2015/03/08 00:23:04 etcdserver: published {Name:etcdtest ClientURLs:[http://10.240.188.68:4001]} to cluster 919fe6c5000f97e3 | |
| 296 fatal error: runtime: out of memory | |
| .... | |
| <runtime stack> | |
| .... | |
| 2015/03/08 00:30:35 netutil: Resolving etcdtest:2380 to 10.240.188.68:2380 | |
| 2015/03/08 00:30:35 etcd: listening for peers on http://localhost:2380 | |
| 2015/03/08 00:30:35 etcd: listening for peers on http://localhost:7001 | |
| 2015/03/08 00:30:35 etcd: listening for client requests on http://0.0.0.0:4001 | |
| 2015/03/08 00:30:35 datadir is valid for the 2.0.1 format | |
| 2015/03/08 00:30:35 snap: unexpected non-snap file 0000000000000002-0000000000007533.snap.broken | |
| 2015/03/08 00:30:48 etcdserver: recovered store from snapshot at index 30003 | |
| 2015/03/08 00:30:48 etcdserver: name = etcdtest | |
| 2015/03/08 00:30:48 etcdserver: data dir = /var/etcd/data | |
| 2015/03/08 00:30:48 etcdserver: member dir = /var/etcd/data/member | |
| 2015/03/08 00:30:48 etcdserver: heartbeat = 100ms | |
| 2015/03/08 00:30:48 etcdserver: election = 1000ms | |
| 2015/03/08 00:30:48 etcdserver: snapshot count = 10000 | |
| 2015/03/08 00:30:48 etcdserver: advertise client URLs = http://10.240.188.68:4001 | |
| 2015/03/08 00:30:48 etcdserver: loaded cluster information from store: etcdtest=http://etcdtest:2380 | |
| 2015/03/08 00:30:59 etcdserver: restart member ed305fcf5035acc7 in cluster 919fe6c5000f97e3 at commit index 30177 | |
| 2015/03/08 00:30:59 raft: ed305fcf5035acc7 became follower at term 3 | |
| 2015/03/08 00:30:59 raft: newRaft ed305fcf5035acc7 [peers: [ed305fcf5035acc7], term: 3, commit: 30177, applied: 30003, lastindex: 30177, lastterm: 3] | |
| 2015/03/08 00:31:00 raft: ed305fcf5035acc7 is starting a new election at term 3 | |
| 2015/03/08 00:31:00 raft: ed305fcf5035acc7 became candidate at term 4 | |
| 2015/03/08 00:31:00 raft: ed305fcf5035acc7 received vote from ed305fcf5035acc7 at term 4 | |
| 2015/03/08 00:31:00 raft: ed305fcf5035acc7 became leader at term 4 | |
| 2015/03/08 00:31:00 raft.node: ed305fcf5035acc7 elected leader ed305fcf5035acc7 at term 4 | |
| 2015/03/08 00:31:00 etcdserver: published {Name:etcdtest ClientURLs:[http://10.240.188.68:4001]} to cluster 919fe6c5000f97e3 | |
| 2015/03/08 00:32:17 error writing event: write tcp 127.0.0.1:41658: connection reset by peer | |
| 2015/03/08 00:32:26 error writing event: write tcp 127.0.0.1:41665: connection reset by peer | |
| 2015/03/08 00:34:51 error writing event: write tcp 127.0.0.1:41673: connection reset by peer | |
| 2015/03/08 00:39:01 etcdserver: start to snapshot (applied: 40004, lastsnap: 30003) | |
| fatal error: runtime: out of memory | |
| .... | |
| <runtime stack> | |
| .... | |
| 2015/03/08 00:39:50 netutil: Resolving etcdtest:2380 to 10.240.188.68:2380 | |
| 2015/03/08 00:39:50 etcd: listening for peers on http://localhost:2380 | |
| 2015/03/08 00:39:50 etcd: listening for peers on http://localhost:7001 | |
| 2015/03/08 00:39:50 etcd: listening for client requests on http://0.0.0.0:4001 | |
| 2015/03/08 00:39:50 datadir is valid for the 2.0.1 format | |
| 2015/03/08 00:39:50 snap: unexpected non-snap file 0000000000000002-0000000000007533.snap.broken | |
| 2015/03/08 00:40:02 etcdserver: recovered store from snapshot at index 30003 | |
| 2015/03/08 00:40:02 etcdserver: name = etcdtest | |
| 2015/03/08 00:40:02 etcdserver: data dir = /var/etcd/data | |
| 2015/03/08 00:40:02 etcdserver: member dir = /var/etcd/data/member | |
| 2015/03/08 00:40:02 etcdserver: heartbeat = 100ms | |
| 2015/03/08 00:40:02 etcdserver: election = 1000ms | |
| 2015/03/08 00:40:02 etcdserver: snapshot count = 10000 | |
| 2015/03/08 00:40:02 etcdserver: advertise client URLs = http://10.240.188.68:4001 | |
| 2015/03/08 00:40:02 etcdserver: loaded cluster information from store: etcdtest=http://etcdtest:2380 | |
| 2015/03/08 00:40:03 etcdserver: restart member ed305fcf5035acc7 in cluster 919fe6c5000f97e3 at commit index 40004 | |
| 2015/03/08 00:40:03 raft: ed305fcf5035acc7 became follower at term 4 | |
| 2015/03/08 00:40:03 raft: newRaft ed305fcf5035acc7 [peers: [ed305fcf5035acc7], term: 4, commit: 40004, applied: 30003, lastindex: 40004, lastterm: 4] | |
| 2015/03/08 00:40:03 etcdserver: start to snapshot (applied: 40004, lastsnap: 30003) | |
| 2015/03/08 00:40:06 etcdserver: compacted log at index 40004 | |
| fatal error: runtime: out of memory | |
| etc |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment