Skip to content

Instantly share code, notes, and snippets.

@kelseyhightower
Created October 3, 2014 20:34
Show Gist options
  • Save kelseyhightower/b483090e82abaa99b3ef to your computer and use it in GitHub Desktop.
Save kelseyhightower/b483090e82abaa99b3ef to your computer and use it in GitHub Desktop.
-- Logs begin at Sat 2014-08-09 14:56:39 UTC, end at Fri 2014-10-03 20:16:12 UTC. --
Sep 28 16:52:37 aurora.c.socialrank-prod.internal systemd[1]: Starting fleet daemon...
Sep 28 16:52:37 aurora.c.socialrank-prod.internal systemd[1]: Started fleet daemon.
Sep 28 16:52:37 aurora.c.socialrank-prod.internal fleetd[720]: INFO fleet.go:141: Using default config file /etc/fleet/fleet.conf
Sep 28 16:52:37 aurora.c.socialrank-prod.internal fleetd[720]: INFO server.go:137: Establishing etcd connectivity
Sep 28 16:52:37 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
Sep 28 16:52:37 aurora.c.socialrank-prod.internal fleetd[720]: ERROR client.go:200: Unable to get result for {Update /_coreos.com/fleet/machines/f401b3ef329f434eaecb377ed066d9f2/object}, retrying in 100ms
Sep 28 16:52:37 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
Sep 28 16:52:37 aurora.c.socialrank-prod.internal fleetd[720]: ERROR client.go:200: Unable to get result for {Update /_coreos.com/fleet/machines/f401b3ef329f434eaecb377ed066d9f2/object}, retrying in 200ms
Sep 28 16:52:38 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
Sep 28 16:52:38 aurora.c.socialrank-prod.internal fleetd[720]: ERROR client.go:200: Unable to get result for {Update /_coreos.com/fleet/machines/f401b3ef329f434eaecb377ed066d9f2/object}, retrying in 400ms
Sep 28 16:52:38 aurora.c.socialrank-prod.internal fleetd[720]: INFO server.go:148: Starting server components
Sep 28 16:52:43 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:222: Writing systemd unit [email protected] (1447b)
Sep 28 16:52:43 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Sep 28 16:52:43 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:222: Writing systemd unit [email protected] (845b)
Sep 28 16:52:43 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=LoadUnit [email protected] reason="unit scheduled here but not loaded"
Sep 28 16:52:43 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Sep 28 16:52:43 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=LoadUnit [email protected] reason="unit scheduled here but not loaded"
Sep 28 16:56:46 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:115: Started systemd unit [email protected](failed)
Sep 28 16:56:46 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=StartUnit [email protected] reason="unit currently loaded but desired state is launched"
Sep 28 16:59:10 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:115: Started systemd unit [email protected](done)
Sep 28 16:59:10 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=StartUnit [email protected] reason="unit currently loaded but desired state is launched"
Sep 28 17:10:36 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:222: Writing systemd unit instance-mx.service (282b)
Sep 28 17:10:36 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Sep 28 17:10:36 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=LoadUnit job=instance-mx.service reason="unit scheduled here but not loaded"
Sep 28 17:10:59 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:115: Started systemd unit instance-mx.service(done)
Sep 28 17:10:59 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=StartUnit job=instance-mx.service reason="unit currently loaded but desired state is launched"
Sep 28 17:16:06 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:123: Stopped systemd unit instance-mx.service(done)
Sep 28 17:16:06 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:235: Removing systemd unit instance-mx.service
Sep 28 17:16:06 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Sep 28 17:16:06 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=UnloadUnit job=instance-mx.service reason="unit loaded but not scheduled here"
Sep 28 17:16:31 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:222: Writing systemd unit instance-mx.service (340b)
Sep 28 17:16:31 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Sep 28 17:16:31 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=LoadUnit job=instance-mx.service reason="unit scheduled here but not loaded"
Sep 28 17:16:33 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:115: Started systemd unit instance-mx.service(failed)
Sep 28 17:16:33 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=StartUnit job=instance-mx.service reason="unit currently loaded but desired state is launched"
Sep 28 17:19:01 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:123: Stopped systemd unit instance-mx.service(done)
Sep 28 17:19:01 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:235: Removing systemd unit instance-mx.service
Sep 28 17:19:01 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Sep 28 17:19:01 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=UnloadUnit job=instance-mx.service reason="unit loaded but not scheduled here"
Sep 28 17:19:23 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:222: Writing systemd unit instance-mx.service (363b)
Sep 28 17:19:23 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Sep 28 17:19:23 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=LoadUnit job=instance-mx.service reason="unit scheduled here but not loaded"
Sep 28 17:19:25 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:115: Started systemd unit instance-mx.service(done)
Sep 28 17:19:25 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=StartUnit job=instance-mx.service reason="unit currently loaded but desired state is launched"
Sep 28 17:20:38 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:222: Writing systemd unit instance-mx.timer (146b)
Sep 28 17:20:38 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Sep 28 17:20:38 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=LoadUnit job=instance-mx.timer reason="unit scheduled here but not loaded"
Sep 28 17:20:38 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:115: Started systemd unit instance-mx.timer(done)
Sep 28 17:20:38 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=StartUnit job=instance-mx.timer reason="unit currently loaded but desired state is launched"
Sep 28 18:01:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:123: Stopped systemd unit [email protected](done)
Sep 28 18:01:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=StopUnit [email protected] reason="unit currently launched but desired state is loaded"
Sep 28 18:02:37 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:115: Started systemd unit [email protected](done)
Sep 28 18:02:37 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=StartUnit [email protected] reason="unit currently loaded but desired state is launched"
Sep 28 18:33:54 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:33:54 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:33:54 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:33:54 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:33:54 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:33:54 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:33:54 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:33:54 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:33:54 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:30 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Sep 28 18:34:30 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:32 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Sep 28 18:34:32 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:34 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Sep 28 18:34:34 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:36 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Sep 28 18:34:36 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:38 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Sep 28 18:34:38 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:39 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:39 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:39 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:39 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:39 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:39 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:39 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:39 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:39 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:40 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Sep 28 18:34:40 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:40 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:40 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:40 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:40 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:40 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:44 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:44 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Sep 28 18:34:44 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:34:56 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Sep 28 18:34:56 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:37:29 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Sep 28 18:37:29 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sep 28 18:37:59 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: dial tcp 10.240.148.47:4001: connection refused
Sep 28 18:37:59 aurora.c.socialrank-prod.internal fleetd[720]: ERROR client.go:200: Unable to get result for {Watch /_coreos.com/fleet/job}, retrying in 100ms
Sep 28 18:37:59 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: dial tcp 10.240.148.47:4001: connection refused
Sep 28 18:37:59 aurora.c.socialrank-prod.internal fleetd[720]: ERROR client.go:200: Unable to get result for {Watch /_coreos.com/fleet/job}, retrying in 100ms
Sep 30 18:35:51 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Sep 30 18:35:52 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 01 06:06:31 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 01 06:06:31 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 01 13:10:33 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 01 13:10:33 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 01 20:49:50 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 01 20:49:50 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 02 17:02:12 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:222: Writing systemd unit [email protected] (1410b)
Oct 02 17:02:12 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 02 17:02:12 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=LoadUnit [email protected] reason="unit scheduled here but not loaded"
Oct 02 17:02:47 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:123: Stopped systemd unit [email protected](done)
Oct 02 17:02:47 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:235: Removing systemd unit [email protected]
Oct 02 17:02:47 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 02 17:02:47 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=UnloadUnit [email protected] reason="unit loaded but not scheduled here"
Oct 02 17:22:30 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:222: Writing systemd unit [email protected] (1513b)
Oct 02 17:22:30 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 02 17:22:30 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=LoadUnit [email protected] reason="unit scheduled here but not loaded"
Oct 02 17:25:30 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:115: Started systemd unit [email protected](done)
Oct 02 17:25:30 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=StartUnit [email protected] reason="unit currently loaded but desired state is launched"
Oct 02 17:53:00 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:123: Stopped systemd unit [email protected](done)
Oct 02 17:53:00 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:235: Removing systemd unit [email protected]
Oct 02 17:53:00 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 02 17:53:00 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=UnloadUnit [email protected] reason="unit loaded but not scheduled here"
Oct 02 18:30:46 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:222: Writing systemd unit [email protected] (1566b)
Oct 02 18:30:46 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 02 18:30:46 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=LoadUnit [email protected] reason="unit scheduled here but not loaded"
Oct 02 19:36:30 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:123: Stopped systemd unit [email protected](done)
Oct 02 19:36:30 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:235: Removing systemd unit [email protected]
Oct 02 19:36:30 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 02 19:36:30 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=UnloadUnit [email protected] reason="unit loaded but not scheduled here"
Oct 02 19:43:02 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:222: Writing systemd unit [email protected] (1566b)
Oct 02 19:43:02 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 02 19:43:02 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=LoadUnit [email protected] reason="unit scheduled here but not loaded"
Oct 02 19:43:20 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:115: Started systemd unit [email protected](done)
Oct 02 19:43:20 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=StartUnit [email protected] reason="unit currently loaded but desired state is launched"
Oct 02 23:39:59 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:123: Stopped systemd unit [email protected](done)
Oct 02 23:39:59 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=StopUnit [email protected] reason="unit currently launched but desired state is loaded"
Oct 03 01:06:28 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:123: Stopped systemd unit [email protected](done)
Oct 03 01:06:28 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:235: Removing systemd unit [email protected]
Oct 03 01:06:28 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 03 01:06:28 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=UnloadUnit [email protected] reason="unit loaded but not scheduled here"
Oct 03 01:07:25 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:222: Writing systemd unit [email protected] (1581b)
Oct 03 01:07:25 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 03 01:07:25 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=LoadUnit [email protected] reason="unit scheduled here but not loaded"
Oct 03 02:05:11 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:115: Started systemd unit [email protected](done)
Oct 03 02:05:11 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=StartUnit [email protected] reason="unit currently loaded but desired state is launched"
Oct 03 06:06:16 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:06:16 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:18 aurora.c.socialrank-prod.internal fleetd[720]: ERROR reconcile.go:106: Failed fetching Units from Registry: timeout reached
Oct 03 06:06:18 aurora.c.socialrank-prod.internal fleetd[720]: ERROR reconcile.go:58: Unable to determine agent's desired state: timeout reached
Oct 03 06:06:18 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:18 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:06:18 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:20 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:20 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:20 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:20 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:20 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:20 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:06:20 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:21 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:21 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:21 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:21 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:21 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:22 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:22 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:22 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:06:22 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:23 aurora.c.socialrank-prod.internal fleetd[720]: ERROR reconcile.go:106: Failed fetching Units from Registry: timeout reached
Oct 03 06:06:23 aurora.c.socialrank-prod.internal fleetd[720]: ERROR reconcile.go:58: Unable to determine agent's desired state: timeout reached
Oct 03 06:06:23 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:23 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:23 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:24 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:06:24 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:26 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:06:26 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:28 aurora.c.socialrank-prod.internal fleetd[720]: ERROR reconcile.go:106: Failed fetching Units from Registry: timeout reached
Oct 03 06:06:28 aurora.c.socialrank-prod.internal fleetd[720]: ERROR reconcile.go:58: Unable to determine agent's desired state: timeout reached
Oct 03 06:06:28 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:28 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:06:28 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:29 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:29 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:29 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:29 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:29 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:29 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:30 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:30 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:06:30 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:32 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:06:32 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:33 aurora.c.socialrank-prod.internal fleetd[720]: ERROR reconcile.go:106: Failed fetching Units from Registry: timeout reached
Oct 03 06:06:33 aurora.c.socialrank-prod.internal fleetd[720]: ERROR reconcile.go:58: Unable to determine agent's desired state: timeout reached
Oct 03 06:06:33 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:34 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:34 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:06:34 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:35 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:35 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:35 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:35 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:35 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:35 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:36 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:36 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:36 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:36 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:36 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:36 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:06:36 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:38 aurora.c.socialrank-prod.internal fleetd[720]: ERROR reconcile.go:106: Failed fetching Units from Registry: timeout reached
Oct 03 06:06:38 aurora.c.socialrank-prod.internal fleetd[720]: ERROR reconcile.go:58: Unable to determine agent's desired state: timeout reached
Oct 03 06:06:38 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:38 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:38 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:06:38 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:39 aurora.c.socialrank-prod.internal fleetd[720]: ERROR server.go:169: Server monitor triggered: Monitor timed out before successful heartbeat
Oct 03 06:06:39 aurora.c.socialrank-prod.internal fleetd[720]: INFO server.go:137: Establishing etcd connectivity
Oct 03 06:06:39 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:39 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:39 aurora.c.socialrank-prod.internal fleetd[720]: ERROR event.go:91: etcd watcher {Watch /_coreos.com/fleet/job} returned error: cancelled
Oct 03 06:06:39 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:39 aurora.c.socialrank-prod.internal fleetd[720]: ERROR event.go:91: etcd watcher {Watch /_coreos.com/fleet/job} returned error: cancelled
Oct 03 06:06:40 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:41 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:43 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:44 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:47 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:48 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:53 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:06:54 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:07:03 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:07:03 aurora.c.socialrank-prod.internal fleetd[720]: INFO server.go:148: Starting server components
Oct 03 06:07:08 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:267: AgentReconciler task chain failed: chain={[email protected] (UnloadUnit, "unit loaded but not scheduled here")} err=task already in flight
Oct 03 06:07:08 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:267: AgentReconciler task chain failed: chain={[email protected] (UnloadUnit, "unit loaded but not scheduled here")} err=task already in flight
Oct 03 06:07:08 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:267: AgentReconciler task chain failed: chain={[email protected] (UnloadUnit, "unit loaded but not scheduled here")} err=task already in flight
Oct 03 06:07:10 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:267: AgentReconciler task chain failed: chain={[email protected] (LoadUnit, "unit scheduled here but not loaded"), (StartUnit, "unit currently loaded but desired state is launched")} err=task already in flight
Oct 03 06:07:10 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:222: Writing systemd unit [email protected] (1447b)
Oct 03 06:07:10 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:267: AgentReconciler task chain failed: chain={[email protected] (UnloadUnit, "unit loaded but not scheduled here")} err=task already in flight
Oct 03 06:07:10 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:267: AgentReconciler task chain failed: chain={[email protected] (UnloadUnit, "unit loaded but not scheduled here")} err=task already in flight
Oct 03 06:07:10 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 03 06:07:10 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:222: Writing systemd unit backup-es.timer (165b)
Oct 03 06:07:10 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=LoadUnit [email protected] reason="unit scheduled here but not loaded"
Oct 03 06:07:10 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 03 06:07:10 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:222: Writing systemd unit [email protected] (1581b)
Oct 03 06:07:10 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=LoadUnit job=backup-es.timer reason="unit scheduled here but not loaded"
Oct 03 06:07:10 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 03 06:07:10 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:222: Writing systemd unit backup-es.service (254b)
Oct 03 06:07:10 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=LoadUnit [email protected] reason="unit scheduled here but not loaded"
Oct 03 06:07:10 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 03 06:07:10 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:115: Started systemd unit backup-es.timer(failed)
Oct 03 06:07:10 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=StartUnit job=backup-es.timer reason="unit currently loaded but desired state is launched"
Oct 03 06:07:10 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=LoadUnit job=backup-es.service reason="unit scheduled here but not loaded"
Oct 03 06:07:14 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:123: Stopped systemd unit [email protected](done)
Oct 03 06:07:14 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:235: Removing systemd unit [email protected]
Oct 03 06:07:14 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 03 06:07:14 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=UnloadUnit [email protected] reason="unit loaded but not scheduled here"
Oct 03 06:07:15 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:267: AgentReconciler task chain failed: chain={[email protected] (UnloadUnit, "unit loaded but not scheduled here")} err=task already in flight
Oct 03 06:07:15 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:222: Writing systemd unit [email protected] (845b)
Oct 03 06:07:15 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:267: AgentReconciler task chain failed: chain={[email protected] (UnloadUnit, "unit loaded but not scheduled here")} err=task already in flight
Oct 03 06:07:15 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 03 06:07:15 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=LoadUnit [email protected] reason="unit scheduled here but not loaded"
Oct 03 06:07:15 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:267: AgentReconciler task chain failed: chain={[email protected] (UnloadUnit, "unit loaded but not scheduled here")} err=task already in flight
Oct 03 06:07:15 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:267: AgentReconciler task chain failed: chain={[email protected] (UnloadUnit, "unit loaded but not scheduled here")} err=task already in flight
Oct 03 06:07:20 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:267: AgentReconciler task chain failed: chain={[email protected] (UnloadUnit, "unit loaded but not scheduled here")} err=task already in flight
Oct 03 06:07:20 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:267: AgentReconciler task chain failed: chain={[email protected] (UnloadUnit, "unit loaded but not scheduled here")} err=task already in flight
Oct 03 06:07:22 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:267: AgentReconciler task chain failed: chain={[email protected] (UnloadUnit, "unit loaded but not scheduled here")} err=task already in flight
Oct 03 06:07:22 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:267: AgentReconciler task chain failed: chain={[email protected] (UnloadUnit, "unit loaded but not scheduled here")} err=task already in flight
Oct 03 06:07:25 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:123: Stopped systemd unit [email protected](done)
Oct 03 06:07:25 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:235: Removing systemd unit [email protected]
Oct 03 06:07:25 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 03 06:07:25 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=UnloadUnit [email protected] reason="unit loaded but not scheduled here"
Oct 03 06:07:27 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:267: AgentReconciler task chain failed: chain={[email protected] (UnloadUnit, "unit loaded but not scheduled here")} err=task already in flight
Oct 03 06:07:30 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:123: Stopped systemd unit [email protected](done)
Oct 03 06:07:30 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:235: Removing systemd unit [email protected]
Oct 03 06:07:30 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 03 06:07:30 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=UnloadUnit [email protected] reason="unit loaded but not scheduled here"
Oct 03 06:07:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:07:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:07:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:07:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:07:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:07:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:07:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:07:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:07:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:07:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:07:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:07 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:08:07 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:08 aurora.c.socialrank-prod.internal fleetd[720]: ERROR reconcile.go:106: Failed fetching Units from Registry: timeout reached
Oct 03 06:08:08 aurora.c.socialrank-prod.internal fleetd[720]: ERROR reconcile.go:58: Unable to determine agent's desired state: timeout reached
Oct 03 06:08:08 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:09 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:08:09 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:11 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:08:11 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:12 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:13 aurora.c.socialrank-prod.internal fleetd[720]: ERROR reconcile.go:106: Failed fetching Units from Registry: timeout reached
Oct 03 06:08:13 aurora.c.socialrank-prod.internal fleetd[720]: ERROR reconcile.go:58: Unable to determine agent's desired state: timeout reached
Oct 03 06:08:13 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:13 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:08:13 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:13 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:15 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:08:15 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:17 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:08:17 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:18 aurora.c.socialrank-prod.internal fleetd[720]: ERROR reconcile.go:106: Failed fetching Units from Registry: timeout reached
Oct 03 06:08:18 aurora.c.socialrank-prod.internal fleetd[720]: ERROR reconcile.go:58: Unable to determine agent's desired state: timeout reached
Oct 03 06:08:18 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:19 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:08:19 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:19 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:19 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:19 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:19 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:19 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:19 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:19 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:19 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:19 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:19 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:19 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:20 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:20 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:20 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:20 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:20 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:20 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:21 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:08:21 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:21 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:21 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:22 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:22 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:23 aurora.c.socialrank-prod.internal fleetd[720]: ERROR reconcile.go:106: Failed fetching Units from Registry: timeout reached
Oct 03 06:08:23 aurora.c.socialrank-prod.internal fleetd[720]: ERROR reconcile.go:58: Unable to determine agent's desired state: timeout reached
Oct 03 06:08:23 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:23 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:08:23 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:24 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:25 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:25 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:08:25 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:27 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:08:27 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:28 aurora.c.socialrank-prod.internal fleetd[720]: ERROR reconcile.go:106: Failed fetching Units from Registry: timeout reached
Oct 03 06:08:28 aurora.c.socialrank-prod.internal fleetd[720]: ERROR reconcile.go:58: Unable to determine agent's desired state: timeout reached
Oct 03 06:08:28 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:28 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:29 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 06:08:29 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:29 aurora.c.socialrank-prod.internal fleetd[720]: ERROR server.go:169: Server monitor triggered: Monitor timed out before successful heartbeat
Oct 03 06:08:29 aurora.c.socialrank-prod.internal fleetd[720]: INFO server.go:137: Establishing etcd connectivity
Oct 03 06:08:29 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:29 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:29 aurora.c.socialrank-prod.internal fleetd[720]: ERROR event.go:91: etcd watcher {Watch /_coreos.com/fleet/job} returned error: cancelled
Oct 03 06:08:29 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:29 aurora.c.socialrank-prod.internal fleetd[720]: ERROR event.go:91: etcd watcher {Watch /_coreos.com/fleet/job} returned error: cancelled
Oct 03 06:08:30 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:31 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:33 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:34 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:37 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:38 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:43 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:44 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:53 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:08:54 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:09:00 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:115: Started systemd unit [email protected](failed)
Oct 03 06:09:00 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=StartUnit [email protected] reason="unit currently loaded but desired state is launched"
Oct 03 06:09:05 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:115: Started systemd unit [email protected](failed)
Oct 03 06:09:05 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=StartUnit [email protected] reason="unit currently loaded but desired state is launched"
Oct 03 06:09:11 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:09:12 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:09:45 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:09:46 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:10:47 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:10:48 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 06:11:48 aurora.c.socialrank-prod.internal fleetd[720]: INFO server.go:148: Starting server components
Oct 03 06:11:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:123: Stopped systemd unit [email protected](done)
Oct 03 06:11:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:235: Removing systemd unit [email protected]
Oct 03 06:11:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:123: Stopped systemd unit [email protected](done)
Oct 03 06:11:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:123: Stopped systemd unit [email protected](done)
Oct 03 06:11:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:123: Stopped systemd unit backup-es.service(done)
Oct 03 06:11:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:123: Stopped systemd unit backup-es.timer(done)
Oct 03 06:11:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 03 06:11:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:235: Removing systemd unit [email protected]
Oct 03 06:11:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=UnloadUnit [email protected] reason="unit loaded but not scheduled here"
Oct 03 06:11:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 03 06:11:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:235: Removing systemd unit [email protected]
Oct 03 06:11:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=UnloadUnit [email protected] reason="unit loaded but not scheduled here"
Oct 03 06:11:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 03 06:11:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:235: Removing systemd unit backup-es.service
Oct 03 06:11:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=UnloadUnit [email protected] reason="unit loaded but not scheduled here"
Oct 03 06:11:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 03 06:11:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:235: Removing systemd unit backup-es.timer
Oct 03 06:11:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=UnloadUnit job=backup-es.service reason="unit loaded but not scheduled here"
Oct 03 06:11:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 03 06:11:49 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=UnloadUnit job=backup-es.timer reason="unit loaded but not scheduled here"
Oct 03 06:11:51 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:222: Writing systemd unit [email protected] (1447b)
Oct 03 06:11:51 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 03 06:11:51 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:222: Writing systemd unit [email protected] (845b)
Oct 03 06:11:51 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=LoadUnit [email protected] reason="unit scheduled here but not loaded"
Oct 03 06:11:51 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:146: Instructing systemd to reload units
Oct 03 06:11:51 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=LoadUnit [email protected] reason="unit scheduled here but not loaded"
Oct 03 06:11:52 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:115: Started systemd unit [email protected](done)
Oct 03 06:11:52 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=StartUnit [email protected] reason="unit currently loaded but desired state is launched"
Oct 03 06:11:58 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:115: Started systemd unit [email protected](failed)
Oct 03 06:11:58 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=StartUnit [email protected] reason="unit currently loaded but desired state is launched"
Oct 03 12:34:16 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:123: Stopped systemd unit [email protected](done)
Oct 03 12:34:16 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=StopUnit [email protected] reason="unit currently launched but desired state is loaded"
Oct 03 12:34:54 aurora.c.socialrank-prod.internal fleetd[720]: INFO manager.go:115: Started systemd unit [email protected](done)
Oct 03 12:34:54 aurora.c.socialrank-prod.internal fleetd[720]: INFO reconcile.go:274: AgentReconciler completed task: type=StartUnit [email protected] reason="unit currently loaded but desired state is launched"
Oct 03 12:37:06 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 12:37:06 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Oct 03 12:39:26 aurora.c.socialrank-prod.internal fleetd[720]: ERROR engine.go:105: Engine leadership acquisition failed: timeout reached
Oct 03 12:39:26 aurora.c.socialrank-prod.internal fleetd[720]: INFO client.go:278: Failed getting response from http://localhost:4001/: cancelled
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment