Skip to content

Instantly share code, notes, and snippets.

@bmahler

bmahler/gist:6f6bdb0385ec245b2346

Created November 3, 2014 22:59
Show Gist options
  • Save bmahler/6f6bdb0385ec245b2346 to your computer and use it in GitHub Desktop.
Save bmahler/6f6bdb0385ec245b2346 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
$ grep ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c scheduler_log
DEBUG [2014-10-30 19:01:27,762] com.hubspot.singularity.scheduler.SingularityNewTaskChecker: Got task state UNHEALTHY_KILL_TASK for task ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c in 00:00.004
DEBUG [2014-10-30 19:01:52,303] com.hubspot.singularity.scheduler.SingularityCleaner: Killing a task SingularityTaskCleanup [user=Optional.absent(), cleanupType=UNHEALTHY_NEW_TASK, timestamp=1414695687762, taskId=ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c] immediately because of its cleanup type
DEBUG [2014-10-30 19:01:52,304] com.hubspot.singularity.scheduler.SingularityCleaner: TaskCleanup SingularityTaskCleanup [user=Optional.absent(), cleanupType=UNHEALTHY_NEW_TASK, timestamp=1414695687762, taskId=ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c] had LB state NOT_LOAD_BALANCED after 00:00.000
INFO [2014-10-30 19:01:52,304] com.hubspot.singularity.mesos.SingularityDriver: Killed task ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c with driver status: DRIVER_RUNNING
DEBUG [2014-10-30 19:05:52,510] com.hubspot.singularity.mesos.SingularityMesosScheduler: Task ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c is now TASK_LOST (Reconciliation: Task is unknown) at 1414695592000
DEBUG [2014-10-30 19:05:52,515] com.hubspot.singularity.mesos.SingularityLogSupport: Already had a directory for task ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c, skipping lookup
ERROR [2014-10-30 19:06:52,531] com.hubspot.singularity.smtp.SingularityMailer: Sandboxmanager failed to read Optional.of(/mnt/mesos/slaves/20141022-230727-2684700170-5050-1555-0/frameworks/Singularity/executors/ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c/runs/c26dd873-a80f-452b-8569-3466f93cf563)/stdout on slave 10.70.7.248
ERROR [2014-10-30 19:07:52,534] com.hubspot.singularity.smtp.SingularityMailer: Sandboxmanager failed to read Optional.of(/mnt/mesos/slaves/20141022-230727-2684700170-5050-1555-0/frameworks/Singularity/executors/ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c/runs/c26dd873-a80f-452b-8569-3466f93cf563)/stderr on slave 10.70.7.248
DEBUG [2014-10-30 19:07:52,538] com.hubspot.singularity.smtp.SingularitySmtpSender: Queuing an email to [[email protected], [email protected], [email protected]]/[] (subject: Task lost (ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c))
DEBUG [2014-10-30 19:07:52,555] com.hubspot.singularity.scheduler.SingularityCleaner: LB cleanup for task ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c had state NOT_LOAD_BALANCED after 00:00.001
DEBUG [2014-10-30 19:23:53,703] com.hubspot.singularity.mesos.SingularityMesosScheduler: Task ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c is now TASK_LOST (Reconciliation: Task is unknown) at 1414697033000
DEBUG [2014-10-30 19:23:53,745] com.hubspot.singularity.mesos.SingularityMesosScheduler: Task ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c is now TASK_LOST (Reconciliation: Task is unknown) at 1414697033000
DEBUG [2014-10-30 19:23:53,789] com.hubspot.singularity.mesos.SingularityMesosScheduler: Task ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c is now TASK_LOST (Reconciliation: Task is unknown) at 1414697033000
DEBUG [2014-10-30 19:23:53,840] com.hubspot.singularity.mesos.SingularityMesosScheduler: Task ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c is now TASK_LOST (Reconciliation: Task is unknown) at 1414697033000
DEBUG [2014-10-30 19:23:53,895] com.hubspot.singularity.mesos.SingularityMesosScheduler: Task ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c is now TASK_LOST (Reconciliation: Task is unknown) at 1414697033000
DEBUG [2014-10-30 19:23:53,943] com.hubspot.singularity.mesos.SingularityMesosScheduler: Task ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c is now TASK_LOST (Reconciliation: Task is unknown) at 1414697033000
DEBUG [2014-10-30 19:23:53,992] com.hubspot.singularity.mesos.SingularityMesosScheduler: Task ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c is now TASK_LOST (Reconciliation: Task is unknown) at 1414697033000
DEBUG [2014-10-30 19:23:54,035] com.hubspot.singularity.mesos.SingularityMesosScheduler: Task ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c is now TASK_LOST (Reconciliation: Task is unknown) at 1414697033000
DEBUG [2014-10-30 19:23:54,069] com.hubspot.singularity.mesos.SingularityMesosScheduler: Task ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c is now TASK_LOST (Reconciliation: Task is unknown) at 1414697033000
DEBUG [2014-10-30 19:23:54,100] com.hubspot.singularity.mesos.SingularityMesosScheduler: Task ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c is now TASK_LOST (Reconciliation: Task is unknown) at 1414697033000
DEBUG [2014-10-30 19:23:54,138] com.hubspot.singularity.mesos.SingularityMesosScheduler: Task ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c is now TASK_LOST (Reconciliation: Task is unknown) at 1414697033000
DEBUG [2014-10-30 19:23:54,180] com.hubspot.singularity.mesos.SingularityMesosScheduler: Task ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c is now TASK_LOST (Reconciliation: Task is unknown) at 1414697033000
DEBUG [2014-10-30 19:23:54,220] com.hubspot.singularity.mesos.SingularityMesosScheduler: Task ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c is now TASK_LOST (Reconciliation: Task is unknown) at 1414697033000
DEBUG [2014-10-30 19:23:54,264] com.hubspot.singularity.mesos.SingularityMesosScheduler: Task ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c is now TASK_LOST (Reconciliation: Task is unknown) at 1414697033000
DEBUG [2014-10-30 19:23:54,308] com.hubspot.singularity.mesos.SingularityMesosScheduler: Task ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c is now TASK_LOST (Reconciliation: Task is unknown) at 1414697033000
DEBUG [2014-10-30 19:23:54,347] com.hubspot.singularity.mesos.SingularityMesosScheduler: Task ci-tagupdate-stryker.2014.10.21T22.57.44-1414434875917-1-10-us_west_2c is now TASK_LOST (Reconciliation: Task is unknown) at 1414697033000
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment