Skip to content

Instantly share code, notes, and snippets.

@errordeveloper
Created July 11, 2016 13:29
Show Gist options
  • Save errordeveloper/42a7750edcc645a2a6d28963a432f205 to your computer and use it in GitHub Desktop.
Save errordeveloper/42a7750edcc645a2a6d28963a432f205 to your computer and use it in GitHub Desktop.

The Marathon UI doesn't say much: Marathon Mesos UI says even less: Mesos main table Mesos details

Agent log on on of the nodes:

[root@mesos-01 vagrant]# journalctl -u mesos-slave | grep 8100a55c-4769
Jul 11 13:15:14 mesos-01 mesos-slave[13462]: I0711 13:15:14.339555 13466 slave.cpp:1361] Got assigned task outyet.8100a55c-4769-11e6-9c8a-a24f98af1591 for framework e5a57e77-2d09-461c-8ea7-5a3631c43516-0000
Jul 11 13:15:14 mesos-01 mesos-slave[13462]: I0711 13:15:14.354274 13470 slave.cpp:1480] Launching task outyet.8100a55c-4769-11e6-9c8a-a24f98af1591 for framework e5a57e77-2d09-461c-8ea7-5a3631c43516-0000
Jul 11 13:15:14 mesos-01 mesos-slave[13462]: I0711 13:15:14.355965 13470 paths.cpp:528] Trying to chown '/var/lib/mesos/slaves/e5a57e77-2d09-461c-8ea7-5a3631c43516-S0/frameworks/e5a57e77-2d09-461c-8ea7-5a3631c43516-0000/executors/outyet.8100a55c-4769-11e6-9c8a-a24f98af1591/runs/3e22524c-575b-4094-af1f-4e582487217f' to user 'root'
Jul 11 13:15:14 mesos-01 mesos-slave[13462]: I0711 13:15:14.363742 13470 slave.cpp:5352] Launching executor outyet.8100a55c-4769-11e6-9c8a-a24f98af1591 of framework e5a57e77-2d09-461c-8ea7-5a3631c43516-0000 with resources cpus(*):0.1; mem(*):32 in work directory '/var/lib/mesos/slaves/e5a57e77-2d09-461c-8ea7-5a3631c43516-S0/frameworks/e5a57e77-2d09-461c-8ea7-5a3631c43516-0000/executors/outyet.8100a55c-4769-11e6-9c8a-a24f98af1591/runs/3e22524c-575b-4094-af1f-4e582487217f'
Jul 11 13:15:14 mesos-01 mesos-slave[13462]: I0711 13:15:14.365597 13470 slave.cpp:1698] Queuing task 'outyet.8100a55c-4769-11e6-9c8a-a24f98af1591' for executor 'outyet.8100a55c-4769-11e6-9c8a-a24f98af1591' of framework e5a57e77-2d09-461c-8ea7-5a3631c43516-0000
Jul 11 13:15:14 mesos-01 mesos-slave[13462]: I0711 13:15:14.372925 13468 docker.cpp:1036] Starting container '3e22524c-575b-4094-af1f-4e582487217f' for task 'outyet.8100a55c-4769-11e6-9c8a-a24f98af1591' (and executor 'outyet.8100a55c-476-11e6-9c8a-a24f98af1591') of framework 'e5a57e77-2d09-461c-8ea7-5a3631c43516-0000'
Jul 11 13:16:14 mesos-01 mesos-slave[13462]: I0711 13:16:14.365823 13467 slave.cpp:4307] Terminating executor ''outyet.8100a55c-4769-11e6-9c8a-a24f98af1591' of framework e5a57e77-2d09-461c-8ea7-5a3631c43516-0000' because it did not register within 1mins
Jul 11 13:16:14 mesos-01 mesos-slave[13462]: E0711 13:16:14.659958 13467 slave.cpp:3758] Container '3e22524c-575b-4094-af1f-4e582487217f' for executor 'outyet.8100a55c-4769-11e6-9c8a-a24f98af1591' of framework e5a57e77-2d09-461c-8ea7-5a3631c43516-0000 failed to start:  future discarded
Jul 11 13:16:14 mesos-01 mesos-slave[13462]: E0711 13:16:14.660315 13467 slave.cpp:3855] Termination of executor 'outyet.8100a55c-4769-11e6-9c8a-a24f98af1591' of framework e5a57e77-2d09-461c-8ea7-5a3631c43516-0000 failed: Unknown container: 3e22524c-575b-4094-af1f-4e582487217f
Jul 11 13:16:14 mesos-01 mesos-slave[13462]: I0711 13:16:14.660468 13467 slave.cpp:3012] Handling status update TASK_FAILED (UUID: 3f9ae582-aab1-4fbc-8331-8ac358c27a60) for task outyet.8100a55c-4769-11e6-9c8a-a24f98af1591 of framework e5a57e77-2d09-461c-8ea7-5a3631c43516-0000 from @0.0.0.0:0
Jul 11 13:16:14 mesos-01 mesos-slave[13462]: I0711 13:16:14.710644 13469 status_update_manager.cpp:320] Received status update TASK_FAILED (UUID: 3f9ae582-aab1-4fbc-8331-8ac358c27a60) for task outyet.8100a55c-4769-11e6-9c8a-a24f98af1591 of framework e5a57e77-2d09-461c-8ea7-5a3631c43516-0000
Jul 11 13:16:14 mesos-01 mesos-slave[13462]: I0711 13:16:14.711376 13469 status_update_manager.cpp:824] Checkpointing UPDATE for status update TASK_FAILED (UUID: 3f9ae582-aab1-4fbc-8331-8ac358c27a60) for task outyet.8100a55c-4769-11e6-9c8a-a24f98af1591 of framework e5a57e77-2d09-461c-8ea7-5a3631c43516-0000
Jul 11 13:16:14 mesos-01 mesos-slave[13462]: I0711 13:16:14.751345 13469 slave.cpp:3410] Forwarding the update TASK_FAILED (UUID: 3f9ae582-aab1-4fbc-8331-8ac358c27a60) for task outyet.8100a55c-4769-11e6-9c8a-a24f98af1591 of framework e5a57e77-2d09-461c-8ea7-5a3631c43516-0000 to [email protected]:5050
Jul 11 13:16:14 mesos-01 mesos-slave[13462]: I0711 13:16:14.885550 13469 status_update_manager.cpp:392] Received status update acknowledgement (UUID: 3f9ae582-aab1-4fbc-8331-8ac358c27a60) for task outyet.8100a55c-4769-11e6-9c8a-a24f98af1591 of framework e5a57e77-2d09-461c-8ea7-5a3631c43516-0000
Jul 11 13:16:14 mesos-01 mesos-slave[13462]: I0711 13:16:14.885702 13469 status_update_manager.cpp:824] Checkpointing ACK for status update TASK_FAILED (UUID: 3f9ae582-aab1-4fbc-8331-8ac358c27a60) for task outyet.8100a55c-4769-11e6-9c8a-a24f98af1591 of framework e5a57e77-2d09-461c-8ea7-5a3631c43516-0000
Jul 11 13:16:14 mesos-01 mesos-slave[13462]: I0711 13:16:14.912014 13469 slave.cpp:3975] Cleaning up executor 'outyet.8100a55c-4769-11e6-9c8a-a24f98af1591' of framework e5a57e77-2d09-461c-8ea7-5a3631c43516-0000
Jul 11 13:16:14 mesos-01 mesos-slave[13462]: I0711 13:16:14.912492 13469 gc.cpp:55] Scheduling '/var/lib/mesos/slaves/e5a57e77-2d09-461c-8ea7-5a3631c43516-S0/frameworks/e5a57e77-2d09-461c-8ea7-5a3631c43516-0000/executors/outyet.8100a55c-4769-11e6-9c8a-a24f98af1591/runs/3e22524c-575b-4094-af1f-4e582487217f' for gc 6.99998944088days in the future
Jul 11 13:16:14 mesos-01 mesos-slave[13462]: I0711 13:16:14.912534 13469 gc.cpp:55] Scheduling '/var/lib/mesos/slaves/e5a57e77-2d09-461c-8ea7-5a3631c43516-S0/frameworks/e5a57e77-2d09-461c-8ea7-5a3631c43516-0000/executors/outyet.8100a55c-4769-11e6-9c8a-a24f98af1591' for gc 6.99998944040593days in the future
Jul 11 13:16:14 mesos-01 mesos-slave[13462]: I0711 13:16:14.912602 13469 gc.cpp:55] Scheduling '/var/lib/mesos/meta/slaves/e5a57e77-2d09-461c-8ea7-5a3631c43516-S0/frameworks/e5a57e77-2d09-461c-8ea7-5a3631c43516-0000/executors/outyet.8100a55c-4769-11e6-9c8a-a24f98af1591/runs/3e22524c-575b-4094-af1f-4e582487217f' for gc 6.99998944009482days in the future
Jul 11 13:16:14 mesos-01 mesos-slave[13462]: I0711 13:16:14.913044 13469 gc.cpp:55] Scheduling '/var/lib/mesos/meta/slaves/e5a57e77-2d09-461c-8ea7-5a3631c43516-S0/frameworks/e5a57e77-2d09-461c-8ea7-5a3631c43516-0000/executors/outyet.8100a55c-4769-11e6-9c8a-a24f98af1591' for gc 6.99998943986074days in the future

Eventually it's all working! Was it just taking so long to pull the images?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment