Skip to content

Instantly share code, notes, and snippets.

View gvilarino's full-sized avatar

Guido Vilariño gvilarino

View GitHub Profile
{
"leader": "0cfae93131c848e79061e14bbb699645",
"followers": {
"15a9569e86e841be811778423e36a6c3": {
"latency": {
"current": 1.019051,
"average": 0.93536997600794,
"standardDeviation": 24.650394802588,
"minimum": 0.589274,
"maximum": 3032.737874
core@dos-deis-coreos-2 ~ $ systemctl status ntpd
● ntpd.service - Network Time Service
Loaded: loaded (/usr/lib64/systemd/system/ntpd.service; disabled; vendor preset: disabled)
Active: inactive (dead) since Sat 2015-03-07 01:09:22 UTC; 4 days ago
Main PID: 559 (code=exited, status=0/SUCCESS)
Mar 07 01:08:46 localhost ntpd[559]: 7 Mar 01:08:46 ntpd[559]: unable to create socket on eth0 (4) for fe80::20d:3aff:fe10:682b%2#123
Mar 07 01:08:46 localhost ntpd[559]: 7 Mar 01:08:46 ntpd[559]: failed to init interface for address fe80::20d:3aff:fe10:682b%2
Mar 07 01:08:46 localhost ntpd[559]: 7 Mar 01:08:46 ntpd[559]: Listening on routing socket on fd #20 for interface updates
Mar 07 01:08:48 localhost ntpd[559]: Listen normally on 5 eth0 100.72.226.33:123
2015-03-11 Status Type Logical ID Status Reason
12:43:50 UTC-0700 CREATE_COMPLETE AWS::EC2::SubnetRouteTableAssociation Subnet1RouteTableAssociation
12:43:50 UTC-0700 CREATE_COMPLETE AWS::EC2::Route PublicRoute
12:43:50 UTC-0700 CREATE_COMPLETE AWS::EC2::SubnetRouteTableAssociation Subnet2RouteTableAssociation
12:43:40 UTC-0700 CREATE_IN_PROGRESS AWS::AutoScaling::AutoScalingGroup CoreOSServerAutoScale Resource creation Initiated
12:43:39 UTC-0700 CREATE_IN_PROGRESS AWS::AutoScaling::AutoScalingGroup CoreOSServerAutoScale
12:43:37 UTC-0700 CREATE_COMPLETE AWS::AutoScaling::LaunchConfiguration CoreOSServerLaunchConfig
12:43:36 UTC-0700 CREATE_COMPLETE AWS::EC2::SecurityGroupIngress VPCSecurityGroupIngress
12:43:36 UTC-0700 CREATE_IN_PROGRESS AWS::AutoScaling::LaunchConfiguration CoreOSServerLaunchConfig Resource creation Initiated
12:43:36 UTC-0700 CREATE_IN_PROGRESS AWS::EC2::SecurityGroupIngress VPCSecurityGroupIngress Resource creation Initiated
core@dos-deis-coreos-0 ~ $ journalctl -f -u deis-database
-- Logs begin at Sat 2015-03-07 01:07:32 UTC. --
Mar 11 18:17:54 dos-deis-coreos-0 sh[31421]: 2015-03-11 18:17:54 UTC LOG: database system was interrupted; last known up at 2015-03-11 18:13:19 UTC
Mar 11 18:17:54 dos-deis-coreos-0 sh[31421]: 2015-03-11 18:17:54 UTC LOG: database system was not properly shut down; automatic recovery in progress
Mar 11 18:17:54 dos-deis-coreos-0 sh[31421]: 2015-03-11 18:17:54 UTC LOG: redo starts at 6/A9000090
Mar 11 18:17:54 dos-deis-coreos-0 sh[31421]: 2015-03-11 18:17:54 UTC LOG: unexpected pageaddr 6/A1000000 in log segment 0000000100000006000000AA, offset 0
Mar 11 18:17:54 dos-deis-coreos-0 sh[31421]: 2015-03-11 18:17:54 UTC LOG: redo done at 6/A9000090
Mar 11 18:17:54 dos-deis-coreos-0 sh[31421]: 2015-03-11 18:17:54 UTC FATAL: the database system is starting up
Mar 11 18:17:54 dos-deis-coreos-0 sh[31421]: psql: FATAL: the database system is starting up
Mar 11 18:17:54 dos-deis-coreos-0 sh[31421]: database: p
Mar 11 18:15:58 dos-deis-coreos-4 sh[44385]: 2015-03-11T18:15:58Z 6eff508647a5 confd[408]: ERROR Config check failed: exit status 1
Mar 11 18:16:03 dos-deis-coreos-4 sh[44385]: 2015-03-11T18:16:03Z 6eff508647a5 confd[408]: ERROR Config check failed: exit status 1
Mar 11 18:16:08 dos-deis-coreos-4 sh[44385]: 2015-03-11T18:16:08Z 6eff508647a5 confd[408]: ERROR Config check failed: exit status 1
Mar 11 18:16:13 dos-deis-coreos-4 sh[44385]: 2015-03-11T18:16:13Z 6eff508647a5 confd[408]: ERROR Config check failed: exit status 1
Mar 11 18:16:18 dos-deis-coreos-4 systemd[1]: Stopping deis-controller...
Mar 11 18:16:18 dos-deis-coreos-4 sh[44385]: time="2015-03-11T18:16:18Z" level="fatal" msg="Error response from daemon: No such container: 6eff508647a520dc1dfa2eea1cb819e35ebcf93cb4d8f0920f6a25dc6446d1c9"
Mar 11 18:16:18 dos-deis-coreos-4 docker[53273]: deis-controller
Mar 11 18:16:18 dos-deis-coreos-4 systemd[1]: Stopped deis-controller.
Mar 11 18:16:22 dos-deis-coreos-4 systemd[1]: Starting deis-controller...
Mar 11
--- VERSIONS ---
CoreOS 557.2.0
Deis v1.3.1
etcd version 0.4.6
fleetd version 0.9.0
--- SYSTEM STATUS ---
-- Logs begin at Sat 2015-03-07 01:08:16 UTC, end at Wed 2015-03-11 05:57:23 UTC. --
Mar 10 21:25:11 dos-deis-coreos-1 etcd[767]: [etcd] Mar 10 21:25:11.936 INFO | 37e821517d374746bd93dda66b7a4320: snapshot of 10098 events at index 4725597 completed
Mar 10 21:35:29 dos-deis-coreos-1 etcd[767]: [etcd] Mar 10 21:35:29.151 INFO | 37e821517d374746bd93dda66b7a4320: snapshot of 10040 events at index 4735637 completed
➜ termshare deisctl journal database
-- Logs begin at Sat 2015-03-07 01:07:32 UTC. --
Mar 10 02:08:06 dos-deis-coreos-0 sh[5959]: File "/usr/local/lib/python2.7/dist-packages/boto/s3/bucket.py", line 714, in delete_keys2
Mar 10 02:08:06 dos-deis-coreos-0 sh[5959]: data=data)
Mar 10 02:08:06 dos-deis-coreos-0 sh[5959]: File "/usr/local/lib/python2.7/dist-packages/boto/s3/connection.py", line 664, in make_request
Mar 10 02:08:06 dos-deis-coreos-0 sh[5959]: retry_handler=retry_handler
Mar 10 02:08:06 dos-deis-coreos-0 sh[5959]: File "/usr/local/lib/python2.7/dist-packages/boto/connection.py", line 1070, in make_request
Mar 10 02:08:06 dos-deis-coreos-0 sh[5959]: retry_handler=retry_handler)
Mar 10 02:08:06 dos-deis-coreos-0 sh[5959]: File "/usr/local/lib/python2.7/dist-packages/boto/connection.py", line 1029, in _mexe
Mar 10 02:08:06 dos-deis-coreos-0 sh[5959]: raise ex
core@dos-deis-coreos-4 ~ $ etcdctl ls --recursive /deis
/deis/store
/deis/store/delayStart
/deis/store/fsid
/deis/store/monSetupLock
/deis/store/minSize
/deis/store/monSetupComplete
/deis/store/osds
/deis/store/osds/100.72.198.36
/deis/store/osds/100.72.250.72
core@dos-deis-coreos-4 ~ $ etcdctl ls --recursive /deis/controller
/deis/controller/unitHostname
/deis/controller/host
/deis/controller/port
/deis/controller/protocol
/deis/controller/secretKey
/deis/controller/builderKey
/deis/controller/registrationEnabled
/deis/controller/webEnabled
Mar 09 22:50:11 dos-deis-coreos-3 sh[2601]: [INFO] - 2015/03/09 22:50:11 [31878] 100.72.178.70 0.0.0.0:2222 2015/03/09 22:49:56 100.72.178.105:2223 0 41
Mar 09 22:50:11 dos-deis-coreos-3 sh[2601]: [INFO] - [09/Mar/2015:22:50:11 +0000] - 73.189.40.255 - - - 403 - "POST /v1/auth/register HTTP/1.1" - 396 - "http://deis.democracyos.com/v1/auth/register" - "python-requests/2.5.1 CPython/2.7.5 Darwin/14.1.0" - "~^deis\x5C.(?<domain>.+)$" - 100.72.156.69:8000
Mar 09 22:50:26 dos-deis-coreos-3 sh[2601]: [INFO] - 2015/03/09 22:50:26 [31878] 100.72.178.70 0.0.0.0:2222 2015/03/09 22:50:11 100.72.178.105:2223 0 41
Mar 09 22:50:41 dos-deis-coreos-3 sh[2601]: [INFO] - 2015/03/09 22:50:41 [31878] 100.72.178.70 0.0.0.0:2222 2015/03/09 22:50:26 100.72.178.105:2223 0 41
Mar 09 22:50:56 dos-deis-coreos-3 sh[2601]: [INFO] - 2015/03/09 22:50:56 [31878] 100.72.178.70 0.0.0.0:2222 2015/03/09 22:50:41 100.72.178.105:2223 0 41
Mar 09 22:51:11 dos-deis-coreos-3 sh[2601]: [INFO] - 2015/03/09 22:51:11 [31878] 100.72.178.70 0.0.0.0:2222