Skip to content

Instantly share code, notes, and snippets.

@cp16net
Created July 24, 2015 04:13
Show Gist options
  • Select an option

  • Save cp16net/54b59b34579ca8519681 to your computer and use it in GitHub Desktop.

Select an option

Save cp16net/54b59b34579ca8519681 to your computer and use it in GitHub Desktop.
trove-guestagent still fails to keep the grant statement when the configs are moved into place
2015-07-23 20:40:32.018 DEBUG trove.openstack.common.service [-] ******************************************************************************** from (pid=921) log_opt_values /usr/local/lib/python2.7/dist-packages/oslo_config/cfg.py:2229
2015-07-23 20:40:32.044 DEBUG trove.common.rpc.service [-] Creating RPC server for service guestagent from (pid=921) start /home/ubuntu/trove/trove/common/rpc/service.py:54
2015-07-23 20:40:32.889 DEBUG oslo_messaging._drivers.amqp [-] Pool creating new connection from (pid=921) create /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqp.py:103
2015-07-23 20:40:33.138 INFO oslo_messaging._drivers.impl_rabbit [-] Connecting to AMQP server on 10.0.0.1:5672
2015-07-23 20:40:34.591 INFO oslo_messaging._drivers.impl_rabbit [-] Connected to AMQP server on 10.0.0.1:5672
2015-07-23 20:40:35.127 DEBUG trove.guestagent.datastore.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Casting set_status message to conductor. from (pid=921) set_status /home/ubuntu/trove/trove/guestagent/datastore/service.py:107
2015-07-23 20:40:35.221 DEBUG trove.conductor.api [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Making async call to cast heartbeat for instance: 06ea8bc8-bc4c-4538-8dd9-04bb42a5edb3 from (pid=921) heartbeat /home/ubuntu/trove/trove/conductor/api.py:48
2015-07-23 20:40:35.273 DEBUG oslo_messaging._drivers.amqp [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Pool creating new connection from (pid=921) create /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqp.py:103
2015-07-23 20:40:35.390 INFO oslo_messaging._drivers.impl_rabbit [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Connecting to AMQP server on 10.0.0.1:5672
2015-07-23 20:40:36.641 INFO oslo_messaging._drivers.impl_rabbit [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Connected to AMQP server on 10.0.0.1:5672
2015-07-23 20:40:36.713 DEBUG trove.guestagent.datastore.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Successfully cast set_status. from (pid=921) set_status /home/ubuntu/trove/trove/guestagent/datastore/service.py:116
2015-07-23 20:40:36.739 INFO trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Preparing Guest as MySQL Server.
2015-07-23 20:40:38.628 DEBUG trove.guestagent.pkg [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Package percona-xtradb-cluster-server already installed. from (pid=921) pkg_is_installed /home/ubuntu/trove/trove/guestagent/pkg.py:395
2015-07-23 20:40:38.685 INFO trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Starting MySQL.
2015-07-23 20:40:38.711 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Enabling MySQL on boot. from (pid=921) _enable_mysql_on_boot /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:717
2015-07-23 20:40:38.742 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo update-rc.d mysql defaults; sudo update-rc.d mysql enable from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:40:44.767 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo update-rc.d mysql defaults; sudo update-rc.d mysql enable" returned: 0 in 6.021s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:40:44.914 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo service mysql start from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:40:46.673 DEBUG trove.openstack.common.periodic_task [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Skipping Manager.update_status, 3 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:40:56.705 DEBUG trove.openstack.common.periodic_task [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Skipping Manager.update_status, 2 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:41:04.061 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo service mysql start" returned: 0 in 19.146s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:41:06.694 DEBUG trove.openstack.common.periodic_task [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Skipping Manager.update_status, 1 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:41:07.270 DEBUG trove.guestagent.datastore.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Waiting for DB status to change to running. from (pid=921) wait_for_real_status_to_change_to /home/ubuntu/trove/trove/guestagent/datastore/service.py:144
2015-07-23 20:41:07.389 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo /usr/bin/mysqladmin ping from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:41:10.298 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo /usr/bin/mysqladmin ping" returned: 0 in 2.908s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:41:10.403 INFO trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] MySQL Service Status is RUNNING.
2015-07-23 20:41:10.450 DEBUG trove.guestagent.datastore.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] DB status was running after 3 seconds. from (pid=921) wait_for_real_status_to_change_to /home/ubuntu/trove/trove/guestagent/datastore/service.py:147
2015-07-23 20:41:10.521 DEBUG trove.guestagent.datastore.mysql.manager [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] start handling the device volume from (pid=921) prepare /home/ubuntu/trove/trove/guestagent/datastore/mysql/manager.py:126
2015-07-23 20:41:10.556 INFO trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Stopping MySQL.
2015-07-23 20:41:10.604 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo service mysql stop from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:41:17.010 DEBUG trove.openstack.common.periodic_task [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running periodic task Manager.update_status from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:106
2015-07-23 20:41:17.663 INFO trove.guestagent.datastore.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] DB server is not installed or is in restart mode, so for now we'll skip determining the status of DB on this instance.
2015-07-23 20:41:26.675 DEBUG trove.openstack.common.periodic_task [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Skipping Manager.update_status, 3 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:41:32.241 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo service mysql stop" returned: 0 in 21.635s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:41:35.418 DEBUG trove.guestagent.datastore.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Waiting for DB status to change to shutdown. from (pid=921) wait_for_real_status_to_change_to /home/ubuntu/trove/trove/guestagent/datastore/service.py:144
2015-07-23 20:41:35.486 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo /usr/bin/mysqladmin ping from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:41:36.704 DEBUG trove.openstack.common.periodic_task [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Skipping Manager.update_status, 2 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:41:37.870 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo /usr/bin/mysqladmin ping" returned: 1 in 2.384s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:41:37.921 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] u'sudo /usr/bin/mysqladmin ping' failed. Not Retrying. from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:308
2015-07-23 20:41:37.946 ERROR trove.common.utils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Command 'sudo /usr/bin/mysqladmin ping' failed. Exit code: 1
stderr: /usr/bin/mysqladmin: connect to server at 'localhost' failed
error: 'Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)'
Check that mysqld is running and that the socket: '/var/run/mysqld/mysqld.sock' exists!
stdout:
2015-07-23 20:41:37.999 ERROR trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Failed to get database status.
2015-07-23 20:41:37.999 TRACE trove.guestagent.datastore.mysql.service Traceback (most recent call last):
2015-07-23 20:41:37.999 TRACE trove.guestagent.datastore.mysql.service File "/home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py", line 171, in _get_actual_db_status
2015-07-23 20:41:37.999 TRACE trove.guestagent.datastore.mysql.service log_output_on_error=True)
2015-07-23 20:41:37.999 TRACE trove.guestagent.datastore.mysql.service File "/home/ubuntu/trove/trove/common/utils.py", line 223, in execute_with_timeout
2015-07-23 20:41:37.999 TRACE trove.guestagent.datastore.mysql.service return execute(*args, **kwargs)
2015-07-23 20:41:37.999 TRACE trove.guestagent.datastore.mysql.service File "/usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py", line 275, in execute
2015-07-23 20:41:37.999 TRACE trove.guestagent.datastore.mysql.service cmd=sanitized_cmd)
2015-07-23 20:41:37.999 TRACE trove.guestagent.datastore.mysql.service ProcessExecutionError: Unexpected error while running command.
2015-07-23 20:41:37.999 TRACE trove.guestagent.datastore.mysql.service Command: sudo /usr/bin/mysqladmin ping
2015-07-23 20:41:37.999 TRACE trove.guestagent.datastore.mysql.service Exit code: 1
2015-07-23 20:41:37.999 TRACE trove.guestagent.datastore.mysql.service Stdout: u''
2015-07-23 20:41:37.999 TRACE trove.guestagent.datastore.mysql.service Stderr: u"\x07/usr/bin/mysqladmin: connect to server at 'localhost' failed\nerror: 'Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)'\nCheck that mysqld is running and that the socket: '/var/run/mysqld/mysqld.sock' exists!\n"
2015-07-23 20:41:37.999 TRACE trove.guestagent.datastore.mysql.service
2015-07-23 20:41:38.264 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): /bin/ps -C mysqld h from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:41:39.499 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "/bin/ps -C mysqld h" returned: 1 in 1.234s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:41:39.581 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] u'/bin/ps -C mysqld h' failed. Not Retrying. from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:308
2015-07-23 20:41:39.627 ERROR trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Process execution failed.
2015-07-23 20:41:39.627 TRACE trove.guestagent.datastore.mysql.service Traceback (most recent call last):
2015-07-23 20:41:39.627 TRACE trove.guestagent.datastore.mysql.service File "/home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py", line 178, in _get_actual_db_status
2015-07-23 20:41:39.627 TRACE trove.guestagent.datastore.mysql.service "mysqld", "h")
2015-07-23 20:41:39.627 TRACE trove.guestagent.datastore.mysql.service File "/home/ubuntu/trove/trove/common/utils.py", line 223, in execute_with_timeout
2015-07-23 20:41:39.627 TRACE trove.guestagent.datastore.mysql.service return execute(*args, **kwargs)
2015-07-23 20:41:39.627 TRACE trove.guestagent.datastore.mysql.service File "/usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py", line 275, in execute
2015-07-23 20:41:39.627 TRACE trove.guestagent.datastore.mysql.service cmd=sanitized_cmd)
2015-07-23 20:41:39.627 TRACE trove.guestagent.datastore.mysql.service ProcessExecutionError: Unexpected error while running command.
2015-07-23 20:41:39.627 TRACE trove.guestagent.datastore.mysql.service Command: /bin/ps -C mysqld h
2015-07-23 20:41:39.627 TRACE trove.guestagent.datastore.mysql.service Exit code: 1
2015-07-23 20:41:39.627 TRACE trove.guestagent.datastore.mysql.service Stdout: u''
2015-07-23 20:41:39.627 TRACE trove.guestagent.datastore.mysql.service Stderr: u''
2015-07-23 20:41:39.627 TRACE trove.guestagent.datastore.mysql.service
2015-07-23 20:41:39.824 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo /usr/sbin/mysqld --print-defaults from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:41:42.390 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo /usr/sbin/mysqld --print-defaults" returned: 0 in 2.565s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:41:42.439 INFO trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] MySQL Service Status is SHUTDOWN.
2015-07-23 20:41:42.462 DEBUG trove.guestagent.datastore.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] DB status was shutdown after 3 seconds. from (pid=921) wait_for_real_status_to_change_to /home/ubuntu/trove/trove/guestagent/datastore/service.py:147
2015-07-23 20:41:42.483 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): grep /dev/vdb /etc/mtab | awk '{print $2}' from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:41:43.023 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "grep /dev/vdb /etc/mtab | awk '{print $2}'" returned: 0 in 0.539s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:41:43.057 INFO trove.guestagent.volume [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Device /dev/vdb is already mounted in . Unmounting now.
2015-07-23 20:41:43.090 DEBUG trove.guestagent.volume [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Checking if /dev/vdb exists. from (pid=921) _check_device_exists /home/ubuntu/trove/trove/guestagent/volume.py:61
2015-07-23 20:41:43.114 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo blockdev --getsize64 /dev/vdb from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:41:44.061 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo blockdev --getsize64 /dev/vdb" returned: 0 in 0.941s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:41:44.095 DEBUG trove.guestagent.volume [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Formatting /dev/vdb. Executing: sudo mkfs -t ext3 -m 5 /dev/vdb. from (pid=921) _format /home/ubuntu/trove/trove/guestagent/volume.py:98
2015-07-23 20:41:46.742 DEBUG trove.openstack.common.periodic_task [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Skipping Manager.update_status, 1 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:41:47.442 DEBUG trove.guestagent.volume [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Checking whether /dev/vdb is formated: sudo dumpe2fs /dev/vdb. from (pid=921) _check_format /home/ubuntu/trove/trove/guestagent/volume.py:74
2015-07-23 20:41:48.251 DEBUG trove.guestagent.volume [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Will mount /dev/vdb at /mnt/volume. from (pid=921) mount /home/ubuntu/trove/trove/guestagent/volume.py:112
2015-07-23 20:41:48.290 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo mkdir -p /mnt/volume from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:41:48.675 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo mkdir -p /mnt/volume" returned: 0 in 0.386s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:41:48.702 DEBUG trove.guestagent.volume [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Mounting volume. Device path:/dev/vdb, mount_point:/mnt/volume, volume_type:ext3, mount options:defaults,noatime from (pid=921) mount /home/ubuntu/trove/trove/guestagent/volume.py:190
2015-07-23 20:41:49.415 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo rsync --safe-links --perms --recursive --owner --group --xattrs --sparse /var/lib/mysql/ /mnt/volume from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:41:53.114 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo rsync --safe-links --perms --recursive --owner --group --xattrs --sparse /var/lib/mysql/ /mnt/volume" returned: 0 in 3.700s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:41:53.986 DEBUG trove.guestagent.volume [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Will mount /dev/vdb at /var/lib/mysql. from (pid=921) mount /home/ubuntu/trove/trove/guestagent/volume.py:112
2015-07-23 20:41:54.005 DEBUG trove.guestagent.volume [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Mounting volume. Device path:/dev/vdb, mount_point:/var/lib/mysql, volume_type:ext3, mount options:defaults,noatime from (pid=921) mount /home/ubuntu/trove/trove/guestagent/volume.py:190
2015-07-23 20:41:54.726 DEBUG trove.guestagent.volume [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Writing new line to fstab:/dev/vdb /var/lib/mysql ext3 defaults,noatime0 0 from (pid=921) write_to_fstab /home/ubuntu/trove/trove/guestagent/volume.py:201
2015-07-23 20:41:54.779 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo install -o root -g root -m 644 /tmp/tmpae5E8C /etc/fstab from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:41:55.299 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo install -o root -g root -m 644 /tmp/tmpae5E8C /etc/fstab" returned: 0 in 0.519s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:41:55.324 DEBUG trove.guestagent.datastore.mysql.manager [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Mounted the volume. from (pid=921) prepare /home/ubuntu/trove/trove/guestagent/datastore/mysql/manager.py:138
2015-07-23 20:41:55.335 INFO trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Starting MySQL.
2015-07-23 20:41:55.345 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Enabling MySQL on boot. from (pid=921) _enable_mysql_on_boot /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:717
2015-07-23 20:41:55.358 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo update-rc.d mysql defaults; sudo update-rc.d mysql enable from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:41:56.685 DEBUG trove.openstack.common.periodic_task [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running periodic task Manager.update_status from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:106
2015-07-23 20:41:56.721 INFO trove.guestagent.datastore.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] DB server is not installed or is in restart mode, so for now we'll skip determining the status of DB on this instance.
2015-07-23 20:41:57.037 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo update-rc.d mysql defaults; sudo update-rc.d mysql enable" returned: 0 in 1.678s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:41:57.051 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo service mysql start from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:42:01.228 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo service mysql start" returned: 0 in 4.175s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:42:04.324 DEBUG trove.guestagent.datastore.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Waiting for DB status to change to running. from (pid=921) wait_for_real_status_to_change_to /home/ubuntu/trove/trove/guestagent/datastore/service.py:144
2015-07-23 20:42:04.351 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo /usr/bin/mysqladmin ping from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:42:04.992 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo /usr/bin/mysqladmin ping" returned: 0 in 0.640s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:42:05.012 INFO trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] MySQL Service Status is RUNNING.
2015-07-23 20:42:05.023 DEBUG trove.guestagent.datastore.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] DB status was running after 3 seconds. from (pid=921) wait_for_real_status_to_change_to /home/ubuntu/trove/trove/guestagent/datastore/service.py:147
2015-07-23 20:42:05.037 DEBUG trove.guestagent.datastore.mysql.manager [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] cluster_config exists with: {u'instance_type': u'member', u'id': u'13e2612f-2635-4e3a-b85a-f84e06fb999b'} from (pid=921) prepare /home/ubuntu/trove/trove/guestagent/datastore/mysql/manager.py:144
2015-07-23 20:42:05.047 DEBUG trove.guestagent.datastore.mysql.manager [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Securing MySQL now. from (pid=921) prepare /home/ubuntu/trove/trove/guestagent/datastore/mysql/manager.py:145
2015-07-23 20:42:05.056 INFO trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Generating admin password.
2015-07-23 20:42:05.079 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Removing expired password. from (pid=921) clear_expired_password /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:84
2015-07-23 20:42:05.091 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo cat /root/.mysql_secret from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:42:05.480 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo cat /root/.mysql_secret" returned: 1 in 0.388s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:42:05.501 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] u'sudo cat /root/.mysql_secret' failed. Not Retrying. from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:308
2015-07-23 20:42:05.518 ERROR trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] /root/.mysql_secret does not exist.
2015-07-23 20:42:05.518 TRACE trove.guestagent.datastore.mysql.service Traceback (most recent call last):
2015-07-23 20:42:05.518 TRACE trove.guestagent.datastore.mysql.service File "/home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py", line 88, in clear_expired_password
2015-07-23 20:42:05.518 TRACE trove.guestagent.datastore.mysql.service run_as_root=True, root_helper="sudo")
2015-07-23 20:42:05.518 TRACE trove.guestagent.datastore.mysql.service File "/usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py", line 275, in execute
2015-07-23 20:42:05.518 TRACE trove.guestagent.datastore.mysql.service cmd=sanitized_cmd)
2015-07-23 20:42:05.518 TRACE trove.guestagent.datastore.mysql.service ProcessExecutionError: Unexpected error while running command.
2015-07-23 20:42:05.518 TRACE trove.guestagent.datastore.mysql.service Command: sudo cat /root/.mysql_secret
2015-07-23 20:42:05.518 TRACE trove.guestagent.datastore.mysql.service Exit code: 1
2015-07-23 20:42:05.518 TRACE trove.guestagent.datastore.mysql.service Stdout: u''
2015-07-23 20:42:05.518 TRACE trove.guestagent.datastore.mysql.service Stderr: u'cat: /root/.mysql_secret: No such file or directory\n'
2015-07-23 20:42:05.518 TRACE trove.guestagent.datastore.mysql.service
2015-07-23 20:42:06.160 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] SELECT DATABASE()
2015-07-23 20:42:06.178 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] ()
2015-07-23 20:42:06.253 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] SHOW VARIABLES LIKE 'character_set%%'
2015-07-23 20:42:06.264 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] ()
2015-07-23 20:42:06.318 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] SHOW VARIABLES LIKE 'sql_mode'
2015-07-23 20:42:06.359 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] ()
2015-07-23 20:42:06.387 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] BEGIN (implicit)
2015-07-23 20:42:06.405 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] DELETE FROM mysql.user WHERE User = '';
2015-07-23 20:42:06.417 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] ()
2015-07-23 20:42:06.450 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] removed anon user from (pid=921) secure /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:638
2015-07-23 20:42:06.463 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] wtf is this _create_admin_user? GRANT ALL PRIVILEGES ON *.* TO `os_admin`@`localhost` IDENTIFIED BY '8arkTNseggAwXr7Rakd7Y7psRMPTpj8QqN4d' WITH GRANT OPTION; from (pid=921) _create_admin_user /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:594
2015-07-23 20:42:06.477 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] GRANT ALL PRIVILEGES ON *.* TO `os_admin`@`localhost` IDENTIFIED BY '8arkTNseggAwXr7Rakd7Y7psRMPTpj8QqN4d' WITH GRANT OPTION;
2015-07-23 20:42:06.486 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] ()
2015-07-23 20:42:06.524 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] select * from mysql.user;
2015-07-23 20:42:06.539 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] ()
2015-07-23 20:42:06.572 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] admin exist? <sqlalchemy.engine.result.ResultProxy object at 0x7f7c7f759a10> from (pid=921) _create_admin_user /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:597
2015-07-23 20:42:06.583 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] row: ('localhost', 'root', '', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', '', '', '', '', 0L, 0L, 0L, 0L, '', '') from (pid=921) _create_admin_user /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:599
2015-07-23 20:42:06.596 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] row: ('devstack1', 'root', '', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', '', '', '', '', 0L, 0L, 0L, 0L, '', '') from (pid=921) _create_admin_user /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:599
2015-07-23 20:42:06.609 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] row: ('127.0.0.1', 'root', '', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', '', '', '', '', 0L, 0L, 0L, 0L, '', '') from (pid=921) _create_admin_user /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:599
2015-07-23 20:42:06.624 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] row: ('::1', 'root', '', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', '', '', '', '', 0L, 0L, 0L, 0L, '', '') from (pid=921) _create_admin_user /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:599
2015-07-23 20:42:06.634 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] row: ('localhost', 'debian-sys-maint', '*F26C6877ABEA9AB116FBA446A5A78CDF92D7F2EB', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'N', '', '', '', '', 0L, 0L, 0L, 0L, '', None) from (pid=921) _create_admin_user /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:599
2015-07-23 20:42:06.648 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] row: ('localhost', 'os_admin', '*FEC9C56361FFC490BD6EECCA661600109B31CBC3', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', '', '', '', '', 0L, 0L, 0L, 0L, '', None) from (pid=921) _create_admin_user /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:599
2015-07-23 20:42:06.659 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] created admin user/pass from (pid=921) secure /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:640
2015-07-23 20:42:06.667 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] have a transaction from (pid=921) __exit__ /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:212
2015-07-23 20:42:06.682 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] flushing transaction from (pid=921) __exit__ /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:218
2015-07-23 20:42:06.693 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] FLUSH PRIVILEGES;
2015-07-23 20:42:06.705 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] ()
2015-07-23 20:42:06.728 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] commiting transaction from (pid=921) __exit__ /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:220
2015-07-23 20:42:06.737 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] COMMIT
2015-07-23 20:42:06.748 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] closing transaction from (pid=921) __exit__ /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:222
2015-07-23 20:42:06.760 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] done with transaction exiting from (pid=921) __exit__ /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:224
2015-07-23 20:42:06.776 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] BEGIN (implicit)
2015-07-23 20:42:06.787 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] checking admin user/pass set from (pid=921) secure /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:642
2015-07-23 20:42:06.797 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] select * from mysql.user;
2015-07-23 20:42:06.810 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] ()
2015-07-23 20:42:06.835 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] admin exist? <sqlalchemy.engine.result.ResultProxy object at 0x7f7c7f759a90> from (pid=921) secure /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:644
2015-07-23 20:42:06.845 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] row: ('localhost', 'root', '', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', '', '', '', '', 0L, 0L, 0L, 0L, '', '') from (pid=921) secure /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:646
2015-07-23 20:42:06.855 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] row: ('devstack1', 'root', '', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', '', '', '', '', 0L, 0L, 0L, 0L, '', '') from (pid=921) secure /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:646
2015-07-23 20:42:06.866 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] row: ('127.0.0.1', 'root', '', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', '', '', '', '', 0L, 0L, 0L, 0L, '', '') from (pid=921) secure /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:646
2015-07-23 20:42:06.877 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] row: ('::1', 'root', '', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', '', '', '', '', 0L, 0L, 0L, 0L, '', '') from (pid=921) secure /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:646
2015-07-23 20:42:06.886 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] row: ('localhost', 'debian-sys-maint', '*F26C6877ABEA9AB116FBA446A5A78CDF92D7F2EB', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'N', '', '', '', '', 0L, 0L, 0L, 0L, '', None) from (pid=921) secure /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:646
2015-07-23 20:42:06.895 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] row: ('localhost', 'os_admin', '*FEC9C56361FFC490BD6EECCA661600109B31CBC3', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', '', '', '', '', 0L, 0L, 0L, 0L, '', None) from (pid=921) secure /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:646
2015-07-23 20:42:06.905 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] have a transaction from (pid=921) __exit__ /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:212
2015-07-23 20:42:06.914 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] flushing transaction from (pid=921) __exit__ /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:218
2015-07-23 20:42:06.926 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] FLUSH PRIVILEGES;
2015-07-23 20:42:06.937 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] ()
2015-07-23 20:42:06.954 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] commiting transaction from (pid=921) __exit__ /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:220
2015-07-23 20:42:06.966 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] COMMIT
2015-07-23 20:42:06.982 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] closing transaction from (pid=921) __exit__ /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:222
2015-07-23 20:42:06.994 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] done with transaction exiting from (pid=921) __exit__ /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:224
2015-07-23 20:42:07.006 INFO trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Stopping MySQL.
2015-07-23 20:42:07.018 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo service mysql stop from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:42:07.137 DEBUG trove.openstack.common.periodic_task [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Skipping Manager.update_status, 3 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:42:17.126 DEBUG trove.openstack.common.periodic_task [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Skipping Manager.update_status, 2 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:42:17.453 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo service mysql stop" returned: 0 in 10.434s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:42:20.469 DEBUG trove.guestagent.datastore.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Waiting for DB status to change to shutdown. from (pid=921) wait_for_real_status_to_change_to /home/ubuntu/trove/trove/guestagent/datastore/service.py:144
2015-07-23 20:42:20.487 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo /usr/bin/mysqladmin ping from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:42:21.106 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo /usr/bin/mysqladmin ping" returned: 1 in 0.619s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:42:21.123 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] u'sudo /usr/bin/mysqladmin ping' failed. Not Retrying. from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:308
2015-07-23 20:42:21.156 ERROR trove.common.utils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Command 'sudo /usr/bin/mysqladmin ping' failed. Exit code: 1
stderr: /usr/bin/mysqladmin: connect to server at 'localhost' failed
error: 'Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)'
Check that mysqld is running and that the socket: '/var/run/mysqld/mysqld.sock' exists!
stdout:
2015-07-23 20:42:21.173 ERROR trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Failed to get database status.
2015-07-23 20:42:21.173 TRACE trove.guestagent.datastore.mysql.service Traceback (most recent call last):
2015-07-23 20:42:21.173 TRACE trove.guestagent.datastore.mysql.service File "/home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py", line 171, in _get_actual_db_status
2015-07-23 20:42:21.173 TRACE trove.guestagent.datastore.mysql.service log_output_on_error=True)
2015-07-23 20:42:21.173 TRACE trove.guestagent.datastore.mysql.service File "/home/ubuntu/trove/trove/common/utils.py", line 223, in execute_with_timeout
2015-07-23 20:42:21.173 TRACE trove.guestagent.datastore.mysql.service return execute(*args, **kwargs)
2015-07-23 20:42:21.173 TRACE trove.guestagent.datastore.mysql.service File "/usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py", line 275, in execute
2015-07-23 20:42:21.173 TRACE trove.guestagent.datastore.mysql.service cmd=sanitized_cmd)
2015-07-23 20:42:21.173 TRACE trove.guestagent.datastore.mysql.service ProcessExecutionError: Unexpected error while running command.
2015-07-23 20:42:21.173 TRACE trove.guestagent.datastore.mysql.service Command: sudo /usr/bin/mysqladmin ping
2015-07-23 20:42:21.173 TRACE trove.guestagent.datastore.mysql.service Exit code: 1
2015-07-23 20:42:21.173 TRACE trove.guestagent.datastore.mysql.service Stdout: u''
2015-07-23 20:42:21.173 TRACE trove.guestagent.datastore.mysql.service Stderr: u"\x07/usr/bin/mysqladmin: connect to server at 'localhost' failed\nerror: 'Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)'\nCheck that mysqld is running and that the socket: '/var/run/mysqld/mysqld.sock' exists!\n"
2015-07-23 20:42:21.173 TRACE trove.guestagent.datastore.mysql.service
2015-07-23 20:42:21.201 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): /bin/ps -C mysqld h from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:42:21.495 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "/bin/ps -C mysqld h" returned: 1 in 0.294s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:42:21.518 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] u'/bin/ps -C mysqld h' failed. Not Retrying. from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:308
2015-07-23 20:42:21.532 ERROR trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Process execution failed.
2015-07-23 20:42:21.532 TRACE trove.guestagent.datastore.mysql.service Traceback (most recent call last):
2015-07-23 20:42:21.532 TRACE trove.guestagent.datastore.mysql.service File "/home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py", line 178, in _get_actual_db_status
2015-07-23 20:42:21.532 TRACE trove.guestagent.datastore.mysql.service "mysqld", "h")
2015-07-23 20:42:21.532 TRACE trove.guestagent.datastore.mysql.service File "/home/ubuntu/trove/trove/common/utils.py", line 223, in execute_with_timeout
2015-07-23 20:42:21.532 TRACE trove.guestagent.datastore.mysql.service return execute(*args, **kwargs)
2015-07-23 20:42:21.532 TRACE trove.guestagent.datastore.mysql.service File "/usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py", line 275, in execute
2015-07-23 20:42:21.532 TRACE trove.guestagent.datastore.mysql.service cmd=sanitized_cmd)
2015-07-23 20:42:21.532 TRACE trove.guestagent.datastore.mysql.service ProcessExecutionError: Unexpected error while running command.
2015-07-23 20:42:21.532 TRACE trove.guestagent.datastore.mysql.service Command: /bin/ps -C mysqld h
2015-07-23 20:42:21.532 TRACE trove.guestagent.datastore.mysql.service Exit code: 1
2015-07-23 20:42:21.532 TRACE trove.guestagent.datastore.mysql.service Stdout: u''
2015-07-23 20:42:21.532 TRACE trove.guestagent.datastore.mysql.service Stderr: u''
2015-07-23 20:42:21.532 TRACE trove.guestagent.datastore.mysql.service
2015-07-23 20:42:21.563 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo /usr/sbin/mysqld --print-defaults from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:42:22.278 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo /usr/sbin/mysqld --print-defaults" returned: 0 in 0.714s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:42:22.303 INFO trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] MySQL Service Status is SHUTDOWN.
2015-07-23 20:42:22.316 DEBUG trove.guestagent.datastore.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] DB status was shutdown after 3 seconds. from (pid=921) wait_for_real_status_to_change_to /home/ubuntu/trove/trove/guestagent/datastore/service.py:147
2015-07-23 20:42:22.347 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] stopped db from (pid=921) secure /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:649
2015-07-23 20:42:22.359 INFO trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Writing my.cnf templates.
2015-07-23 20:42:22.380 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo mv /tmp/my.cnf.tmp /etc/mysql/my.cnf from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:42:23.257 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo mv /tmp/my.cnf.tmp /etc/mysql/my.cnf" returned: 0 in 0.872s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:42:23.383 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo mv /tmp/my.cnf.tmp /etc/mysql/my.cnf from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:42:23.861 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo mv /tmp/my.cnf.tmp /etc/mysql/my.cnf" returned: 0 in 0.477s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:42:23.886 INFO trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Wiping ib_logfiles.
2015-07-23 20:42:23.902 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo rm -f -R /var/lib/mysql/ib_logfile0 from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:42:24.339 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo rm -f -R /var/lib/mysql/ib_logfile0" returned: 0 in 0.438s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:42:24.386 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo rm -f -R /var/lib/mysql/ib_logfile1 from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:42:24.813 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo rm -f -R /var/lib/mysql/ib_logfile1" returned: 0 in 0.426s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:42:24.846 INFO trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Writing new temp overrides.cnf file.
2015-07-23 20:42:24.861 INFO trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Moving overrides.cnf into correct location.
2015-07-23 20:42:24.875 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo mv /tmp/overrides.cnf.tmp /etc/mysql/conf.d/overrides.cnf from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:42:25.299 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo mv /tmp/overrides.cnf.tmp /etc/mysql/conf.d/overrides.cnf" returned: 0 in 0.423s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:42:25.331 INFO trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Setting permissions on overrides.cnf.
2015-07-23 20:42:25.345 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo chmod -R =064 /etc/mysql/conf.d/overrides.cnf from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:42:25.794 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo chmod -R =064 /etc/mysql/conf.d/overrides.cnf" returned: 0 in 0.448s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:42:25.826 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] write the mysql config and overrides and all that stuff from (pid=921) secure /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:651
2015-07-23 20:42:25.839 INFO trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Starting MySQL.
2015-07-23 20:42:25.850 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Enabling MySQL on boot. from (pid=921) _enable_mysql_on_boot /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:717
2015-07-23 20:42:25.892 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo update-rc.d mysql defaults; sudo update-rc.d mysql enable from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:42:27.142 DEBUG trove.openstack.common.periodic_task [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Skipping Manager.update_status, 1 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:42:27.612 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo update-rc.d mysql defaults; sudo update-rc.d mysql enable" returned: 0 in 1.720s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:42:27.662 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo service mysql start from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:42:37.187 DEBUG trove.openstack.common.periodic_task [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running periodic task Manager.update_status from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:106
2015-07-23 20:42:37.384 INFO trove.guestagent.datastore.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] DB server is not installed or is in restart mode, so for now we'll skip determining the status of DB on this instance.
2015-07-23 20:42:47.173 DEBUG trove.openstack.common.periodic_task [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Skipping Manager.update_status, 3 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:42:57.182 DEBUG trove.openstack.common.periodic_task [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Skipping Manager.update_status, 2 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:42:57.673 ERROR trove.common.utils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Time out after waiting 30 seconds when running proc: ('sudo service mysql start',) {'shell': True}.
2015-07-23 20:43:00.703 DEBUG trove.guestagent.datastore.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Waiting for DB status to change to running. from (pid=921) wait_for_real_status_to_change_to /home/ubuntu/trove/trove/guestagent/datastore/service.py:144
2015-07-23 20:43:00.744 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo /usr/bin/mysqladmin ping from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:43:01.911 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo /usr/bin/mysqladmin ping" returned: 1 in 1.167s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:43:01.980 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] u'sudo /usr/bin/mysqladmin ping' failed. Not Retrying. from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:308
2015-07-23 20:43:02.001 ERROR trove.common.utils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Command 'sudo /usr/bin/mysqladmin ping' failed. Exit code: 1
stderr: /usr/bin/mysqladmin: connect to server at 'localhost' failed
error: 'Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)'
Check that mysqld is running and that the socket: '/var/run/mysqld/mysqld.sock' exists!
stdout:
2015-07-23 20:43:02.059 ERROR trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Failed to get database status.
2015-07-23 20:43:02.059 TRACE trove.guestagent.datastore.mysql.service Traceback (most recent call last):
2015-07-23 20:43:02.059 TRACE trove.guestagent.datastore.mysql.service File "/home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py", line 171, in _get_actual_db_status
2015-07-23 20:43:02.059 TRACE trove.guestagent.datastore.mysql.service log_output_on_error=True)
2015-07-23 20:43:02.059 TRACE trove.guestagent.datastore.mysql.service File "/home/ubuntu/trove/trove/common/utils.py", line 223, in execute_with_timeout
2015-07-23 20:43:02.059 TRACE trove.guestagent.datastore.mysql.service return execute(*args, **kwargs)
2015-07-23 20:43:02.059 TRACE trove.guestagent.datastore.mysql.service File "/usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py", line 275, in execute
2015-07-23 20:43:02.059 TRACE trove.guestagent.datastore.mysql.service cmd=sanitized_cmd)
2015-07-23 20:43:02.059 TRACE trove.guestagent.datastore.mysql.service ProcessExecutionError: Unexpected error while running command.
2015-07-23 20:43:02.059 TRACE trove.guestagent.datastore.mysql.service Command: sudo /usr/bin/mysqladmin ping
2015-07-23 20:43:02.059 TRACE trove.guestagent.datastore.mysql.service Exit code: 1
2015-07-23 20:43:02.059 TRACE trove.guestagent.datastore.mysql.service Stdout: u''
2015-07-23 20:43:02.059 TRACE trove.guestagent.datastore.mysql.service Stderr: u"\x07/usr/bin/mysqladmin: connect to server at 'localhost' failed\nerror: 'Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)'\nCheck that mysqld is running and that the socket: '/var/run/mysqld/mysqld.sock' exists!\n"
2015-07-23 20:43:02.059 TRACE trove.guestagent.datastore.mysql.service
2015-07-23 20:43:02.152 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): /bin/ps -C mysqld h from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:43:02.635 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "/bin/ps -C mysqld h" returned: 0 in 0.482s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:43:02.678 INFO trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] MySQL Service Status 3138 is BLOCKED.
2015-07-23 20:43:02.701 DEBUG trove.guestagent.datastore.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] DB status was blocked after 3 seconds. from (pid=921) wait_for_real_status_to_change_to /home/ubuntu/trove/trove/guestagent/datastore/service.py:147
2015-07-23 20:43:05.726 DEBUG trove.guestagent.datastore.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Waiting for DB status to change to running. from (pid=921) wait_for_real_status_to_change_to /home/ubuntu/trove/trove/guestagent/datastore/service.py:144
2015-07-23 20:43:05.745 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo /usr/bin/mysqladmin ping from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:43:06.295 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo /usr/bin/mysqladmin ping" returned: 0 in 0.549s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:43:06.318 INFO trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] MySQL Service Status is RUNNING.
2015-07-23 20:43:06.331 DEBUG trove.guestagent.datastore.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] DB status was running after 6 seconds. from (pid=921) wait_for_real_status_to_change_to /home/ubuntu/trove/trove/guestagent/datastore/service.py:147
2015-07-23 20:43:06.351 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] started mysql up again from (pid=921) secure /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:653
2015-07-23 20:43:06.377 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] BEGIN (implicit)
2015-07-23 20:43:06.397 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] checking admin user/pass set yet again from (pid=921) secure /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:657
2015-07-23 20:43:06.479 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] select * from mysql.user;
2015-07-23 20:43:06.514 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] ()
2015-07-23 20:43:06.668 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] have a transaction from (pid=921) __exit__ /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:212
2015-07-23 20:43:06.698 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] rolling back the transaction : <class 'sqlalchemy.exc.OperationalError'> from (pid=921) __exit__ /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:214
2015-07-23 20:43:06.731 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] closing transaction from (pid=921) __exit__ /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:222
2015-07-23 20:43:06.986 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] done with transaction exiting from (pid=921) __exit__ /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:224
2015-07-23 20:43:07.002 ERROR trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] failed to query mysql
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service Traceback (most recent call last):
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service File "/home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py", line 658, in secure
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service out = client.execute(text("select * from mysql.user;"))
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 662, in execute
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service params)
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 761, in _execute_clauseelement
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service compiled_sql, distilled_params
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 874, in _execute_context
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service context)
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1024, in _handle_dbapi_exception
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service exc_info
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 196, in raise_from_cause
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service reraise(type(exception), exception, tb=exc_tb)
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 867, in _execute_context
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service context)
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 324, in do_execute
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service cursor.execute(statement, parameters)
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service File "/usr/lib/python2.7/dist-packages/MySQLdb/cursors.py", line 174, in execute
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service self.errorhandler(self, exc, value)
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service File "/usr/lib/python2.7/dist-packages/MySQLdb/connections.py", line 36, in defaulterrorhandler
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service raise errorclass, errorvalue
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service OperationalError: (OperationalError) (2006, 'MySQL server has gone away') 'select * from mysql.user;' ()
2015-07-23 20:43:07.002 TRACE trove.guestagent.datastore.mysql.service
2015-07-23 20:43:07.226 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Running cmd (subprocess): sudo awk /password\t=/{print $3; exit} /etc/mysql/my.cnf from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:230
2015-07-23 20:43:07.338 DEBUG trove.openstack.common.periodic_task [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Skipping Manager.update_status, 1 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:43:07.764 DEBUG oslo_concurrency.processutils [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] CMD "sudo awk /password\t=/{print $3; exit} /etc/mysql/my.cnf" returned: 0 in 0.537s from (pid=921) execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
2015-07-23 20:43:07.851 ERROR trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] failed to query mysql
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service Traceback (most recent call last):
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service File "/home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py", line 666, in secure
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service with LocalSqlClient(get_engine()) as client:
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service File "/home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py", line 206, in __enter__
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service self.conn = self.engine.connect()
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1641, in connect
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service return self._connection_cls(self, **kwargs)
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 59, in __init__
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service self.__connection = connection or engine.raw_connection()
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1699, in raw_connection
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service return self.pool.unique_connection()
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 220, in unique_connection
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service return _ConnectionFairy(self).checkout()
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 431, in __init__
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service rec = self._connection_record = pool._do_get()
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 772, in _do_get
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service return self._create_connection()
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 225, in _create_connection
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service return _ConnectionRecord(self)
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 318, in __init__
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service self.connection = self.__connect()
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 379, in __connect
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service connection = self.__pool._creator()
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/strategies.py", line 80, in connect
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service return dialect.connect(*cargs, **cparams)
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 283, in connect
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service return self.dbapi.connect(*cargs, **cparams)
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service File "/usr/lib/python2.7/dist-packages/MySQLdb/__init__.py", line 81, in Connect
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service return Connection(*args, **kwargs)
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service File "/usr/lib/python2.7/dist-packages/MySQLdb/connections.py", line 187, in __init__
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service super(Connection, self).__init__(*args, **kwargs2)
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service OperationalError: (OperationalError) (1045, "Access denied for user 'os_admin'@'localhost' (using password: YES)") None None
2015-07-23 20:43:07.851 TRACE trove.guestagent.datastore.mysql.service
2015-07-23 20:43:07.958 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] BEGIN (implicit)
2015-07-23 20:43:07.976 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] checking admin user/pass set yet again from (pid=921) secure /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:677
2015-07-23 20:43:07.988 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] select * from mysql.user;
2015-07-23 20:43:07.999 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] ()
2015-07-23 20:43:08.054 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] admin exist? <sqlalchemy.engine.result.ResultProxy object at 0x7f7c7ecc53d0> from (pid=921) secure /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:679
2015-07-23 20:43:08.067 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] row: ('localhost', 'root', '', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', '', '', '', '', 0L, 0L, 0L, 0L, '', '') from (pid=921) secure /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:681
2015-07-23 20:43:08.076 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] row: ('devstack1', 'root', '', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', '', '', '', '', 0L, 0L, 0L, 0L, '', '') from (pid=921) secure /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:681
2015-07-23 20:43:08.086 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] row: ('127.0.0.1', 'root', '', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', '', '', '', '', 0L, 0L, 0L, 0L, '', '') from (pid=921) secure /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:681
2015-07-23 20:43:08.098 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] row: ('::1', 'root', '', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', '', '', '', '', 0L, 0L, 0L, 0L, '', '') from (pid=921) secure /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:681
2015-07-23 20:43:08.113 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] row: ('localhost', 'debian-sys-maint', '*F26C6877ABEA9AB116FBA446A5A78CDF92D7F2EB', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'Y', 'N', '', '', '', '', 0L, 0L, 0L, 0L, '', None) from (pid=921) secure /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:681
2015-07-23 20:43:08.125 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] have a transaction from (pid=921) __exit__ /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:212
2015-07-23 20:43:08.150 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] flushing transaction from (pid=921) __exit__ /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:218
2015-07-23 20:43:08.161 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] FLUSH PRIVILEGES;
2015-07-23 20:43:08.172 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] ()
2015-07-23 20:43:08.189 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] commiting transaction from (pid=921) __exit__ /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:220
2015-07-23 20:43:08.200 INFO sqlalchemy.engine.base.Engine [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] COMMIT
2015-07-23 20:43:08.212 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] closing transaction from (pid=921) __exit__ /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:222
2015-07-23 20:43:08.255 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] done with transaction exiting from (pid=921) __exit__ /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:224
2015-07-23 20:43:08.265 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] MySQL secure complete. from (pid=921) secure /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:685
2015-07-23 20:43:08.277 DEBUG trove.guestagent.datastore.mysql.manager [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] secure with config_contents and overrides done from (pid=921) prepare /home/ubuntu/trove/trove/guestagent/datastore/mysql/manager.py:147
2015-07-23 20:43:08.285 DEBUG trove.guestagent.datastore.mysql.manager [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] secure remote 3 from (pid=921) prepare /home/ubuntu/trove/trove/guestagent/datastore/mysql/manager.py:161
2015-07-23 20:43:08.297 DEBUG trove.guestagent.datastore.mysql.service [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] securing root from (pid=921) secure_root /home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py:688
2015-07-23 20:43:08.319 ERROR oslo_messaging.rpc.dispatcher [req-c1f9ea81-5438-413d-b73d-f57b5c5e2758 b3e64229a159444cb567fc97b0e514bc f52eda5160fa4751ae8eb85928d13445] Exception during message handling: (OperationalError) (1045, "Access denied for user 'os_admin'@'localhost' (using password: YES)") None None
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher Traceback (most recent call last):
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher executor_callback))
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher executor_callback)
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 129, in _do_dispatch
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher result = func(ctxt, **new_args)
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/osprofiler/profiler.py", line 105, in wrapper
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher return f(*args, **kwargs)
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher File "/home/ubuntu/trove/trove/guestagent/datastore/mysql/manager.py", line 162, in prepare
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher app.secure_root(secure_remote_root=True)
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher File "/home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py", line 689, in secure_root
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher with LocalSqlClient(get_engine()) as client:
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher File "/home/ubuntu/trove/trove/guestagent/datastore/mysql/service.py", line 206, in __enter__
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher self.conn = self.engine.connect()
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1641, in connect
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher return self._connection_cls(self, **kwargs)
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 59, in __init__
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher self.__connection = connection or engine.raw_connection()
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1699, in raw_connection
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher return self.pool.unique_connection()
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 220, in unique_connection
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher return _ConnectionFairy(self).checkout()
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 431, in __init__
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher rec = self._connection_record = pool._do_get()
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 772, in _do_get
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher return self._create_connection()
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 225, in _create_connection
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher return _ConnectionRecord(self)
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 318, in __init__
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher self.connection = self.__connect()
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 379, in __connect
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher connection = self.__pool._creator()
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/strategies.py", line 80, in connect
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher return dialect.connect(*cargs, **cparams)
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 283, in connect
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher return self.dbapi.connect(*cargs, **cparams)
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/MySQLdb/__init__.py", line 81, in Connect
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher return Connection(*args, **kwargs)
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/MySQLdb/connections.py", line 187, in __init__
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher super(Connection, self).__init__(*args, **kwargs2)
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher OperationalError: (OperationalError) (1045, "Access denied for user 'os_admin'@'localhost' (using password: YES)") None None
2015-07-23 20:43:08.319 TRACE oslo_messaging.rpc.dispatcher
2015-07-23 20:43:17.330 DEBUG trove.openstack.common.periodic_task [-] Running periodic task Manager.update_status from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:106
2015-07-23 20:43:17.350 INFO trove.guestagent.datastore.service [-] DB server is not installed or is in restart mode, so for now we'll skip determining the status of DB on this instance.
2015-07-23 20:43:27.331 DEBUG trove.openstack.common.periodic_task [-] Skipping Manager.update_status, 3 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:43:37.331 DEBUG trove.openstack.common.periodic_task [-] Skipping Manager.update_status, 2 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:43:47.331 DEBUG trove.openstack.common.periodic_task [-] Skipping Manager.update_status, 1 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:43:57.332 DEBUG trove.openstack.common.periodic_task [-] Running periodic task Manager.update_status from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:106
2015-07-23 20:43:57.343 INFO trove.guestagent.datastore.service [-] DB server is not installed or is in restart mode, so for now we'll skip determining the status of DB on this instance.
2015-07-23 20:44:07.333 DEBUG trove.openstack.common.periodic_task [-] Skipping Manager.update_status, 3 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:44:17.334 DEBUG trove.openstack.common.periodic_task [-] Skipping Manager.update_status, 2 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:44:27.334 DEBUG trove.openstack.common.periodic_task [-] Skipping Manager.update_status, 1 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:44:37.335 DEBUG trove.openstack.common.periodic_task [-] Running periodic task Manager.update_status from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:106
2015-07-23 20:44:37.343 INFO trove.guestagent.datastore.service [-] DB server is not installed or is in restart mode, so for now we'll skip determining the status of DB on this instance.
2015-07-23 20:44:47.335 DEBUG trove.openstack.common.periodic_task [-] Skipping Manager.update_status, 3 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:44:57.337 DEBUG trove.openstack.common.periodic_task [-] Skipping Manager.update_status, 2 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:45:07.338 DEBUG trove.openstack.common.periodic_task [-] Skipping Manager.update_status, 1 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:45:17.336 DEBUG trove.openstack.common.periodic_task [-] Running periodic task Manager.update_status from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:106
2015-07-23 20:45:17.347 INFO trove.guestagent.datastore.service [-] DB server is not installed or is in restart mode, so for now we'll skip determining the status of DB on this instance.
2015-07-23 20:45:27.337 DEBUG trove.openstack.common.periodic_task [-] Skipping Manager.update_status, 3 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:45:37.337 DEBUG trove.openstack.common.periodic_task [-] Skipping Manager.update_status, 2 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:45:47.338 DEBUG trove.openstack.common.periodic_task [-] Skipping Manager.update_status, 1 ticks left until next run from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:100
2015-07-23 20:45:57.338 DEBUG trove.openstack.common.periodic_task [-] Running periodic task Manager.update_status from (pid=921) run_periodic_tasks /home/ubuntu/trove/trove/openstack/common/periodic_task.py:106
2015-07-23 20:45:57.346 INFO trove.guestagent.datastore.service [-] DB server is not installed or is in restart mode, so for now we'll skip determining the status of DB on this instance.
@gpaterno
Copy link

Hi! Wish to know if you solved this issue. Thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment