Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Select an option

  • Save obengwilliam/cb0ea1e4b46fc347534764ed082918d0 to your computer and use it in GitHub Desktop.

Select an option

Save obengwilliam/cb0ea1e4b46fc347534764ed082918d0 to your computer and use it in GitHub Desktop.
How to recover RabbitMQ after running out of disk space

If RabbitMQ wont start and show the following in the startup logs:

# cat  /var/log/rabbitmq/startup_log


BOOT FAILED
===========

Error description:
   {error,corrupt_cluster_status_files,[]}

Log files (may contain more information):
   /var/log/rabbitmq/rabbit@exodus.log
   /var/log/rabbitmq/rabbit@exodus-sasl.log

Stack trace:
   [{rabbit_node_monitor,'-prepare_cluster_status_files/0-fun-0-',1},
    {rabbit_node_monitor,prepare_cluster_status_files,0},
    {rabbit,'-boot/0-fun-1-',0},
    {rabbit,start_it,1},
    {init,start_it,1},
    {init,start_em,1}]

{"init terminating in do_boot",{rabbit,failure_during_boot,{error,corrupt_cluster_status_files,[]}}}
# cat /var/log/rabbitmq/rabbit@exodus.log

=INFO REPORT==== 25-Mar-2014::04:43:36 ===
Error description:
   {error,corrupt_cluster_status_files,[]}

Log files (may contain more information):
   /var/log/rabbitmq/rabbit@exodus.log
   /var/log/rabbitmq/rabbit@exodus-sasl.log

Stack trace:
   [{rabbit_node_monitor,'-prepare_cluster_status_files/0-fun-0-',1},
    {rabbit_node_monitor,prepare_cluster_status_files,0},
    {rabbit,'-boot/0-fun-1-',0},
    {rabbit,start_it,1},
    {init,start_it,1},
    {init,start_em,1}]


=INFO REPORT==== 25-Mar-2014::04:44:24 ===
Error description:
   {error,corrupt_cluster_status_files,[]}

Log files (may contain more information):
   /var/log/rabbitmq/rabbit@exodus.log
   /var/log/rabbitmq/rabbit@exodus-sasl.log

Stack trace:
   [{rabbit_node_monitor,'-prepare_cluster_status_files/0-fun-0-',1},
    {rabbit_node_monitor,prepare_cluster_status_files,0},
    {rabbit,'-boot/0-fun-1-',0},
    {rabbit,start_it,1},
    {init,start_it,1},
    {init,start_em,1}]


=INFO REPORT==== 25-Mar-2014::04:44:39 ===
Error description:
   {error,corrupt_cluster_status_files,[]}

Log files (may contain more information):
   /var/log/rabbitmq/rabbit@exodus.log
   /var/log/rabbitmq/rabbit@exodus-sasl.log

Stack trace:
   [{rabbit_node_monitor,'-prepare_cluster_status_files/0-fun-0-',1},
    {rabbit_node_monitor,prepare_cluster_status_files,0},
    {rabbit,'-boot/0-fun-1-',0},
    {rabbit,start_it,1},
    {init,start_it,1},
    {init,start_em,1}]


=INFO REPORT==== 25-Mar-2014::04:46:27 ===
Error description:
   {error,corrupt_cluster_status_files,[]}

Log files (may contain more information):
   /var/log/rabbitmq/rabbit@exodus.log
   /var/log/rabbitmq/rabbit@exodus-sasl.log

Stack trace:
   [{rabbit_node_monitor,'-prepare_cluster_status_files/0-fun-0-',1},
    {rabbit_node_monitor,prepare_cluster_status_files,0},
    {rabbit,'-boot/0-fun-1-',0},
    {rabbit,start_it,1},
    {init,start_it,1},
    {init,start_em,1}]


=INFO REPORT==== 25-Mar-2014::04:48:06 ===
Error description:
   {error,corrupt_cluster_status_files,[]}

Log files (may contain more information):
   /var/log/rabbitmq/rabbit@exodus.log
   /var/log/rabbitmq/rabbit@exodus-sasl.log

Stack trace:
   [{rabbit_node_monitor,'-prepare_cluster_status_files/0-fun-0-',1},
    {rabbit_node_monitor,prepare_cluster_status_files,0},
    {rabbit,'-boot/0-fun-1-',0},
    {rabbit,start_it,1},
    {init,start_it,1},
    {init,start_em,1}]

Manually purge the Queues by removing them from /var/lib/rabbitmq/mnesia/ and then starting the service.

# rm -fr /var/lib/rabbitmq/mnesia/*
# service rabbitmq-server start
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment