Shut down foreman-tasks:
service foreman-tasks stop
Open the rails console:
foreman-rake console
and run:
ForemanTasks::Task.where(:label => 'Actions::Candlepin::ListenOnCandlepinEvents').destroy_all
exit
start foreman-tasks:
service foreman-tasks start