Reconcile Cloudera director

clouderaDirectorReconcile

https://community.cloudera.com/t5/Cloudera-Director-Cloud-based/Director-pipeline-SUSPENDED-UPDATE-FAILED/td-p/28598/page/3

I think the TL;DR was that there's a CRaSH shell (https://www.crashub.org/) running on the Director node that allows some emergency recovery commands to be run. The default port is 2000 and you can use your regular admin login.

[centos@ip-10-10-4-28 ~]$ ssh -p 2000 -l admin localhost
Password authentication
Password:

This CRaSH shell contains a set of administrative commands that are not available
through the Cloudera Director UI or API. Improper use of many these commands can
leave Director in an erroneous state. Troubleshooting with these commands should
be done with care and only as a last resort.

Commands:
  pipelines   : commands to manage Director pipelines
  deployments : commands to manage Director deployments
  clusters    : commands to manage Director clusters
  instances   : commands to manage Director instances
  users       : commands to manage Director users

Use help to view the sub-commands, e.g.: pipelines help

% help
Try one of these commands with the -h or --help switch:

NAME        DESCRIPTION
Util
autoconfig  Display auto configuration report from ApplicationContext
beans       Display beans in ApplicationContext
clusters    Manage Cloudera Director Clusters
cron        manages the cron plugin
dashboard   a monitoring dashboard
deployments Manage Cloudera Director deployments
egrep       search file(s) for lines that match a pattern
endpoint    Invoke actuator endpoints
env         display the term env
filter      a filter for a stream of map
instances   Manage Cloudera Director instances
java        various java language commands
jul         java.util.logging commands
jvm         JVM informations
less        opposite of more
mail        interact with emails
man         format and display the on-line manual pages
metrics     Display metrics provided by Spring Boot
pipelines   Manage Cloudera Director pipelines
shell       shell related command
sleep       sleep for some time
sort        sort a map
system      vm system properties commands
thread      JVM thread commands
users       Manage Cloudera Director users
help        provides basic help
repl        list the repl or change the current repl```