This took me some time to figure out so writing it down for posterity.
Setting up Rundeck in AWS running on Amazon Linux 2 using RPM install: https://docs.rundeck.com/docs/administration/install/linux-rpm.html
JRE runtime using AWS Corretto 8: https://docs.aws.amazon.com/corretto/latest/corretto-8-ug/amazon-linux-install.html
DB Backend using Aurora MySQL Serverless v2. Create rundeck user/pass.