I want to be able to publish every code commit of our react app.
Azure support deployment slots, which can be used but unfortunately, there is limited count of deployment slots that you can get.
By installing nginx as a deployment on kubernetes (single instance could be fine, you don't need to have an instance for each deployment) and make sure that nginx http folder is get mounted from azure file share