Recognizing Receipt stamp and reading dates

gistfile1.txt

I am looking for a solution to build a Neural network that can be 1) First, identify the receipt stamp seal of any shape in a test image 2) once done then read the date onto that stamp seal indicating on this date receipt was done

Eg. circle seal with say today's date 4/7/2018

This is the solution I think of

1)CNN to read seal image
2)feed that features to LSTM to recognize the date
3)I m stuck how LSTM and decoder is expected to work