- Reading records from the json or other form of dumps (usually from data streams)
- Cleaning and processing records into mutually agreed data format
- Keeping logs of records whose reading and processed has completed (Metadata recording read records for future purposes, verifying duplicates etc.)
- Validating data and discarding them in case they are invalid
- Book keeping of imported records (??)
- Inserting records into the database