Skip to content

Instantly share code, notes, and snippets.

@netdesign
Created September 25, 2011 17:40
Show Gist options
  • Select an option

  • Save netdesign/1240881 to your computer and use it in GitHub Desktop.

Select an option

Save netdesign/1240881 to your computer and use it in GitHub Desktop.
Simple Flow/Arch
MainParser parses an XML document like this:
<ExternalPage about="http://www.awn.com/"><d:Title></d:Title><d:Description></d:Description><priority>1</priority><topic>Top/Arts/Animation</topic></ExternalPage>
<ExternalPage about="http://www.awn.com/"><d:Title></d:Title><d:Description></d:Description><priority>1</priority><topic>Top/Arts/Animation</topic></ExternalPage>
[......many other nodes]
then queues a single <ExternalPage><tags/data></ExternalPage>
then xmlParser (but also xmlSecondParser) get attribs and texts from the first node of the Queue and then INSERTS them in DB
If I queue a bulk of XML the whole program will parse XML twice... I think
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment