Skip to content

Instantly share code, notes, and snippets.

@jineshpaloor

jineshpaloor/lda_distributed.sh

Last active September 3, 2015 12:06
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save jineshpaloor/c93338334427a7da7848 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save jineshpaloor/c93338334427a7da7848 to your computer and use it in GitHub Desktop.
Download ZIP
steps to follow to run gensim lda in distributed systems
Raw
lda_distributed.sh
# run name server
python -m Pyro4.naming -n 0.0.0.0 &
# run lda worker (2 times)
python -m gensim.models.lda_worker > data/worker1.log 2>&1 &
# run lda dispatcher
python -m gensim.models.lda_dispatcher > data/dispatcher.log 2>&1 &
# run the script (client) on any server
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment