This is meant to be an approximate port of Web Words, written in Elixir. I was appalled at the number of external dependencies needed (MongoDB, RabbitMQ), so I decided to see if I could come up with something similar.
Also, I wasn't smart enough to understand the Scala code – my brain melted and my eyes bled. My apologies to all Scala programmers out there.
The application takes in a Wikipedia site URL and performs crawling of various other Wikipedia pages. As it goes through the pages, it calculates the word frequencies and presents the results in "real-time" (whatever that means). Stop words are ignored (e.g. 'a', 'the', 'of' etc.).