Skip to content

Instantly share code, notes, and snippets.

@felipehummel
Created October 18, 2012 16:26
Show Gist options
  • Save felipehummel/3912959 to your computer and use it in GitHub Desktop.
Save felipehummel/3912959 to your computer and use it in GitHub Desktop.
crawler problem
class CrawlRoundSender(master: ActorRef, scheduler: CrawlScheduler) extends Actor {
def receive = {
case CrawlRound => {
scheduler.next() match {
case Some(crawlFeed) => {
master ! crawlFeed
self ! CrawlRound
}
case None => context.system.scheduler.scheduleOnce(100.millis, self, CrawlRound)
}
}
}
}
class MasterActor(...) extends Actor {
...
def receive = {
case crawlFeed: CrawlFeed => {
...
logger.info("Master sending to crawl FeedId="+crawlFeed.site.id)
workerRouter ! crawlFeed
...
}
}
// 11:13:42.990 c.b.c.HeapCrawlScheduler - Scheduler Sending to crawl FeedId=10822
// 11:13:42.990 c.b.c.HeapCrawlScheduler - Scheduler Sending to crawl FeedId=12590
// 11:13:43.085 c.b.c.MasterActor - Master sending to crawl FeedId=10822
// 11:13:43.085 c.b.c.MasterActor - Master sending to crawl FeedId=10822
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment