Skip to content

Instantly share code, notes, and snippets.

@aljungberg

aljungberg/fix_multiprocessing.py

Created October 14, 2010 16:35
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save aljungberg/626518 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save aljungberg/626518 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
fix_multiprocessing.py
# Fix keyboard interrupts when using multiprocessing.pool.imap().
# Usage:
# import fix_multiprocessing.py
from multiprocessing.pool import IMapIterator
def wrapper(func):
def wrap(self, timeout=None):
# Note: the timeout of 1 googol seconds introduces a rather subtle
# bug for Python scripts intended to run many times the age of the universe.
return func(self, timeout=timeout if timeout is not None else 1e100)
return wrap
IMapIterator.next = wrapper(IMapIterator.next)
@gaberosser

gaberosser commented Apr 28, 2015

Copy link
Copy Markdown

What a pity, I want to run my code for one googol and one seconds.

@pombredanne

pombredanne commented Nov 11, 2016

Copy link
Copy Markdown

@aljungberg what would be the license for this?

@aljungberg

aljungberg commented Feb 13, 2017

Copy link
Copy Markdown
Author

@pombredanne sorry for not noticing your message. Let's go with the MIT license for this.

@pombredanne

pombredanne commented Feb 13, 2017

Copy link
Copy Markdown

Thanks!

@pombredanne

pombredanne commented May 27, 2023

Copy link
Copy Markdown

FYI, I have been using this code for a while in https://github.com/nexB/scancode-toolkit/blob/4ec7a92ac21bf050a872b5dc07ce22baefcfb41d/src/scancode/pool.py
Thank you ++

@aljungberg

aljungberg commented Jun 4, 2023

Copy link
Copy Markdown
Author

Hah, that's awesome! Thanks for the heads up.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment