Project

General

Profile

Statistics
| Revision:

root @ 1888

Name Size Revision Age Author Comment
  _archive 1598 almost 13 years Aaron Marcuse-Kubitza Moved _archive/tapir2flatClient/trunk/client/ t...
  bin 1886 almost 13 years Aaron Marcuse-Kubitza bin/map: Share locals() with the pool at variou...
  config 272 about 13 years Aaron Marcuse-Kubitza Moved bien_password to new config dir
  inputs 1854 almost 13 years Aaron Marcuse-Kubitza input.Makefile: Editing import: Use $(datasrc) ...
  lib 1888 almost 13 years Aaron Marcuse-Kubitza Added Proxy.py
  mappings 1843 almost 13 years Aaron Marcuse-Kubitza mappings: Build VegX-VegBIEN.organisms.csv from...
  schemas 1751 almost 13 years Aaron Marcuse-Kubitza vegbien.ERD.mwb: Fixed lines
  to_do 811 almost 13 years Aaron Marcuse-Kubitza Added to_do/milestones.doc
Makefile 7.72 KB 1845 almost 13 years Aaron Marcuse-Kubitza root Makefile: python-Linux: Added `sudo pip in...
README.TXT 2.58 KB 1774 almost 13 years Aaron Marcuse-Kubitza README.TXT: Schema changes: Split updating grap...
map 867 Bytes 1299 almost 13 years Aaron Marcuse-Kubitza map: On nimoy, use bien2_staging unless otherwi...

Latest revisions

# Date Author Comment
1888 04/16/2012 10:18 PM Aaron Marcuse-Kubitza

Added Proxy.py
1887 04/16/2012 09:32 PM Aaron Marcuse-Kubitza

parallel.py: MultiProducerPool: Added code to create a shared Namespace object, commented out. Updated share() doc comment to reflect that it will writably share the values as well.
1886 04/16/2012 08:49 PM Aaron Marcuse-Kubitza

bin/map: Share locals() with the pool at various times to try to get as many unpicklable values into the shared vars as possible
1885 04/16/2012 08:45 PM Aaron Marcuse-Kubitza

dicts.py: Turned id_dict() factory function into IdDict class. parallel.py: MultiProducerPool: Added share_vars(). main_loop(): Only consider the program to be done if the queue is empty and there are no running tasks.
1884 04/16/2012 08:00 PM Aaron Marcuse-Kubitza

collection.py: rmap(): Treat only built-in sequences specially instead of iterables. Pass whether the value is a leaf to the func. Added option to only recurse up to a certain # of levels.
1883 04/16/2012 07:10 PM Aaron Marcuse-Kubitza

Added lists.py
1882 04/16/2012 04:40 PM Aaron Marcuse-Kubitza

collection.py: rmap(): Fixed bugs: Made it recursive. Use iters.is_iterable() instead of isinstance(value, list) to work on all iterables. Use value and not nonexistent var list_.
1881 04/16/2012 04:38 PM Aaron Marcuse-Kubitza

iters.py: Added is_iterable()
1880 04/16/2012 04:11 PM Aaron Marcuse-Kubitza

parallel.py: prepickle(): Pickle all objects in vars_id_dict_ by ID, not just unpicklable ones. This ensures that a DB connection created in the main process will be shared with subprocesses by reference (id()) instead of by value, so that each process can take advantage of e.g. shared caches in the connection object. Note that this may require some synchronization.
1879 04/16/2012 04:06 PM Aaron Marcuse-Kubitza

parallel.py: MultiProducerPool.main_loop(): Got rid of no longer correct doc comment

View all revisions | View revisions

Also available in: Atom