Project

General

Profile

Statistics
| Revision:
Name Size Revision Age Author Comment
  _archive 1598 almost 13 years Aaron Marcuse-Kubitza Moved _archive/tapir2flatClient/trunk/client/ t...
  bin 1619 almost 13 years Aaron Marcuse-Kubitza count_error_rows: Allow input to be specified a...
  config 272 about 13 years Aaron Marcuse-Kubitza Moved bien_password to new config dir
  inputs 1651 over 12 years Aaron Marcuse-Kubitza inputs/REMIB/src/nodes.make: Don't abort entire...
  lib 1648 over 12 years Aaron Marcuse-Kubitza profiling.py ItersProfiler, exc.py ExPercentTra...
  mappings 1625 over 12 years Aaron Marcuse-Kubitza mappings/DwC2-VegBIEN.specimens.csv: minimumEle...
  schemas 1640 over 12 years Aaron Marcuse-Kubitza schemas/postgresql.nimoy.conf: Increased shared...
  to_do 811 almost 13 years Aaron Marcuse-Kubitza Added to_do/milestones.doc
Makefile 7.58 KB 1628 over 12 years Aaron Marcuse-Kubitza Makefiles: Let subdir's Makefile decide whether...
README.TXT 1.8 KB 1556 almost 13 years Aaron Marcuse-Kubitza README.TXT: Added instructions how to stop all ...
map 867 Bytes 1299 almost 13 years Aaron Marcuse-Kubitza map: On nimoy, use bien2_staging unless otherwi...

Latest revisions

# Date Author Comment
1651 03/27/2012 06:43 PM Aaron Marcuse-Kubitza

inputs/REMIB/src/nodes.make: Don't abort entire import on empty response, because an empty response is also returned for nodes that are temporarily down, not just nodes that don't exist (assumed to be after the highest numbered node). Instead, stop import after 150 nodes if user did not specify an explicit # nodes.

1650 03/27/2012 05:50 PM Aaron Marcuse-Kubitza

inputs/REMIB/src/nodes.make: Abort prefix on empty response using break, rather than just done = True, to avoid running any more code except the finally block. Moved metadata row validation outside metadata row retrieval try-except block.

1649 03/27/2012 05:41 PM Aaron Marcuse-Kubitza

inputs/REMIB/src/nodes.make: If a read times out, abort the entire node rather than just the prefix to avoid waiting 20 sec for each of 26*26 prefixes

1648 03/27/2012 05:40 PM Aaron Marcuse-Kubitza

profiling.py ItersProfiler, exc.py ExPercentTracker: Only output fraction of rows with errors if self.iter_ct > 0, to avoid divide-by-zero error

1647 03/27/2012 04:55 PM Aaron Marcuse-Kubitza

inputs/REMIB/src/nodes.make: Fixed bug where row count was output in the middle of the row processing code, instead of after the first row is processed and the row count incremented. This removes "Processed 0 row(s)" messages at the beginning of every prefix.

1646 03/27/2012 04:40 PM Aaron Marcuse-Kubitza

inputs/REMIB/src/nodes.make: Support custom starting node ID and # nodes processed via env vars

1645 03/27/2012 04:29 PM Aaron Marcuse-Kubitza

Renamed inputs/REMIB/src/nodes.all.0.header.specimens.csv to node.0.header.specimens.csv so it would sort correctly with the new output file names

1644 03/27/2012 04:27 PM Aaron Marcuse-Kubitza

Renamed inputs/REMIB/src/nodes.all.specimens.csv.make to inputs/REMIB/src/nodes.make since it will not be used to generate nodes.all.specimens.csv. However, it can still be used with the `src/%.make` make target, but will generate a dummy empty output file "nodes".

1643 03/27/2012 04:21 PM Aaron Marcuse-Kubitza

inputs/REMIB/src/nodes.all.specimens.csv.make: Write each node to a separate output file

1642 03/27/2012 04:00 PM Aaron Marcuse-Kubitza

inputs/REMIB/src/nodes.all.specimens.csv.make: Raise InputException instead of AssertionError if invalid metadata row, so that it will be caught and printed instead of aborting the program

View all revisions | View revisions

Also available in: Atom