Project

General

Profile

Statistics
| Revision:
Name Size Revision Age Author Comment
  _archive 1598 over 12 years Aaron Marcuse-Kubitza Moved _archive/tapir2flatClient/trunk/client/ t...
  analysis 3076 about 12 years Aaron Marcuse-Kubitza Added top-level analysis dir for range modeling
  bin 3117 about 12 years Aaron Marcuse-Kubitza bin/map: Use new DbConn.close()
  config 272 over 12 years Aaron Marcuse-Kubitza Moved bien_password to new config dir
  inputs 3072 about 12 years Aaron Marcuse-Kubitza inputs/SpeciesLink/src: Added custom header tha...
  lib 3121 about 12 years Aaron Marcuse-Kubitza db_xml.py: put_table(): Partitioning in_table: ...
  mappings 2529 about 12 years Aaron Marcuse-Kubitza mappings/DwC2-VegBIEN.specimens.csv: Removed _t...
  schemas 3070 about 12 years Aaron Marcuse-Kubitza schemas/vegbien.sql: Added location.location_co...
  to_do 2547 about 12 years Aaron Marcuse-Kubitza to_do/timeline.doc: Updated to reflect the mont...
Makefile 10.2 KB 2983 about 12 years Aaron Marcuse-Kubitza main Makefile: Added explicit schemas/temp/rein...
README.TXT 2.76 KB 2976 about 12 years Aaron Marcuse-Kubitza README.TXT: Changed documentation to use make s...
map 978 Bytes 1979 about 12 years Aaron Marcuse-Kubitza root map: Fill in defaults for inputs from VegB...

Latest revisions

# Date Author Comment
3121 06/27/2012 07:11 PM Aaron Marcuse-Kubitza

db_xml.py: put_table(): Partitioning in_table: Adjust bounds of last partition to actual row #s included

3120 06/27/2012 06:43 PM Aaron Marcuse-Kubitza

sql.py: DbConn: Added _ to reset() to indicate that it's a protected method and users should not call it directly

3119 06/27/2012 06:41 PM Aaron Marcuse-Kubitza

sql.py: DbConn.close(): Reset the connection completely using reset()

3118 06/27/2012 06:40 PM Aaron Marcuse-Kubitza

sql.py: DbConn: Added clear_cache() and reset() and use reset() in init()

3117 06/27/2012 06:31 PM Aaron Marcuse-Kubitza

bin/map: Use new DbConn.close()

3116 06/27/2012 06:31 PM Aaron Marcuse-Kubitza

sql.py: DbConn: Added close()

3115 06/27/2012 06:07 PM Aaron Marcuse-Kubitza

db_xml.py: partition_size: Set to just more than the size of the largest data source that was successfully imported in simultaneous import

3114 06/27/2012 05:32 PM Aaron Marcuse-Kubitza

db_xml.py: put_table(): Partition in_table if larger than a threshold. The threshold is initially set to disable partitioning. Partitioning will hopefully eliminate the excessive disk usage for large input tables, which has caused the system to run out of disk space due to what may be a bug in PostgreSQL.

3113 06/27/2012 05:27 PM Aaron Marcuse-Kubitza

db_xml.py: put_table(): Set in_table's default srcs to in_table itself instead of sql_gen.src_self, so that any copies of in_table will inherit the same srcs instead of being treated as a top-level table. This ensures that the top-level table's errors table will always be used.

3112 06/27/2012 05:17 PM Aaron Marcuse-Kubitza

sql_io.py: cast(): Always convert exceptions to warnings if the input is a column or expression, even if there is no place to save the errors, so that invalid data does not need to be handled by the caller in a (much slower) extra exception-handling loop

View all revisions | View revisions

Also available in: Atom