Project

General

Profile

Statistics
| Revision:
Name Size Revision Age Author Comment
  _archive 1598 over 12 years Aaron Marcuse-Kubitza Moved _archive/tapir2flatClient/trunk/client/ t...
  bin 2049 about 12 years Aaron Marcuse-Kubitza bin/map: Turn SQL query caching off by default
  config 272 over 12 years Aaron Marcuse-Kubitza Moved bien_password to new config dir
  inputs 2028 about 12 years Aaron Marcuse-Kubitza mappings/DwC1-DwC2.specimens.csv: Mapped collec...
  lib 2047 about 12 years Aaron Marcuse-Kubitza sql.py: Make caching DbConn enablable. Turn cac...
  mappings 2028 about 12 years Aaron Marcuse-Kubitza mappings/DwC1-DwC2.specimens.csv: Mapped collec...
  schemas 2036 about 12 years Aaron Marcuse-Kubitza Moved "CREATE PROCEDURAL LANGUAGE plpgsql" to m...
  to_do 811 over 12 years Aaron Marcuse-Kubitza Added to_do/milestones.doc
Makefile 8.78 KB 2037 about 12 years Aaron Marcuse-Kubitza main Makefile: VegBIEN DB: mk_db: Use template1...
README.TXT 2.7 KB 1967 about 12 years Aaron Marcuse-Kubitza main Makefile: VegBIEN DB: Install public schem...
map 978 Bytes 1979 about 12 years Aaron Marcuse-Kubitza root map: Fill in defaults for inputs from VegB...

Latest revisions

# Date Author Comment
2049 05/03/2012 06:44 PM Aaron Marcuse-Kubitza

bin/map: Turn SQL query caching off by default

2048 05/03/2012 06:39 PM Aaron Marcuse-Kubitza

bin/map: Added cache_sql env var to enable SQL query caching

2047 05/03/2012 06:39 PM Aaron Marcuse-Kubitza

sql.py: Make caching DbConn enablable. Turn caching off by default because recent benchmarks (n=1000) were showing that it slows things down.

2046 05/03/2012 04:53 PM Aaron Marcuse-Kubitza

bin/map: Added new verbose_errors mode, enabled in test mode and off otherwise, which controls whether the output row and tracebacks are included in error messages. Having this off in import mode will reduce the size of error logs so they don't fill up the vegbiendev hard disk as quickly.

2045 05/03/2012 04:51 PM Aaron Marcuse-Kubitza

exc.py: print_ex(): Added detail option to turn off traceback

2044 05/03/2012 04:10 PM Aaron Marcuse-Kubitza

bin/map: Turn parallel processing off by default. This should fix "Cannot allocate memory" errors in large imports.

2043 05/01/2012 07:58 AM Aaron Marcuse-Kubitza

bin/map: in_is_db: Don't cache the main SELECT query

2042 05/01/2012 07:56 AM Aaron Marcuse-Kubitza

bin/map: by_col: Use the created template, which already has the column names in it, instead of mapping a sample row

2041 05/01/2012 07:50 AM Aaron Marcuse-Kubitza

bin/map: Fixed bug where db_xml could not be imported twice, or it was treated as an undefined variable for some reason

2040 05/01/2012 07:45 AM Aaron Marcuse-Kubitza

bin/map: map_table(): Make each column a db_xml.ColRef instead of a bare index, so that it will appear as the column name when converted to a string. This will provide better debugging info in the template tree and also avoid needing to create a separate sample row in by_col.

View all revisions | View revisions

Also available in: Atom