Project

General

Profile

Statistics
| Revision:
Name Size Revision Age Author Comment
  _archive 1598 over 12 years Aaron Marcuse-Kubitza Moved _archive/tapir2flatClient/trunk/client/ t...
  bin 2053 over 12 years Aaron Marcuse-Kubitza bin/map: Always pass qual_name(table) to sql.se...
  config 272 almost 13 years Aaron Marcuse-Kubitza Moved bien_password to new config dir
  inputs 2028 over 12 years Aaron Marcuse-Kubitza mappings/DwC1-DwC2.specimens.csv: Mapped collec...
  lib 2052 over 12 years Aaron Marcuse-Kubitza db_xml.py: put_table(): Take separate in_table ...
  mappings 2028 over 12 years Aaron Marcuse-Kubitza mappings/DwC1-DwC2.specimens.csv: Mapped collec...
  schemas 2036 over 12 years Aaron Marcuse-Kubitza Moved "CREATE PROCEDURAL LANGUAGE plpgsql" to m...
  to_do 811 almost 13 years Aaron Marcuse-Kubitza Added to_do/milestones.doc
Makefile 8.78 KB 2037 over 12 years Aaron Marcuse-Kubitza main Makefile: VegBIEN DB: mk_db: Use template1...
README.TXT 2.7 KB 1967 over 12 years Aaron Marcuse-Kubitza main Makefile: VegBIEN DB: Install public schem...
map 978 Bytes 1979 over 12 years Aaron Marcuse-Kubitza root map: Fill in defaults for inputs from VegB...

Latest revisions

# Date Author Comment
2053 05/04/2012 02:14 PM Aaron Marcuse-Kubitza

bin/map: Always pass qual_name(table) to sql.select(). This is possible now that qual_name() can handle None schemas.

2052 05/04/2012 02:08 PM Aaron Marcuse-Kubitza

db_xml.py: put_table(): Take separate in_table and in_schema names, instead of in_table and table_is_esc, because the in_schema is needed to scope the temp tables appropriately

2051 05/04/2012 02:04 PM Aaron Marcuse-Kubitza

sql.py: qual_name(): If schema is None, don't prepend schema

2050 05/03/2012 06:59 PM Aaron Marcuse-Kubitza

bin/map, sql.py: Turned SQL query caching back on because benchmarks of just the caching on vs. off reveal that it does reduce processing time significantly. However, there is a slowdown that was introduced between the time caching was added and the time the same XML tree was used for each node, which was giving the false indication that the slowdown was due to the caching.

2049 05/03/2012 06:44 PM Aaron Marcuse-Kubitza

bin/map: Turn SQL query caching off by default

2048 05/03/2012 06:39 PM Aaron Marcuse-Kubitza

bin/map: Added cache_sql env var to enable SQL query caching

2047 05/03/2012 06:39 PM Aaron Marcuse-Kubitza

sql.py: Make caching DbConn enablable. Turn caching off by default because recent benchmarks (n=1000) were showing that it slows things down.

2046 05/03/2012 04:53 PM Aaron Marcuse-Kubitza

bin/map: Added new verbose_errors mode, enabled in test mode and off otherwise, which controls whether the output row and tracebacks are included in error messages. Having this off in import mode will reduce the size of error logs so they don't fill up the vegbiendev hard disk as quickly.

2045 05/03/2012 04:51 PM Aaron Marcuse-Kubitza

exc.py: print_ex(): Added detail option to turn off traceback

2044 05/03/2012 04:10 PM Aaron Marcuse-Kubitza

bin/map: Turn parallel processing off by default. This should fix "Cannot allocate memory" errors in large imports.

View all revisions | View revisions

Also available in: Atom