Project

General

Profile

Statistics
| Revision:
Name Size Revision Age Author Comment
  _archive 1598 over 12 years Aaron Marcuse-Kubitza Moved _archive/tapir2flatClient/trunk/client/ t...
  analysis 3076 over 12 years Aaron Marcuse-Kubitza Added top-level analysis dir for range modeling
  backups 7037 almost 12 years Aaron Marcuse-Kubitza backups/Makefile: Synchronization: %/download: ...
  bin 7245 almost 12 years Aaron Marcuse-Kubitza input.Makefile: $(import?): Renamed $public_imp...
  config 6321 about 12 years Aaron Marcuse-Kubitza Added config/bien_read_password
  inputs 7246 almost 12 years Aaron Marcuse-Kubitza Placed inputs/SpeciesLink/_archive/ under versi...
  lib 7243 almost 12 years Aaron Marcuse-Kubitza db_xml.py: put_table(): Fixed bug where for vie...
  mappings 7215 almost 12 years Aaron Marcuse-Kubitza mappings/VegCore-VegBIEN.csv: fieldNumber (auth...
  schemas 7244 almost 12 years Aaron Marcuse-Kubitza schemas/vegbien.sql: analytical_stem_view: Chan...
  to_do 7207 almost 12 years Aaron Marcuse-Kubitza Added to_do/timeline.2013.xls (from Brad, conve...
  validation 5971 about 12 years Aaron Marcuse-Kubitza Updated validation/BIEN2_Analytical_DB_overview...
Makefile 11.7 KB 7231 almost 12 years Aaron Marcuse-Kubitza root Makefile: python-Darwin: Added instruction...
README.TXT 16.9 KB 7224 almost 12 years Aaron Marcuse-Kubitza README.TXT: Data import: Checking free disk spa...
map 1001 Bytes 6949 almost 12 years Aaron Marcuse-Kubitza vegbien_dest: Changed default $prefix to "", so...
new_terms.csv 38.1 KB 7222 almost 12 years Aaron Marcuse-Kubitza new_terms.csv: Regenerated
unmapped_terms.csv 13.1 KB 7201 almost 12 years Aaron Marcuse-Kubitza **/new_terms.csv, **/unmapped_terms.csv: Regene...

Latest revisions

# Date Author Comment
7246 01/16/2013 08:21 AM Aaron Marcuse-Kubitza

Placed inputs/SpeciesLink/_archive/ under version control

7245 01/16/2013 07:56 AM Aaron Marcuse-Kubitza

input.Makefile: $(import?): Renamed $public_import option to $full_import because it applies to any import of all datasources, not just a public import on vegbiendev

7244 01/16/2013 07:23 AM Aaron Marcuse-Kubitza

schemas/vegbien.sql: analytical_stem_view: Changed `WHERE COALESCE` to a join condition to enable using the taxondetermination_single_current_determination index, which produces the filtered rows directly. Note that this index will not be used for full-database imports, because the query planner uses hash joins everywhere instead of nested loops.

7243 01/16/2013 06:47 AM Aaron Marcuse-Kubitza

db_xml.py: put_table(): Fixed bug where for views, shouldn't advance start (OFFSET clause) after each chunk, because views are typically dynamic and will contain a new set of rows after the first set is imported

7242 01/16/2013 06:41 AM Aaron Marcuse-Kubitza

sql.py: Added view_exists()

7241 01/16/2013 06:16 AM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: Removed no longer used tnrs_canon. unscrubbed_taxondetermination_view uses its definition directly instead.

7240 01/16/2013 06:14 AM Aaron Marcuse-Kubitza

schemas/vegbien.sql: unscrubbed_taxondetermination_view: Added comment from tnrs_canon

7239 01/16/2013 06:12 AM Aaron Marcuse-Kubitza

schemas/vegbien.sql: unscrubbed_taxondetermination_view: Added comment from tnrs_canon

7238 01/16/2013 06:09 AM Aaron Marcuse-Kubitza

schemas/vegbien.sql: unscrubbed_taxondetermination_view: Do the tnrs_canon joins manually instead of using tnrs_canon, to allow PostgreSQL to use a nested loop join on just the needed tnrs rows instead of a hash self-join of all tnrs rows. The query planner is not yet advanced enough to automatically integrate the select on the view into the top-level joins list, which would make this change automatically.

7237 01/16/2013 05:52 AM Aaron Marcuse-Kubitza

inputs/.TNRS/public.unscrubbed_taxondetermination_view/scrub.make: rowsAdded(): Look at last 100 rows instead of last 10, because rows are added to the log file each time the script waits and the Inserted # new rows message must be in the tailed rows

View all revisions | View revisions

Also available in: Atom