Project

General

Profile

Statistics
| Revision:
Name Size Revision Age Author Comment
  _archive 1598 almost 13 years Aaron Marcuse-Kubitza Moved _archive/tapir2flatClient/trunk/client/ t...
  analysis 3076 over 12 years Aaron Marcuse-Kubitza Added top-level analysis dir for range modeling
  backups 7037 almost 12 years Aaron Marcuse-Kubitza backups/Makefile: Synchronization: %/download: ...
  bin 7245 almost 12 years Aaron Marcuse-Kubitza input.Makefile: $(import?): Renamed $public_imp...
  config 6321 about 12 years Aaron Marcuse-Kubitza Added config/bien_read_password
  inputs 7245 almost 12 years Aaron Marcuse-Kubitza input.Makefile: $(import?): Renamed $public_imp...
  lib 7243 almost 12 years Aaron Marcuse-Kubitza db_xml.py: put_table(): Fixed bug where for vie...
  mappings 7215 almost 12 years Aaron Marcuse-Kubitza mappings/VegCore-VegBIEN.csv: fieldNumber (auth...
  schemas 7244 almost 12 years Aaron Marcuse-Kubitza schemas/vegbien.sql: analytical_stem_view: Chan...
  to_do 7207 almost 12 years Aaron Marcuse-Kubitza Added to_do/timeline.2013.xls (from Brad, conve...
  validation 5971 about 12 years Aaron Marcuse-Kubitza Updated validation/BIEN2_Analytical_DB_overview...
Makefile 11.7 KB 7231 almost 12 years Aaron Marcuse-Kubitza root Makefile: python-Darwin: Added instruction...
README.TXT 16.9 KB 7224 almost 12 years Aaron Marcuse-Kubitza README.TXT: Data import: Checking free disk spa...
map 1001 Bytes 6949 about 12 years Aaron Marcuse-Kubitza vegbien_dest: Changed default $prefix to "", so...
new_terms.csv 38.1 KB 7222 almost 12 years Aaron Marcuse-Kubitza new_terms.csv: Regenerated
unmapped_terms.csv 13.1 KB 7201 almost 12 years Aaron Marcuse-Kubitza **/new_terms.csv, **/unmapped_terms.csv: Regene...

Latest revisions

# Date Author Comment
7245 01/16/2013 07:56 AM Aaron Marcuse-Kubitza

input.Makefile: $(import?): Renamed $public_import option to $full_import because it applies to any import of all datasources, not just a public import on vegbiendev

7244 01/16/2013 07:23 AM Aaron Marcuse-Kubitza

schemas/vegbien.sql: analytical_stem_view: Changed `WHERE COALESCE` to a join condition to enable using the taxondetermination_single_current_determination index, which produces the filtered rows directly. Note that this index will not be used for full-database imports, because the query planner uses hash joins everywhere instead of nested loops.

7243 01/16/2013 06:47 AM Aaron Marcuse-Kubitza

db_xml.py: put_table(): Fixed bug where for views, shouldn't advance start (OFFSET clause) after each chunk, because views are typically dynamic and will contain a new set of rows after the first set is imported

7242 01/16/2013 06:41 AM Aaron Marcuse-Kubitza

sql.py: Added view_exists()

7241 01/16/2013 06:16 AM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: Removed no longer used tnrs_canon. unscrubbed_taxondetermination_view uses its definition directly instead.

7240 01/16/2013 06:14 AM Aaron Marcuse-Kubitza

schemas/vegbien.sql: unscrubbed_taxondetermination_view: Added comment from tnrs_canon

7239 01/16/2013 06:12 AM Aaron Marcuse-Kubitza

schemas/vegbien.sql: unscrubbed_taxondetermination_view: Added comment from tnrs_canon

7238 01/16/2013 06:09 AM Aaron Marcuse-Kubitza

schemas/vegbien.sql: unscrubbed_taxondetermination_view: Do the tnrs_canon joins manually instead of using tnrs_canon, to allow PostgreSQL to use a nested loop join on just the needed tnrs rows instead of a hash self-join of all tnrs rows. The query planner is not yet advanced enough to automatically integrate the select on the view into the top-level joins list, which would make this change automatically.

7237 01/16/2013 05:52 AM Aaron Marcuse-Kubitza

inputs/.TNRS/public.unscrubbed_taxondetermination_view/scrub.make: rowsAdded(): Look at last 100 rows instead of last 10, because rows are added to the log file each time the script waits and the Inserted # new rows message must be in the tailed rows

7236 01/16/2013 05:48 AM Aaron Marcuse-Kubitza

inputs/.TNRS/public.unscrubbed_taxondetermination_view/scrub.make: rowsAdded(): Fixed bug where need to test if log file exists before using it in tail, because if tail fails and causes rowsAdded to return false, this error exit status will be indistinguishable from false for no rows added and the script will keep going

View all revisions | View revisions

Also available in: Atom