Project

General

Profile

Statistics
| Revision:
Name Size Revision Age Author Comment
  _archive 1598 almost 13 years Aaron Marcuse-Kubitza Moved _archive/tapir2flatClient/trunk/client/ t...
  analysis 3076 over 12 years Aaron Marcuse-Kubitza Added top-level analysis dir for range modeling
  backups 7564 almost 12 years Aaron Marcuse-Kubitza lib/common.Makefile: remote server: Use jupiter...
  bin 8183 over 11 years Aaron Marcuse-Kubitza schemas/*functions.sql: Renamed to *util.sql be...
  config 7801 almost 12 years Aaron Marcuse-Kubitza root Makefile: VegBIEN DB: mk_db: Added command...
  inputs 8224 over 11 years Aaron Marcuse-Kubitza inputs/GBIF/: Added scripts for subsetting refresh
  lib 8223 over 11 years Aaron Marcuse-Kubitza lib/sql.py: table_order_by(): Documented that i...
  mappings 8206 over 11 years Aaron Marcuse-Kubitza mappings/VegCore-VegBIEN.csv: subplotID,subplot...
  planning 8167 almost 12 years Aaron Marcuse-Kubitza planning/timeline/timeline.2013.xls: Updated fo...
  schemas 8212 over 11 years Aaron Marcuse-Kubitza schemas/util.sql: Renamed rename_if_exists() to...
  validation 5971 about 12 years Aaron Marcuse-Kubitza Updated validation/BIEN2_Analytical_DB_overview...
  web 8226 over 11 years Aaron Marcuse-Kubitza Added web/main/svn, svn-web symlinks to Redmine...
Makefile 12.1 KB 8081 almost 12 years Aaron Marcuse-Kubitza root Makefile: Installation: Fixed bug where ne...
README.TXT 19.3 KB 8135 almost 12 years Aaron Marcuse-Kubitza README.TXT: Full database import: Manual steps ...
fix_perms 97 Bytes 7560 almost 12 years Aaron Marcuse-Kubitza Added root fix_perms
map 1001 Bytes 6949 about 12 years Aaron Marcuse-Kubitza vegbien_dest: Changed default $prefix to "", so...
new_terms.csv 38.1 KB 7222 almost 12 years Aaron Marcuse-Kubitza new_terms.csv: Regenerated
unmapped_terms.csv 13.1 KB 7201 almost 12 years Aaron Marcuse-Kubitza **/new_terms.csv, **/unmapped_terms.csv: Regene...

Latest revisions

# Date Author Comment
8226 03/28/2013 10:50 AM Aaron Marcuse-Kubitza

Added web/main/svn, svn-web symlinks to Redmine/* for shorter URLs

8225 03/28/2013 10:49 AM Aaron Marcuse-Kubitza

Added web/main/Redmine/svn-web/

8224 03/28/2013 08:28 AM Aaron Marcuse-Kubitza

inputs/GBIF/: Added scripts for subsetting refresh

8223 03/28/2013 12:24 AM Aaron Marcuse-Kubitza

lib/sql.py: table_order_by(): Documented that it returns None if table is a view, because table_cluster_on() would return None. This is necessary for inputs/FIA/occurrence_all/ sorting to work correctly, because specifying a manual sort order would prevent the query planner from just using fast nested loop joins and instead cause it to perform a slow sort. (This appears to be a bug in the query planner, because when the column list specified matches the joined-on indexes, there should be no need for post-nested loop re-sorting.)

8222 03/28/2013 12:20 AM Aaron Marcuse-Kubitza

inputs/FIA/occurrence_all/test.xml.ref: Updated inserted row count for new row sort order

8221 03/28/2013 12:19 AM Aaron Marcuse-Kubitza

lib/db_xml.py: put_table(): Fixed bug where also need to advance start to fetch next set when table is a view, because the views that are now being used with the import (inputs/FIA/occurrence_all/) are static rather than dynamic and do not return different rows after the previous set of rows has been imported

8220 03/27/2013 11:43 PM Aaron Marcuse-Kubitza

inputs/FIA/occurrence_all/import: Removed no longer applicable comment that directional joins are needed for PostgreSQL query planner to avoid slow sorts

8219 03/27/2013 11:40 PM Aaron Marcuse-Kubitza

inputs/FIA/TREE/import: Reclustered table by TREE.parent path index, to facilitate path-order joins

8218 03/27/2013 11:39 PM Aaron Marcuse-Kubitza

inputs/FIA/occurrence_all/import: Changed all RIGHT JOINs to inner joins so that tables would be joined in path order (i.e. general->specific). This optimizes the incremental joins so that the small tables are joined to each other before being joined to the large tables, rather than each row of the large tables being looked up in the small tables. This effect may not be noticeable for small LIMIT values, but would become apparent for large LIMIT values, such as the 1-million-row partitions used by db_xml.put_table() for column-based import. Note that inner joins used to cause the query planner to produce incorrect results containing slow sorts, but now this appears to no longer be an issue, perhaps because the result is not sorted by the TREE.ID index (which is not in the same order as the path indexes *.unique, *.parent).

8217 03/27/2013 10:46 PM Aaron Marcuse-Kubitza

inputs/FIA/occurrence_all/import: Removed trailing whitespace

View all revisions | View revisions

Also available in: Atom