Project

General

Profile

Statistics
| Revision:

root @ 8341

Name Size Revision Age Author Comment
  _archive 1598 almost 13 years Aaron Marcuse-Kubitza Moved _archive/tapir2flatClient/trunk/client/ t...
  analysis 3076 over 12 years Aaron Marcuse-Kubitza Added top-level analysis dir for range modeling
  backups 7564 almost 12 years Aaron Marcuse-Kubitza lib/common.Makefile: remote server: Use jupiter...
  bin 8320 over 11 years Aaron Marcuse-Kubitza bin/make_analytical_db: Commented out export_an...
  config 7801 almost 12 years Aaron Marcuse-Kubitza root Makefile: VegBIEN DB: mk_db: Added command...
  inputs 8332 over 11 years Aaron Marcuse-Kubitza inputs/FIA/occurrence_all/import: Run mk_subset...
  lib 8335 over 11 years Aaron Marcuse-Kubitza lib/sql.py: mk_select(): using subset function:...
  mappings 8235 over 11 years Aaron Marcuse-Kubitza mappings/VegCore.htm: Renamed salvias_plots tab...
  planning 8315 over 11 years Aaron Marcuse-Kubitza Added planning/workflow/normalized_vs_denormali...
  schemas 8341 over 11 years Aaron Marcuse-Kubitza schemas/VegCore/VegCore.ERD.mwb: Populated legend
  validation 5971 about 12 years Aaron Marcuse-Kubitza Updated validation/BIEN2_Analytical_DB_overview...
  web 8228 over 11 years Aaron Marcuse-Kubitza Added web/main/svn*/, now using .htaccess to fo...
Makefile 12.1 KB 8081 almost 12 years Aaron Marcuse-Kubitza root Makefile: Installation: Fixed bug where ne...
README.TXT 19.7 KB 8319 over 11 years Aaron Marcuse-Kubitza bin/export_analytical_db: Replaced analytical_a...
fix_perms 97 Bytes 7560 almost 12 years Aaron Marcuse-Kubitza Added root fix_perms
map 1001 Bytes 6949 about 12 years Aaron Marcuse-Kubitza vegbien_dest: Changed default $prefix to "", so...
new_terms.csv 38.1 KB 7222 almost 12 years Aaron Marcuse-Kubitza new_terms.csv: Regenerated
unmapped_terms.csv 13.1 KB 7201 almost 12 years Aaron Marcuse-Kubitza **/new_terms.csv, **/unmapped_terms.csv: Regene...

Latest revisions

# Date Author Comment
8341 04/09/2013 03:25 AM Aaron Marcuse-Kubitza

schemas/VegCore/VegCore.ERD.mwb: Populated legend
8340 04/05/2013 12:23 AM Aaron Marcuse-Kubitza

schemas/VegCore/VegCore.ERD.mwb: Added exports
8339 04/05/2013 12:23 AM Aaron Marcuse-Kubitza

schemas/VegCore/VegCore.ERD.mwb: Fixed lines and settings for the Linux MySQL Workbench
8338 04/04/2013 10:01 PM Aaron Marcuse-Kubitza

schemas/VegCore/VegCore.ERD.mwb: Added table colors
8337 04/04/2013 10:01 PM Aaron Marcuse-Kubitza

Removed backup file schemas/VegCore/VegCore.ERD.mwb.bak
8336 04/04/2013 09:48 PM Aaron Marcuse-Kubitza

Added schemas/VegCore/VegCore.ERD.mwb, VegCore.my.sql with first VegCore ERD and MySQL schema. All tables are in the ERD, but contain only pkey and fkey columns.
8335 04/04/2013 09:52 AM Aaron Marcuse-Kubitza

lib/sql.py: mk_select(): using subset function: Turn off enable_sort (within the transaction) to avoid unwanted slow sorts. This change (along with the subset functions themselves) should significantly reduce the long FIA.occurrence_all table subset time (~8 hours altogether) and with it the total import time, which had more than doubled as a result of the FIA refresh. Note that this issue would have been even more pronounced for larger datasets, such as the GBIF refresh, which would have taken ~2.5 days longer (400 million rows * ~30% are plants * (FIA: ~8 hours/16.7 million rows) * 1 day/24 hours).
8334 04/04/2013 09:30 AM Aaron Marcuse-Kubitza

lib/sql.py: mk_select(): Use subset function when it's available for fast querying at large OFFSET values
8333 04/04/2013 09:29 AM Aaron Marcuse-Kubitza

lib/sql.py: Added has_subset_func()
8332 04/04/2013 08:48 AM Aaron Marcuse-Kubitza

inputs/FIA/occurrence_all/import: Run mk_subset_by_row_num_func() to make the subset functions available for fast querying at large OFFSET values

View all revisions | View revisions

Also available in: Atom