Project

General

Profile

Statistics
| Revision:
Name Size Revision Age Author Comment
  _archive 1598 over 12 years Aaron Marcuse-Kubitza Moved _archive/tapir2flatClient/trunk/client/ t...
  analysis 3076 about 12 years Aaron Marcuse-Kubitza Added top-level analysis dir for range modeling
  backups 7564 over 11 years Aaron Marcuse-Kubitza lib/common.Makefile: remote server: Use jupiter...
  bin 7862 over 11 years Aaron Marcuse-Kubitza import_times: When there are no matching logs, ...
  config 7801 over 11 years Aaron Marcuse-Kubitza root Makefile: VegBIEN DB: mk_db: Added command...
  inputs 7863 over 11 years Aaron Marcuse-Kubitza inputs/import.stats.xls: Updated import times. ...
  lib 7728 over 11 years Aaron Marcuse-Kubitza lib/common.Makefile: rsync: $(rsync): Also excl...
  mappings 7841 over 11 years Aaron Marcuse-Kubitza mappings/VegCore.htm: Regenerated from wiki. Re...
  planning 7786 over 11 years Aaron Marcuse-Kubitza Added planning/use_cases/rare_species.png
  schemas 7854 over 11 years Aaron Marcuse-Kubitza schemas/vegbien.sql: tnrs_input_name: taxonlabe...
  validation 5971 over 11 years Aaron Marcuse-Kubitza Updated validation/BIEN2_Analytical_DB_overview...
Makefile 12.1 KB 7836 over 11 years Aaron Marcuse-Kubitza root Makefile: Datasources: scrub: Removed no l...
README.TXT 19.3 KB 7860 over 11 years Aaron Marcuse-Kubitza README.TXT: Full database import: record the im...
fix_perms 97 Bytes 7560 over 11 years Aaron Marcuse-Kubitza Added root fix_perms
map 1001 Bytes 6949 over 11 years Aaron Marcuse-Kubitza vegbien_dest: Changed default $prefix to "", so...
new_terms.csv 38.1 KB 7222 over 11 years Aaron Marcuse-Kubitza new_terms.csv: Regenerated
unmapped_terms.csv 13.1 KB 7201 over 11 years Aaron Marcuse-Kubitza **/new_terms.csv, **/unmapped_terms.csv: Regene...

Latest revisions

# Date Author Comment
7863 03/06/2013 07:50 PM Aaron Marcuse-Kubitza

inputs/import.stats.xls: Updated import times. The core import time has dropped by more than half (!) to ~12 hours, now that the TNRS scrubbing is added using a simple LEFT JOIN, instead of being pushed through the normalized schema. Not since October has the import been this fast!

7862 03/06/2013 07:27 PM Aaron Marcuse-Kubitza

import_times: When there are no matching logs, exit with status 0 instead of 1 because this is a normal condition

7861 03/06/2013 07:26 PM Aaron Marcuse-Kubitza

import_times: Fixed bug where sed would wait for user input from stdin when there were no matching logs

7860 03/06/2013 07:22 PM Aaron Marcuse-Kubitza

README.TXT: Full database import: record the import times in inputs/import.stats.xls: If the row counts do not match up: Added step to get the datasource names from the log file footers

7859 03/06/2013 07:12 PM Aaron Marcuse-Kubitza

inputs/UNCC/Specimen/map.csv: cultivated: assume anything non-NULL to be cultivated, so that we err on the side of excluding possibly-cultivated specimens

7858 03/06/2013 06:49 PM Aaron Marcuse-Kubitza

inputs/UNCC/_src/_README.TXT: Added e-mail conv between Jim Matthews at Habitat Assessment and Bob Peet about the meanings of the Leaf, Flower, Fruit, and Root codes

7857 03/06/2013 05:38 PM Aaron Marcuse-Kubitza

README.TXT: Full database import: Added steps to manually back up the DB. (These steps are specific to the import process, and include filters to exclude previous imports. There are also general backup steps in the Backups > Full DB section.)

7856 03/06/2013 02:56 PM Aaron Marcuse-Kubitza

inputs/ACAD/Specimen/map.csv: institutionCode: Replace "Acadia University" with the IH code ACAD

7855 03/06/2013 02:18 PM Aaron Marcuse-Kubitza

inputs/.TNRS/data.sql: Re-ran TNRS on the test_taxonomic_names so that the sample data would contain all the accepted names under the current acceptedScientificName formula, and would not produce any entries for unscrubbed names in tnrs_input_name

7854 03/06/2013 01:59 PM Aaron Marcuse-Kubitza

schemas/vegbien.sql: tnrs_input_name: taxonlabel.taxonomicname subquery: Don't exclude taxonlabels with a matched_label_id, because matched_label_id is no longer used to indicate that a name has a scrubbed name (this was used when all of TNRS was imported at the beginning of the import)

View all revisions | View revisions

Also available in: Atom