Project

General

Profile

Statistics
| Revision:
Name Size Revision Age Author Comment
  BIEN2 10896 about 11 years Aaron Marcuse-Kubitza added BIEN2/traits_observation_counts.xls
  _archive 1598 over 12 years Aaron Marcuse-Kubitza Moved _archive/tapir2flatClient/trunk/client/ t...
  backups 10873 about 11 years Aaron Marcuse-Kubitza added backups/vegbien.r10848.backup.md5
  bin 10871 about 11 years Aaron Marcuse-Kubitza bugfix: bin/import_all: use reimport_scrub inst...
  config 7801 over 11 years Aaron Marcuse-Kubitza root Makefile: VegBIEN DB: mk_db: Added command...
  derived 10897 about 11 years Aaron Marcuse-Kubitza added derived/biengeo/Geovalidation_and_geoscru...
  exports 10853 about 11 years Aaron Marcuse-Kubitza exports/: svn:ignore *.zip
  inputs 11002 about 11 years Aaron Marcuse-Kubitza bugfix: inputs/VegBank/taxon_observation.**/pos...
  lib 11000 about 11 years Aaron Marcuse-Kubitza bugfix: lib/runscripts/*: calls to rm: use `rm ...
  mappings 10848 about 11 years Aaron Marcuse-Kubitza bugfix: mappings/VegCore-VegBIEN.csv: don't map...
  planning 10982 about 11 years Aaron Marcuse-Kubitza planning/timeline/timeline.2013.xls: updated fo...
  schemas 10995 about 11 years Aaron Marcuse-Kubitza schemas/VegCore/ERD/VegCore.ERD.png.map.htm: re...
  web 10894 about 11 years Aaron Marcuse-Kubitza web/links/index.htm: updated to Firefox bookmar...
.htaccess 326 Bytes 8771 over 11 years Aaron Marcuse-Kubitza /.htaccess: use canonical URL without symlinks
.rsync_filter.upload 33 Bytes 10042 over 11 years Aaron Marcuse-Kubitza /.rsync_ignore: temp files: hide them on upload...
.rsync_ignore 12 Bytes 10042 over 11 years Aaron Marcuse-Kubitza /.rsync_ignore: temp files: hide them on upload...
Makefile 12.6 KB 10539 over 11 years Aaron Marcuse-Kubitza bugfix: /Makefile: postgres-Linux: phppgadmin.c...
README.TXT 23.6 KB 10981 about 11 years Aaron Marcuse-Kubitza bugfix: /README.TXT: to backup files not in Tim...
fix_perms 97 Bytes 7560 almost 12 years Aaron Marcuse-Kubitza Added root fix_perms
map 1001 Bytes 6949 almost 12 years Aaron Marcuse-Kubitza vegbien_dest: Changed default $prefix to "", so...
new_terms.csv 38.1 KB 7222 almost 12 years Aaron Marcuse-Kubitza new_terms.csv: Regenerated
run 661 Bytes 10881 about 11 years Aaron Marcuse-Kubitza /run: geoscrub_input/make(): updated runtime (2...
unmapped_terms.csv 13.1 KB 7201 almost 12 years Aaron Marcuse-Kubitza **/new_terms.csv, **/unmapped_terms.csv: Regene...

Latest revisions

# Date Author Comment
11002 09/18/2013 02:03 PM Aaron Marcuse-Kubitza

bugfix: inputs/VegBank/taxon_observation.**/postprocess.sql: removed row_num (=identificationID), because there is actually more than one row per VegBank taxonobservation_, so this does not properly enumerate the view rows. this is because there is a 1:many left-join to stemcount_, stemlocation_ which adds rows to each taxonobservation_. since the row_num is gone, any row-subsetting of the view using OFFSET will always need to materialize the entire view up to the OFFSET value. this works for smaller datasources like VegBank that fit almost entirely into one column-based import chunk (1 million rows), but not for larger datasources like FIA where it would be much slower to materialize all preceding 16 million rows on the last chunk (which is what OFFSET normally does with left-joins).

11001 09/18/2013 01:51 PM Aaron Marcuse-Kubitza

bugfix: inputs/VegBank/taxon_observation.**/: generated header.csv and related files, which were previously not generated because the error in `rm header.csv` aborted the runscript

11000 09/17/2013 10:05 PM Aaron Marcuse-Kubitza

bugfix: lib/runscripts/*: calls to rm: use `rm -f` instead to avoid an error (which aborts the program) if the file does not yet exist

10999 09/16/2013 07:51 AM Aaron Marcuse-Kubitza

inputs/VegBank/: added taxon_observation.** left-join of the tables, using the steps at http://wiki.vegpath.org/Left-joining_a_datasource

10998 09/16/2013 07:48 AM Aaron Marcuse-Kubitza

inputs/VegBank/taxonobservation_/create.sql: join starting with taxoninterpretation so that we can use the taxoninterpretation_id as the row_num (text strings, formed from concatenated #s cannot be used as a row_num). there is only 1 taxonobservation without a taxoninterpretation, so we can just include one row for each taxoninterpretation.

10997 09/16/2013 02:32 AM Aaron Marcuse-Kubitza

bugfix: inputs/VegBank/taxonobservation_/test.xml.ref: updated after reloading staging table. this fixed a bug where observationGranularity apparently either did not exist or was not the right type of constant column to be properly inlined the last time the tester was run. the inlining is important for using metadata switches to generate the correct XML import script.

10996 09/16/2013 12:13 AM Aaron Marcuse-Kubitza

bugfix: lib/sh/make.sh: don't allow rm to override remake if an invoked script uses this file. this fixes a bug in `rm=1 inputs/.../.../run` where the remake action would be invoked on the map_table command even though it had been suppressed, because it was run externally (i.e. make.sh was reloaded) and the rm=1 flag was still active

10995 09/15/2013 10:50 PM Aaron Marcuse-Kubitza

schemas/VegCore/ERD/VegCore.ERD.png.map.htm: reordered in dependency order: moved traceable before party because party is a subclass of it

10994 09/15/2013 10:02 PM Aaron Marcuse-Kubitza

bugfix: inputs/input.Makefile: `%/install: %/create.sql`: don't include %/header.csv as a target, so that it won't get deleted if the install fails (especially on a step that happens after the header is exported)

10993 09/15/2013 09:07 PM Aaron Marcuse-Kubitza

inputs/VegBank/taxonobservation_/postprocess.sql: added primary key. note that the inserted row count changes, most likely because the rows are now in sorted order.

View all revisions | View revisions

Also available in: Atom