Project

General

Profile

Statistics
| Revision:
Name Size Revision Age Author Comment
  logs 8801 over 11 years Aaron Marcuse-Kubitza inputs/input.Makefile: SVN: add, %/add: */logs:...
.map.csv.last_cleanup 0 Bytes 6742 almost 12 years Aaron Marcuse-Kubitza inputs/CVS/: Refreshed data with new export fro...
VegBIEN.csv 42 Bytes 11749 about 11 years Aaron Marcuse-Kubitza inputs/CVS/: switched to new-style import, usin...
_no_import 0 Bytes 11760 about 11 years Aaron Marcuse-Kubitza inputs/CVS/: don't import joined tables, becaus...
create.sql 85 Bytes 6760 almost 12 years Aaron Marcuse-Kubitza inputs/CVS/: Joined together taxonImportance an...
header.csv 646 Bytes 6759 almost 12 years Aaron Marcuse-Kubitza inputs/CVS/: Joined together taxonImportance an...
map.csv 1.77 KB 11759 about 11 years Aaron Marcuse-Kubitza inputs/CVS/: added taxon_observation.** left-jo...
new_terms.csv 1.64 KB 11758 about 11 years Aaron Marcuse-Kubitza inputs/CVS/stemCount_/map.csv: remapped stratum...
postprocess.sql 631 Bytes 11759 about 11 years Aaron Marcuse-Kubitza inputs/CVS/: added taxon_observation.** left-jo...
run 63 Bytes 11749 about 11 years Aaron Marcuse-Kubitza inputs/CVS/: switched to new-style import, usin...
test.xml.ref 1.62 KB 11759 about 11 years Aaron Marcuse-Kubitza inputs/CVS/: added taxon_observation.** left-jo...
unmapped_terms.csv 1.01 KB 11759 about 11 years Aaron Marcuse-Kubitza inputs/CVS/: added taxon_observation.** left-jo...
  • svn:ignore: *

Latest revisions

# Date Author Comment
11970 01/20/2014 11:33 AM Aaron Marcuse-Kubitza

moved everything into /trunk/ to create the standard svn layout, for use with tools that require this (eg. git-svn). IMPORTANT: do NOT do an `svn up`. instead, re-use your working copy's existing files with `svn switch` (http://svnbook.red-bean.com/en/1.6/svn.ref.svn.c.switch.html).

11760 11/26/2013 05:54 AM Aaron Marcuse-Kubitza

inputs/CVS/: don't import joined tables, because they are now imported in the taxon_observation.** left-join instead

11759 11/26/2013 05:53 AM Aaron Marcuse-Kubitza

inputs/CVS/: added taxon_observation.** left-join of the tables, using the steps at http://wiki.vegpath.org/Left-joining_a_datasource. this involves renaming taxonOccurrenceID->taxonOccurrenceID__overall_plot so that it can then be joined together with aggregateOrganismObservationID to create the full taxonOccurrenceID (as in VegBank).

11758 11/26/2013 05:46 AM Aaron Marcuse-Kubitza

inputs/CVS/stemCount_/map.csv: remapped stratum_ID->*STRATUM_ID so it would match up with stratum.*STRATUM_ID

11754 11/25/2013 09:43 PM Aaron Marcuse-Kubitza

inputs/CVS/: prepended the table name to each column name to prevent column collisions, using the steps at http://wiki.vegpath.org/Left-joining_a_datasource

11749 11/25/2013 07:52 PM Aaron Marcuse-Kubitza

inputs/CVS/: switched to new-style import, using the steps at http://wiki.vegpath.org/Adding_new-style_import_to_a_datasource

11738 11/25/2013 03:22 PM Aaron Marcuse-Kubitza

inputs/CVS/stemCount_/: translated filters to postprocessing derived columns, using the steps at http://wiki.vegpath.org/Adding_new-style_import_to_a_datasource#1-Translate-filters-to-postprocessing-derived-columns. note that the inserted row count changes, because there is now a primary key (which the table is auto-sorted by) where previously there was none.

11707 11/21/2013 08:26 AM Aaron Marcuse-Kubitza

bugfix: inputs/CVS/stemCount_/map.csv: ensure the aggregateoccurrence.sourceaccessioncode is always populated, because this is a required field when using sourceaccessioncodes. without it, the import will exclude rows which lack a value in this field because it cannot deduplicate on it for these rows, leading to the dropping of large numbers of occurrences. this shows up when comparing provider_count to the input table's row count, and produces the following error in the .errors table:...

11512 10/30/2013 09:46 PM Aaron Marcuse-Kubitza

bugfix: mappings/VegCore-VegBIEN.csv: main taxondetermination: use [!isoriginal=true] instead of [!isoriginal] so that adding a manual isoriginal field does not prevent this selector from matching

11396 10/21/2013 07:14 PM Aaron Marcuse-Kubitza

fix: bin/map: put template: comment out the "Put template:" label so that the output is valid XML, and displays properly in a browser rather than showing a syntax error

View revisions

Also available in: Atom