schemas/vegbien.ERD.mwb: synced to schemas/vegbien.my.sql, which adds the validation schema

schemas/util.sql: added diff_views()

schemas/util.sql: added diff_cols(), for use with the aggregating validations

bugfix: schemas/Makefile: public/uninstall: need to uninstall the validation schema in addition to the public schema (deleting the public schema would only cascade to the contents of the validation schema)

schemas/vegbien.sql: added validation schema, which contains queries used in the aggregating validations. schemas/Makefile: include schemas that depend on `public` (eg. `validation`) so they are restored along with it.

bugfix: bin/pg_dump_vegbien: fixed arg-count check to allow passing command-line options to pg_dump via args

bugfix: inputs/SALVIAS/verify/plots.out.sql: fixed ' quoting syntax to use '' instead of \' to escape '

inputs/input.Makefile: verify/%.out: use a *.sql file in the verify/ directory itself to generate *.out, so that each datasource can have its own set of output queries. for datasources that should share the same set of queries, they can instead be symlinked to the same file.

fix: inputs/CVS/project/: added _no_import since this should not also be imported separately from taxon_observation.**

fix: validation/aggregating/traits/_archive/bien3_validations_traits_bien3.by=Brad@iPlant,Aaron@UCSB,Brad@iPlant.sql: added missing .url extension

added validation/aggregating/traits/_archive/bien3_validations_traits_bien3.by=Brad@iPlant,Aaron@UCSB,Brad@iPlant.sql

validation/aggregating/traits/BIEN2_traits/_archive/bien3_validations_traits_original_mysql.by=Brad@iPlant,Aaron@UCSB,Brad@iPlant.sql.url: renamed to indicate that it's just by Brad (it was the other file, the output queries, that were created by both of us)

added validation/aggregating/traits/BIEN2_traits/_archive/bien3_validations_traits_original_mysql.by=Brad@iPlant,Aaron@UCSB,Brad@iPlant.sql.url

validation/aggregating/plots/_archive/bien3_validations_salvias_vegbien.by=Brad@iPlant.sql.url: removed trailing @

deleted validation/aggregating/traits/_archive/bien3_validations_traits_bien3.by=Brad@iPlant.sql.url@, since there is already a version without the trailing @

validation/aggregating/traits/BIEN2_traits/_archive/bien3_validations_traits_original.by=Brad@iPlant.sql.url: removed trailing (apparently, the escape for paths containing @ should only be used on the input path)

added inputs/XAL/Specimen/_no_import, since this is a demo-only datasource and there isn't a staging table for it

inputs/.geoscrub/county_centroids/test.xml.ref, inputs/.NCBI/{names.src,nodes.src}/test.xml.ref: accepted test outputs (generated now that these tables are in import_order.txt)

inputs/FIA/taxon_observation.**/header.csv: updated for new REF_RESEARCH_STATION.country metadata value col

/README.TXT: Full database import: `make test by_col=1`: documented runtime (20 min)

/README.TXT: Full database import: `. bin/import_all`: documented how to view progress

fix: schemas/Makefile: %/uninstall: don't prompt to delete auxiliary schemas, as these do not contain data

schemas/vegbien.sql: added top_plot view

/README.TXT: to back up the version history: added steps to sync the git repository to jupiter and the local machine

/README.TXT: added steps to back up the version history

validation/aggregating/plots/bien3_validations_salvias_vegbien.by=Brad@iPlant.sql.url: moved to _archive/ so only the most recent version would be in the main plots/ directory

planning/resources/dev_machine.specs/sys_info.spx+/system_power_settings.txt: updated: enabled "Automatic Restart on Power Loss" and "Wake on LAN" for UPS (this requires using pmset, as described at http://vegpath.org/links/#pmset%281%29%20Mac%20OS%20X%20Manual%20Page )

web/links/index.htm: updated to Firefox bookmarks: wake for network access: added link to pmset man page, which contains commands for setting "wake for network access" for all power sources. note that "automatic restart on power loss" also needs to be set for all power sources, because the computer will always be in UPS mode at the time of a power failure.

inputs/input.Makefile: add!: verify/: also svn:ignore *.tsv, *.txt

validation/aggregating/traits/bien3_validations_traits_bien3.by=Brad@iPlant.sql*: moved to _archive/

validation/aggregating/traits/BIEN2_traits/bien3_validations_traits_original.by=Brad@iPlant.sql*: moved to _archive/

schemas/vegbien.sql: location_set_top_plot(): only do the lookup of the parent's top_plot when there is a parent_id

schemas/vegbien.sql: location: added autopopulated top_plot

schemas/vegbien.sql: locationevent: added locationevent_pull_forward_from_parent() trigger which populates project_id from the parent locationevent

web/links/index.htm: updated to Firefox bookmarks: NCEAS: added link to phone list, which contains the Balboa Building maintenance numbers

/README.TXT: Notes on running programs: added warning that you should always start with a clean shell to avoid spurious bugs

schemas/vegbien.sql: locationevent__pull_forward_from_parent(): renamed to locationevent_pull_forward_from_parent_for_stratum() since it actually has a filter that causes it to apply only to stratum events

added validation/aggregating/, containing folders for Brad's scripts (the scripts themselves cannot be in the repository because they are not UCSB-owned)

web/links/index.htm: updated to Firefox bookmarks: svn: added steps to add a file containing (append to the path)

web/links/index.htm: updated to Firefox bookmarks: `mysql`: added commands to get interactive formatting (including echoed queries) when inputting from a file, and to get raw formatting when inputting from the console. git: added equivalent to `svn update`.

bugfix: schemas/vegbien.sql: commconcept: added missing unique constraint on commdescription, which is also an identifying field in addition to the ID (which is in commname.commname)

inputs/publishable datasources.xlsx: updated

inputs/publishable datasources.xlsx: updated

fix: inputs/SALVIAS/projects/postprocess.sql: remove private data that should not be publicly visible: remove projects that do not have "There are no specific use conditions attached to this dataset"

fix: inputs/SALVIAS/salvias_plots.~.clean_up.sql: Remove private data that should not be publicly visible: also need to remove metadata-only plots

bugfix: inputs/SALVIAS/plotMetadata_/map.csv: things mapped to project_participant: remapped to event__participant because these actually relate to the event, not the project, even though they seem like project-related fields

mappings/VegCore-VegBIEN.csv: event__participant: allow multiple event__participant columns

fix: inputs/SALVIAS/plotMetadata_/map.csv, inputs/Madidi/LocationObservation/map.csv: things mapped to communityID: remapped to communityName, which is what's used in analytical_stem (communityID is for numeric IDs)

bugfix: schemas/vegbien.sql: locationevent__communities(): inner-join to commdetermination instead of left-joining, so that this does not produce community entries (which occur because there is one commclass per locationevent, but only some commclasses will then have a commdetermination)

inputs/SALVIAS/plotMetadata_/create.sql, map.csv: expanded plot_administrator:party_code_party_ and mapped plot_administrator_name to a 2nd project_participant

mappings/VegCore-VegBIEN.csv: project_participant: use [!...] negative lookahead assertion so that multiple project_participant columns will properly map to separate projectcontributor rows

fix: lib/Parser.py: syntax_err(): error message: lightened the shade of gray so the boundary between the strings before and after the error would be clearer

inputs/SALVIAS/plotMetadata_/map.csv: mapped PrimOwnerID_name->project_participant

inputs/SALVIAS/plotMetadata_/create.sql: added join to PrimOwnerID:party_code_party_

bugfix: inputs/SALVIAS/import_order.txt: added party_code_party_

bugfix: inputs/SALVIAS/party_code_party_/create.sql: need to remove duplicate entries in party_code_party

schemas/vegbien.sql: projectcontributor: added missing unique constraint

web/links/index.htm: updated to Firefox bookmarks: OS X 10.9 Mavericks upgrade: added links for whether to upgrade (conclusion: don't, it breaks existing programs)

inputs/SALVIAS/party_code_party_/map.csv: mapped fullname->event_participant_name for use by other tables

mapped inputs/SALVIAS/party_code_party_/

planning/resources/dev_machine.specs/sys_info.spx+/system_power_settings.txt: updated: enabled PrioritizeNetworkReachabilityOverSleep

/README.TXT: Testing: added pointer to development machine specs

added planning/resources/dev_machine.specs/

inputs/SALVIAS/_MySQL/salvias_plots.*.sql: refreshed. this adds the party and party_code_party tables Brad provided for mapping the plot contributors.

fix: inputs/SALVIAS/salvias_plots.~.clean_up.sql: Delete rows that do not satisfy foreign key constraints: also need to do this for plotObservations, since the refreshed data contains dangling rows for that as well

inputs/SALVIAS/run_: documented *.sql install runtime (3 min), as separate from the full `datasrc_make reinstall` runtime (3.5 min)

inputs/SALVIAS/run_: refresh(): `datasrc_make reinstall`: updated runtime. documented that runtimes are from starscream.

added inputs/SALVIAS/run_, which includes a refresh() target

lib/runscripts/in_datasrc_dir.run: datasrc_make(): use `if remaking ...` instead of accessing $_remake manually, for clarity

bugfix: lib/runscripts/in_datasrc_dir.run: datasrc_make(): use set_make_vars and $_remake as required in lib/sh/make.sh `remaking`

lib/sh/make.sh: remaking alias: documented that you MUST use set_make_vars at the beginning of any function that uses this, so that $_remake is properly set to $remake and not left at its previous value

web/links/index.htm: updated to Firefox bookmarks. git: added instructions to migrate from svn.

web/links/index.htm: updated to Firefox bookmarks. git: added instructions to migrate from svn.

web/links/index.htm: updated to Firefox bookmarks. added instructions for running `svn switch` after moving everything into /trunk/ (for us, use `svn switch --force https://code.nceas.ucsb.edu/code/projects/bien/trunk # runtime: <1 min`).

web/links/index.htm: updated to Firefox bookmarks. added instructions for running `svn switch` after moving everything into /trunk/ (for us, use `svn switch --force https://code.nceas.ucsb.edu/code/projects/bien/trunk # runtime: <1 min`).

/: re-set svn:ignore on new root (/trunk/)

moved everything into /trunk/ to create the standard svn layout, for use with tools that require this (eg. git-svn). IMPORTANT: do NOT do an `svn up`. instead, re-use your working copy's existing files with `svn switch` (http://svnbook.red-bean.com/en/1.6/svn.ref.svn.c.switch.html).

added standard svn dirs branches, tags, trunk

web/links/index.htm: updated to Firefox bookmarks. added links to the sPlot ERD. Dropbox: added information about a missing upgrade notification when you use the Dropbox client to look up a file on the Dropbox website.

/README.TXT: added note that shell scripts should always be read-only, so that editing them while an import is in progress will not crash the import (see http://vegpath.org/links/#**%20modifying%20a%20running%20shell%20script)

/: svn:ignore the new extern/ dir, which will contain non-UCSB files

bugfix: inputs/.TNRS/schema.sql: scrubbed_family: Name_matched_accepted_family was missing from the TNRS results at one point, so we are now using Family_matched as a workaround to populate this. the workaround is for accepted names only, as no opinion names do not have an Accepted_name_family to prepend to the scrubbed name to parse.

inputs/.TNRS/schema.sql: reexported from live DB, which changes the element order

schemas/vegbien.sql: plot.**, analytical_stem_view, analytical_plot: added project_contributors

schemas/vegbien.sql: added project_contributors()

inputs/VegBank/import_order.txt: added projectcontributor_

inputs/VegBank/projectcontributor_/map.csv, postprocess.sql: added project_participant

mappings/VegCore-VegBIEN.csv: mapped project_participant

mappings/VegCore.htm: regenerated from wiki. merged confusingly-named TaxonObservation into TaxonOccurrence. added project_participant.

added inputs/VegBank/projectcontributor_/

inputs/VegBank/vegbank.~.clean_up.sql: projectcontributor.surname: prepend table name to avoid join collisions

inputs/VegBank/vegbank.~.clean_up.sql, inputs/CVS/cvs.~.clean_up.sql: Prevent "column name specified more than once" errors when tables are joined: put tables in alphabetical order for consistency

web/links/index.htm: updated to Firefox bookmarks. Quick links: removed page descriptions, which clutter up the quick links list.

web/links/index.htm: updated to Firefox bookmarks. Quick links: added VegBIEN FAQ.

bugfix: bin/boldify: also match [[]]-style links at the beginning and end of a line

bin/boldify: made it idempotent

bugfix: bin/boldify: fixed extended regular expression syntax, which doesn't support a \] inside [] (you instead have to put the ] right after the opening [^ )

added bin/boldify, which makes Redmine links bold

web/links/index.htm: updated to Firefox bookmarks. Quick links: removed page descriptions, which clutter up the quick links list

web/links/index.htm: updated to Firefox bookmarks. Quick links: added link to meetings