Project

General

Profile

Statistics
| Revision:

# Date Author Comment
7748 02/27/2013 06:20 PM Aaron Marcuse-Kubitza

Moved schemas/vegbank.* to schemas/VegBank/

7747 02/27/2013 06:15 PM Aaron Marcuse-Kubitza

Added planning/milestones/BIEN3 - Progress since the 2011 working group.docx

7746 02/27/2013 06:13 PM Aaron Marcuse-Kubitza

planning/meetings/: Added Martha's conference call notes

7745 02/27/2013 06:06 PM Aaron Marcuse-Kubitza

Moved planning/milestones.doc to planning/milestones/

7744 02/27/2013 06:04 PM Aaron Marcuse-Kubitza

Moved planning/timeline.* to timeline/

7743 02/27/2013 06:01 PM Aaron Marcuse-Kubitza

Renamed to_do/ to planning/

7742 02/27/2013 05:53 PM Aaron Marcuse-Kubitza

Added schemas/VegCore/

7741 02/27/2013 05:53 PM Aaron Marcuse-Kubitza

Added schemas/DwC/

7740 02/27/2013 05:35 PM Aaron Marcuse-Kubitza

Added schemas/BIEN_logo.png from the bien.nceas.ucsb.edu website

7739 02/27/2013 05:29 PM Aaron Marcuse-Kubitza

Renamed schemas/BIEN_logo.png to BIEN_logo.small.png

7738 02/27/2013 05:10 PM Aaron Marcuse-Kubitza

Added inputs/SALVIAS/_archive/salvias_bien_19nov2009.tar.gz.url, .md5

7737 02/27/2013 04:57 PM Aaron Marcuse-Kubitza

Added inputs/REMIB/_archive/remib_raw.0.header.specimens.txt

7736 02/27/2013 04:53 PM Aaron Marcuse-Kubitza

Added inputs/CTFS/_src/ctfs_extract.tab.url, .md5

7735 02/27/2013 04:48 PM Aaron Marcuse-Kubitza

Added inputs/NVS/_src/NVS_VegX.XSLT, _src/VegX/

7734 02/27/2013 04:43 PM Aaron Marcuse-Kubitza

Added inputs/NVS/_src/_README.TXT

7733 02/27/2013 04:41 PM Aaron Marcuse-Kubitza

Added inputs/TurboVeg/_src/DBASEDIC_rkp2011*.xlsx

7732 02/27/2013 04:40 PM Aaron Marcuse-Kubitza

Added inputs/TurboVeg/_src/_README.TXT

7731 02/27/2013 03:45 PM Aaron Marcuse-Kubitza

inputs/import.stats.xls: Updated import times

7730 02/27/2013 03:36 PM Aaron Marcuse-Kubitza

README.TXT: Full database import: Don't run backups/fix_perms with sudo because owners are not rsynced to jupiter, so fixing them first is unnecessary. (It's not necessary to change the file owner to bien at any other time, either, because commands are not run as the bien user. It's in fact better to leave the file owner as yourself, to allow rsync to set the modification times.)

7729 02/27/2013 03:24 PM Aaron Marcuse-Kubitza

README.TXT: Full database import: Added steps to set $version in all vegbiendev terminals

7728 02/27/2013 03:00 PM Aaron Marcuse-Kubitza

lib/common.Makefile: rsync: $(rsync): Also exclude .lk* lock files

7727 02/27/2013 02:57 PM Aaron Marcuse-Kubitza

README.TXT: Full database import: Updated log file sync steps for syncing via jupiter

7726 02/27/2013 02:56 PM Aaron Marcuse-Kubitza

inputs/BRIT/specimen_flat/test.xml.ref: Updated inserted row count

7725 02/26/2013 08:27 PM Aaron Marcuse-Kubitza

schemas/py_functions.sql: Added _date(year integer, month integer, day integer)

7724 02/26/2013 08:08 PM Aaron Marcuse-Kubitza

inputs/BRIT/specimen_flat/postprocess.sql: Added primary key

7723 02/26/2013 07:40 PM Aaron Marcuse-Kubitza

schemas/functions.sql: Added _dms_to_dd() that takes text arguments and casts them to the appropriate type

7722 02/26/2013 07:11 PM Aaron Marcuse-Kubitza

inputs/HVAA/Specimen/map.csv: Remapped fieldNotes to UNUSED. This also fixes a bug where fieldNotes was colliding with other occurrenceRemarks inputs because it was missing a filter.

7721 02/26/2013 06:46 PM Aaron Marcuse-Kubitza

schemas/vegbien.sql: analytical_specimen/analytical_plot: Added occurrenceRemarks

7720 02/26/2013 06:32 PM Aaron Marcuse-Kubitza

inputs/REMIB/Specimen/map.csv: Mapping NULL-equivalent lat/long to NULL: Fixed bug where need special *=* mapping to pass through values not in the map

7719 02/26/2013 06:30 PM Aaron Marcuse-Kubitza

inputs/REMIB/Specimen/map.csv: Map NULL-equivalent text fields (country, state, etc.) to NULL

7718 02/26/2013 06:23 PM Aaron Marcuse-Kubitza

inputs/REMIB/Specimen/map.csv: Map NULL-equivalent lat/long to NULL

7717 02/26/2013 05:59 PM Aaron Marcuse-Kubitza

inputs/SpeciesLink/Specimen/map.csv: dwc_dwcore_Remarks: Remapped to occurrenceRemarks (it had been incorrectly automapped to taxonRemarks). Combined occurrenceRemarks inputs using /_alt.

7716 02/26/2013 05:47 PM Aaron Marcuse-Kubitza

mappings/VegCore.htm: Regenerated from wiki. Remapped organismNotes to be a synonym of occurrenceRemarks, since notes on an organism are more generally notes on an occurrence.

7715 02/26/2013 05:28 PM Aaron Marcuse-Kubitza

inputs/HVAA/Specimen/map.csv: Remapped dynamicProperties to occurrenceRemarks because it contains occurrenceRemarks data

7714 02/26/2013 05:23 PM Aaron Marcuse-Kubitza

schemas/vegbien.sql: analytical_stem_view: Added occurrenceRemarks

7713 02/26/2013 05:19 PM Aaron Marcuse-Kubitza

mappings/VegCore-VegBIEN.csv: Mapped occurrenceRemarks

7712 02/26/2013 04:53 PM Aaron Marcuse-Kubitza

mappings/VegCore-VegBIEN.csv: Only use one of collection and collectionURL instead of concatenating them when both are provided (as requested by Brad <https://projects.nceas.ucsb.edu/nceas/projects/bien/wiki/Spot-checking#ACAD&gt;)

7711 02/26/2013 04:53 PM Aaron Marcuse-Kubitza

mappings/VegCore-VegBIEN.csv: _avg(): Use numeric param names to work with SQL functions

7710 02/26/2013 04:52 PM Aaron Marcuse-Kubitza

mappings/VegCore-VegBIEN.csv: _avg(): Use numeric param names to work with SQL functions

7709 02/26/2013 04:44 PM Aaron Marcuse-Kubitza

inputs/FIA/_src/_README.TXT: Added e-mail from Brad Boyle on 2013-2-8

7708 02/26/2013 04:42 PM Aaron Marcuse-Kubitza

inputs/FIA/_src/: Added attachments from Brad's e-mail on 2013-2-8

7707 02/26/2013 04:37 PM Aaron Marcuse-Kubitza

xml_func.py: Removed no longer used _range(). Use SQL functions._range() instead.

7706 02/26/2013 04:34 PM Aaron Marcuse-Kubitza

schemas/functions.sql: Added _range()

7705 02/26/2013 04:30 PM Aaron Marcuse-Kubitza

xml_func.py: Removed no longer used _avg(). Use SQL functions._avg() instead.

7704 02/26/2013 04:29 PM Aaron Marcuse-Kubitza

schemas/functions.sql: Added _avg()

7703 02/26/2013 04:27 PM Aaron Marcuse-Kubitza

mappings/VegCore-VegBIEN.csv: _avg(): Use numeric param names to work with SQL functions

7702 02/26/2013 04:15 PM Aaron Marcuse-Kubitza

schemas/functions.sql: _dms_to_dd(text): Corrected concatenated form to interpret last 5 digits as MMmmm = MM.mmm instead of MMSSS, per Tom Wendt's explanation that this form is "degrees/minutes/decimalminutes"

7701 02/26/2013 04:05 PM Aaron Marcuse-Kubitza

inputs/MO/Specimen/postprocess.sql: Use :table instead of hardcoding "MO"."Specimen"

7700 02/26/2013 04:04 PM Aaron Marcuse-Kubitza

inputs/MO/Specimen/postprocess.sql: Also remove frameshifted rows where InstitutionCode is NULL

7699 02/26/2013 03:44 PM Aaron Marcuse-Kubitza

inputs/UNCC/Specimen/map.csv: herbarium->specimenIndexer: Replace UNCCD (UNCC database?) with UNCC

7698 02/26/2013 03:27 PM Aaron Marcuse-Kubitza

schemas/functions.sql: functions._dms_to_dd(): Added support for DMS values without separators

7697 02/26/2013 03:09 PM Aaron Marcuse-Kubitza

README.TXT: Datasource setup: Update vegbiendev: Removed command to run the tests on vegbiendev because vegbiendev no longer has an empty public schema for running tests on (the public schema instead contains the latest published import)

7696 02/26/2013 03:04 PM Aaron Marcuse-Kubitza

Mapped inputs/BRIT/

7695 02/26/2013 02:36 PM Aaron Marcuse-Kubitza

my2pg: Remove (0) after char

7694 02/26/2013 02:35 PM Aaron Marcuse-Kubitza

my2pg: Remove any (#) after bytea

7693 02/26/2013 02:33 PM Aaron Marcuse-Kubitza

my2pg: Translate binary to bytea

7692 02/26/2013 02:30 PM Aaron Marcuse-Kubitza

README.TXT: Datasource setup: MySQL inputs: Editing _MySQL/*.make: Set $server to vegbiendev instead so the export command will work from any machine (though it will be faster from vegbiendev itself)

7691 02/26/2013 02:28 PM Aaron Marcuse-Kubitza

inputs/BRIT/_MySQL/MySQL.*.sql.make: Fixed bug where needs to be set to just localhost and --user to bien instead

7690 02/26/2013 02:27 PM Aaron Marcuse-Kubitza

README.TXT: Datasource setup: MySQL inputs: Editing _MySQL/*.make: Fixed bug where $server needs to be set to just localhost and --user to bien instead.

7689 02/26/2013 02:25 PM Aaron Marcuse-Kubitza

lib/MySQL.*.sql.make: Added --user option to demonstrate how to set the DB user vs. the ssh user

7688 02/26/2013 02:19 PM Aaron Marcuse-Kubitza

inputs/BRIT/_MySQL/MySQL.*.sql.make: Fixed bug where $server needs to be set to bien@localhost

7687 02/26/2013 02:18 PM Aaron Marcuse-Kubitza

README.TXT: Datasource setup: MySQL inputs: Editing _MySQL/*.make: Specified that $server needs to be set to bien@localhost. Install the staging tables: Specified that for a MySQL .sql export, this must be done on vegbiendev.

7686 02/26/2013 02:15 PM Aaron Marcuse-Kubitza

inputs/BRIT/: Added _MySQL/MySQL.*.sql.make

7685 02/26/2013 02:08 PM Aaron Marcuse-Kubitza

README.TXT: Datasource setup: MySQL inputs: .sql exports: Run mysql_bien in the background

7684 02/26/2013 02:03 PM Aaron Marcuse-Kubitza

README.TXT: Datasource setup: MySQL inputs: .sql exports: Added steps to sync the export to vegbiendev. Specified that the database for the MySQL export should be created on vegbiendev.

7683 02/26/2013 01:58 PM Aaron Marcuse-Kubitza

README.TXT: Datasource setup: Update vegbiendev: Updated steps for syncing via jupiter

7682 02/26/2013 01:56 PM Aaron Marcuse-Kubitza

Added inputs/BRIT/ (not yet translated to PostgreSQL)

7681 02/26/2013 01:35 PM Aaron Marcuse-Kubitza

mappings/VegCore-VegBIEN.csv: Mapped latitude/longitude_DMS to coordinates.latitude_deg using new _dms_to_dd(text)

7680 02/26/2013 01:34 PM Aaron Marcuse-Kubitza

mappings/VegCore-VegBIEN.csv: Mapped latitude/longitude_DMS to coordinates.latitude_deg using new _dms_to_dd(text)

7679 02/26/2013 01:29 PM Aaron Marcuse-Kubitza

schemas/functions.sql: Added _dms_to_dd(text)

7678 02/26/2013 01:28 PM Aaron Marcuse-Kubitza

schemas/functions.sql: _dms_to_dd(): Fixed bug where need to use 1 as the multiplier when dir is NULL

7677 02/26/2013 01:19 PM Aaron Marcuse-Kubitza

schemas/functions.sql: _dms_to_dd(): Fixed bug where need to apply the sign multiplier after the components are added, because it applies to the DMS as a whole rather than just to the degree component

7676 02/26/2013 12:58 PM Aaron Marcuse-Kubitza

README.TXT: Full database import: Before running `make inputs/upload`, added step to do ./fix_perms on local machine so that files are not uploaded to jupiter with incorrect permissions

7675 02/26/2013 12:57 PM Aaron Marcuse-Kubitza

README.TXT: Full database import: Before running `make inputs/upload`, added step to do svn up on jupiter so that unversioned files are not uploaded before their versioned equivalents are checked out from svn (requiring each file to be manually svn-added before the svn up can proceed)

7674 02/26/2013 12:30 PM Aaron Marcuse-Kubitza

schemas/functions.sql: _dms_to_dd(): Added dir param to specify compass dir suffix, in order to calculate the sign correctly

7673 02/26/2013 11:05 AM Aaron Marcuse-Kubitza

Moved compass_dir from schemas/vegbien.sql to schemas/functions.sql so it can be used by _dms_to_dd()

7672 02/26/2013 10:56 AM Aaron Marcuse-Kubitza

Moved _dms_to_dd() from schemas/vegbien.sql to schemas/functions.sql so it can use functions schema functions

7671 02/26/2013 10:51 AM Aaron Marcuse-Kubitza

schemas/vegbien.sql: Added compass_dir enum

7670 02/26/2013 10:42 AM Aaron Marcuse-Kubitza

inputs/TEX/Specimen/map.csv: Remapped LAT/LONG_DEGREES,MINUTES,SECONDS to new latitude/longitude_deg,min,sec, allowing the DMS coordinates to be translated

7669 02/26/2013 10:40 AM Aaron Marcuse-Kubitza

inputs/REMIB/Specimen/map.csv: Remapped lat/long_deg,min,sec to new latitude/longitude_deg,min,sec, allowing the DMS coordinates to be translated

7668 02/26/2013 10:39 AM Aaron Marcuse-Kubitza

mappings/VegCore-VegBIEN.csv: latitude/longitude_deg,min,sec: Also mapped to the geoscrub coordinates entry

7667 02/26/2013 10:34 AM Aaron Marcuse-Kubitza

mappings/VegCore-VegBIEN.csv: latitude/longitude_sec: Fixed name, which had been incorrectly automapped to verbatim*

7666 02/26/2013 10:31 AM Aaron Marcuse-Kubitza

mappings/VegCore.htm: Regenerated from wiki. latitude/longitude: Moved _deg,min,sec components after unit alternatives so that unit alternatives following them wouldn't incorrectly be interpreted as alternatives for the *components instead of for the overall, unitless term.

7665 02/26/2013 10:22 AM Aaron Marcuse-Kubitza

mappings/VegCore-VegBIEN.csv: Mapped latitude/longitude_deg,min,sec

7664 02/26/2013 10:15 AM Aaron Marcuse-Kubitza

mappings/VegCore.htm: Regenerated from wiki. Merged coordinateUncertainty and coordinatePrecision, since datasources often use these interchangeably (the only difference is the DwC-recommended units).

7663 02/26/2013 10:08 AM Aaron Marcuse-Kubitza

mappings/VegCore.htm: Regenerated from wiki. Source: Added authors. Renamed creator to firstPublisher. Moved dataOwner to Source as list. Coordinates: latitude/longitude, coordinatePrecision: Added units disambiguation. latitude/longitude_DMS: Added components. Global IDs: Changed "globally unique" tag to "global ID" and hyperlinked it to <https://projects.nceas.ucsb.edu/nceas/projects/bien/wiki/Global_IDs> (which now includes detailed examples of the various types of global IDs).

7662 02/26/2013 09:58 AM Aaron Marcuse-Kubitza

inputs/SpeciesLink/Specimen/map.csv: conceptual_darwin_2003_1_0_CoordinatePrecision: Remapped to coordinateUncertaintyInMeters, assuming units based on the range and precision of values

7661 02/26/2013 09:53 AM Aaron Marcuse-Kubitza

inputs/HVAA/Specimen/map.csv: Remapped coordinatePrecision to UNUSED

7660 02/26/2013 09:50 AM Aaron Marcuse-Kubitza

inputs/ARIZ/omoccurrences/map.csv: Remapped coordinatePrecision to UNUSED

7659 02/26/2013 09:05 AM Aaron Marcuse-Kubitza

schemas/vegbien.sql: Added _dms_to_dd()

7658 02/26/2013 08:49 AM Aaron Marcuse-Kubitza

inputs/bien2_traits/TraitObservation/map.csv: Remapped Source to sourceType

7657 02/26/2013 08:43 AM Aaron Marcuse-Kubitza

Added inputs/TEX/

7656 02/26/2013 08:42 AM Aaron Marcuse-Kubitza

units.py: convert(): Support ranges

7655 02/26/2013 08:35 AM Aaron Marcuse-Kubitza

Moved parse_range() from xml_func.py to units.py

7654 02/26/2013 08:02 AM Aaron Marcuse-Kubitza

units.py: conversions: Added ft->m conversion

7653 02/26/2013 07:12 AM Aaron Marcuse-Kubitza

src_map: Reopen stdin (/dev/stdin) in universal newlines mode to support files with \r as the line ending

7652 02/26/2013 06:51 AM Aaron Marcuse-Kubitza

csv2db: Open input stream in universal newlines mode to support files with \r as the line ending

7651 02/22/2013 11:15 PM Aaron Marcuse-Kubitza

mappings/VegCore.htm: Regenerated from wiki. Moved Forming IDs section to separate Global IDs wiki page (https://projects.nceas.ucsb.edu/nceas/projects/bien/wiki/Global_IDs).

7650 02/22/2013 11:09 PM Aaron Marcuse-Kubitza

input.Makefile: $(exts): Added .tab

7649 02/22/2013 10:29 PM Aaron Marcuse-Kubitza

mappings/VegCore.htm: Regenerated from wiki. Moved preferred ID order to Forming IDs section as examples list. Made examples globally unique by prefixing the outer ID that scopes the value.