Project

General

Profile

Activity

From 11/28/2011 to 12/27/2011

12/22/2011

12:41 PM Task #302: Make changes to VegBIEN schema
Bob Peet's changes are at [[VegBIEN from VegBank]]
E-mail from Bob Peet on 2011-12-22:
I promised to summarize ...
Aaron Marcuse-Kubitza
12:31 PM Task #310 (Resolved): automated build process
I set up an automated build process for all the BIEN scripts and dependencies. It runs on both vegbiendev and nimoy. ... Aaron Marcuse-Kubitza
12:31 PM Task #310 (Resolved): automated build process
Aaron Marcuse-Kubitza

12/16/2011

12:31 PM Task #300: TurboVeg data
Mike Lee's mapping is on nimoy under @/home/bien_shared/raw_data/turboveg/DBASEDIC_rkp2011_mtl2011.xlsx@ Aaron Marcuse-Kubitza
12:21 PM Task #309 (Rejected): mapping and export utility from VegBank to VegX
Ideally, what I have in mind is mapping and export utility from VegBank to VegX. Of course this means more work up fr... Aaron Marcuse-Kubitza
12:20 PM Task #308 (Resolved): do a direct transfer of some public data from VegBank
Even higher priority, do you think you could set us up to do a direct transfer of some public data from VegBank? At t... Aaron Marcuse-Kubitza

12/15/2011

03:42 PM Task #307 (Resolved): Acquire additional specimen data sets in both DwC and DwCA format, esp. GBIF
Aaron Marcuse-Kubitza
03:42 PM Task #306 (Resolved): Acquire additional plot data sets from providers willing to work with Aaron on mappings and validations
Bob: TurboVeg; Brad: RAINFOR, CTFS Aaron Marcuse-Kubitza
03:42 PM Task #305 (Resolved): Complete full-dataset validations for NYBG & SALVIAS
Aaron Marcuse-Kubitza
03:41 PM Task #304 (Resolved): Complete full dataset imports to VegBIEN via VegX of NYBG and SALVIAS
* Identify and make changes to VegX needed to enable full-dataset imports
* Or report changes needed to Nick, Miquel...
Aaron Marcuse-Kubitza
03:41 PM Task #303 (New): Mapping from VegBIEN to original VegBank
the latter to be used as web schema for BIEN web interface Aaron Marcuse-Kubitza
03:40 PM Task #302 (Resolved): Make changes to VegBIEN schema
Aaron Marcuse-Kubitza
02:49 PM Task #294: find plot data source provider to work with Aaron
Brad has contacted two data source provider (RAINFOR, CTFS) regarding working with Aaron to develop mappings Brad Boyle
01:55 PM Task #285 (Resolved): CSV to XML mappings for NYBG, SALVIAS
initial data sources NYBG and SALVIAS have been fully mapped Aaron Marcuse-Kubitza
01:53 PM Task #291 (Resolved): list of milestones
got commented milestones from Martha Aaron Marcuse-Kubitza
01:03 PM Task #286: CSV-XML-database mapping script
I added support for mapping XML to XML, which will enable us to process NVS's VegX data, and eventually also their in... Aaron Marcuse-Kubitza
01:03 PM Task #296: Direct mapping from native salvias_plots MySQL database to VegBIEN
I added a new mapping to get SALVIAS data directly from the salvias_plots database on nimoy. You can see the results ... Aaron Marcuse-Kubitza

12/14/2011

02:29 PM Task #299: Mapping from NVS to VegX and VegBIEN
NVS data from Nick Spencer is on nimoy in @/home/bien_shared/raw_data/nvs/@ Aaron Marcuse-Kubitza
02:06 PM Task #299 (Resolved): Mapping from NVS to VegX and VegBIEN
Will require finding someone at NVS willing to work with Aaron and mappings and validations Aaron Marcuse-Kubitza
02:25 PM Task #300: TurboVeg data
TurboVeg info from Bob Peet is on nimoy in @/home/bien_shared/raw_data/turboveg/@ Aaron Marcuse-Kubitza
02:07 PM Task #300 (New): TurboVeg data
with commitment by someone familiar with DB to work with Aaron on (a) evaluating mappings, and (b) developing validat... Aaron Marcuse-Kubitza
02:07 PM Task #301 (Resolved): RAINFOR data
with commitment by someone familiar with DB to work with Aaron on (a) evaluating mappings, and (b) developing validat... Aaron Marcuse-Kubitza
02:06 PM Task #298 (New): Try to find source of DwCA (DwC Archives) data
hoping GBIF will be willing to work with us on this. Possibly approach Remsen directly Aaron Marcuse-Kubitza
02:05 PM Task #297 (Resolved): Request new data dump of specimen data from GBIF, this time in DwC format
Aaron Marcuse-Kubitza
02:03 PM Task #296 (Resolved): Direct mapping from native salvias_plots MySQL database to VegBIEN
Aaron Marcuse-Kubitza
01:59 PM Task #289: look for formal mapping mechanism
Got NVS mapping tool from Nick Spencer, which is on nimoy in @/home/bien_shared/raw_data/nvs/VegX/@ Aaron Marcuse-Kubitza
01:54 PM Task #286: CSV-XML-database mapping script
Added support for database and XML inputs Aaron Marcuse-Kubitza

12/13/2011

12:11 PM Task #295 (Resolved): provide benchmark queries for NYBG data
Brad Boyle provided NYBG queries, which are on the wiki under [[NYBG tests]] Aaron Marcuse-Kubitza
12:10 PM Task #290: benchmark tests for database loading
Brad Boyle provided NYBG queries, which are on the wiki under [[NYBG tests]] Aaron Marcuse-Kubitza
11:57 AM Task #291: list of milestones
updated to do list Aaron Marcuse-Kubitza
11:56 AM Task #291: list of milestones
Brad created a timeline, which is on the wiki under [[December 8 2011 WebEx meeting]]. Aaron Marcuse-Kubitza

12/08/2011

05:38 PM Task #285: CSV to XML mappings for NYBG, SALVIAS
To make it easier to review the mappings, I created human-readable versions "in Subversion":https://projects.nceas.uc... Aaron Marcuse-Kubitza
03:12 PM Task #295 (Resolved): provide benchmark queries for NYBG data
Aaron Marcuse-Kubitza
03:11 PM Task #294 (Resolved): find plot data source provider to work with Aaron
Aaron Marcuse-Kubitza
01:07 PM Task #290: benchmark tests for database loading
Brad Boyle provided SALVIAS queries, which are on the wiki under [[SALVIAS tests]] Aaron Marcuse-Kubitza

12/07/2011

04:05 PM Task #288: VegX-VegBank mapping
If you would like to browse the @vegbank@ database on nimoy, you can now use "phpPgAdmin":http://bien.nceas.ucsb.edu/... Aaron Marcuse-Kubitza
03:47 PM Task #293: mapping inversion script
updated transformations Aaron Marcuse-Kubitza
01:43 PM Task #293: mapping inversion script
suggested name and location: @svn/scripts/util/invert_map@ Aaron Marcuse-Kubitza
01:41 PM Task #293 (New): mapping inversion script
A Python script to invert a mapping spreadsheet. This will be useful for mapping VegBank to VegX, so that we can just... Aaron Marcuse-Kubitza
02:18 PM Task #289: look for formal mapping mechanism
*"RDF SPARQL":http://en.wikipedia.org/wiki/SPARQL:*
* SELECT-style queries for RDF data
* uses concise Turtle syn...
Aaron Marcuse-Kubitza
02:01 PM Task #289: look for formal mapping mechanism
*"IBM Clio":http://www.almaden.ibm.com/cs/projects/criollo/:*
* "Clio then also interprets these mappings to const...
Aaron Marcuse-Kubitza
01:23 PM Task #289: look for formal mapping mechanism
updated to do list Aaron Marcuse-Kubitza
01:11 PM Task #289: look for formal mapping mechanism
*"Bourret's XML-ER mapping":http://rpbourret.com/:*
* *summary: his various mapping methods are already used by Ve...
Aaron Marcuse-Kubitza
12:45 PM Task #289: look for formal mapping mechanism
*XQuery:*
* "XQuery Tutorial":http://www.w3schools.com/xquery/default.asp
** XQuery iterates over XML documents stor...
Aaron Marcuse-Kubitza
12:38 PM Task #289: look for formal mapping mechanism
*Altova XMLSpy's graphical generation of XPaths:*
* *summary: XMLSpy and Oxygen XML both have Copy XPath commands (O...
Aaron Marcuse-Kubitza

12/06/2011

04:34 PM Task #288: VegX-VegBank mapping
A mostly working VegX-VegBank mapping is now available is now available in svn at https://projects.nceas.ucsb.edu/nce... Aaron Marcuse-Kubitza
04:31 PM Task #287 (Resolved): XML to database conversion script (merged into CSV-XML-database mapping script)
Aaron Marcuse-Kubitza
04:28 PM Task #285: CSV to XML mappings for NYBG, SALVIAS
Working NYBG-VegBank mappings are now available in svn at https://projects.nceas.ucsb.edu/nceas/projects/bien/reposit... Aaron Marcuse-Kubitza
04:26 PM Task #286: CSV-XML-database mapping script
We are now able to import NYBG data directly into VegBank, using the map2vegbank script on nimoy at @/home/bien_share... Aaron Marcuse-Kubitza

12/05/2011

12:14 PM Task #292: VegBank metadata query mechanism
(Moved to issue description) Aaron Marcuse-Kubitza
12:13 PM Task #292 (New): VegBank metadata query mechanism
For data discovery of VegBank schema.
Mike Lee's suggestion: (e-mail on 2011-11-9)
I'm wondering if you all tal...
Aaron Marcuse-Kubitza
12:09 PM Task #289: look for formal mapping mechanism
Mike Lee's explanation of the VegBank XML serialization format: (e-mail on 2011-12-2)
My recollection is that our in...
Aaron Marcuse-Kubitza

12/01/2011

04:44 PM Task #291: list of milestones
I put the tasks from today's conference call into the "Redmine issue tracker":https://projects.nceas.ucsb.edu/nceas/p... Aaron Marcuse-Kubitza
04:35 PM Task #291 (Resolved): list of milestones
*Conference call:*
* -need list of milestones for the next 6-12 months-
* -*add conference call tasks to Redmine ...
Aaron Marcuse-Kubitza
04:34 PM Task #290 (Resolved): benchmark tests for database loading
*Conference call:*
* *develop benchmark tests to check that datasource data was inserted correctly into VegBank*
...
Aaron Marcuse-Kubitza
04:32 PM Task #289 (Resolved): look for formal mapping mechanism
*Conference call:*
* look into VegBranch's way of capturing mappings and metadata
* -look into Altova XMLSpy's gr...
Aaron Marcuse-Kubitza
04:29 PM Task #285: CSV to XML mappings for NYBG, SALVIAS
*Conference call:*
* Ignore SALVIAS @voucher_string@ because it is sometimes missing collector's name
* Ignore SALVI...
Aaron Marcuse-Kubitza
10:50 AM Task #285: CSV to XML mappings for NYBG, SALVIAS
The latest mapping spreadsheets for datasources->VegX and VegX->VegBank are now available in svn at https://projects.... Aaron Marcuse-Kubitza
10:53 AM Task #286: CSV-XML-database mapping script
I've merged data2xml and xml2db into one script called map, which can be run on nimoy at /home/bien_shared/svn/script... Aaron Marcuse-Kubitza
10:52 AM Task #288: VegX-VegBank mapping
The mapping spreadsheet for VegX->VegBank is now available in svn at https://projects.nceas.ucsb.edu/nceas/projects/b... Aaron Marcuse-Kubitza

11/30/2011

01:40 PM Task #288 (Resolved): VegX-VegBank mapping
CSV spreadsheet mapping VegX to VegBank Aaron Marcuse-Kubitza
01:37 PM Task #287: XML to database conversion script (merged into CSV-XML-database mapping script)
Merged into CSV-XML-database mapping script Aaron Marcuse-Kubitza
01:35 PM Task #286: CSV-XML-database mapping script
Merged in XML to database conversion script Aaron Marcuse-Kubitza
 

Also available in: Atom