Project

General

Profile

Activity

From 12/08/2011 to 01/06/2012

01/05/2012

04:53 PM Task #311 (Resolved): Decouple VegBIEN from VegBank and map directly from VegX to VegBIEN
Decoupled VegBIEN from VegBank and removed mappings to VegBank Aaron Marcuse-Kubitza
03:07 PM Task #311 (Resolved): Decouple VegBIEN from VegBank and map directly from VegX to VegBIEN
Aaron Marcuse-Kubitza
03:09 PM Task #315 (New): Import TurboVeg data
Aaron Marcuse-Kubitza
03:09 PM Task #314 (Resolved): Import CTFS data
* coordinate with Shash
* CTFS has a lot of stems data
Aaron Marcuse-Kubitza
03:08 PM Task #313 (Resolved): Import full NYBG data
Aaron Marcuse-Kubitza
03:08 PM Task #312 (Resolved): Finish importing SALVIAS data
# -Import stems data-
# -Fix data format issues-: _Not sure what these were, probably long fixed_
# -Map invalid da...
Aaron Marcuse-Kubitza
11:26 AM Task #290: benchmark tests for database loading
You can view the validation results by running the following on vegbiendev:
@make verify --directory=/home/bien/svn/...
Aaron Marcuse-Kubitza
11:25 AM Task #305: Complete full-dataset validations for NYBG & SALVIAS
You can view the validation results by running the following on vegbiendev:
@make verify --directory=/home/bien/svn/...
Aaron Marcuse-Kubitza
11:25 AM Task #302: Make changes to VegBIEN schema
The vegbien db now contains some of the modifications Bob Peet made to the VegBank schema for VegBIEN, so some table ... Aaron Marcuse-Kubitza
11:24 AM Task #304: Complete full dataset imports to VegBIEN via VegX of NYBG and SALVIAS
I loaded the SALVIAS data (plots and organisms) into VegBIEN on vegbiendev. To browse the data, follow the [[phpPgAdm... Aaron Marcuse-Kubitza

01/04/2012

05:00 PM Task #305: Complete full-dataset validations for NYBG & SALVIAS
Created mechanism to write verification queries and compare to desired output Aaron Marcuse-Kubitza
04:57 PM Task #304: Complete full dataset imports to VegBIEN via VegX of NYBG and SALVIAS
Core SALVIAS data (plots and organisms) are on vegbiendev in VegBIEN.
Takes overnight to reinsert organisms data whe...
Aaron Marcuse-Kubitza
04:49 PM Task #303: Mapping from VegBIEN to original VegBank
Search-and-replace operations that transform VegBank to VegBIEN can in many cases be reversed to transform VegBIEN to... Aaron Marcuse-Kubitza
04:48 PM Task #302: Make changes to VegBIEN schema
All functions that used to output to VegBank now output to VegBIEN db.
The VegBIEN schema is automatically generated...
Aaron Marcuse-Kubitza
04:45 PM Task #296: Direct mapping from native salvias_plots MySQL database to VegBIEN
We will also need to import the projects, stems, and lookup_MethodCode tables in order for all the verification queri... Aaron Marcuse-Kubitza
04:43 PM Task #290: benchmark tests for database loading
Created mechanism to write verification queries and compare to desired output Aaron Marcuse-Kubitza

12/22/2011

12:41 PM Task #302: Make changes to VegBIEN schema
Bob Peet's changes are at [[VegBIEN from VegBank]]
E-mail from Bob Peet on 2011-12-22:
I promised to summarize ...
Aaron Marcuse-Kubitza
12:31 PM Task #310 (Resolved): automated build process
I set up an automated build process for all the BIEN scripts and dependencies. It runs on both vegbiendev and nimoy. ... Aaron Marcuse-Kubitza
12:31 PM Task #310 (Resolved): automated build process
Aaron Marcuse-Kubitza

12/16/2011

12:31 PM Task #300: TurboVeg data
Mike Lee's mapping is on nimoy under @/home/bien_shared/raw_data/turboveg/DBASEDIC_rkp2011_mtl2011.xlsx@ Aaron Marcuse-Kubitza
12:21 PM Task #309 (Rejected): mapping and export utility from VegBank to VegX
Ideally, what I have in mind is mapping and export utility from VegBank to VegX. Of course this means more work up fr... Aaron Marcuse-Kubitza
12:20 PM Task #308 (Resolved): do a direct transfer of some public data from VegBank
Even higher priority, do you think you could set us up to do a direct transfer of some public data from VegBank? At t... Aaron Marcuse-Kubitza

12/15/2011

03:42 PM Task #307 (Resolved): Acquire additional specimen data sets in both DwC and DwCA format, esp. GBIF
Aaron Marcuse-Kubitza
03:42 PM Task #306 (Resolved): Acquire additional plot data sets from providers willing to work with Aaron on mappings and validations
Bob: TurboVeg; Brad: RAINFOR, CTFS Aaron Marcuse-Kubitza
03:42 PM Task #305 (Resolved): Complete full-dataset validations for NYBG & SALVIAS
Aaron Marcuse-Kubitza
03:41 PM Task #304 (Resolved): Complete full dataset imports to VegBIEN via VegX of NYBG and SALVIAS
* Identify and make changes to VegX needed to enable full-dataset imports
* Or report changes needed to Nick, Miquel...
Aaron Marcuse-Kubitza
03:41 PM Task #303 (New): Mapping from VegBIEN to original VegBank
the latter to be used as web schema for BIEN web interface Aaron Marcuse-Kubitza
03:40 PM Task #302 (Resolved): Make changes to VegBIEN schema
Aaron Marcuse-Kubitza
02:49 PM Task #294: find plot data source provider to work with Aaron
Brad has contacted two data source provider (RAINFOR, CTFS) regarding working with Aaron to develop mappings Brad Boyle
01:55 PM Task #285 (Resolved): CSV to XML mappings for NYBG, SALVIAS
initial data sources NYBG and SALVIAS have been fully mapped Aaron Marcuse-Kubitza
01:53 PM Task #291 (Resolved): list of milestones
got commented milestones from Martha Aaron Marcuse-Kubitza
01:03 PM Task #286: CSV-XML-database mapping script
I added support for mapping XML to XML, which will enable us to process NVS's VegX data, and eventually also their in... Aaron Marcuse-Kubitza
01:03 PM Task #296: Direct mapping from native salvias_plots MySQL database to VegBIEN
I added a new mapping to get SALVIAS data directly from the salvias_plots database on nimoy. You can see the results ... Aaron Marcuse-Kubitza

12/14/2011

02:29 PM Task #299: Mapping from NVS to VegX and VegBIEN
NVS data from Nick Spencer is on nimoy in @/home/bien_shared/raw_data/nvs/@ Aaron Marcuse-Kubitza
02:06 PM Task #299 (Resolved): Mapping from NVS to VegX and VegBIEN
Will require finding someone at NVS willing to work with Aaron and mappings and validations Aaron Marcuse-Kubitza
02:25 PM Task #300: TurboVeg data
TurboVeg info from Bob Peet is on nimoy in @/home/bien_shared/raw_data/turboveg/@ Aaron Marcuse-Kubitza
02:07 PM Task #300 (New): TurboVeg data
with commitment by someone familiar with DB to work with Aaron on (a) evaluating mappings, and (b) developing validat... Aaron Marcuse-Kubitza
02:07 PM Task #301 (Resolved): RAINFOR data
with commitment by someone familiar with DB to work with Aaron on (a) evaluating mappings, and (b) developing validat... Aaron Marcuse-Kubitza
02:06 PM Task #298 (New): Try to find source of DwCA (DwC Archives) data
hoping GBIF will be willing to work with us on this. Possibly approach Remsen directly Aaron Marcuse-Kubitza
02:05 PM Task #297 (Resolved): Request new data dump of specimen data from GBIF, this time in DwC format
Aaron Marcuse-Kubitza
02:03 PM Task #296 (Resolved): Direct mapping from native salvias_plots MySQL database to VegBIEN
Aaron Marcuse-Kubitza
01:59 PM Task #289: look for formal mapping mechanism
Got NVS mapping tool from Nick Spencer, which is on nimoy in @/home/bien_shared/raw_data/nvs/VegX/@ Aaron Marcuse-Kubitza
01:54 PM Task #286: CSV-XML-database mapping script
Added support for database and XML inputs Aaron Marcuse-Kubitza

12/13/2011

12:11 PM Task #295 (Resolved): provide benchmark queries for NYBG data
Brad Boyle provided NYBG queries, which are on the wiki under [[NYBG tests]] Aaron Marcuse-Kubitza
12:10 PM Task #290: benchmark tests for database loading
Brad Boyle provided NYBG queries, which are on the wiki under [[NYBG tests]] Aaron Marcuse-Kubitza
11:57 AM Task #291: list of milestones
updated to do list Aaron Marcuse-Kubitza
11:56 AM Task #291: list of milestones
Brad created a timeline, which is on the wiki under [[December 8 2011 WebEx meeting]]. Aaron Marcuse-Kubitza

12/08/2011

05:38 PM Task #285: CSV to XML mappings for NYBG, SALVIAS
To make it easier to review the mappings, I created human-readable versions "in Subversion":https://projects.nceas.uc... Aaron Marcuse-Kubitza
03:12 PM Task #295 (Resolved): provide benchmark queries for NYBG data
Aaron Marcuse-Kubitza
03:11 PM Task #294 (Resolved): find plot data source provider to work with Aaron
Aaron Marcuse-Kubitza
01:07 PM Task #290: benchmark tests for database loading
Brad Boyle provided SALVIAS queries, which are on the wiki under [[SALVIAS tests]] Aaron Marcuse-Kubitza
 

Also available in: Atom