Activity
From 12/12/2011 to 01/10/2012
01/10/2012
- 02:20 PM Task #314: Import CTFS data
- e-mail from Mark Schildhauer on 2012-1-10:
I think tt would be best (and certainly most scaleable) if the elements... - 01:20 PM Task #314: Import CTFS data
- Looking at Shash's VegX file, I noticed that she uses different VegX elements than we do for SALVIAS and NYBG data. F...
01/09/2012
- 04:44 PM Task #302: Make changes to VegBIEN schema
- Added new tables and moved/updated columns
- 04:44 PM Task #302: Make changes to VegBIEN schema
- I asked Bob a few questions about the new Collection table in the VegBIEN modifications:
* Is the Collection table m... - 11:40 AM Task #314: Import CTFS data
- I uploaded Shash's VegX file to vegbiendev at @/home/bien/svn/inputs/CTFS/src.VegX.xml@ .
01/05/2012
- 04:53 PM Task #311 (Resolved): Decouple VegBIEN from VegBank and map directly from VegX to VegBIEN
- Decoupled VegBIEN from VegBank and removed mappings to VegBank
- 03:07 PM Task #311 (Resolved): Decouple VegBIEN from VegBank and map directly from VegX to VegBIEN
- 03:09 PM Task #315 (New): Import TurboVeg data
- 03:09 PM Task #314 (Resolved): Import CTFS data
- * coordinate with Shash
* CTFS has a lot of stems data - 03:08 PM Task #313 (Resolved): Import full NYBG data
- 03:08 PM Task #312 (Resolved): Finish importing SALVIAS data
- # -Import stems data-
# -Fix data format issues-: _Not sure what these were, probably long fixed_
# -Map invalid da... - 11:26 AM Task #290: benchmark tests for database loading
- You can view the validation results by running the following on vegbiendev:
@make verify --directory=/home/bien/svn/... - 11:25 AM Task #305: Complete full-dataset validations for NYBG & SALVIAS
- You can view the validation results by running the following on vegbiendev:
@make verify --directory=/home/bien/svn/... - 11:25 AM Task #302: Make changes to VegBIEN schema
- The vegbien db now contains some of the modifications Bob Peet made to the VegBank schema for VegBIEN, so some table ...
- 11:24 AM Task #304: Complete full dataset imports to VegBIEN via VegX of NYBG and SALVIAS
- I loaded the SALVIAS data (plots and organisms) into VegBIEN on vegbiendev. To browse the data, follow the [[phpPgAdm...
01/04/2012
- 05:00 PM Task #305: Complete full-dataset validations for NYBG & SALVIAS
- Created mechanism to write verification queries and compare to desired output
- 04:57 PM Task #304: Complete full dataset imports to VegBIEN via VegX of NYBG and SALVIAS
- Core SALVIAS data (plots and organisms) are on vegbiendev in VegBIEN.
Takes overnight to reinsert organisms data whe... - 04:49 PM Task #303: Mapping from VegBIEN to original VegBank
- Search-and-replace operations that transform VegBank to VegBIEN can in many cases be reversed to transform VegBIEN to...
- 04:48 PM Task #302: Make changes to VegBIEN schema
- All functions that used to output to VegBank now output to VegBIEN db.
The VegBIEN schema is automatically generated... - 04:45 PM Task #296: Direct mapping from native salvias_plots MySQL database to VegBIEN
- We will also need to import the projects, stems, and lookup_MethodCode tables in order for all the verification queri...
- 04:43 PM Task #290: benchmark tests for database loading
- Created mechanism to write verification queries and compare to desired output
12/22/2011
- 12:41 PM Task #302: Make changes to VegBIEN schema
- Bob Peet's changes are at [[VegBIEN from VegBank]]
E-mail from Bob Peet on 2011-12-22:
I promised to summarize ... - 12:31 PM Task #310 (Resolved): automated build process
- I set up an automated build process for all the BIEN scripts and dependencies. It runs on both vegbiendev and nimoy. ...
- 12:31 PM Task #310 (Resolved): automated build process
12/16/2011
- 12:31 PM Task #300: TurboVeg data
- Mike Lee's mapping is on nimoy under @/home/bien_shared/raw_data/turboveg/DBASEDIC_rkp2011_mtl2011.xlsx@
- 12:21 PM Task #309 (Rejected): mapping and export utility from VegBank to VegX
- Ideally, what I have in mind is mapping and export utility from VegBank to VegX. Of course this means more work up fr...
- 12:20 PM Task #308 (Resolved): do a direct transfer of some public data from VegBank
- Even higher priority, do you think you could set us up to do a direct transfer of some public data from VegBank? At t...
12/15/2011
- 03:42 PM Task #307 (Resolved): Acquire additional specimen data sets in both DwC and DwCA format, esp. GBIF
- 03:42 PM Task #306 (Resolved): Acquire additional plot data sets from providers willing to work with Aaron on mappings and validations
- Bob: TurboVeg; Brad: RAINFOR, CTFS
- 03:42 PM Task #305 (Resolved): Complete full-dataset validations for NYBG & SALVIAS
- 03:41 PM Task #304 (Resolved): Complete full dataset imports to VegBIEN via VegX of NYBG and SALVIAS
- * Identify and make changes to VegX needed to enable full-dataset imports
* Or report changes needed to Nick, Miquel... - 03:41 PM Task #303 (New): Mapping from VegBIEN to original VegBank
- the latter to be used as web schema for BIEN web interface
- 03:40 PM Task #302 (Resolved): Make changes to VegBIEN schema
- 02:49 PM Task #294: find plot data source provider to work with Aaron
- Brad has contacted two data source provider (RAINFOR, CTFS) regarding working with Aaron to develop mappings
- 01:55 PM Task #285 (Resolved): CSV to XML mappings for NYBG, SALVIAS
- initial data sources NYBG and SALVIAS have been fully mapped
- 01:53 PM Task #291 (Resolved): list of milestones
- got commented milestones from Martha
- 01:03 PM Task #286: CSV-XML-database mapping script
- I added support for mapping XML to XML, which will enable us to process NVS's VegX data, and eventually also their in...
- 01:03 PM Task #296: Direct mapping from native salvias_plots MySQL database to VegBIEN
- I added a new mapping to get SALVIAS data directly from the salvias_plots database on nimoy. You can see the results ...
12/14/2011
- 02:29 PM Task #299: Mapping from NVS to VegX and VegBIEN
- NVS data from Nick Spencer is on nimoy in @/home/bien_shared/raw_data/nvs/@
- 02:06 PM Task #299 (Resolved): Mapping from NVS to VegX and VegBIEN
- Will require finding someone at NVS willing to work with Aaron and mappings and validations
- 02:25 PM Task #300: TurboVeg data
- TurboVeg info from Bob Peet is on nimoy in @/home/bien_shared/raw_data/turboveg/@
- 02:07 PM Task #300 (New): TurboVeg data
- with commitment by someone familiar with DB to work with Aaron on (a) evaluating mappings, and (b) developing validat...
- 02:07 PM Task #301 (Resolved): RAINFOR data
- with commitment by someone familiar with DB to work with Aaron on (a) evaluating mappings, and (b) developing validat...
- 02:06 PM Task #298 (New): Try to find source of DwCA (DwC Archives) data
- hoping GBIF will be willing to work with us on this. Possibly approach Remsen directly
- 02:05 PM Task #297 (Resolved): Request new data dump of specimen data from GBIF, this time in DwC format
- 02:03 PM Task #296 (Resolved): Direct mapping from native salvias_plots MySQL database to VegBIEN
- 01:59 PM Task #289: look for formal mapping mechanism
- Got NVS mapping tool from Nick Spencer, which is on nimoy in @/home/bien_shared/raw_data/nvs/VegX/@
- 01:54 PM Task #286: CSV-XML-database mapping script
- Added support for database and XML inputs
12/13/2011
- 12:11 PM Task #295 (Resolved): provide benchmark queries for NYBG data
- Brad Boyle provided NYBG queries, which are on the wiki under [[NYBG tests]]
- 12:10 PM Task #290: benchmark tests for database loading
- Brad Boyle provided NYBG queries, which are on the wiki under [[NYBG tests]]
- 11:57 AM Task #291: list of milestones
- updated to do list
- 11:56 AM Task #291: list of milestones
- Brad created a timeline, which is on the wiki under [[December 8 2011 WebEx meeting]].
Also available in: Atom