Project

General

Profile

Actions

Task #304

closed

Complete full dataset imports to VegBIEN via VegX of NYBG and SALVIAS

Added by Aaron Marcuse-Kubitza about 13 years ago. Updated over 12 years ago.

Status:
Resolved
Priority:
Normal
Start date:
12/15/2011
Due date:
% Done:

100%

Estimated time:
Activity type:

Description

  • Identify and make changes to VegX needed to enable full-dataset imports
  • Or report changes needed to Nick, Miquel and Martin and have them make changes
  • Even if you make changes yourself, but sure to report to Nick et al. so these changes change be incorporated to the draft schema on TDWG
Actions #1

Updated by Aaron Marcuse-Kubitza almost 13 years ago

  • % Done changed from 0 to 50

Core SALVIAS data (plots and organisms) are on vegbiendev in VegBIEN.
Takes overnight to reinsert organisms data when schema changes.
Some input data is not in the correct format for the VegBIEN db, so additional conversion functions will need to be added to get the rows that had errors.

Actions #2

Updated by Aaron Marcuse-Kubitza almost 13 years ago

I loaded the SALVIAS data (plots and organisms) into VegBIEN on vegbiendev. To browse the data, follow the phpPgAdmin instructions on the wiki. (The instructions contain a few sample queries you can run.)

You can also view the validation results by running the following on vegbiendev:
make verify --directory=/home/bien/svn/inputs/SALVIAS/
The validation results highlight areas where the imported data differs from the input data, which can be used to find potential bugs.

Note that the vegbien db now contains some of the modifications Bob Peet made to the VegBank schema for VegBIEN, so some table names will be different to those familiar with VegBank.

Actions #3

Updated by Aaron Marcuse-Kubitza almost 13 years ago

  • % Done changed from 50 to 80

First full NYBG load is complete, with 0.12% error rate. Full stats under Benchmarking.

Actions #4

Updated by Aaron Marcuse-Kubitza over 12 years ago

  • Status changed from New to Resolved
  • % Done changed from 80 to 100
Actions

Also available in: Atom PDF