Project

General

Profile

Activity

From 02/11/2013 to 03/12/2013

03/08/2013

09:53 PM Task #584 (Resolved): enable running all the import steps from one runscript
see [[Import process]] Aaron Marcuse-Kubitza

03/06/2013

10:57 PM Task #581 (New): mechanism to dynamically autopopulate NOT NULL values
* this is currently done using sql_io.put_table()'s col_defaults parameter, which only supports constant values
* th...
Aaron Marcuse-Kubitza
09:08 PM Task #580 (New): automap each word *in* a VegCore term instead of just the whole term
* this avoids the need to create repetitive synonyms for each variation of a term (e.g. with different units) Aaron Marcuse-Kubitza
08:45 PM Task #579 (New): in sql_gen.EnsureNotNull, use ARRAY[] instead of COALESCE() to wrap values where NULL should be compared literally
* this avoids the need for different null sentinels for each datatype
* it would still be necessary to ensure that t...
Aaron Marcuse-Kubitza
02:08 PM Task #578 (New): replace all fields of type text with a domain type that ensures the value is non-empty (not '')
* empty strings tend to cause bugs all over the database because they are sometimes, but not always, treated as NULL Aaron Marcuse-Kubitza

03/05/2013

09:05 PM Task #577 (Rejected): use views instead of map spreadsheets to store the datasource mappings
* this allows the contents of the view to be appended directly to the flat Occurrence table, with the column names ma... Aaron Marcuse-Kubitza
07:55 PM Task #565 (Resolved): partition the TaxonDetermination table by row into the different types of determinations
See TNRS.AcceptedTaxon, MatchedTaxon, ScrubbedTaxon Aaron Marcuse-Kubitza
05:09 AM Task #576 (New): merge the datasources' mappings into the VegCore data dictionary
* each mapping defines a synonym of a VegCore term Aaron Marcuse-Kubitza
05:07 AM Task #468 (Resolved): rename/delete and recreate public schema in one transaction
Aaron Marcuse-Kubitza
05:04 AM Task #340 (Resolved): put together definitions of abstract BIEN terms
See [[VegCore data dictionary]] Aaron Marcuse-Kubitza

02/27/2013

05:47 PM Task #575 (New): put all wiki attachments in svn
Wiki attachments are not version controlled, so it's better to link to the web URL of a file in the repository:
* ...
Aaron Marcuse-Kubitza

02/26/2013

12:48 PM Task #574 (New): mechanism to manually override the CSV dialect, encoding, etc.
Aaron Marcuse-Kubitza
12:37 PM Task #573 (New): automap the analytical DB columns
* This will ensure the analytical DB schema stays up to date with VegCore
h3. Method
In @schemas/vegbien.sql@:
...
Aaron Marcuse-Kubitza

02/14/2013

11:04 AM Task #566 (New): automatically adjust staging tables for easier mapping
* remove empty columns
* mark columns with data in every row as NOT NULL
Aaron Marcuse-Kubitza
07:20 AM Task #386 (Resolved): load Canadensys data
Aaron Marcuse-Kubitza
07:19 AM Task #470 (Resolved): source terms from old versions of DwC to the DwC history page
Aaron Marcuse-Kubitza
07:18 AM Task #472 (Rejected): replace accessioncodes with datasource_id+sourceaccessioncode
Accessioncode fields have been removed instead. Globally unique ID fields (#561) will eventually serve the purpose th... Aaron Marcuse-Kubitza
07:06 AM Task #565 (Resolved): partition the TaxonDetermination table by row into the different types of determinations
* this makes it easy to horizontally join the different types of determinations for a row
** it avoids the need for ...
Aaron Marcuse-Kubitza
06:37 AM Task #564 (New): make all VegBIEN column names globally unique
* this enables creating a table to contain the results of a join, without needing to resolve column name collisions
...
Aaron Marcuse-Kubitza
06:33 AM Task #563 (New): refactor VegBIEN to use VegCore terms
* add key VegCore tables such as Occurrence and Record
* note that many VegCore tables have an inheritance relations...
Aaron Marcuse-Kubitza
05:17 AM Task #562 (New): flatten the mappings
* put the destination table at the beginning of the mapping, rather than nesting it within a hierarchy of tables it h... Aaron Marcuse-Kubitza
04:47 AM Task #561 (New): make VegBIEN ID fields plain-text instead of numeric
h3. Rationale
* this makes it possible to append data from multiple sources without having pkey collisions
h3. ...
Aaron Marcuse-Kubitza
04:12 AM Task #560 (New): move VegCore data dictionary to a phpPgAdmin-accessible database
* term details go in column comments, with Redmine formatting translated to HTML
* each synonym becomes a parameter ...
Aaron Marcuse-Kubitza
 

Also available in: Atom