Activity
From 02/11/2013 to 03/12/2013
03/08/2013
- 09:53 PM Task #584 (Resolved): enable running all the import steps from one runscript
- see [[Import process]]
03/06/2013
- 10:57 PM Task #581 (New): mechanism to dynamically autopopulate NOT NULL values
- * this is currently done using sql_io.put_table()'s col_defaults parameter, which only supports constant values
* th... - 09:08 PM Task #580 (New): automap each word *in* a VegCore term instead of just the whole term
- * this avoids the need to create repetitive synonyms for each variation of a term (e.g. with different units)
- 08:45 PM Task #579 (New): in sql_gen.EnsureNotNull, use ARRAY[] instead of COALESCE() to wrap values where NULL should be compared literally
- * this avoids the need for different null sentinels for each datatype
* it would still be necessary to ensure that t... - 02:08 PM Task #578 (New): replace all fields of type text with a domain type that ensures the value is non-empty (not '')
- * empty strings tend to cause bugs all over the database because they are sometimes, but not always, treated as NULL
03/05/2013
- 09:05 PM Task #577 (Rejected): use views instead of map spreadsheets to store the datasource mappings
- * this allows the contents of the view to be appended directly to the flat Occurrence table, with the column names ma...
- 07:55 PM Task #565 (Resolved): partition the TaxonDetermination table by row into the different types of determinations
- See TNRS.AcceptedTaxon, MatchedTaxon, ScrubbedTaxon
- 05:09 AM Task #576 (New): merge the datasources' mappings into the VegCore data dictionary
- * each mapping defines a synonym of a VegCore term
- 05:07 AM Task #468 (Resolved): rename/delete and recreate public schema in one transaction
- 05:04 AM Task #340 (Resolved): put together definitions of abstract BIEN terms
- See [[VegCore data dictionary]]
02/27/2013
- 05:47 PM Task #575 (New): put all wiki attachments in svn
- Wiki attachments are not version controlled, so it's better to link to the web URL of a file in the repository:
* ...
02/26/2013
- 12:48 PM Task #574 (New): mechanism to manually override the CSV dialect, encoding, etc.
- 12:37 PM Task #573 (New): automap the analytical DB columns
- * This will ensure the analytical DB schema stays up to date with VegCore
h3. Method
In @schemas/vegbien.sql@:
...
02/14/2013
- 11:04 AM Task #566 (New): automatically adjust staging tables for easier mapping
- * remove empty columns
* mark columns with data in every row as NOT NULL - 07:20 AM Task #386 (Resolved): load Canadensys data
- 07:19 AM Task #470 (Resolved): source terms from old versions of DwC to the DwC history page
- 07:18 AM Task #472 (Rejected): replace accessioncodes with datasource_id+sourceaccessioncode
- Accessioncode fields have been removed instead. Globally unique ID fields (#561) will eventually serve the purpose th...
- 07:06 AM Task #565 (Resolved): partition the TaxonDetermination table by row into the different types of determinations
- * this makes it easy to horizontally join the different types of determinations for a row
** it avoids the need for ... - 06:37 AM Task #564 (New): make all VegBIEN column names globally unique
- * this enables creating a table to contain the results of a join, without needing to resolve column name collisions
... - 06:33 AM Task #563 (New): refactor VegBIEN to use VegCore terms
- * add key VegCore tables such as Occurrence and Record
* note that many VegCore tables have an inheritance relations... - 05:17 AM Task #562 (New): flatten the mappings
- * put the destination table at the beginning of the mapping, rather than nesting it within a hierarchy of tables it h...
- 04:47 AM Task #561 (New): make VegBIEN ID fields plain-text instead of numeric
- h3. Rationale
* this makes it possible to append data from multiple sources without having pkey collisions
h3. ... - 04:12 AM Task #560 (New): move VegCore data dictionary to a phpPgAdmin-accessible database
- * term details go in column comments, with Redmine formatting translated to HTML
* each synonym becomes a parameter ...
Also available in: Atom