2014-03-27 conference call¶

note: Brad recommends not to upgrade to Mac OS X Mavericks because it's much slower than the previous version

upcoming¶

• the next conference call is next week at the usual time (Th. 9am PT/9am Tucson/12pm ET)

availability¶

• please add your availability for spring 2014 to the *spreadsheet*:

decisions¶

plots aggregating validations¶

• won't denormalize SALVIAS because already have input queries for it (Brad)
• validate FIA last because it's a special case (Brad)

specimens aggregating validations¶

• OK to run NY validations when writing specimens output queries instead of at the end with the other specimens datasources (Brad)
• when writing specimens output queries based on NY input queries, treat query name as authoritative rather than query implementation (Brad)
• use taxonoccurrence as the main specimen table
• use concatenated taxon name instead of concatenating the ranks, since not all specimens datasources provide the ranks
  • do not use TNRS to parse apart the input names in order to use the ranks for an output query, that does not make sense for the validations (Brad)

new-style import¶

• needs to include the denormalization of normalized datasources

NY¶

• use artificial key as pkey instead of removing rows that are missing an accessionNumber (Brad)

to do for Aaron¶

aggregating validations¶

1. finish specimens output queries
   • use concatenated taxon name instead of concatenating the ranks
   • in #1, use taxonoccurrence instead of location as the main specimen table
2. run specimens output queries on NY to test them
3. denormalize normalized plots datasources: TEAM, Madidi
4. write denormalized plots input queries
5. finish fixing plots output queries
6. validate plots datasources: SALVIAS, VegBank, CVS, TEAM, Madidi, CTFS, FIA
7. validate specimens datasources

new-style import¶

• denormalize normalized plots datasources: TEAM, Madidi, later SALVIAS

NY¶

• use artificial key as pkey instead of accessionNumber

FIA¶

• remap what's mapped to locationName to a suffix of it instead (locationName itself corresponds to plotCode below)
• map INVYR to a suffix of authorEventCode (authorEventCode itself corresponds to plotCensusCode below)
• add plotCode, plotCensusCode derived columns:
  

  plotCode = CONCAT_WS("_",STATECD,COUNTYCD,PLOT)
  plotCensusCode = CONCAT_WS("_",STATECD,COUNTYCD,PLOT,INVYR)
  

  • mapped to locationName, authorEventCode