05/03/2014

05:30 PM Task #909 (New): in aggregating validations pipeline, support using input result sets from CSVs instead of only by querying the staging tables

* allows using input query results run on the raw data rather than the preprocessed staging tables
* enables providi... Aaron Marcuse-Kubitza

04/30/2014

02:33 PM Task #908 (New): generate the source-general derived columns directly on the denormalized staging table

* avoids needing to run the full Python import, which is the part that is currently buggy
* see [[New-style_import#s... Aaron Marcuse-Kubitza

04/29/2014

05:46 PM Task #907 (Resolved): troubleshoot rsync verification errors

* normally only happens when a file is concurrently modified, but this file was not in use
* this may indicate disk ... Aaron Marcuse-Kubitza

04/25/2014

05:58 AM Task #905 (Resolved): narrow down the cause of the import bug (incorrect join columns and disk space leak)

_see #887, #902_
h3. -alternate OS approach-
p(. _tried, and problem also occurs on Mac, so using other approac... Aaron Marcuse-Kubitza

04/23/2014

07:22 PM Task #887: fix disk space leak that fills the disk and crashes the import

VM upgraded to Ubuntu 14.04 and using the official Ubuntu version of Postgres, but problem still occurs Aaron Marcuse-Kubitza

06:06 PM Task #903 (Resolved): fix Ubuntu 14.04 upgrade bug that prevents Apache from displaying vegbiendev.nceas.ucsb.edu properly

Aaron Marcuse-Kubitza

06:00 PM Task #903: fix Ubuntu 14.04 upgrade bug that prevents Apache from displaying vegbiendev.nceas.ucsb.edu properly

added workaround for broken MultiViews Aaron Marcuse-Kubitza

04:14 PM Task #903 (Resolved): fix Ubuntu 14.04 upgrade bug that prevents Apache from displaying vegbiendev.nceas.ucsb.edu properly

this consists of 2 problems:
# -http://vegbiendev.nceas.ucsb.edu/index.php now includes the VegCore wiki page inst... Aaron Marcuse-Kubitza

04:42 PM Task #904 (Resolved): add MySQL public user to allow accessing the normalized VegCore data dictionary

__* see "normalized VegCore data dictionary":http://vegbiendev.nceas.ucsb.edu/vegbiendev/db/my/VegCore Aaron Marcuse-Kubitza

04:00 PM Task #884 (Rejected): fix Postgres bug that causes query planner to use seq scans and slow sorts instead of index scans in the import

duplicate of #902: slow sorts are caused by joining on the wrong columns, not query planner settings Aaron Marcuse-Kubitza

03:52 PM Task #902 (Resolved): fix bug that causes joining on the wrong columns in the import

_bug fixed in r14074_
h3. issue
* in some queries, the columns being joined on are completely the wrong set (co... Aaron Marcuse-Kubitza

03:16 PM Task #901: schedule regular pg_dump backups of the DB

see @backups/pg_snapshot@, @backups/mysql_snapshot@ Aaron Marcuse-Kubitza

04/17/2014

08:14 PM Task #887: fix disk space leak that fills the disk and crashes the import

main DB backed up, (close to?) ready to roll back and/or upgrade the VM Aaron Marcuse-Kubitza

10:31 AM Task #887: fix disk space leak that fills the disk and crashes the import

submitted support request to restore vegbiendev to last working configuration and install a past revision of Postgres... Aaron Marcuse-Kubitza

08:12 PM Task #901: schedule regular pg_dump backups of the DB

seem to have settled on shutting down VM before tape backup as the approach for this Aaron Marcuse-Kubitza

01:23 PM Task #901 (New): schedule regular pg_dump backups of the DB

* this is not backed up with the rest of the VM due to bandwidth limitations and available tape drive space
* use @-... Aaron Marcuse-Kubitza

04/16/2014

10:14 PM Task #899 (New): remove dependencies on Mac

* avoids needing to support Mac as well as Linux in all our scripts
** note that Mac software must be installed manu... Aaron Marcuse-Kubitza

10:10 PM Task #898 (New): remove dependencies on the development machine

* the development process should not require both a VM and a specially-configured local machine to make changes to th... Aaron Marcuse-Kubitza

04/11/2014

04:02 PM Task #887 (Rejected): fix disk space leak that fills the disk and crashes the import

_the bug that triggers this Postgres bug (#902) has now been fixed, so no need to fix this_
h3. issue
* in the ... Aaron Marcuse-Kubitza

04/10/2014

03:24 AM Task #345 (Resolved): integrate GNRS into VegBIEN

see "biengeo":http://vegbiendev.nceas.ucsb.edu/fs/derived/biengeo/ Aaron Marcuse-Kubitza

03:21 AM Task #326 (Rejected): generic MOU template to request data

making the database public instead Aaron Marcuse-Kubitza

03:19 AM Task #485: track data provider's citation requirements in VegBIEN

the [[Datasource conditions of use|conditions of use]] have been gathered Aaron Marcuse-Kubitza

04/07/2014

12:13 PM Task #886 (New): move test DB to vegbiendev VM

* avoids needing to maintain a separate testing machine for the purposes of using the test DB
* helps remove depende... Aaron Marcuse-Kubitza