Activity
From 04/01/2014 to 04/30/2014
04/30/2014
- 02:33 PM Task #908 (New): generate the source-general derived columns directly on the denormalized staging table
- * avoids needing to run the full Python import, which is the part that is currently buggy
* see [[New-style_import#s...
04/29/2014
- 05:46 PM Task #907 (Resolved): troubleshoot rsync verification errors
- * normally only happens when a file is concurrently modified, but this file was not in use
* this may indicate disk ...
04/25/2014
- 05:58 AM Task #905 (Resolved): narrow down the cause of the import bug (incorrect join columns and disk space leak)
- _see #887, #902_
h3. -alternate OS approach-
p(. _tried, and problem also occurs on Mac, so using other approac...
04/23/2014
- 07:22 PM Task #887: fix disk space leak that fills the disk and crashes the import
- VM upgraded to Ubuntu 14.04 and using the official Ubuntu version of Postgres, but problem still occurs
- 06:06 PM Task #903 (Resolved): fix Ubuntu 14.04 upgrade bug that prevents Apache from displaying vegbiendev.nceas.ucsb.edu properly
- 06:00 PM Task #903: fix Ubuntu 14.04 upgrade bug that prevents Apache from displaying vegbiendev.nceas.ucsb.edu properly
- added workaround for broken MultiViews
- 04:14 PM Task #903 (Resolved): fix Ubuntu 14.04 upgrade bug that prevents Apache from displaying vegbiendev.nceas.ucsb.edu properly
- this consists of 2 problems:
# -http://vegbiendev.nceas.ucsb.edu/index.php now includes the VegCore wiki page inst... - 04:42 PM Task #904 (Resolved): add MySQL public user to allow accessing the normalized VegCore data dictionary
- __* see "normalized VegCore data dictionary":http://vegbiendev.nceas.ucsb.edu/vegbiendev/db/my/VegCore
- 04:00 PM Task #884 (Rejected): fix Postgres bug that causes query planner to use seq scans and slow sorts instead of index scans in the import
- duplicate of #902: slow sorts are caused by joining on the wrong columns, not query planner settings
- 03:52 PM Task #902 (Resolved): fix bug that causes joining on the wrong columns in the import
- _bug fixed in r14074_
h3. issue
* in some queries, the columns being joined on are completely the wrong set (co... - 03:16 PM Task #901: schedule regular pg_dump backups of the DB
- see @backups/pg_snapshot@, @backups/mysql_snapshot@
04/17/2014
- 08:14 PM Task #887: fix disk space leak that fills the disk and crashes the import
- main DB backed up, (close to?) ready to roll back and/or upgrade the VM
- 10:31 AM Task #887: fix disk space leak that fills the disk and crashes the import
- submitted support request to restore vegbiendev to last working configuration and install a past revision of Postgres...
- 08:12 PM Task #901: schedule regular pg_dump backups of the DB
- seem to have settled on shutting down VM before tape backup as the approach for this
- 01:23 PM Task #901 (New): schedule regular pg_dump backups of the DB
- * this is not backed up with the rest of the VM due to bandwidth limitations and available tape drive space
* use @-...
04/16/2014
- 10:14 PM Task #899 (New): remove dependencies on Mac
- * avoids needing to support Mac as well as Linux in all our scripts
** note that Mac software must be installed manu... - 10:10 PM Task #898 (New): remove dependencies on the development machine
- * the development process should not require both a VM and a specially-configured local machine to make changes to th...
04/11/2014
- 04:02 PM Task #887 (Rejected): fix disk space leak that fills the disk and crashes the import
- _the bug that triggers this Postgres bug (#902) has now been fixed, so no need to fix this_
h3. issue
* in the ...
04/10/2014
- 03:24 AM Task #345 (Resolved): integrate GNRS into VegBIEN
- see "biengeo":http://vegbiendev.nceas.ucsb.edu/fs/derived/biengeo/
- 03:21 AM Task #326 (Rejected): generic MOU template to request data
- making the database public instead
- 03:19 AM Task #485: track data provider's citation requirements in VegBIEN
- the [[Datasource conditions of use|conditions of use]] have been gathered
04/07/2014
- 12:13 PM Task #886 (New): move test DB to vegbiendev VM
- * avoids needing to maintain a separate testing machine for the purposes of using the test DB
* helps remove depende...
04/02/2014
- 03:32 PM Task #884 (Rejected): fix Postgres bug that causes query planner to use seq scans and slow sorts instead of index scans in the import
- h3. issue
* see the following @pg_stat_activity@ snapshots (note the @EXPLAIN@ output below each query):... - 10:10 AM Task #882 (Rejected): add limit on the # of parallel import processes
- it turns out this would not fix the problem, because it occurs even when only a few datasources are running
- 10:07 AM Task #883: have import scripts regularly check disk space and pause processes if getting close to limit
- merging info in #882, so that this info is not maintained in two places
04/01/2014
- 05:02 PM Task #883 (Rejected): have import scripts regularly check disk space and pause processes if getting close to limit
- h3. issue
* there is no soft limit on disk space inside Postgres, so the hard limit gets reached instead, causing ... - 04:11 PM Task #882 (Rejected): add limit on the # of parallel import processes
- see description of problem in #883
Also available in: Atom