Project

General

Profile

Statistics
| Revision:

root/trunk @ 13031

Name Size Revision Age Author Comment
  BIEN2 12779 almost 11 years Aaron Marcuse-Kubitza *{.sh,run}: use new begin_target instead of `ec...
  _archive 11970 almost 11 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
  _license 12225 almost 11 years Aaron Marcuse-Kubitza _license/non-open-source/applies_to.txt: clarif...
  backups 13008 over 10 years Aaron Marcuse-Kubitza backups/TNRS.backup.md5: updated
  bin 12995 over 10 years Aaron Marcuse-Kubitza bin/make_analytical_db: removed remake_diff_tab...
  config 11970 almost 11 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
  derived 11970 almost 11 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
  exports 12968 over 10 years Aaron Marcuse-Kubitza *{.sh,run}: runscript targets: use begin_target...
  inputs 13018 over 10 years Aaron Marcuse-Kubitza lib/common.Makefile: added $(nice) and use it e...
  issues 12124 almost 11 years Aaron Marcuse-Kubitza **/LICENSE.TXT: corrected "it recommended" to "...
  lib 13019 over 10 years Aaron Marcuse-Kubitza fix: lib/common.Makefile: $(nice): use an incre...
  mappings 12961 over 10 years Aaron Marcuse-Kubitza fix: mappings/VegCore-VegBIEN.csv: taxonoccurre...
  planning 12947 over 10 years Aaron Marcuse-Kubitza planning/workflow/bien3_architecture/stage_I.pn...
  schemas 12994 over 10 years Aaron Marcuse-Kubitza bugfix: schemas/vegbien.sql: schemas/vegbien.sq...
  validation 12965 over 10 years Aaron Marcuse-Kubitza validation/aggregating/specimens/qualitative_va...
  web 12968 over 10 years Aaron Marcuse-Kubitza *{.sh,run}: runscript targets: use begin_target...
  wiki 12124 almost 11 years Aaron Marcuse-Kubitza **/LICENSE.TXT: corrected "it recommended" to "...
.htaccess 326 Bytes 11970 almost 11 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
.rsync_filter.upload 33 Bytes 11970 almost 11 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
.rsync_ignore 12 Bytes 11970 almost 11 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
LICENSE.TXT 6.18 KB 12124 almost 11 years Aaron Marcuse-Kubitza **/LICENSE.TXT: corrected "it recommended" to "...
Makefile 13.7 KB 13015 over 10 years Aaron Marcuse-Kubitza /Makefile: postgres_restart-Linux: documented t...
README.TXT 31.5 KB 13031 over 10 years Aaron Marcuse-Kubitza /README.TXT: Full database import: disk space: ...
fix_perms 97 Bytes 11970 almost 11 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
map 1001 Bytes 11970 almost 11 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
new_terms.csv 80.2 KB 11970 almost 11 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
run 518 Bytes 12968 over 10 years Aaron Marcuse-Kubitza *{.sh,run}: runscript targets: use begin_target...
unmapped_terms.csv 33 KB 11970 almost 11 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
  • svn:ignore: extern

Latest revisions

# Date Author Comment
13031 04/02/2014 11:17 AM Aaron Marcuse-Kubitza

/README.TXT: Full database import: disk space: added high-water mark of 1.8 TB @11:15:05
13030 04/02/2014 10:56 AM Aaron Marcuse-Kubitza

/README.TXT: Full database import: added steps to figure out which datasource tables were not successfully imported due to disk space errors
13029 04/02/2014 10:45 AM Aaron Marcuse-Kubitza

fix: /README.TXT: Full database import: moved verification of exit statuses before verification of DB contents because there is no point in verifying the DB if the datasources didn't finish importing
13028 04/02/2014 09:01 AM Aaron Marcuse-Kubitza

/README.TXT: Full database import: disk space: documented that the entire disk again gets used long after the beginning of the import, when only a few datasources are running (ie. it definitely seems to be a recent bug in Postgres, and not a latent problem)
13027 04/01/2014 05:40 PM Aaron Marcuse-Kubitza

/README.TXT: Maintenance: added task to regularly re-run full-database import so that bugs in it don't pile up. it needs to be kept in working order so that it works when it's needed.
13026 04/01/2014 04:24 PM Aaron Marcuse-Kubitza

/README.TXT: Full database import: added steps to manually reimport the applicable datasources if there are errors due to exceeding available disk space
13025 04/01/2014 04:13 PM Aaron Marcuse-Kubitza

/README.TXT: Full database import: removed extra `ssh -t vegbiendev.nceas.ucsb.edu` before "upload logs", because the previous steps also occur on vegbiendev
13024 04/01/2014 04:04 PM Aaron Marcuse-Kubitza

/README.TXT: Notes on system stability: added recommendation to maintain a snapshot copy of the VM as it was at the last successful import, for fallback use if a system upgrade breaks anything. system upgrades on the snapshot VM should be disabled completely, and because this will also disable security fixes, the snapshot VM should be disconnected from the internet and all networking interfaces. (this is an unfortunate consequence of modern OSes being written in non-memory-safe languages such as C and C++.)
13023 04/01/2014 03:43 PM Aaron Marcuse-Kubitza

/README.TXT: Full database import: disk space: documented that a higher high-water mark actually occurs later in the import, so that the disk usage issue actually remains a problem after the very beginning
13022 04/01/2014 03:37 PM Aaron Marcuse-Kubitza

fix: /README.TXT: Full database import: disk space: increased the minimum free space recommendation to 1 TB, because analysis of the disk usage during the beginning of the import shows that actually close to the entire amount is being used. however, this problem is normally undetectable unless the disk space is specifically checked, because it only manifests itself if the available disk space is exceeded completely.

View revisions

Also available in: Atom