Project

General

Profile

Statistics
| Revision:
Name Size Revision Age Author Comment
  BIEN2 12779 about 10 years Aaron Marcuse-Kubitza *{.sh,run}: use new begin_target instead of `ec...
  _archive 11970 over 10 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
  _license 12225 over 10 years Aaron Marcuse-Kubitza _license/non-open-source/applies_to.txt: clarif...
  backups 13008 about 10 years Aaron Marcuse-Kubitza backups/TNRS.backup.md5: updated
  bin 12995 about 10 years Aaron Marcuse-Kubitza bin/make_analytical_db: removed remake_diff_tab...
  config 11970 over 10 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
  derived 11970 over 10 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
  exports 12968 about 10 years Aaron Marcuse-Kubitza *{.sh,run}: runscript targets: use begin_target...
  inputs 13018 about 10 years Aaron Marcuse-Kubitza lib/common.Makefile: added $(nice) and use it e...
  issues 12124 over 10 years Aaron Marcuse-Kubitza **/LICENSE.TXT: corrected "it recommended" to "...
  lib 13019 about 10 years Aaron Marcuse-Kubitza fix: lib/common.Makefile: $(nice): use an incre...
  mappings 12961 about 10 years Aaron Marcuse-Kubitza fix: mappings/VegCore-VegBIEN.csv: taxonoccurre...
  planning 12947 about 10 years Aaron Marcuse-Kubitza planning/workflow/bien3_architecture/stage_I.pn...
  schemas 12994 about 10 years Aaron Marcuse-Kubitza bugfix: schemas/vegbien.sql: schemas/vegbien.sq...
  validation 12965 about 10 years Aaron Marcuse-Kubitza validation/aggregating/specimens/qualitative_va...
  web 12968 about 10 years Aaron Marcuse-Kubitza *{.sh,run}: runscript targets: use begin_target...
  wiki 12124 over 10 years Aaron Marcuse-Kubitza **/LICENSE.TXT: corrected "it recommended" to "...
.htaccess 326 Bytes 11970 over 10 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
.rsync_filter.upload 33 Bytes 11970 over 10 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
.rsync_ignore 12 Bytes 11970 over 10 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
LICENSE.TXT 6.18 KB 12124 over 10 years Aaron Marcuse-Kubitza **/LICENSE.TXT: corrected "it recommended" to "...
Makefile 13.7 KB 13015 about 10 years Aaron Marcuse-Kubitza /Makefile: postgres_restart-Linux: documented t...
README.TXT 31.4 KB 13028 about 10 years Aaron Marcuse-Kubitza /README.TXT: Full database import: disk space: ...
fix_perms 97 Bytes 11970 over 10 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
map 1001 Bytes 11970 over 10 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
new_terms.csv 80.2 KB 11970 over 10 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
run 518 Bytes 12968 about 10 years Aaron Marcuse-Kubitza *{.sh,run}: runscript targets: use begin_target...
unmapped_terms.csv 33 KB 11970 over 10 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
  • svn:ignore: extern

Latest revisions

# Date Author Comment
13028 04/02/2014 09:01 AM Aaron Marcuse-Kubitza

/README.TXT: Full database import: disk space: documented that the entire disk again gets used long after the beginning of the import, when only a few datasources are running (ie. it definitely seems to be a recent bug in Postgres, and not a latent problem)

13027 04/01/2014 05:40 PM Aaron Marcuse-Kubitza

/README.TXT: Maintenance: added task to regularly re-run full-database import so that bugs in it don't pile up. it needs to be kept in working order so that it works when it's needed.

13026 04/01/2014 04:24 PM Aaron Marcuse-Kubitza

/README.TXT: Full database import: added steps to manually reimport the applicable datasources if there are errors due to exceeding available disk space

13025 04/01/2014 04:13 PM Aaron Marcuse-Kubitza

/README.TXT: Full database import: removed extra `ssh -t vegbiendev.nceas.ucsb.edu` before "upload logs", because the previous steps also occur on vegbiendev

13024 04/01/2014 04:04 PM Aaron Marcuse-Kubitza

/README.TXT: Notes on system stability: added recommendation to maintain a snapshot copy of the VM as it was at the last successful import, for fallback use if a system upgrade breaks anything. system upgrades on the snapshot VM should be disabled completely, and because this will also disable security fixes, the snapshot VM should be disconnected from the internet and all networking interfaces. (this is an unfortunate consequence of modern OSes being written in non-memory-safe languages such as C and C++.)

13023 04/01/2014 03:43 PM Aaron Marcuse-Kubitza

/README.TXT: Full database import: disk space: documented that a higher high-water mark actually occurs later in the import, so that the disk usage issue actually remains a problem after the very beginning

13022 04/01/2014 03:37 PM Aaron Marcuse-Kubitza

fix: /README.TXT: Full database import: disk space: increased the minimum free space recommendation to 1 TB, because analysis of the disk usage during the beginning of the import shows that actually close to the entire amount is being used. however, this problem is normally undetectable unless the disk space is specifically checked, because it only manifests itself if the available disk space is exceeded completely.

13021 04/01/2014 02:04 PM Aaron Marcuse-Kubitza

/README.TXT: Full database import: documented that the beginning of the import should be scheduled at a time when the DB will not be needed for other uses, because vegbiendev will be slow for the first few hours of the import due to the import using all the available cores

13020 04/01/2014 01:36 PM Aaron Marcuse-Kubitza

/README.TXT: Full database import: documented that CPU load warning e-mails can safely be ignored. they happen because the parallel imports use all the available cores.

13019 04/01/2014 01:31 PM Aaron Marcuse-Kubitza

fix: lib/common.Makefile: $(nice): use an increment of +10 instead of +5 because +5 still leaves the shell sluggish

View revisions

Also available in: Atom