Project

General

Profile

# Date Author Comment
14883 10/25/2014 06:08 PM Aaron Marcuse-Kubitza

/README.TXT: record the import times: documented how to update the Postprocessing times

14882 10/25/2014 06:07 PM Aaron Marcuse-Kubitza

bugfix: /README.TXT: globs that list all the datasources: this was incorrectly excluding U, so fixed to match bin/with_all $hidden_srcs

14878 10/25/2014 04:18 PM Aaron Marcuse-Kubitza

fix: /README.TXT: record the import times: need to first click the "current" tab

14877 10/25/2014 03:19 PM Aaron Marcuse-Kubitza

/README.TXT: To re-run geoscrubbing: updated runtimes and revision #s

14876 10/24/2014 06:33 PM Aaron Marcuse-Kubitza

bugfix: /README.TXT: To re-run geoscrubbing: don't close subshell because it closes automatically (this would instead exit `screen`)

14875 10/24/2014 06:31 PM Aaron Marcuse-Kubitza

/README.TXT: To re-run geoscrubbing: updated runtimes

14872 10/24/2014 04:10 PM Aaron Marcuse-Kubitza

/README.TXT: To re-run geoscrubbing: updated runtimes

14871 10/24/2014 03:58 PM Aaron Marcuse-Kubitza

bugfix: /README.TXT: To re-run geoscrubbing: "press Enter" and `unset TMOUT` steps are reversed

14868 10/24/2014 01:29 PM Aaron Marcuse-Kubitza

/README.TXT: datasource removal: linked to runtimes on the wiki

14824 10/14/2014 10:34 AM Aaron Marcuse-Kubitza

/README.TXT: To re-run geoscrubbing: re-create public-schema views that were cascadingly deleted: listed which views these currently are

14823 10/14/2014 10:26 AM Aaron Marcuse-Kubitza

/README.TXT: To re-run geoscrubbing: updated runtimes

14813 10/13/2014 07:17 AM Aaron Marcuse-Kubitza

bugfix: /README.TXT: Datasource setup: For MS Access databases: also need to comment out `CREATE DATABASE` because pg_dump_limit is only applied to data.sql (due to requirements of the TNRS datasource)

14807 10/13/2014 04:45 AM Aaron Marcuse-Kubitza

/README.TXT: To re-run geoscrubbing: updated runtimes

14802 10/06/2014 11:35 PM Aaron Marcuse-Kubitza

/README.TXT: To re-run geoscrubbing: also need to `unset TMOUT` because TMOUT causes shell to exit even with background processes

14798 10/03/2014 05:08 PM Aaron Marcuse-Kubitza

/README.TXT: To re-run geoscrubbing: `rm=1 inputs/.geoscrub/run`: should just need to reinstall the geoscrub_output table

14793 10/02/2014 09:42 PM Aaron Marcuse-Kubitza

/README.TXT: To re-run geoscrubbing: updated runtimes. note that these are faster on the new hardware.

14792 10/01/2014 09:51 PM Aaron Marcuse-Kubitza

fix: /README.TXT: To re-run geoscrubbing: `rm=1 inputs/.geoscrub/geoscrub_output/geoscrub.csv.run`: use a subshell to avoid closing screen on errexit

14791 10/01/2014 09:39 PM Aaron Marcuse-Kubitza

fix: /README.TXT: Single datasource refresh: also back up DB after this

14790 10/01/2014 09:38 PM Aaron Marcuse-Kubitza

/README.TXT: datasource removal: documented bien2_traits runtime

14788 10/01/2014 09:32 PM Aaron Marcuse-Kubitza

/README.TXT: added datasource removal instructions

14787 10/01/2014 09:22 PM Aaron Marcuse-Kubitza

fix: /README.TXT: Single datasource refresh: place updated extract: generalized datasrc name

14758 09/25/2014 02:48 AM Aaron Marcuse-Kubitza

/README.TXT: Installation: added instructions for inputs/download/live prompts

14757 09/25/2014 02:44 AM Aaron Marcuse-Kubitza

/README.TXT: Installation: added instructions for MySQL installation prompts

14756 09/25/2014 02:18 AM Aaron Marcuse-Kubitza

fix: /README.TXT: Installation: "Are you sure you want to continue connecting" prompt comes before "aaronmk@jupiter's password" prompt

14748 09/24/2014 11:53 PM Aaron Marcuse-Kubitza

fix: /README.TXT: Installation: added instructions for "aaronmk@jupiter's password" prompt

14747 09/24/2014 11:49 PM Aaron Marcuse-Kubitza

/README.TXT: Installation: added step to open a terminal window

14746 09/24/2014 11:48 PM Aaron Marcuse-Kubitza

fix: /README.TXT: Installation: added instructions for "Are you sure you want to continue connecting" prompt

14743 09/24/2014 11:13 PM Aaron Marcuse-Kubitza

fix: /README.TXT: Installation: need instructions for "reload PATH" prompt

14742 09/24/2014 11:10 PM Aaron Marcuse-Kubitza

fix: /README.TXT: Installation: `apt-get install subversion`: need --yes

14738 09/24/2014 07:52 PM Aaron Marcuse-Kubitza

README.TXT: bin/sync_upload calls as root: don't need to set $USER because this is now set to the correct value in bin/sync_upload's scripts

14699 09/19/2014 02:53 PM Aaron Marcuse-Kubitza

/README.TXT: Installation: `make install`: added instructions for what to do at each prompt

14698 09/19/2014 02:25 PM Aaron Marcuse-Kubitza

/README.TXT: Installation: Check out svn: need to install svn first as this does not come preinstalled on Ubuntu

14696 09/16/2014 05:35 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's hard drive: just do a single pass, to avoid the numerous different steps

14693 09/16/2014 04:07 PM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up the local machine's settings: to jupiter: need `sudo -E` for new Documents/BIEN/vegbiendev*/

14692 09/16/2014 03:47 PM Aaron Marcuse-Kubitza

/README.TXT: backups of ~/.dropbox/: just pause and resume Dropbox instead of quitting and restarting it

14691 09/16/2014 03:40 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's settings: to Dropbox: exclude gmvault-db/ to save space in Dropbox

14690 09/16/2014 03:36 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's settings: don't need to exclude ~/Library/Thunderbird/Profiles/9oo8rcyn.default/global-messages-db.sqlite because the disk that was corrupting this file has been replaced (#907)

14689 09/16/2014 03:33 PM Aaron Marcuse-Kubitza

/README.TXT: to back up e-mails: don't need to also sync because these e-mails are also in (auto-forwarded)

14688 09/16/2014 03:16 PM Aaron Marcuse-Kubitza

/README.TXT: Notes on system stability: removed no longer applicable warning about system upgrades, which is now incorrect because the disk space overrun bug (#887) was found not to have been caused by a system upgrade

14670 09/05/2014 10:51 PM Aaron Marcuse-Kubitza

/README.TXT: to synchronize vegbiendev, jupiter, and your local machine: avoid extraneous diffs when rsyncing: clarified the machines that the command should be run on

14667 09/05/2014 10:43 PM Aaron Marcuse-Kubitza

fix: /README.TXT: to backup files not in Time Machine: need to use 2 TB external hard drive instead of Time Machine drive because Time Machine drive does not have ~/Documents/BIEN/ in a location where it can be hardlinked against

14662 09/05/2014 08:48 PM Aaron Marcuse-Kubitza

/README.TXT: Datasource setup: For MS Access databases: added that one should use the settings in the associated .ini file where available

14661 09/05/2014 08:46 PM Aaron Marcuse-Kubitza

/README.TXT: Datasource setup: For MS Access databases: program link: added page subsections

14660 09/05/2014 07:44 PM Aaron Marcuse-Kubitza

/README.TXT: to backup files not in Time Machine: note that Time Machine dereferences hard links: added commands documenting that this is the case

14659 09/05/2014 05:12 PM Aaron Marcuse-Kubitza

fix: /README.TXT: to backup files not in Time Machine: on first run, create parent dirs: added mkdir for Postgres

14658 09/05/2014 05:11 PM Aaron Marcuse-Kubitza

bugfix: /README.TXT: to backup files not in Time Machine: on first run, create parent dirs: mkdir: need sudo

14657 09/05/2014 05:07 PM Aaron Marcuse-Kubitza

/README.TXT: to backup files not in Time Machine: moved to root/ subdir to group the multiple top-level dirs together

14656 09/05/2014 04:53 PM Aaron Marcuse-Kubitza

/README.TXT: to backup files not in Time Machine: added the vegbiendev archival backups, which cannot be backed up by Time Machine because it dereferences hard links

14655 09/05/2014 04:12 PM Aaron Marcuse-Kubitza

/README.TXT: to backup files not in Time Machine: documented why Postgres cannot be backed up by Time Machine

14654 09/04/2014 11:52 AM Aaron Marcuse-Kubitza

/README.TXT: Single datasource refresh: added steps to place the updated extract and extracted flat file(s)

14653 09/04/2014 11:48 AM Aaron Marcuse-Kubitza

/README.TXT: Single datasource refresh: connect to vegbiendev first, even though steps before it have their own step to do this

14652 09/04/2014 11:47 AM Aaron Marcuse-Kubitza

/README.TXT: Single datasource refresh: reimport_scrub: added step to view progress

14651 09/04/2014 11:45 AM Aaron Marcuse-Kubitza

/README.TXT: Single datasource refresh: moved to top since these steps are performed more often

14639 09/04/2014 01:50 AM Aaron Marcuse-Kubitza

/README.TXT: Single datasource import: renamed to Single datasource refresh since it works on existing datasources

14638 09/04/2014 01:45 AM Aaron Marcuse-Kubitza

/README.TXT: Single datasource import: also need to reload staging tables

14637 09/04/2014 01:42 AM Aaron Marcuse-Kubitza

/README.TXT: Single datasource import: added steps to re-run geoscrubbing and back up the vegbiendev database

14627 08/29/2014 12:13 AM Aaron Marcuse-Kubitza

: renamed 2TB drive's BIEN3 partition to BIEN3.**SAVE since one might not see the SAVE file in it

14623 08/28/2014 11:42 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's hard drive: also exclude *-files indicating the (differing) retention statuses of the partitions involved

14609 08/28/2014 08:57 AM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's hard drive: renamed backup partition to BIEN3 to make clear what the backup drive contains

14608 08/28/2014 08:54 AM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up the local machine's hard drive: updated location of `screen` for added commands

14607 08/28/2014 08:53 AM Aaron Marcuse-Kubitza

/README.TXT: added trailing / on dirs to make clear that they're dirs

14601 08/28/2014 05:47 AM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up vegbiendev: also back up /home/aaronmk/bien/ (instead of just symlinking to the local copy), since this can be done space-efficiently with hardlinks. this ensures that the vegbiendev backup will not be modified when the local copy of bien/ is.

14581 08/26/2014 03:47 AM Aaron Marcuse-Kubitza

/README.TXT: to backup files not in Time Machine: don't need to review diff because command is unidirectional

14580 08/26/2014 02:59 AM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up the local machine's hard drive: "repeat until only minimal changes" should refer to the first sync command

14574 08/25/2014 08:18 PM Aaron Marcuse-Kubitza

/README.TXT: to back up vegbiendev: use inplace=1 to speed stopping and resuming transfer

14573 08/25/2014 07:54 PM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up the local machine's hard drive: removed --extended-attributes (after initial sync) because rsync apparently has to visit every file for this

14572 08/25/2014 07:35 PM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up the local machine's hard drive: also need --extended-attributes

14571 08/25/2014 07:34 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's hard drive: removed --delete-before now that that partition has been expanded

14570 08/25/2014 07:16 PM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up vegbiendev: exclude /var/lib/mysql.bak,postgresql.bak because the local machine doesn't need 2 copies of this information

14569 08/25/2014 07:05 PM Aaron Marcuse-Kubitza

/README.TXT: to back up vegbiendev: removed no longer needed exclude of Dropbox subdir backup

14568 08/25/2014 06:58 PM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up vegbiendev: also need to do steps under Maintenance > "to synchronize vegbiendev, jupiter, and your local machine" because /home/aaronmk/bien is not synced here

14567 08/25/2014 06:52 PM Aaron Marcuse-Kubitza

bugfix: /README.TXT: to back up vegbiendev: need `overwrite=1`

14566 08/25/2014 06:47 PM Aaron Marcuse-Kubitza

/README.TXT: to back up vegbiendev: removed no longer needed exclude of Dropbox subdir backup

14565 08/25/2014 06:46 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the version history: don't also need this on vegbiendev because it's already on jupiter and the local machine

14564 08/25/2014 06:43 PM Aaron Marcuse-Kubitza

bugfix: /README.TXT: to back up vegbiendev: need to include Postgres config files

14563 08/25/2014 06:24 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's hard drive: don't back up temp files: added /.fseventsd/

14562 08/25/2014 05:54 PM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up the local machine's hard drive: initial runtime: use range instead because some of the later runtime might have been from the same files

14561 08/25/2014 05:52 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's hard drive: updated initial runtime to include additional transferred files (17 h)

14560 08/25/2014 05:36 PM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up the local machine's hard drive: need to use --delete-before because the backup partition is near capacity

14559 08/25/2014 05:34 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's hard drive: don't back up temp files such as /private/var/vm/*

14558 08/25/2014 05:30 PM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up the local machine's hard drive: back up most Dropbox/Postgres files before stopping processes, to minimize downtime

14557 08/21/2014 07:35 PM Aaron Marcuse-Kubitza

bugfix: /README.TXT: to back up the local machine's hard drive: can't use ~ with --exclude

14555 08/21/2014 07:24 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's hard drive: back up the non-Dropbox, non-Postgres files separately to minimize the Dropbox and Postgres downtime

14554 08/21/2014 06:03 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the vegbiendev databases: don't need to review diff for these as it's always unidirectional

14553 08/21/2014 05:55 PM Aaron Marcuse-Kubitza

/README.TXT: added instructions to back up vegbiendev

14552 08/21/2014 05:12 PM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up the local machine's hard drive: also need to repeat backup command until only minimal changes

14551 08/21/2014 05:11 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's hard drive: added step to stop Postgres

14550 08/21/2014 05:10 PM Aaron Marcuse-Kubitza

bugfix: /README.TXT: to back up the local machine's hard drive: also need to stop Dropbox

14549 08/21/2014 05:06 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's settings: added step to remove .DS_Store

14548 08/21/2014 04:47 PM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up the local machine's settings: Dropbox: shoudl not run with `del=`, because the backup should be an exact replica

14536 08/21/2014 08:38 AM Aaron Marcuse-Kubitza

/README.TXT: To re-run geoscrubbing: updated runtimes

14531 08/20/2014 11:29 AM Aaron Marcuse-Kubitza

/README.TXT: Full database import: converted database commands to command-line commands to make them easier to run

14530 08/20/2014 11:28 AM Aaron Marcuse-Kubitza

/README.TXT: Full database import: converted database commands to command-line commands to make them easier to run

14447 08/10/2014 05:28 AM Aaron Marcuse-Kubitza

/README.TXT: Full database import: added steps to re-run geoscrubbing

14401 08/01/2014 04:22 PM Aaron Marcuse-Kubitza

/README.TXT: added steps to restore from Time Machine

14400 08/01/2014 04:15 PM Aaron Marcuse-Kubitza

/README.TXT: added steps to back up the local machine's hard drive

14399 08/01/2014 04:13 PM Aaron Marcuse-Kubitza

/README.TXT: to synchronize a Mac's settings with my testing machine's: renamed to "to back up the local machine's settings"

14398 08/01/2014 04:11 PM Aaron Marcuse-Kubitza

/README.TXT: to synchronize a Mac's settings with my testing machine's: removed download section because we don't use this

14197 07/20/2014 03:40 PM Aaron Marcuse-Kubitza

bugfix: /README.TXT: Full database import: added warnings that you should not run backups/pg_snapshot while the import is running, nor until the previous import has been replaced

14091 07/16/2014 05:05 PM Aaron Marcuse-Kubitza

/README.TXT: Notes on system stability: added warning that when shutting down the VM, one should always first stop Postgres, to prevent the OS from SIGKILLing it