Project

General

Profile

# Date Author Comment
14924 10/31/2014 06:51 AM Aaron Marcuse-Kubitza

bugfix: /README.TXT: to back up the local machine's settings: backing up / to vegbiendev: also need standard excludes from "to back up the local machine's hard drive"

14923 10/31/2014 06:50 AM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's settings: also back up / to vegbiendev

14922 10/31/2014 06:49 AM Aaron Marcuse-Kubitza

/README.TXT: `sudo find / -name .DS_Store -print -delete`: documented runtime (23 min)

14920 10/30/2014 08:43 PM Aaron Marcuse-Kubitza

bugfix: /README.TXT: to back up the local machine's hard drive: need to turn off Time Machine to prevent Time Machine from running when the backup is booted, which messes up the Time Machine backup because the partition UUID is different

14919 10/30/2014 08:33 PM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up the local machine's hard drive: don't need to pause Dropbox, since it will be reinitialized for the new partition UUID anyway

14917 10/30/2014 12:06 PM Aaron Marcuse-Kubitza

bugfix: /README.TXT: to back up the local machine's hard drive: first need to resize the BIEN3.**SAVE** partition so there is enough space

14916 10/30/2014 11:52 AM Aaron Marcuse-Kubitza

bugfix: /README.TXT: to backup files not in Time Machine: need to use `brew services _ postgresql` instead of `launchctl _ ~/Library/LaunchAgents/homebrew.mxcl.postgresql.plist`

14915 10/30/2014 11:51 AM Aaron Marcuse-Kubitza

bugfix: /README.TXT: to back up the local machine's hard drive: need to use `brew services _ postgresql` instead of `launchctl _ ~/Library/LaunchAgents/homebrew.mxcl.postgresql.plist`

14912 10/30/2014 06:05 AM Aaron Marcuse-Kubitza

bugfix: /README.TXT: to back up vegbiendev: can't use inplace=1 optimization because this messes up the shared hardlinks used by ~/Documents/BIEN/vegbiendev.2014-2-2_1-07-32PT*/

14911 10/30/2014 04:26 AM Aaron Marcuse-Kubitza

bugfix: /README.TXT: to back up vegbiendev: also need to lock hardlinked files at end

14902 10/26/2014 01:22 PM Aaron Marcuse-Kubitza

/README.TXT: Installation: `make install`: added alternative command to install a complete DB with all the datasources (instead of a blank DB)

14895 10/26/2014 06:20 AM Aaron Marcuse-Kubitza

bugfix: /README.TXT: Full database import: need to unlock hardlinked files

14894 10/26/2014 05:57 AM Aaron Marcuse-Kubitza

/README.TXT: back up Postgres: backups/pg_snapshot: documented runtime when queries have been run (1 h)

14893 10/26/2014 04:33 AM Aaron Marcuse-Kubitza

fix: /README.TXT: Full database import: also need to run `unset TMOUT` in the outer `screen` shell

14892 10/26/2014 04:20 AM Aaron Marcuse-Kubitza

fix: /README.TXT: back up Postgres: needs to be run in `screen`

14891 10/26/2014 04:16 AM Aaron Marcuse-Kubitza

/README.TXT: to synchronize vegbiendev, jupiter, and your local machine: update mtimes in Dropbox: preserve uncommitted changes

14890 10/26/2014 04:06 AM Aaron Marcuse-Kubitza

fix: /README.TXT: to synchronize vegbiendev, jupiter, and your local machine: update mtimes in Dropbox: don't update perms because this would incorrectly transfer the hardlink lock status

14889 10/26/2014 03:38 AM Aaron Marcuse-Kubitza

fix: /README.TXT: to synchronize vegbiendev, jupiter, and your local machine: TWiki: need to fix_perms after running this to reset perms on hardlinks

14888 10/26/2014 02:31 AM Aaron Marcuse-Kubitza

/README.TXT: syncing: use del instead of overwrite where possible, to avoid overwriting newer files

14887 10/25/2014 07:32 PM Aaron Marcuse-Kubitza

/README.TXT: Full database import: should also snapshot Postgres before starting import

14883 10/25/2014 06:08 PM Aaron Marcuse-Kubitza

/README.TXT: record the import times: documented how to update the Postprocessing times

14882 10/25/2014 06:07 PM Aaron Marcuse-Kubitza

bugfix: /README.TXT: globs that list all the datasources: this was incorrectly excluding U, so fixed to match bin/with_all $hidden_srcs

14878 10/25/2014 04:18 PM Aaron Marcuse-Kubitza

fix: /README.TXT: record the import times: need to first click the "current" tab

14877 10/25/2014 03:19 PM Aaron Marcuse-Kubitza

/README.TXT: To re-run geoscrubbing: updated runtimes and revision #s

14876 10/24/2014 06:33 PM Aaron Marcuse-Kubitza

bugfix: /README.TXT: To re-run geoscrubbing: don't close subshell because it closes automatically (this would instead exit `screen`)

14875 10/24/2014 06:31 PM Aaron Marcuse-Kubitza

/README.TXT: To re-run geoscrubbing: updated runtimes

14872 10/24/2014 04:10 PM Aaron Marcuse-Kubitza

/README.TXT: To re-run geoscrubbing: updated runtimes

14871 10/24/2014 03:58 PM Aaron Marcuse-Kubitza

bugfix: /README.TXT: To re-run geoscrubbing: "press Enter" and `unset TMOUT` steps are reversed

14868 10/24/2014 01:29 PM Aaron Marcuse-Kubitza

/README.TXT: datasource removal: linked to runtimes on the wiki

14824 10/14/2014 10:34 AM Aaron Marcuse-Kubitza

/README.TXT: To re-run geoscrubbing: re-create public-schema views that were cascadingly deleted: listed which views these currently are

14823 10/14/2014 10:26 AM Aaron Marcuse-Kubitza

/README.TXT: To re-run geoscrubbing: updated runtimes

14813 10/13/2014 07:17 AM Aaron Marcuse-Kubitza

bugfix: /README.TXT: Datasource setup: For MS Access databases: also need to comment out `CREATE DATABASE` because pg_dump_limit is only applied to data.sql (due to requirements of the TNRS datasource)

14807 10/13/2014 04:45 AM Aaron Marcuse-Kubitza

/README.TXT: To re-run geoscrubbing: updated runtimes

14802 10/06/2014 11:35 PM Aaron Marcuse-Kubitza

/README.TXT: To re-run geoscrubbing: also need to `unset TMOUT` because TMOUT causes shell to exit even with background processes

14798 10/03/2014 05:08 PM Aaron Marcuse-Kubitza

/README.TXT: To re-run geoscrubbing: `rm=1 inputs/.geoscrub/run`: should just need to reinstall the geoscrub_output table

14793 10/02/2014 09:42 PM Aaron Marcuse-Kubitza

/README.TXT: To re-run geoscrubbing: updated runtimes. note that these are faster on the new hardware.

14792 10/01/2014 09:51 PM Aaron Marcuse-Kubitza

fix: /README.TXT: To re-run geoscrubbing: `rm=1 inputs/.geoscrub/geoscrub_output/geoscrub.csv.run`: use a subshell to avoid closing screen on errexit

14791 10/01/2014 09:39 PM Aaron Marcuse-Kubitza

fix: /README.TXT: Single datasource refresh: also back up DB after this

14790 10/01/2014 09:38 PM Aaron Marcuse-Kubitza

/README.TXT: datasource removal: documented bien2_traits runtime

14788 10/01/2014 09:32 PM Aaron Marcuse-Kubitza

/README.TXT: added datasource removal instructions

14787 10/01/2014 09:22 PM Aaron Marcuse-Kubitza

fix: /README.TXT: Single datasource refresh: place updated extract: generalized datasrc name

14758 09/25/2014 02:48 AM Aaron Marcuse-Kubitza

/README.TXT: Installation: added instructions for inputs/download/live prompts

14757 09/25/2014 02:44 AM Aaron Marcuse-Kubitza

/README.TXT: Installation: added instructions for MySQL installation prompts

14756 09/25/2014 02:18 AM Aaron Marcuse-Kubitza

fix: /README.TXT: Installation: "Are you sure you want to continue connecting" prompt comes before "aaronmk@jupiter's password" prompt

14748 09/24/2014 11:53 PM Aaron Marcuse-Kubitza

fix: /README.TXT: Installation: added instructions for "aaronmk@jupiter's password" prompt

14747 09/24/2014 11:49 PM Aaron Marcuse-Kubitza

/README.TXT: Installation: added step to open a terminal window

14746 09/24/2014 11:48 PM Aaron Marcuse-Kubitza

fix: /README.TXT: Installation: added instructions for "Are you sure you want to continue connecting" prompt

14743 09/24/2014 11:13 PM Aaron Marcuse-Kubitza

fix: /README.TXT: Installation: need instructions for "reload PATH" prompt

14742 09/24/2014 11:10 PM Aaron Marcuse-Kubitza

fix: /README.TXT: Installation: `apt-get install subversion`: need --yes

14738 09/24/2014 07:52 PM Aaron Marcuse-Kubitza

README.TXT: bin/sync_upload calls as root: don't need to set $USER because this is now set to the correct value in bin/sync_upload's scripts

14699 09/19/2014 02:53 PM Aaron Marcuse-Kubitza

/README.TXT: Installation: `make install`: added instructions for what to do at each prompt

14698 09/19/2014 02:25 PM Aaron Marcuse-Kubitza

/README.TXT: Installation: Check out svn: need to install svn first as this does not come preinstalled on Ubuntu

14696 09/16/2014 05:35 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's hard drive: just do a single pass, to avoid the numerous different steps

14693 09/16/2014 04:07 PM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up the local machine's settings: to jupiter: need `sudo -E` for new Documents/BIEN/vegbiendev*/

14692 09/16/2014 03:47 PM Aaron Marcuse-Kubitza

/README.TXT: backups of ~/.dropbox/: just pause and resume Dropbox instead of quitting and restarting it

14691 09/16/2014 03:40 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's settings: to Dropbox: exclude gmvault-db/ to save space in Dropbox

14690 09/16/2014 03:36 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's settings: don't need to exclude ~/Library/Thunderbird/Profiles/9oo8rcyn.default/global-messages-db.sqlite because the disk that was corrupting this file has been replaced (#907)

14689 09/16/2014 03:33 PM Aaron Marcuse-Kubitza

/README.TXT: to back up e-mails: don't need to also sync because these e-mails are also in (auto-forwarded)

14688 09/16/2014 03:16 PM Aaron Marcuse-Kubitza

/README.TXT: Notes on system stability: removed no longer applicable warning about system upgrades, which is now incorrect because the disk space overrun bug (#887) was found not to have been caused by a system upgrade

14670 09/05/2014 10:51 PM Aaron Marcuse-Kubitza

/README.TXT: to synchronize vegbiendev, jupiter, and your local machine: avoid extraneous diffs when rsyncing: clarified the machines that the command should be run on

14667 09/05/2014 10:43 PM Aaron Marcuse-Kubitza

fix: /README.TXT: to backup files not in Time Machine: need to use 2 TB external hard drive instead of Time Machine drive because Time Machine drive does not have ~/Documents/BIEN/ in a location where it can be hardlinked against

14662 09/05/2014 08:48 PM Aaron Marcuse-Kubitza

/README.TXT: Datasource setup: For MS Access databases: added that one should use the settings in the associated .ini file where available

14661 09/05/2014 08:46 PM Aaron Marcuse-Kubitza

/README.TXT: Datasource setup: For MS Access databases: program link: added page subsections

14660 09/05/2014 07:44 PM Aaron Marcuse-Kubitza

/README.TXT: to backup files not in Time Machine: note that Time Machine dereferences hard links: added commands documenting that this is the case

14659 09/05/2014 05:12 PM Aaron Marcuse-Kubitza

fix: /README.TXT: to backup files not in Time Machine: on first run, create parent dirs: added mkdir for Postgres

14658 09/05/2014 05:11 PM Aaron Marcuse-Kubitza

bugfix: /README.TXT: to backup files not in Time Machine: on first run, create parent dirs: mkdir: need sudo

14657 09/05/2014 05:07 PM Aaron Marcuse-Kubitza

/README.TXT: to backup files not in Time Machine: moved to root/ subdir to group the multiple top-level dirs together

14656 09/05/2014 04:53 PM Aaron Marcuse-Kubitza

/README.TXT: to backup files not in Time Machine: added the vegbiendev archival backups, which cannot be backed up by Time Machine because it dereferences hard links

14655 09/05/2014 04:12 PM Aaron Marcuse-Kubitza

/README.TXT: to backup files not in Time Machine: documented why Postgres cannot be backed up by Time Machine

14654 09/04/2014 11:52 AM Aaron Marcuse-Kubitza

/README.TXT: Single datasource refresh: added steps to place the updated extract and extracted flat file(s)

14653 09/04/2014 11:48 AM Aaron Marcuse-Kubitza

/README.TXT: Single datasource refresh: connect to vegbiendev first, even though steps before it have their own step to do this

14652 09/04/2014 11:47 AM Aaron Marcuse-Kubitza

/README.TXT: Single datasource refresh: reimport_scrub: added step to view progress

14651 09/04/2014 11:45 AM Aaron Marcuse-Kubitza

/README.TXT: Single datasource refresh: moved to top since these steps are performed more often

14639 09/04/2014 01:50 AM Aaron Marcuse-Kubitza

/README.TXT: Single datasource import: renamed to Single datasource refresh since it works on existing datasources

14638 09/04/2014 01:45 AM Aaron Marcuse-Kubitza

/README.TXT: Single datasource import: also need to reload staging tables

14637 09/04/2014 01:42 AM Aaron Marcuse-Kubitza

/README.TXT: Single datasource import: added steps to re-run geoscrubbing and back up the vegbiendev database

14627 08/29/2014 12:13 AM Aaron Marcuse-Kubitza

: renamed 2TB drive's BIEN3 partition to BIEN3.**SAVE since one might not see the SAVE file in it

14623 08/28/2014 11:42 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's hard drive: also exclude *-files indicating the (differing) retention statuses of the partitions involved

14609 08/28/2014 08:57 AM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's hard drive: renamed backup partition to BIEN3 to make clear what the backup drive contains

14608 08/28/2014 08:54 AM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up the local machine's hard drive: updated location of `screen` for added commands

14607 08/28/2014 08:53 AM Aaron Marcuse-Kubitza

/README.TXT: added trailing / on dirs to make clear that they're dirs

14601 08/28/2014 05:47 AM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up vegbiendev: also back up /home/aaronmk/bien/ (instead of just symlinking to the local copy), since this can be done space-efficiently with hardlinks. this ensures that the vegbiendev backup will not be modified when the local copy of bien/ is.

14581 08/26/2014 03:47 AM Aaron Marcuse-Kubitza

/README.TXT: to backup files not in Time Machine: don't need to review diff because command is unidirectional

14580 08/26/2014 02:59 AM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up the local machine's hard drive: "repeat until only minimal changes" should refer to the first sync command

14574 08/25/2014 08:18 PM Aaron Marcuse-Kubitza

/README.TXT: to back up vegbiendev: use inplace=1 to speed stopping and resuming transfer

14573 08/25/2014 07:54 PM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up the local machine's hard drive: removed --extended-attributes (after initial sync) because rsync apparently has to visit every file for this

14572 08/25/2014 07:35 PM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up the local machine's hard drive: also need --extended-attributes

14571 08/25/2014 07:34 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's hard drive: removed --delete-before now that that partition has been expanded

14570 08/25/2014 07:16 PM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up vegbiendev: exclude /var/lib/mysql.bak,postgresql.bak because the local machine doesn't need 2 copies of this information

14569 08/25/2014 07:05 PM Aaron Marcuse-Kubitza

/README.TXT: to back up vegbiendev: removed no longer needed exclude of Dropbox subdir backup

14568 08/25/2014 06:58 PM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up vegbiendev: also need to do steps under Maintenance > "to synchronize vegbiendev, jupiter, and your local machine" because /home/aaronmk/bien is not synced here

14567 08/25/2014 06:52 PM Aaron Marcuse-Kubitza

bugfix: /README.TXT: to back up vegbiendev: need `overwrite=1`

14566 08/25/2014 06:47 PM Aaron Marcuse-Kubitza

/README.TXT: to back up vegbiendev: removed no longer needed exclude of Dropbox subdir backup

14565 08/25/2014 06:46 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the version history: don't also need this on vegbiendev because it's already on jupiter and the local machine

14564 08/25/2014 06:43 PM Aaron Marcuse-Kubitza

bugfix: /README.TXT: to back up vegbiendev: need to include Postgres config files

14563 08/25/2014 06:24 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's hard drive: don't back up temp files: added /.fseventsd/

14562 08/25/2014 05:54 PM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up the local machine's hard drive: initial runtime: use range instead because some of the later runtime might have been from the same files

14561 08/25/2014 05:52 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's hard drive: updated initial runtime to include additional transferred files (17 h)

14560 08/25/2014 05:36 PM Aaron Marcuse-Kubitza

fix: /README.TXT: to back up the local machine's hard drive: need to use --delete-before because the backup partition is near capacity

14559 08/25/2014 05:34 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's hard drive: don't back up temp files such as /private/var/vm/*