Project

General

Profile

# Date Author Comment
11970 01/20/2014 11:33 AM Aaron Marcuse-Kubitza

moved everything into /trunk/ to create the standard svn layout, for use with tools that require this (eg. git-svn). IMPORTANT: do NOT do an `svn up`. instead, re-use your working copy's existing files with `svn switch` (http://svnbook.red-bean.com/en/1.6/svn.ref.svn.c.switch.html).

10267 07/13/2013 10:35 PM Aaron Marcuse-Kubitza

backups/Makefile: %.backup/restore: documented runtime (11 h; ~5 h to insert data). note that this is still much shorter than re-running column-based import.

10254 07/11/2013 05:54 AM Aaron Marcuse-Kubitza

backups/Makefile: $(restore): added --verbose to display pg_restore's incremental progress

10027 06/25/2013 01:21 PM Aaron Marcuse-Kubitza

backups/Makefile: upload: use bin/sync_upload

7564 02/16/2013 05:25 AM Aaron Marcuse-Kubitza

lib/common.Makefile: remote server: Use jupiter instead of vegbiendev, to ensure that all files get uploaded there rather than only to vegbiendev. This involves adding an extra database import step to download the uploaded files from jupiter onto vegbiendev.

7559 02/15/2013 11:58 PM Aaron Marcuse-Kubitza

Moved Checksums from backups/Makefile to lib/common.Makefile so all dirs (including inputs/) can use md5sum testing

7557 02/15/2013 11:04 PM Aaron Marcuse-Kubitza

lib/common.Makefile: Renamed $(src_server) to $(remote_host) and $(src_user) to $(remote_user) for clarity

7326 01/22/2013 02:49 PM Aaron Marcuse-Kubitza

backups/Makefile: %.md5/test: Added comment to run with `make -s` to avoid echoing make commands

7037 01/03/2013 02:21 AM Aaron Marcuse-Kubitza

backups/Makefile: Synchronization: %/download: Download the .md5 file first, so that the user is prompted right away for their password rather than after the main file has finished downloading, by which time the password prompt has timed out

7026 01/02/2013 06:36 PM Aaron Marcuse-Kubitza

backups/Makefile: Removed no longer used $(psqlVerbose)

7025 01/02/2013 06:36 PM Aaron Marcuse-Kubitza

backups/Makefile: Removed %.backup/rm_indexes, which is no longer needed because archived imports are now backed up instead of being stored without indexes in the live DB

7024 01/02/2013 06:31 PM Aaron Marcuse-Kubitza

backups/Makefile: %.backup/remove: Fixed bug where need to use $no_search_path option to psql_script_vegbien

6965 12/20/2012 09:25 AM Aaron Marcuse-Kubitza

backups/Makefile: Factored $(isMac) out into lib/common.Makefile

6940 12/19/2012 11:56 AM Aaron Marcuse-Kubitza

backups/Makefile; $(public*): Don't add a "public." prefix to get the name of the public schema

6939 12/19/2012 11:40 AM Aaron Marcuse-Kubitza

backups/Makefile: Removed no longer used $(rmSchema)

6938 12/19/2012 11:39 AM Aaron Marcuse-Kubitza

backups/Makefile: Use \$(rmSchemaCmd) from lib/common.Makefile instead of \$(rmSchema)

6924 12/19/2012 09:07 AM Aaron Marcuse-Kubitza

backups/Makefile: Removed no longer used $(dateFmt), $(mtime)

6923 12/19/2012 08:59 AM Aaron Marcuse-Kubitza

backups/Makefile: Removed %.backup/rotate, because this incorrectly causes the current time rather than the version to be used in the backup filename. The version should instead be specified in the backup filename when it's created.

6915 12/19/2012 06:15 AM Aaron Marcuse-Kubitza

Makefiles: Factored out common vars/functions into lib/common.Makefile

6890 12/17/2012 04:59 PM Aaron Marcuse-Kubitza

backups/Makefile: Synchronization: $(remote): Fixed bug where need trailing / at end of path

6889 12/17/2012 04:32 PM Aaron Marcuse-Kubitza

backups/Makefile: Synchronization: $(remote): Updated path to backups

6724 12/10/2012 07:45 PM Aaron Marcuse-Kubitza

backups/Makefile: Synchronization: %/download: Also download any .md5 file for the file

6667 12/06/2012 09:56 PM Aaron Marcuse-Kubitza

backups/Makefile: Synchronization: Replaced download target, which downloads all backups, with %/download, which downloads just a specific backup, because you would generally only want to extract a single backup from the archive for reinstallation

6666 12/06/2012 09:47 PM Aaron Marcuse-Kubitza

backups/Makefile: Synchronization: Sync with jupiter instead of vegbiendev. This requires running `make backups/upload` on vegbiendev to archive the files, instead of `make backups/download` to download them to your local machine.

6655 12/06/2012 06:07 PM Aaron Marcuse-Kubitza

backups/Makefile: Checksums: %.md5/test: Only use md5sum's -v option on Mac, because it's not supported on Linux (there, verbose mode is the default)

6648 12/06/2012 04:33 PM Aaron Marcuse-Kubitza

backups/Makefile: SQL: Full DB: vegbien.%.backup: Also generate MD5 sum

6645 12/05/2012 10:56 AM Aaron Marcuse-Kubitza

backups/Makefile: Support removing public schema versions based on the version of a full DB backup

6595 12/04/2012 11:52 PM Aaron Marcuse-Kubitza

backups/Makefile: Synchronization: Also sync *.md5

6573 12/04/2012 07:07 PM Aaron Marcuse-Kubitza

backups/Makefile: Checksums: %.md5/test: Made it an _always target

6572 12/04/2012 07:05 PM Aaron Marcuse-Kubitza

backups/Makefile: Checksums: Added %.md5/test to test generated checksums

6571 12/04/2012 07:01 PM Aaron Marcuse-Kubitza

backups/Makefile: Moved md5-related targets to separate Checksums section

6570 12/04/2012 06:59 PM Aaron Marcuse-Kubitza

backups/Makefile: %.md5: Removed not applicable comment which had been copied from %.sql

6536 12/03/2012 02:47 PM Aaron Marcuse-Kubitza

backups/Makefile: %.md5: Fixed bug where md5sum does not have a -q option like md5

6535 12/03/2012 02:43 PM Aaron Marcuse-Kubitza

backups/Makefile: %.md5: Fixed bug where need to use md5sum instead of md5 on Linux

6526 12/03/2012 11:06 AM Aaron Marcuse-Kubitza

backups/Makefile: Added md5s target to generate .md5 files for all backups

6524 12/03/2012 10:48 AM Aaron Marcuse-Kubitza

backups/Makefile: %.md5: Run with `nice -n +5` to avoid slowing down the UI

6522 12/03/2012 10:42 AM Aaron Marcuse-Kubitza

backups/Makefile: Changed paths to be relative to the Makefile rather than the current directory, so this Makefile can be used in other directories as well (such as jupiter:/aaronmk/VegBIEN.backups/)

6521 12/03/2012 10:34 AM Aaron Marcuse-Kubitza

backups/Makefile: %.backup: Also create MD5 of backup

6520 12/03/2012 10:31 AM Aaron Marcuse-Kubitza

backups/Makefile: Added %.md5 target to create checksums of each backup

6469 11/27/2012 12:27 PM Aaron Marcuse-Kubitza

backups/Makefile: $(rsyncBackups): Added *.csv

4751 09/17/2012 11:58 AM Aaron Marcuse-Kubitza

backups/Makefile: Backups: Full DB: Specify the date suffix of the backup when it's created rather than adding it afterwards. This allows the user to specify a suffix that matches the corresponding public-schema backup.

3701 07/31/2012 09:05 PM Aaron Marcuse-Kubitza

backups/Makefile: Added synchronization of backups with vegbiendev. Added downloading backups to After a new import steps.

3699 07/31/2012 08:54 PM Aaron Marcuse-Kubitza

backups/Makefile: Refactored to include lib/common.Makefile

3546 07/23/2012 06:39 PM Aaron Marcuse-Kubitza

backups/Makefile: Full DB: Added vegbien.backup/all to run both test and rotate

3544 07/23/2012 06:19 PM Aaron Marcuse-Kubitza

backups/Makefile: .sql: When testing, turn it off so make won't skip `.sql: %` in favor of it

3543 07/23/2012 06:07 PM Aaron Marcuse-Kubitza

backups/Makefile: Split %.backup and %.sql into separate targets for clarity

3438 07/18/2012 03:31 PM Aaron Marcuse-Kubitza

backups/Makefile: Added %.backup/rotate

3437 07/18/2012 02:58 PM Aaron Marcuse-Kubitza

backups/Makefile: Rearranged sections so that backup targets, which apply to both Archived imports and Full DB, are at the top of a common Backups section

3409 07/17/2012 03:47 PM Aaron Marcuse-Kubitza

backups/Makefile: Added %.backup/test

3407 07/16/2012 08:23 PM Aaron Marcuse-Kubitza

backups/Makefile: Full DB backups: Added vegbien.backup

3404 07/16/2012 07:37 PM Aaron Marcuse-Kubitza

backups/Makefile: Factored backup command into $(backup) for later use by full DB backups. Made Backups, Archived imports sections subsections of Archived imports so Full DB backups can have its own section.

3403 07/16/2012 07:16 PM Aaron Marcuse-Kubitza

backups/Makefile: Fixed bug where $(SHELL) needed to be set to bash so that $'\n' would be interpreted correctly

3402 07/16/2012 07:06 PM Aaron Marcuse-Kubitza

backups/Makefile: Fixed bug where *.sql files needed to be restored using psql because pg_restore only supports "non-plain-text formats"

3399 07/16/2012 06:19 PM Aaron Marcuse-Kubitza

backups/Makefile: Don't log stderr or run the command verbosely and instead just output the command and run time to the terminal. This matches what we do for pg_dump, which works better because it just prints the useful information when it's done running.

3398 07/16/2012 05:28 PM Aaron Marcuse-Kubitza

backups/Makefile: Remove log files after successful restore/extraction because they are only useful for tail -f when the restore operation is running in the background

3395 07/16/2012 04:39 PM Aaron Marcuse-Kubitza

backups/Makefile: Backups: Fixed bug where `%.sql: %` needed to come before %.sql with no prerequisites to be matched first

3393 07/16/2012 04:08 PM Aaron Marcuse-Kubitza

Moved archived imports and make targets to maintain them to new backups dir