Project

General

Profile

Statistics
| Revision:
  • svn:ignore: extern

# Date Author Comment
13295 04/23/2014 01:08 PM Aaron Marcuse-Kubitza

/Makefile: postgres-Linux: added warning that the install commands were designed to run on Ubuntu 12.04, which is no longer the version used by vegbiendev (it is now 14.04)

13294 04/23/2014 12:09 PM Aaron Marcuse-Kubitza

backups/mysql_snapshot: documented initial vegbiendev->jupiter upload time for GBIF/raw_occurrence_record.MYD (7 h for 91 GB = 3.7 MB/s)

13293 04/23/2014 12:12 AM Aaron Marcuse-Kubitza

fix: web/links/index.htm: updated to Firefox bookmarks: PostgreSQL: backups: wal_keep_segments method: clarified how to determine the value of wal_keep_segments. filesystem-level backups: documented the advantages of filesystem-level backups over traditional database-level backups with pg_dump.

13292 04/22/2014 11:32 PM Aaron Marcuse-Kubitza

fix: web/links/index.htm: updated to Firefox bookmarks: PostgreSQL: backups: wal_keep_segments: restored annotations

13291 04/22/2014 11:26 PM Aaron Marcuse-Kubitza

web/links/index.htm: updated to Firefox bookmarks: PostgreSQL: backups: documented how to set up online and offline backups (with two possible approaches for online backups)

13290 04/22/2014 11:24 PM Aaron Marcuse-Kubitza

web/links/index.htm: updated to Firefox bookmarks: PostgreSQL: backups: documented how to set up online and offline backups (with two possible approaches for online backups)

13289 04/22/2014 11:21 PM Aaron Marcuse-Kubitza

web/links/index.htm: updated to Firefox bookmarks: PostgreSQL: backups: documented how to set up online and offline backups (with two possible approaches for online backups)

13288 04/22/2014 10:33 PM Aaron Marcuse-Kubitza

lib/sh/db.sh: pg_snapshot(): perform online backup if possible, to avoid needing to restart the server

13287 04/22/2014 10:31 PM Aaron Marcuse-Kubitza

lib/sh/db.sh: added pg_start_backup(), pg_stop_backup()

13286 04/22/2014 10:29 PM Aaron Marcuse-Kubitza

lib/sh/db.sh: psql(): only set redirs if can redirect

13285 04/22/2014 10:17 PM Aaron Marcuse-Kubitza

bugfix: psql(): when as_root is on, need to avoid redirections as these are not passed through by sudo

13284 04/22/2014 08:14 PM Aaron Marcuse-Kubitza

/README.TXT: use `sudo -u ... -i` instead of `sudo su - ...` to avoid using two commands to accomplish the login

13283 04/22/2014 06:01 PM Aaron Marcuse-Kubitza

bugfix: lib/sh/db.sh: psql(): don't use `--file /dev/fd/40` when can't redirect

13282 04/22/2014 05:59 PM Aaron Marcuse-Kubitza

fix: lib/sh/db.sh: psql(): when using sudo with custom $stdin, raise error that this is not supported

13281 04/22/2014 05:50 PM Aaron Marcuse-Kubitza

lib/sh/db.sh: psql(): $data_bypasses_filter: renamed to $data2stdout for clarity

13280 04/22/2014 05:29 PM Aaron Marcuse-Kubitza

lib/sh/db.sh: psql(): $bypass_ok: renamed to $can_redir for clarity

13279 04/22/2014 05:22 PM Aaron Marcuse-Kubitza

lib/sh/db.sh: psql(): usage: $stdin: documented that can also use process substitution for this

13278 04/22/2014 04:45 PM Aaron Marcuse-Kubitza

bugfix: lib/sh/util.sh: `type` calls: need -- before cmd in case it starts with -

13277 04/22/2014 04:44 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: cmd2rel_path: use is_extern()

13276 04/22/2014 04:00 PM Aaron Marcuse-Kubitza

lib/sh/sync.sh: db_snapshot(): use `end_try` as specified in `try` usage

13275 04/22/2014 03:59 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: try: usage: added location of finally block

13274 04/22/2014 03:57 PM Aaron Marcuse-Kubitza

schemas/postgresql.conf: wal_level: set to hot_standby to enable online backup with pg_start_backup()

13273 04/22/2014 03:04 PM Aaron Marcuse-Kubitza

lib/sh/sync.sh: upload(): always print the function and kw_params

13272 04/22/2014 04:00 AM Aaron Marcuse-Kubitza

added backups/mysql_snapshot, pg_snapshot

13271 04/21/2014 08:21 PM Aaron Marcuse-Kubitza

bugfix: lib/sh/util.sh: type(): need to handle options before command name

13270 04/21/2014 08:21 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: added 1st_non_opt()

13269 04/21/2014 08:07 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: unalias(): use self_builtin, which is now defined before it

13268 04/21/2014 08:01 PM Aaron Marcuse-Kubitza

lib/runscripts/util.run: sudo(): avoid slow $wrap_fn when using `command` (ie. always executable)

13267 04/21/2014 07:59 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: unalias(): use self_builtin, which is now defined before it

13266 04/21/2014 07:57 PM Aaron Marcuse-Kubitza

bugfix: lib/sh/util.sh: commands: `type` calls: need to account for the fact that any alias is already expanded

13265 04/21/2014 07:56 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: functions: moved before commands since commands are more complex

13264 04/21/2014 07:38 PM Aaron Marcuse-Kubitza

lib/sh/sync.sh: db_copy() and callers: pass args as rsync options

13263 04/21/2014 07:28 PM Aaron Marcuse-Kubitza

fix: lib/sh/sync.sh: db_copy(): need to exclude files which prevent tape backup

13262 04/21/2014 07:22 PM Aaron Marcuse-Kubitza

lib/sh/db.sh: added pg_ctl(), pg_snapshot()

13261 04/21/2014 07:17 PM Aaron Marcuse-Kubitza

lib/sh/sync.sh: db_snapshot(): copy changes before stopping DB to minimize the time that it's shut down

13260 04/21/2014 07:12 PM Aaron Marcuse-Kubitza

lib/sh/sync.sh: db_snapshot(): factored copy operation out into separate db_copy() function

13259 04/21/2014 07:03 PM Aaron Marcuse-Kubitza

lib/sh/db.sh: mysql_snapshot(): use new db_snapshot()

13258 04/21/2014 07:02 PM Aaron Marcuse-Kubitza

lib/sh/sync.sh: added db_snapshot()

13257 04/21/2014 05:55 PM Aaron Marcuse-Kubitza

lib/Firefox_bookmarks.reformat.csv: changed "page's own description" to "page's self-description" for clarity

13256 04/21/2014 05:50 PM Aaron Marcuse-Kubitza

web/links/index.htm: updated to Firefox bookmarks: removed dead links

13255 04/21/2014 05:43 PM Aaron Marcuse-Kubitza

web/links/index.htm: updated to Firefox bookmarks: updated favicons

13254 04/21/2014 05:28 PM Aaron Marcuse-Kubitza

web/links/index.htm: updated to Firefox bookmarks: modifying a running shell script: updated to document that `svn up` actually does use two-stage save automatically

13253 04/21/2014 04:46 PM Aaron Marcuse-Kubitza

lib/sh/db.sh: mysql_snapshot(): for large files, don't re-copy entire file

13252 04/21/2014 04:44 PM Aaron Marcuse-Kubitza

lib/sh/db.sh: mysql_snapshot(): use live mode as the default

13251 04/21/2014 04:30 PM Aaron Marcuse-Kubitza

fix: lib/sh/db.sh: mysql_snapshot(): need to create dest dir if doesn't exist

13250 04/21/2014 04:27 PM Aaron Marcuse-Kubitza

bugfix: lib/sh/db.sh: mysql_snapshot(): try: need to use split syntax with prep_try instead, to work with prefix vars

13249 04/21/2014 04:23 PM Aaron Marcuse-Kubitza

bugfix: lib/sh/db.sh: mysql_snapshot(): try: need to use split syntax with prep_try instead, to work with prefix vars

13248 04/21/2014 04:20 PM Aaron Marcuse-Kubitza

fix: lib/sh/util.sh: try usage: documented that the split syntax with prep_try is meant to be used with vars before the cmd

13247 04/21/2014 03:37 PM Aaron Marcuse-Kubitza

fix: lib/sh/util.sh: echo_vars(): also need to print unset vars (including unset kw_params)

13246 04/21/2014 03:31 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: echo_vars(): put loop var on same line as `for`

13245 04/21/2014 02:59 PM Aaron Marcuse-Kubitza

bugfix: lib/sh/util.sh: sudo(): need to preserve PATH separately because -E does not preserve this

13244 04/21/2014 02:17 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: echo_redirs_cmd(): inline the function alias since it's only used in one place

13243 04/21/2014 02:15 PM Aaron Marcuse-Kubitza

bugfix: lib/sh/util.sh: redir(): need to load new aliases before it

13242 04/21/2014 02:13 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: echo_redirs_cmd(): log $PATH to facilitate troubleshooting

13241 04/21/2014 01:54 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: echo_redirs_cmd(): documented what the $(...) section does

13240 04/21/2014 01:50 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: echo_redirs_cmd(): moved comment about <>file redirs to line that it applies to

13239 04/21/2014 01:47 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: moved echo_redirs_cmd() to right before redir() which uses it

13238 04/21/2014 02:55 AM Aaron Marcuse-Kubitza

lib/sh/util.sh: catch(): log at higher log_level, since this is internal code

13237 04/21/2014 02:43 AM Aaron Marcuse-Kubitza

fix: lib/sh/util.sh: die_e(): treat SIGPIPE as benign error

13236 04/21/2014 02:32 AM Aaron Marcuse-Kubitza

lib/sh/util.sh: removed no longer used ignore_sig(). use ignore() instead, which now supports SIG*.

13235 04/21/2014 02:32 AM Aaron Marcuse-Kubitza

lib/sh/util.sh: piped_cmd(): use ignore, which now supports SIG*

13234 04/21/2014 02:31 AM Aaron Marcuse-Kubitza

lib/sh/util.sh: signals: catch(): added echo_func

13233 04/21/2014 02:28 AM Aaron Marcuse-Kubitza

lib/sh/util.sh: set_global_fds(): debug to global stderr in case stderr filtered

13232 04/21/2014 02:26 AM Aaron Marcuse-Kubitza

lib/sh/util.sh: debugging: use configurable debug_fd (set to $err_fd)

13231 04/21/2014 02:13 AM Aaron Marcuse-Kubitza

lib/sh/util.sh: signals: override catch() to support SIG* as exception type

13230 04/21/2014 02:11 AM Aaron Marcuse-Kubitza

lib/sh/util.sh: moved primitives sections before more complex sections that depend on them

13229 04/21/2014 02:07 AM Aaron Marcuse-Kubitza

lib/sh/util.sh: 2nd functions section: moved to 1st functions section

13228 04/21/2014 01:16 AM Aaron Marcuse-Kubitza

bugfix: lib/sh/util.sh: added workaround for bash bug where exit sometimes inxeplicably ignores $?

13227 04/21/2014 01:15 AM Aaron Marcuse-Kubitza

fix: lib/sh/util.sh: self_builtin: avoid $() so that $? isn't modified

13226 04/21/2014 01:07 AM Aaron Marcuse-Kubitza

lib/sh/util.sh: use new self_builtin

13225 04/21/2014 01:06 AM Aaron Marcuse-Kubitza

lib/sh/util.sh: added self_builtin

13224 04/21/2014 12:50 AM Aaron Marcuse-Kubitza

lib/sh/util.sh: pv(), pf(): moved to debugging section

13223 04/21/2014 12:48 AM Aaron Marcuse-Kubitza

bugfix: lib/sh/util.sh: stderr_matches(): also need to handle any filter error, such as caused by Ctrl+C

13222 04/21/2014 12:26 AM Aaron Marcuse-Kubitza

lib/sh/util.sh: stderr_matches(): echo_vars @PIPESTATUS_ to assist debugging

13221 04/20/2014 11:37 PM Aaron Marcuse-Kubitza

bugfix: lib/sh/util.sh: stderr2stdout(): use piped_cmd to ignore SIGPIPE since the output of this will piped to another command

13220 04/20/2014 06:22 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: setup_log_fd(): $log_fd: use 3 (stdlog) since other scripts are likely to use this for logging as well

13219 04/20/2014 06:20 PM Aaron Marcuse-Kubitza

fix: lib/sh/util.sh: setup_log_fd(): fd_set_default(): use $log_fd instead of repeating the value of it

13218 04/20/2014 06:05 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: die(): log at higher log_level, since this is logging code

13217 04/20/2014 06:02 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: highlight_log_msg(): log at higher log_level, since this is logging code

13216 04/20/2014 05:54 PM Aaron Marcuse-Kubitza

bugfix: lib/runscripts/util.run: $subdirs: adjusted log_level now that echo_vars is one log_level lower

13215 04/20/2014 05:46 PM Aaron Marcuse-Kubitza

bugfix: lib/sh/util.sh: stderr_matches(): only set benign_error=1 if the matched error occurred

13214 04/20/2014 05:44 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: ignore_e(): also set benign_error=1

13213 04/20/2014 05:40 PM Aaron Marcuse-Kubitza

fix: lib/sh/util.sh: prep_try alias: removed inaccurate comment

13212 04/20/2014 05:33 PM Aaron Marcuse-Kubitza

bugfix: lib/sh/util.sh: stdout2fd(): moved after redir() which it depends on

13211 04/20/2014 05:24 PM Aaron Marcuse-Kubitza

fix: lib/sh/util.sh: command(): moved `|| die_e` to command__exec so it would be properly indented under the echoed command

13210 04/20/2014 05:12 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: verbosity_compat(): log at higher log_level because it's logging code

13209 04/20/2014 05:10 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: $benign_error: log at higher log_level because it's logging code

13208 04/20/2014 05:06 PM Aaron Marcuse-Kubitza

lib/runscripts/util.run: $wrap_fn: log at higher log_level because it's startup code

13207 04/20/2014 04:55 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: $top_* vars, $is_outermost: log at higher log_level because it's startup code

13206 04/20/2014 04:52 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: $top_script: echo_vars this like the other $top_* vars

13205 04/20/2014 04:50 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: .(): log at higher log_level because it's startup code

13204 04/20/2014 04:45 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: is_dot_script(): run with higher log_level since this is run at the beginning of the script

13203 04/20/2014 04:44 PM Aaron Marcuse-Kubitza

lib/sh/util.sh, runscripts/util.run: set_paths(): run with higher log_level to hide all the paths that are set at the beginning of the script

13202 04/20/2014 04:28 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: added log++ stub

13201 04/20/2014 04:22 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: added log_local stub

13200 04/20/2014 03:15 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: added log() stub so internal commands can use it

13199 04/20/2014 03:10 PM Aaron Marcuse-Kubitza

fix: lib/sh/util.sh: echo_vars(): log at same log_level as echo_func so kw_params are displayed along with positional params

13198 04/20/2014 03:08 PM Aaron Marcuse-Kubitza

fix: lib/sh/util.sh: rel_path(): log this internal command at a higher log_level so it's normally hidden

13197 04/20/2014 02:43 PM Aaron Marcuse-Kubitza

fix: lib/sh/util.sh: log_msg!(): log split_lines at a higher log_level so it's normally hidden

13196 04/19/2014 10:22 PM Aaron Marcuse-Kubitza

bugfix: lib/sh/util.sh: stderr_matches(): `log_local; log++` should apply to just stdout_contains() and part of stderr2stdout() rather than all of stderr_matches()