bugfix: lib/sh/archives.sh: compress(): need to use zip's path syntax to avoid the file in the archive being named "-"

lib/sh/archives.sh: added compress(), expand(), which handle compression of individual files

bugfix: lib/sh/util.sh: str2varname(): need to lowercase str because on case-insensitive filesystems, paths sometimes canonicalize to a different capitalization than the original

lib/sh/util.sh: added lowercase()

bugfix: lib/sh/util.sh: die(): need stub since this is invoked before it's defined

bugfix: lib/sh/util.sh: setup_log_fd(): don't change $log_fd to stdlog until stdlog is set up, to avoid "Bad file descriptor" errors

lib/sh/util.sh: func_override(), copy_func(): added echo_func to facilitate debugging

bugfix: lib/sh/util.sh: stubs: log++ alias also needs to be moved to stub section

lib/sh/sync.sh: db_snapshot(): before backing up, trim bloated temp files (eg. from rolled back changes)

bugfix: lib/sh/db.sh: pg_dump(): need use_pg to import $pg_database before checking for existence of $database

lib/sh/util.sh: import_vars: documented that it's idempotent

bugfix: benign_does_not_exist_error(): removed ignore_e=3, because this exit status is also used for other errors

fix: lib/sh/db.sh: benign_does_not_exist_error(): use benign_error=1, which is now supported properly by stderr_matches()

bugfix: lib/sh/util.sh: stderr_matches(): support $benign_error properly, by handling exit status logging in this func instead

bugfix: lib/sh/db.sh: pg_schema_exists(): also need to benignify "does not exist" error if returns false

bugfix: lib/sh/util.sh: stderr_matches(): need to separately display errors that were incorrectly suppressed due to $benign_error

bugfix: lib/sh/util.sh: is_err(): rethrow must be inverted (rethrow->false if error)

lib/sh/util.sh: added is_err()

lib/sh/local.sh: public_schema_exists(): moved to lib/sh/db.sh since this no longer depends on BIEN-specific configurations

bugfix: lib/sh/db.sh: public_schema_exists(): don't hide the function call tree so it's clear which function is running the psql commands

bugfix: lib/sh/db.sh: public_schema_exists(): don't hide the function call tree so it's clear which function is running the psql commands

fix: *{.sh,run}: stderr_matches() callers: usage: documented that they may require benign_error=1

fix: lib/sh/util.sh: stderr_matches(): usage: documented that this may require benign_error=1

bugfix: lib/sh/db.sh: pg_cmd(): updated for new echo_vars log_level

fix: lib/sh/db.sh: pg_schema_exists(): display the function name so it's clear which function is running the psql commands

fix: lib/sh/db.sh: pg_schema_exists(): don't use log++ because it hides the command that produces the benign error

fix: lib/sh/db.sh: psql(): removed debugging changes

bugfix: lib/sh/util.sh: highlight_log_msg(): when not can_highlight_log_msg, need to remove any surrounding formatting

fix: lib/sh/util.sh: die_error_hidden(): always log local vars at same log_level as echo_func

fix: *{.sh,run}: always log kw_params at same log_level as echo_func

lib/sh/util.sh: split_lines(): usage: matched up and synced different syntaxes

bugfix: lib/sh/util.sh: log_msg!(): split_lines does not support being invoked by wrapper; need to use `declare lines; wrapper "split_lines" str` instead

fix: lib/sh/util.sh: split_lines(): usage: documented different syntax for when using wrapper

bugfix: lib/sh/util.sh: die_error_hidden(): echo_func to assist debugging

bugfix: lib/sh/util.sh: split(): need to limit the effects of IFS to just the splitting, so it doesn't cause strange errors in other functions

bugfix: stderr2stdout(): fd 2 must be redirected back to fd 2, not log-filtered, in case there are other errors in addition to the benign error. this fixes a bug in pg_schema_exists(), where errors about the DB being down were not displayed because they were log-filtered out.

lib/sh/make.sh: set_make_vars: don't display make vars at verbosity 2 to avoid clutter

bugfix: lib/sh/make.sh: begin_target: don't echo_func twice

lib/sh/db.sh: pg_snapshot(): perform online backup if possible, to avoid needing to restart the server

lib/sh/db.sh: added pg_start_backup(), pg_stop_backup()

lib/sh/db.sh: psql(): only set redirs if can redirect

bugfix: psql(): when as_root is on, need to avoid redirections as these are not passed through by sudo

bugfix: lib/sh/db.sh: psql(): don't use `--file /dev/fd/40` when can't redirect

fix: lib/sh/db.sh: psql(): when using sudo with custom $stdin, raise error that this is not supported

lib/sh/db.sh: psql(): $data_bypasses_filter: renamed to $data2stdout for clarity

lib/sh/db.sh: psql(): $bypass_ok: renamed to $can_redir for clarity

lib/sh/db.sh: psql(): usage: $stdin: documented that can also use process substitution for this

bugfix: lib/sh/util.sh: `type` calls: need -- before cmd in case it starts with -

lib/sh/util.sh: cmd2rel_path: use is_extern()

lib/sh/sync.sh: db_snapshot(): use `end_try` as specified in `try` usage

lib/sh/util.sh: try: usage: added location of finally block

lib/sh/sync.sh: upload(): always print the function and kw_params

bugfix: lib/sh/util.sh: type(): need to handle options before command name

lib/sh/util.sh: added 1st_non_opt()

lib/sh/util.sh: unalias(): use self_builtin, which is now defined before it

lib/sh/util.sh: unalias(): use self_builtin, which is now defined before it

bugfix: lib/sh/util.sh: commands: `type` calls: need to account for the fact that any alias is already expanded

lib/sh/util.sh: functions: moved before commands since commands are more complex

lib/sh/sync.sh: db_copy() and callers: pass args as rsync options

fix: lib/sh/sync.sh: db_copy(): need to exclude files which prevent tape backup

lib/sh/db.sh: added pg_ctl(), pg_snapshot()

lib/sh/sync.sh: db_snapshot(): copy changes before stopping DB to minimize the time that it's shut down

lib/sh/sync.sh: db_snapshot(): factored copy operation out into separate db_copy() function

lib/sh/db.sh: mysql_snapshot(): use new db_snapshot()

lib/sh/sync.sh: added db_snapshot()

lib/sh/db.sh: mysql_snapshot(): for large files, don't re-copy entire file

lib/sh/db.sh: mysql_snapshot(): use live mode as the default

fix: lib/sh/db.sh: mysql_snapshot(): need to create dest dir if doesn't exist

bugfix: lib/sh/db.sh: mysql_snapshot(): try: need to use split syntax with prep_try instead, to work with prefix vars

bugfix: lib/sh/db.sh: mysql_snapshot(): try: need to use split syntax with prep_try instead, to work with prefix vars

fix: lib/sh/util.sh: try usage: documented that the split syntax with prep_try is meant to be used with vars before the cmd

fix: lib/sh/util.sh: echo_vars(): also need to print unset vars (including unset kw_params)

lib/sh/util.sh: echo_vars(): put loop var on same line as `for`

bugfix: lib/sh/util.sh: sudo(): need to preserve PATH separately because -E does not preserve this

lib/sh/util.sh: echo_redirs_cmd(): inline the function alias since it's only used in one place

bugfix: lib/sh/util.sh: redir(): need to load new aliases before it

lib/sh/util.sh: echo_redirs_cmd(): log $PATH to facilitate troubleshooting

lib/sh/util.sh: echo_redirs_cmd(): documented what the $(...) section does

lib/sh/util.sh: echo_redirs_cmd(): moved comment about <>file redirs to line that it applies to

lib/sh/util.sh: moved echo_redirs_cmd() to right before redir() which uses it

lib/sh/util.sh: catch(): log at higher log_level, since this is internal code

fix: lib/sh/util.sh: die_e(): treat SIGPIPE as benign error

lib/sh/util.sh: removed no longer used ignore_sig(). use ignore() instead, which now supports SIG*.

lib/sh/util.sh: piped_cmd(): use ignore, which now supports SIG*

lib/sh/util.sh: signals: catch(): added echo_func

lib/sh/util.sh: set_global_fds(): debug to global stderr in case stderr filtered

lib/sh/util.sh: debugging: use configurable debug_fd (set to $err_fd)

lib/sh/util.sh: signals: override catch() to support SIG* as exception type

lib/sh/util.sh: moved primitives sections before more complex sections that depend on them

lib/sh/util.sh: 2nd functions section: moved to 1st functions section

bugfix: lib/sh/util.sh: added workaround for bash bug where exit sometimes inxeplicably ignores $?

fix: lib/sh/util.sh: self_builtin: avoid $() so that $? isn't modified

lib/sh/util.sh: use new self_builtin

lib/sh/util.sh: added self_builtin

lib/sh/util.sh: pv(), pf(): moved to debugging section

bugfix: lib/sh/util.sh: stderr_matches(): also need to handle any filter error, such as caused by Ctrl+C

lib/sh/util.sh: stderr_matches(): echo_vars @PIPESTATUS_ to assist debugging

bugfix: lib/sh/util.sh: stderr2stdout(): use piped_cmd to ignore SIGPIPE since the output of this will piped to another command

lib/sh/util.sh: setup_log_fd(): $log_fd: use 3 (stdlog) since other scripts are likely to use this for logging as well

fix: lib/sh/util.sh: setup_log_fd(): fd_set_default(): use $log_fd instead of repeating the value of it