Project

General

Profile

Statistics
| Revision:

# Date Author Comment
8796 05/02/2013 08:35 PM Aaron Marcuse-Kubitza

lib/runscripts/local.run: moved log_sql (), pg_* () to lib/util.sh because these do not depend on local external scripts in bin/

8795 05/02/2013 08:27 PM Aaron Marcuse-Kubitza

lib/runscripts/local.run: added pg_copy_to (), pg_header (), pg_export_table_no_header (), pg_export_table_to_dir_no_header ()

8794 05/02/2013 08:26 PM Aaron Marcuse-Kubitza

lib/runscripts/local.run: added mk_schema_esc, mk_table_esc aliases as shortcuts for `local *_esc; mk_esc_name *`

8793 05/02/2013 08:09 PM Aaron Marcuse-Kubitza

lib/util.sh: self_not_included (): added support for loading newly-defined aliases for use in functions in the same file, and documentation for how to do this

8792 05/02/2013 02:49 PM Aaron Marcuse-Kubitza

lib/runscripts/local.run: psql (): output only the query results to stdout (using --output), and redirect everything else to stderr

8791 05/02/2013 02:26 PM Aaron Marcuse-Kubitza

added /exports/

8790 05/02/2013 02:24 PM Aaron Marcuse-Kubitza

lib/runscripts/local.run: added log_sql (). mysql (): don't echo SQL commands when not in verbose mode. this is needed to support commands that use the query result in a $() expression, and should not have echoed commands cluttering up stdout. (unfortunately, the SQL commands are echoed to stdout rather than stderr.)

8789 05/02/2013 01:52 PM Aaron Marcuse-Kubitza

schemas/vegbien.sql: range_modeling_input: use analytical_stem instead of analytical_stem_view because it takes a long time (~2 min) to get a row from the left-joined view, due to the large number of joins and large number of rows in the joined tables

8788 05/02/2013 01:41 PM Aaron Marcuse-Kubitza

web/links/index.htm: updated to Firefox bookmarks. grouped related items together.

8787 05/02/2013 01:28 PM Aaron Marcuse-Kubitza

web/links/index.htm: author comments at beginning of bookmark desc: start with a line containing only dashes (-) rather than a blank line, because a newline will be trimmed away on reimport into Firefox, such that reexporting it will lose the author comment indicator

8786 05/02/2013 01:24 PM Aaron Marcuse-Kubitza

lib/Firefox_bookmarks.reformat.csv: label page's description: support starting a description with a line containing only dashes (-) to indicate author comments. this is better than a newline, because a newline will be trimmed away on reimport into Firefox, such that reexporting it will lose the author comment indicator

8785 05/02/2013 01:16 PM Aaron Marcuse-Kubitza

lib/Firefox_bookmarks.reformat.csv: add hyperlinked HTML anchors for folders: switch back to using <a href=...> instead of onclick, but put the <a> tag around the <H3> rather than inside it so that Firefox can correctly parse out the folder name when importing the bookmarks

8784 05/02/2013 12:52 PM Aaron Marcuse-Kubitza

lib/Firefox_bookmarks.reformat.csv: add hyperlinked HTML anchors for folders: use `onclick="javascript:document.location = '#...'"` instead of <a href=...> to allow clicking the header to go to the anchor, so that the <a> tag doesn't prevent Firefox from parsing the folder name

8783 05/02/2013 12:42 PM Aaron Marcuse-Kubitza

bugfix: lib/Firefox_bookmarks.reformat.csv: add hyperlinked HTML anchors for folders: moved <a name=.../> outside the <H3> so that Firefox can correctly parse out the folder name when importing the bookmarks

8782 05/02/2013 12:27 PM Aaron Marcuse-Kubitza

web/links/index.htm: updated to Firefox bookmarks. grouped related items together.

8781 05/02/2013 12:19 PM Aaron Marcuse-Kubitza

lib/Firefox_bookmarks.reformat.csv: indexing: add hyperlinked HTML anchors for folders

8780 05/02/2013 11:50 AM Aaron Marcuse-Kubitza

web/links/index.htm: updated to Firefox bookmarks

8779 05/02/2013 08:30 AM Aaron Marcuse-Kubitza

schemas/vegbien.sql: added range_modeling_input view

8778 05/02/2013 08:21 AM Aaron Marcuse-Kubitza

schemas/vegbien.sql: analytical_stem_view: order by datasource name so that the rows have a predictable rather than random ordering

8777 05/02/2013 06:14 AM Aaron Marcuse-Kubitza

bugfix: lib/util.sh: moved mysql (), psql () to local.run because they use local commands that are only available after local.run sets the PATH. retain a mysql () function in util.sh that adds the --verbose option to mysql.

8776 05/02/2013 05:44 AM Aaron Marcuse-Kubitza

lib/util.sh: removed "$bin_dir"/ before commands because the bin dir is now in the PATH

8775 05/02/2013 05:13 AM Aaron Marcuse-Kubitza

lib/runscripts/table.run: moved general DB commands to lib/util.sh

8774 05/02/2013 04:47 AM Aaron Marcuse-Kubitza

moved lib/*.run into runscripts/ subdir so runscripts are grouped together and easier to find rather than being scattered throughout lib/

8773 05/02/2013 04:19 AM Aaron Marcuse-Kubitza

bugfix: lib/util.sh: canon_rel_path (): use $(pwd -P) instead of $PWD because symlinks are resolved by realpath (readlink -f), so they also need to be resolved in the current dir, but $PWD does not contain the symlinks-resolved version of the current dir

8772 05/02/2013 03:48 AM Aaron Marcuse-Kubitza

inputs/GBIF/MySQL_export: use lib/util.sh instead of util.run now that the non-runscript-specific functions have been separated out into it. this ensures that MySQL_export is not unintentionally treated as a runscript (which functions differently from a normal shell script).

8771 05/02/2013 02:46 AM Aaron Marcuse-Kubitza

/.htaccess: use canonical URL without symlinks

8770 05/02/2013 02:44 AM Aaron Marcuse-Kubitza

added /.htaccess to create the right self-referential URL since / is outside the document root (linked from /vegbiendev/fs/)

8769 05/02/2013 02:14 AM Aaron Marcuse-Kubitza

schemas/VegCore/VegCore.ERD.mwb: TNRS taxonomic scrubbing steps: moved labels to the start of the arrow they label, so that the user can more easily follow the arrows from step to step by looking for an outward-pointing arrow with a label

8768 05/02/2013 01:48 AM Aaron Marcuse-Kubitza

added inputs/GBIF/_MySQL/MySQL.data.sql.gz.md5

8767 05/02/2013 12:46 AM Aaron Marcuse-Kubitza

bugfix: lib/common.Makefile: Compression: %.gz <-> %: only run command if target does not exist, to avoid overwriting the target when the compressed or uncompressed version is newer than it. the difference in mtimes can arise when one file is created after the other, and should not cause the opposite operation to be performed to try to make the other file up-to-date (leading to an infinite back-and-forth of creating one file from the other).

8766 04/30/2013 11:13 PM Aaron Marcuse-Kubitza

web/links/index.htm: updated to Firefox bookmarks. the VegPath link now includes the new favicon.

8765 04/30/2013 11:12 PM Aaron Marcuse-Kubitza

added web/favicon.ico generated from schemas/BIEN_logo.png

8764 04/30/2013 11:01 PM Aaron Marcuse-Kubitza

web/main.conf: added SSL-protected site for use with password-protected areas of the site, so that the user's password is not transmitted in plaintext. (because the SSL certificate is self-signed, it will unfortunately display the Confirm Security Exception message in Firefox.) note that digest authentication cannot be used to avoid plaintext passwords, because it requires knowing the user's original password to generate the digest, but we have only the MD5 sums in /etc/shadow.

8763 04/30/2013 09:26 PM Aaron Marcuse-Kubitza

web/links/index.htm: updated to Firefox bookmarks

8762 04/30/2013 08:08 PM Aaron Marcuse-Kubitza

web/links/index.htm: put all bookmarks into one subfolder named BIEN links, to facilitate importing them all into one folder on another machine. this also helps when upgrading to a newer version of the bookmarks, because the previous version must be deleted and this now requires deleting only a single folder.

8761 04/30/2013 08:02 PM Aaron Marcuse-Kubitza

lib/Firefox_bookmarks.reformat.csv: use <H3 style="font-size: 200%;"> instead of <H1> to make the first folder's name the page title, so that Firefox can reimport the first folder as a bookmarks folder

8760 04/30/2013 07:42 PM Aaron Marcuse-Kubitza

bugfix: lib/Firefox_bookmarks.reformat.csv: make first folder name the page title: added back replacement string

8759 04/30/2013 07:40 PM Aaron Marcuse-Kubitza

web/links/index.htm.run: clean_up (): removed command to add page title because this is now done by lib/Firefox_bookmarks.reformat.csv

8758 04/30/2013 07:40 PM Aaron Marcuse-Kubitza

lib/Firefox_bookmarks.reformat.csv: use page title as window title

8757 04/30/2013 07:31 PM Aaron Marcuse-Kubitza

lib/Firefox_bookmarks.reformat.csv: remove previous page title

8756 04/30/2013 07:29 PM Aaron Marcuse-Kubitza

lib/Firefox_bookmarks.reformat.csv: make first folder name the page title

8755 04/30/2013 07:21 PM Aaron Marcuse-Kubitza

lib/Firefox_bookmarks.reformat.csv: move Bookmarks Toolbar inside first folder instead of before it. this allows storing all bookmarks in one subfolder so that when the web page is imported into another computer's bookmarks, the imported bookmarks are all together in one folder.

8754 04/30/2013 07:16 PM Aaron Marcuse-Kubitza

bugfix: lib/Firefox_bookmarks.reformat.csv: refactored regexps to account for Python applying (?s) to the entire regexp, even if it appears inside a () subgroup. the Python behavior is in contrast to the standard regexp behavior used by Java, etc. where (?s) applies only to the subgroup it appears in.

8753 04/30/2013 06:19 PM Aaron Marcuse-Kubitza

web/links/index.htm: updated to Firefox bookmarks. resources: put unsorted links into subfolders.

8752 04/30/2013 06:11 PM Aaron Marcuse-Kubitza

bugfix: lib/Firefox_bookmarks.reformat.csv: add <style>: format bookmark description as plaintext: use `white-space: pre-wrap` instead of pre in order to wrap long lines

8751 04/30/2013 06:07 PM Aaron Marcuse-Kubitza

bugfix: lib/Firefox_bookmarks.reformat.csv: favicon images: made replacements idempotent so that the favicons would not be deleted the next time the web/links/index.htm.run is run (due to a newline being added before ICON= )

8750 04/30/2013 05:52 PM Aaron Marcuse-Kubitza

lib/Firefox_bookmarks.reformat.csv: favicon images: display placeholder favicon image for every link to ensure uniform alignment

8749 04/30/2013 05:45 PM Aaron Marcuse-Kubitza

added web/links/blank.gif symlink to web/blank.gif for shorter blank.gif URLs

8748 04/30/2013 05:43 PM Aaron Marcuse-Kubitza

added web/blank.gif

8747 04/30/2013 05:14 PM Aaron Marcuse-Kubitza

lib/Firefox_bookmarks.reformat.csv: display ICON attributes as separate images. note that this uses the "data:" embedded image contents provided in the bookmarks file, so the images load instantly along with the page instead of needing to be separately retrieved from each server.

8746 04/30/2013 04:45 PM Aaron Marcuse-Kubitza

lib/Firefox_bookmarks.reformat.csv: instead of removing ICON attributes with favicon contents, put them on their own line so the rest of the line is easier to see

8745 04/30/2013 04:35 PM Aaron Marcuse-Kubitza

lib/Firefox_bookmarks.reformat.csv: divided replacements into sections

8744 04/30/2013 04:27 PM Aaron Marcuse-Kubitza

lib/Firefox_bookmarks.reformat.csv: move Bookmarks Toolbar to beginning, remove its desc, and rename it to Quick links

8743 04/30/2013 04:13 PM Aaron Marcuse-Kubitza

web/links/index.htm: removed extra divider after Recent Tags, Recently Bookmarked because section dividers interfere with regexp matching and the Bookmarks Toolbar is already visually separate from them

8742 04/30/2013 04:09 PM Aaron Marcuse-Kubitza

web/links/index.htm: moved Recent Tags, Recently Bookmarked special folders to end because they are Firefox-specific and not part of the BIEN links (they also do not work in a browser because they are Firefox-specific query bookmarks instead of actual folders)

8741 04/30/2013 03:32 PM Aaron Marcuse-Kubitza

web/links/index.htm.run: clean_up (): rename the page title from "Bookmarks" to "BIEN links"

8740 04/30/2013 03:18 PM Aaron Marcuse-Kubitza

bin/repl: skip header instead of parsing it, since its columns are not used. this also allows using just a blank line as the header when the column names are not important.

8739 04/30/2013 03:05 PM Aaron Marcuse-Kubitza

web/links/index.htm: use initial blank line instead of previous "-" workaround to indicate author comment at start of bookmark desc

8738 04/30/2013 03:04 PM Aaron Marcuse-Kubitza

web/links/index.htm: use initial blank line to indicate author comment at start of bookmark desc

8737 04/30/2013 02:59 PM Aaron Marcuse-Kubitza

lib/Firefox_bookmarks.reformat.csv: label page's description: don't label a bookmark desc starting with a blank line (indicating an author-added comment) as a page's description

8736 04/30/2013 02:51 PM Aaron Marcuse-Kubitza

lib/Firefox_bookmarks.reformat.csv: label page's description: don't label an author-added quotation (which starts with " ) as the page's description

8735 04/30/2013 02:33 PM Aaron Marcuse-Kubitza

bin/in_place: set the permissions of the new file to the original file when `chmod --reference` is available. this ensures that when a file is marked web-accessible, it stays web-accessible when you run an in_place command on it.

8734 04/30/2013 02:22 PM Aaron Marcuse-Kubitza

web/links/index.htm: BitTorrent Sync: security warning about data leak: added link to reported bug at http://forum.bittorrent.com/topic/18612-security-hole-in-linux-webui-makes-all-your-files-publicly-accessible/ . updated workaround instructions.

8733 04/30/2013 01:20 PM Aaron Marcuse-Kubitza

web/links/index.htm: updated to Firefox bookmarks. BitTorrent Sync: added security warning that running btsync on Linux will by default create a publicly-accessible, unprotected WebUI, allowing anyone on the web to create a sync folder to view and edit any of your files. to avoid this, always run btsync with a config file which sets a password on the WebUI. if you have already run btsync, run `killall btsync` to turn off the WebUI.

8732 04/30/2013 12:59 PM Aaron Marcuse-Kubitza

web/links/index.htm: updated to Firefox bookmarks. changes include links about BitTorrent Sync.

8731 04/30/2013 12:51 PM Aaron Marcuse-Kubitza

lib/Firefox_bookmarks.reformat.csv: label <meta> description: renamed label text to "page's description" to be understandable to non-programmers

8730 04/30/2013 12:49 PM Aaron Marcuse-Kubitza

lib/Firefox_bookmarks.reformat.csv: label <meta> description: remove any existing description label, to avoid duplicating the description label when the text of the description label changes

8729 04/30/2013 12:37 PM Aaron Marcuse-Kubitza

lib/Firefox_bookmarks.reformat.csv: label <meta> description as such to avoid confusing it with comments added by the bookmark author, who may not agree with it. the <meta> description is in the 1st paragraph(s), when provided.

8728 04/30/2013 12:13 PM Aaron Marcuse-Kubitza

lib/Firefox_bookmarks.reformat.csv: remove LAST_MODIFIED attributes, which seem to change whenever the favicon is updated and clutter up the svn diff

8727 04/30/2013 12:05 PM Aaron Marcuse-Kubitza

lib/Firefox_bookmarks.reformat.csv: remove ICON attributes with favicon contents, which clutter up the svn diffs

8726 04/30/2013 11:52 AM Aaron Marcuse-Kubitza

added web/links/index.htm.run with clean_up action to run whenever the index.htm bookmarks file is changed (`web/links/index.htm.run clean_up`)

8725 04/30/2013 11:51 AM Aaron Marcuse-Kubitza

added lib/Firefox_bookmarks.reformat.csv

8724 04/25/2013 09:58 PM Aaron Marcuse-Kubitza

README.TXT: Maintenance: to synchronize a Mac's settings with my testing machine's: exclude only backup files in the Documents/BIEN/svn/backups/ dir (sync the other files)

8723 04/25/2013 09:53 PM Aaron Marcuse-Kubitza

README.TXT: Maintenance: to synchronize vegbiendev, jupiter, and your local machine: when changes are made on vegbiendev: don't sync the group, which can be bien on vegbiendev but not on jupiter (where aaronmk is not a member of the bien group)

8722 04/25/2013 09:51 PM Aaron Marcuse-Kubitza

README.TXT: Maintenance: to synchronize vegbiendev, jupiter, and your local machine: when changes are made on vegbiendev: include *.md5

8721 04/25/2013 09:08 PM Aaron Marcuse-Kubitza

README.TXT: Maintenance: removed step to backup the Ubuntu VM, because this is now done as part of the "backup files not in Time Machine" step

8720 04/25/2013 09:07 PM Aaron Marcuse-Kubitza

README.TXT: Maintenance: added steps to backup files not in Time Machine

8719 04/25/2013 08:57 PM Aaron Marcuse-Kubitza

README.TXT: Maintenance: to synchronize a Mac's settings with my testing machine's: back up (almost) all files in the home directory instead of just Library/ (to both jupiter and Dropbox)

8718 04/25/2013 06:45 PM Aaron Marcuse-Kubitza

README.TXT: put commands: removed unnecessary /** after dirs to exclude

8717 04/25/2013 06:26 PM Aaron Marcuse-Kubitza

README.TXT: Maintenance: to synchronize a Mac's settings with my testing machine's: added steps to also backup the settings to Dropbox (in addition to jupiter)

8716 04/25/2013 06:13 PM Aaron Marcuse-Kubitza

lib/util.sh: added realpath () and use it where `readlink -f` is used

8715 04/25/2013 06:05 PM Aaron Marcuse-Kubitza

lib/util.run: doc comment: changed "run scripts" to "runscripts"

8714 04/25/2013 06:04 PM Aaron Marcuse-Kubitza

lib/util.run: factored general utils (non-runscript-specific) out into new util.sh

8713 04/25/2013 05:55 PM Aaron Marcuse-Kubitza

lib/util.run: renamed $verbose to $verbosity because it's an integer level, not a boolean. continue to support specifying the verbosity in $verbose.

8712 04/25/2013 05:52 PM Aaron Marcuse-Kubitza

lib/util.run: support $verbose="", which is treated as 0

8711 04/25/2013 05:50 PM Aaron Marcuse-Kubitza

lib/util.run: only automatically echo env vars when they are set if verbosity is >= 2

8710 04/25/2013 05:49 PM Aaron Marcuse-Kubitza

lib/util.run: added $verbose var to control logging. this is normally set to 0, but defaults to 2 for a runscript.

8709 04/25/2013 05:41 PM Aaron Marcuse-Kubitza

lib/util.run: moved `shopt -s expand_aliases` inside the include guard so callers can override the setting without it being reset if util.run is included again

8708 04/25/2013 05:39 PM Aaron Marcuse-Kubitza

lib/local.run: add $bin_dir to the PATH

8707 04/25/2013 05:15 PM Aaron Marcuse-Kubitza

bin/in_place: don't run if no command to run, because that would erase the file

8706 04/25/2013 05:10 PM Aaron Marcuse-Kubitza

bin/in_place: use -e (exit on error) option to sh instead of adding `|| exit` after every command

8705 04/25/2013 04:49 PM Aaron Marcuse-Kubitza

*run: added include guards

8704 04/25/2013 04:30 PM Aaron Marcuse-Kubitza

bugfix: lib/util.run: added include guard to prevent issues in "diamond includes", where a runscript includes two runscripts and each includes util.run, causing the second include of util.run to reset any methods overridden in the first included runscript. this prevents util.run from being included twice in the first place.

8703 04/25/2013 04:25 PM Aaron Marcuse-Kubitza

lib/util.run: added include_guard_var (), self_not_included () for use by path-based include guards

8702 04/25/2013 03:40 PM Aaron Marcuse-Kubitza

lib/util.run: echo_stdin (): print a separator before and after the echoed output to help distinguish it from other verbose output

8701 04/25/2013 03:37 PM Aaron Marcuse-Kubitza

lib/table.run: use new local.run instead of defining $bin_dir, etc. itself

8700 04/25/2013 03:36 PM Aaron Marcuse-Kubitza

lib/util.run: echo_export (): run the export builtin using `builtin` to avoid recursively calling any export alias or function defined by the user (e.g. `alias export=echo_export`. this causes util.run to be idempotent, such that it can be included multiple times without causing problems due to the redefinition of functions, vars, etc.

8699 04/25/2013 03:04 PM Aaron Marcuse-Kubitza

added lib/local.run, which links to locally-available resources such as $bin_dir

8698 04/25/2013 02:50 PM Aaron Marcuse-Kubitza

lib/table.run: added mysql (), mysql_ANSI ()

8697 04/25/2013 02:41 PM Aaron Marcuse-Kubitza

added web/links/index.htm containing Firefox bookmarks exported to HTML. CSS style information has been added to fix default HTML tag formatting, improve readability, and handle the Firefox bookmarks format. <dd> tags have been manually closed where HTML would not auto-close them properly. note that these changes must be reapplied each time the bookmarks file is reexported (`svn di` will show the changes to make).