Project

General

Profile

Statistics
| Revision:
  • svn:ignore: extern

# Date Author Comment
14793 10/02/2014 09:42 PM Aaron Marcuse-Kubitza

/README.TXT: To re-run geoscrubbing: updated runtimes. note that these are faster on the new hardware.

14792 10/01/2014 09:51 PM Aaron Marcuse-Kubitza

fix: /README.TXT: To re-run geoscrubbing: `rm=1 inputs/.geoscrub/geoscrub_output/geoscrub.csv.run`: use a subshell to avoid closing screen on errexit

14791 10/01/2014 09:39 PM Aaron Marcuse-Kubitza

fix: /README.TXT: Single datasource refresh: also back up DB after this

14790 10/01/2014 09:38 PM Aaron Marcuse-Kubitza

/README.TXT: datasource removal: documented bien2_traits runtime

14789 10/01/2014 09:35 PM Aaron Marcuse-Kubitza

added inputs/bien2_traits/_no_import since bien2_traits has been replaced by Cyrille_traits

14788 10/01/2014 09:32 PM Aaron Marcuse-Kubitza

/README.TXT: added datasource removal instructions

14787 10/01/2014 09:22 PM Aaron Marcuse-Kubitza

fix: /README.TXT: Single datasource refresh: place updated extract: generalized datasrc name

14786 09/30/2014 07:45 AM Aaron Marcuse-Kubitza

added inputs/Cyrille_traits/

14785 09/30/2014 07:36 AM Aaron Marcuse-Kubitza

lib/sql_io.py: null_strs: added N/A and NA (this will remove a common abbr for North America, but we don't use the continent, so this is OK)

14784 09/30/2014 05:04 AM Aaron Marcuse-Kubitza

mappings/VegCore.htm: regenerated from wiki. made verbatimLocality a synonym of locality since they are used to store the same data.

14783 09/30/2014 03:25 AM Aaron Marcuse-Kubitza

bugfix: schemas/util.sql: col_rename(): also need to run util.name_truncate() on the names used in the "don't try to rename to itself" comparison

14782 09/30/2014 01:54 AM Aaron Marcuse-Kubitza

fix: schemas/util.sql: col_rename(): don't try to rename a column to itself (this will cause an error)

14781 09/30/2014 01:22 AM Aaron Marcuse-Kubitza

schemas/util.sql: set_col_names(): use util.col_rename() so that all renames uses this function

14780 09/30/2014 12:54 AM Aaron Marcuse-Kubitza

schemas/util.sql: added col_rename()

14779 09/30/2014 12:02 AM Aaron Marcuse-Kubitza

schemas/util.sql: added quote_ident() wrapper

14778 09/30/2014 12:01 AM Aaron Marcuse-Kubitza

schemas/util.sql: added name_truncate()

14777 09/26/2014 10:57 PM Aaron Marcuse-Kubitza

fix: inputs/input.Makefile: $(nonHeaderSrcs): updated to exclude new header.txt

14776 09/26/2014 10:21 PM Aaron Marcuse-Kubitza

lib/runscripts/table.run: added check_headers()

14775 09/26/2014 10:21 PM Aaron Marcuse-Kubitza

bugfix: lib/runscripts/table.run: srcs: missing []

14774 09/26/2014 10:08 PM Aaron Marcuse-Kubitza

lib/runscripts/table.run: added header() and use it in header.txt()

14773 09/26/2014 09:50 PM Aaron Marcuse-Kubitza

lib/runscripts/table.run: 1st_src(): use a variable for this instead, to avoid needing to run this function each time it's used, and to make @srcs available

14772 09/26/2014 09:22 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: wildcard.(): clarified that it only removes . .. when at then beginning of the list

14771 09/26/2014 07:10 PM Aaron Marcuse-Kubitza

fix: schemas/public_.sql: view_full_occurrence_individual_view: materialize time: updated revision

14770 09/26/2014 06:45 PM Aaron Marcuse-Kubitza

schemas/public_.sql: view_full_occurrence_individual_view: materialize time: updated (2 days)

14769 09/26/2014 06:32 PM Aaron Marcuse-Kubitza

web/links/index.htm: updated to Firefox bookmarks: added bash shellshock links. LibreOffice: added steps to convert files from the command line.

14768 09/26/2014 02:31 AM Aaron Marcuse-Kubitza

lib/runscripts/table.run: added header.txt()

14767 09/26/2014 02:31 AM Aaron Marcuse-Kubitza

lib/runscripts/table.run: added 1st_src()

14766 09/26/2014 02:30 AM Aaron Marcuse-Kubitza

inputs/input.Makefile: added %/list_srcs

14765 09/26/2014 02:30 AM Aaron Marcuse-Kubitza

lib/runscripts/subdir.run: subdir_make(): use new $datasrc_dir

14764 09/26/2014 02:29 AM Aaron Marcuse-Kubitza

lib/runscripts/subdir.run: added $datasrc_dir

14763 09/26/2014 02:29 AM Aaron Marcuse-Kubitza

lib/sh/make.sh: make(): added support for $output_data mode which uses --silent

14762 09/26/2014 12:36 AM Aaron Marcuse-Kubitza

fix: lib/sh/util.sh: already_exists_msg(): changed calling convention to avoid it seeming like `return 0` is run if already_exists_msg() throws an error, when in fact already_exists_msg() is just a command that should be run before returning/errexiting

14761 09/25/2014 04:28 PM Aaron Marcuse-Kubitza

fix: inputs/input.Makefile: need to escape $ in commands, including inside comments

14760 09/25/2014 03:28 PM Aaron Marcuse-Kubitza

bugfix: lib/common.Makefile: $(wildcard/): need final pass with $(wildcard) to support inputs without wildcard chars

14759 09/25/2014 03:15 PM Aaron Marcuse-Kubitza

bugfix: inputs/input.Makefile: `$(call add*,$(svnFiles))` must be invoked externally to clear the $(wildcard) cache before expanding $(svnFiles)

14758 09/25/2014 02:48 AM Aaron Marcuse-Kubitza

/README.TXT: Installation: added instructions for inputs/download/live prompts

14757 09/25/2014 02:44 AM Aaron Marcuse-Kubitza

/README.TXT: Installation: added instructions for MySQL installation prompts

14756 09/25/2014 02:18 AM Aaron Marcuse-Kubitza

fix: /README.TXT: Installation: "Are you sure you want to continue connecting" prompt comes before "aaronmk@jupiter's password" prompt

14755 09/25/2014 02:13 AM Aaron Marcuse-Kubitza

/Makefile: phppgadmin-Linux: removed no longer needed $(editApacheConfForPhppgadmin), as phpPgAdmin no longer uses this file (/etc/phppgadmin/apache.conf)

14754 09/25/2014 02:12 AM Aaron Marcuse-Kubitza

/Makefile: phppgadmin-Linux: removed no longer needed $(editPhppgadminApacheConf)

14753 09/25/2014 01:58 AM Aaron Marcuse-Kubitza

/Makefile: misc-Linux: added htop

14752 09/25/2014 01:58 AM Aaron Marcuse-Kubitza

/Makefile: misc-Linux: added jedit

14751 09/25/2014 01:50 AM Aaron Marcuse-Kubitza

/Makefile: postgres-Linux: added pgadmin3

14750 09/25/2014 01:45 AM Aaron Marcuse-Kubitza

bugfix: /Makefile: $(postgresReload-*) calls: do not prepend $(MAKE) or - because these are multi-command functions

14749 09/25/2014 01:36 AM Aaron Marcuse-Kubitza

bugfix: /Makefile: $(bien*Password): need to use = instead of := because these files are not available until config/download/live has run

14748 09/24/2014 11:53 PM Aaron Marcuse-Kubitza

fix: /README.TXT: Installation: added instructions for "aaronmk@jupiter's password" prompt

14747 09/24/2014 11:49 PM Aaron Marcuse-Kubitza

/README.TXT: Installation: added step to open a terminal window

14746 09/24/2014 11:48 PM Aaron Marcuse-Kubitza

fix: /README.TXT: Installation: added instructions for "Are you sure you want to continue connecting" prompt

14745 09/24/2014 11:34 PM Aaron Marcuse-Kubitza

inputs/VegBank/run*.log: updated. this adds the function call context in addition to the function location.

14744 09/24/2014 11:28 PM Aaron Marcuse-Kubitza

bugfix: /Makefile: $(uutils_install): need to exit after printing instructions instead of continuing

14743 09/24/2014 11:13 PM Aaron Marcuse-Kubitza

fix: /README.TXT: Installation: need instructions for "reload PATH" prompt

14742 09/24/2014 11:10 PM Aaron Marcuse-Kubitza

fix: /README.TXT: Installation: `apt-get install subversion`: need --yes

14741 09/24/2014 10:58 PM Aaron Marcuse-Kubitza

bugfix: /Makefile: bin/install: uutils: need to reopen terminal window before can proceed with other installation steps

14740 09/24/2014 09:04 PM Aaron Marcuse-Kubitza

/Makefile: python-Linux: removed no longer used installation of pp (Parallel Python). we use Python's multiprocessing package instead.

14739 09/24/2014 07:57 PM Aaron Marcuse-Kubitza

bugfix: /Makefile: install: must be config/download/live, not config/download

14738 09/24/2014 07:52 PM Aaron Marcuse-Kubitza

README.TXT: bin/sync_upload calls as root: don't need to set $USER because this is now set to the correct value in bin/sync_upload's scripts

14737 09/24/2014 07:50 PM Aaron Marcuse-Kubitza

bugfix: lib/sh/local.sh: $sync_remote_url: jupiter user is always aaronmk, not the local user

14736 09/24/2014 07:41 PM Aaron Marcuse-Kubitza

*{.sh,run}: use standard WARNING syntax for warning labels

14735 09/24/2014 07:32 PM Aaron Marcuse-Kubitza

bugfix: /Makefile: bin/install: also need to install uutils

14734 09/24/2014 07:26 PM Aaron Marcuse-Kubitza

*{.sh,run}: use standard WARNING syntax for warning labels

14733 09/24/2014 07:25 PM Aaron Marcuse-Kubitza

fix: lib/sh/util.sh: verbosity_compat(): documented that this should not be run until right before executing an external command, so that it doesn't mess up the logging mechanism

14732 09/24/2014 07:23 PM Aaron Marcuse-Kubitza

bugfix: bin/make: don't run verbosity_compat until right before executing the external command, so that it doesn't mess up the logging mechanism. this is run automatically by command(), so there is no need to do anything here. note that logging bugs like these can now be troubleshooted much more easily with pst() to narrow down which functions could be causing the problem.

14731 09/24/2014 06:55 PM Aaron Marcuse-Kubitza

bugfix: lib/sh/util.sh: functions called by pst(): commented out/removed logging calls that would have caused infinite recursion when pst()'ing a logging function

14730 09/24/2014 06:38 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: echo_func(): get call context before wrapper(s), which is more useful for debugging. this uses skip_stack_frames()'s lookahead=1 mode.

14729 09/24/2014 06:37 PM Aaron Marcuse-Kubitza

fix: lib/sh/util.sh: skip_stack_frames() callers: updated for new skip_stack_frames rather than get_stack_frame behavior

14728 09/24/2014 06:32 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: skip_stack_frames(): added lookahead support, which looks at entry after current to deterine whether to skip current. this is useful for skipping wrappers, by looking at the calling function's name.

14727 09/24/2014 06:30 PM Aaron Marcuse-Kubitza

fix: lib/sh/util.sh: skip_stack_frames(): for new skip_stack_frames rather than get_stack_frame behavior, stack frames must be skipped in the caller to preserve the stack frame pointer

14726 09/24/2014 06:26 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: get_stack_frame_after(): renamed to skip_stack_frames() for clarity

14725 09/24/2014 06:25 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: added skip_stack_frame_in_caller, unskip_stack_frame_in_caller

14724 09/24/2014 06:24 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: added prev_stack_frame

14723 09/24/2014 07:04 AM Aaron Marcuse-Kubitza

lib/sh/util.sh: echo_func(): use new format_stack_frame, which adds call context information to what was provided by func_loc

14722 09/24/2014 07:02 AM Aaron Marcuse-Kubitza

fix: lib/sh/util.sh: format_stack_frame(): need to hide canon_rel_path() info using log+

14721 09/24/2014 07:01 AM Aaron Marcuse-Kubitza

lib/sh/util.sh: added get_stack_frame_after()

14720 09/24/2014 06:59 AM Aaron Marcuse-Kubitza

lib/sh/util.sh: added matches()

14719 09/24/2014 06:58 AM Aaron Marcuse-Kubitza

lib/sh/util.sh: next_stack_frame: documented usage

14718 09/24/2014 04:24 AM Aaron Marcuse-Kubitza

fix: lib/runscripts/util.run: runscript template: all(): moved example commands to target(), where they would more likely be located

14717 09/24/2014 02:35 AM Aaron Marcuse-Kubitza

lib/sh/util.sh: format_stack_frame(): support including args

14716 09/24/2014 12:08 AM Aaron Marcuse-Kubitza

lib/sh/util.sh: debugging: added pst() (print_stack_trace)

14715 09/24/2014 12:05 AM Aaron Marcuse-Kubitza

lib/sh/util.sh: added stack_trace(), print_stack_trace()

14714 09/24/2014 12:04 AM Aaron Marcuse-Kubitza

lib/sh/util.sh: added format_stack_frame()

14713 09/24/2014 12:03 AM Aaron Marcuse-Kubitza

lib/sh/util.sh: added get_stack_frame() and helpers

14712 09/23/2014 10:29 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: terminal: moved before errors so it can be used by it

14711 09/23/2014 10:25 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: errors, debugging: moved after datatype sections so their functions can use these

14710 09/22/2014 05:45 PM Aaron Marcuse-Kubitza

bugfix: lib/sh/util.sh: canon_rel_path() stub: proper no-op requires passing through original path

14709 09/22/2014 05:42 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: canon_rel_path(): fall back to original path if can't resolve, instead of errexiting

14708 09/22/2014 05:39 PM Aaron Marcuse-Kubitza

bugfix: lib/sh/util.sh: canon_rel_path(): don't re-localize $path because this clears it

14707 09/22/2014 05:36 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: canon_rel_path(): import $1 to $path before function body, so that the function body can be moved to a nested function

14706 09/22/2014 03:48 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: added canon_rel_path() stub for use by debugging functions

14705 09/22/2014 03:39 PM Aaron Marcuse-Kubitza

bugfix: /Makefile: install: run bin/install first since config/download depends on it

14704 09/22/2014 03:36 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: moved func_loc() to before debugging section so it can be used by debugging functions

14703 09/20/2014 02:34 PM Aaron Marcuse-Kubitza

bugfix: lib/sh/util.sh: command__exec(): need to restore $verbosity before calling die_e

14702 09/19/2014 03:51 PM Aaron Marcuse-Kubitza

bugfix: /Makefile: install: also need to run config/download to get the necessary passwords

14701 09/19/2014 03:43 PM Aaron Marcuse-Kubitza

config/Makefile: added download target

14700 09/19/2014 03:11 PM Aaron Marcuse-Kubitza

/Makefile: config: renamed to bin/install because config is the name of a directory

14699 09/19/2014 02:53 PM Aaron Marcuse-Kubitza

/README.TXT: Installation: `make install`: added instructions for what to do at each prompt

14698 09/19/2014 02:25 PM Aaron Marcuse-Kubitza

/README.TXT: Installation: Check out svn: need to install svn first as this does not come preinstalled on Ubuntu

14697 09/18/2014 04:57 PM Aaron Marcuse-Kubitza

fix: inputs/.geoscrub/geoscrub_output/geoscrub.csv.run: make(): added warning that this will truncate the geoscrub database tables

14696 09/16/2014 05:35 PM Aaron Marcuse-Kubitza

/README.TXT: to back up the local machine's hard drive: just do a single pass, to avoid the numerous different steps

14695 09/16/2014 05:25 PM Aaron Marcuse-Kubitza

backups/*retention_policy*: on jupiter: changed to avoid retaining backups further back, as these consume significant disk space on jupiter and are not useful for anything

14694 09/16/2014 04:25 PM Aaron Marcuse-Kubitza

fix: lib/sh/local.sh: $sync_remote_url: need $USER so user can be overridden when running as root