Project

General

Profile

Activity

From 09/14/2014 to 10/13/2014

10/13/2014

07:40 AM Revision 14815: bugfix: web/links/index.htm: updated to Firefox bookmarks: Mac: automatic restart on power loss: also need to disable the UPSShutdownAtLevel/UPSShutdownAtMinutesLeft functions because an orderly shutdown prevents the computer from auto-restarting on power loss. Bookmarks Toolbar: reordered links to put those most relevant to VegBIEN users first.
Aaron Marcuse-Kubitza
07:25 AM Revision 14814: bugfix: config/dev_machine/com.apple.PowerManagement.plist: disable the UPSShutdownAtLevel/UPSShutdownAtMinutesLeft functions because an orderly shutdown prevents the computer from auto-restarting on power loss
Aaron Marcuse-Kubitza
07:17 AM Revision 14813: bugfix: /README.TXT: Datasource setup: For MS Access databases: also need to comment out `CREATE DATABASE` because pg_dump_limit is only applied to data.sql (due to requirements of the TNRS datasource)
Aaron Marcuse-Kubitza
06:31 AM Revision 14812: added inputs/CVS/_src/cvs-eep-archive-2014-10-07-correctedCVSData.{data,schema}.sql.ini
Aaron Marcuse-Kubitza
06:31 AM Revision 14811: bugfix: inputs/CVS/_src/{data,schema}.sql.ini: sourcefilename: this needs to be on the VM's own HD to avoid crashing MSAccess to PostgreSQL. destinationdatabase: added this back since it is fine to leave this blank.
Aaron Marcuse-Kubitza
06:23 AM Revision 14810: added inputs/CVS/_src/cvs-eep-archive-2013-10-22-VegBIEN.{data,schema}.sql.ini
Aaron Marcuse-Kubitza
06:17 AM Revision 14809: added inputs/CVS/_src/{data,schema}.sql.ini
Aaron Marcuse-Kubitza
05:25 AM Revision 14808: added backups/vegbien.r14673.backup.md5
Aaron Marcuse-Kubitza
04:45 AM Revision 14807: /README.TXT: To re-run geoscrubbing: updated runtimes
Aaron Marcuse-Kubitza

10/12/2014

03:58 PM Revision 14806: inputs/publishable datasources.xlsx: updated: use white text on dark backgrounds for better visibility, and to create more visual contrast for the unredistributable indicators
Aaron Marcuse-Kubitza
03:52 PM Revision 14805: inputs/publishable datasources.xlsx: updated: consolidated Brian E's new columns into a single "conditions?" column. fix: "what is needed to publish it": renamed to "conditions of use/remaining tasks". "conditions of use": changed color scheme to match "publishable?" columns.
Aaron Marcuse-Kubitza

10/09/2014

12:34 AM Revision 14804: added inputs/CVS/verify/Review of CVS data in BIEN3-RKP2014Sept7-Revised.docx from Bob
Aaron Marcuse-Kubitza

10/07/2014

12:01 AM Revision 14803: bugfix: lib/tnrs.py: encode_map: also need to encode + because TNRS removes it from the morphospecies (vegpath.org/wiki/CVS_validation#Bobs-revised-document > issue #4)
Aaron Marcuse-Kubitza

10/06/2014

11:35 PM Revision 14802: /README.TXT: To re-run geoscrubbing: also need to `unset TMOUT` because TMOUT causes shell to exit even with background processes
Aaron Marcuse-Kubitza

10/03/2014

05:56 PM Revision 14801: config/dev_machine/com.apple.PowerManagement.plist: UPSShutdownAtLevel: decreased to 5% to allow working longer on UPS power
Aaron Marcuse-Kubitza
05:53 PM Revision 14800: config/dev_machine/com.apple.PowerManagement.plist: UPSShutdownAtMinutesLeft: decreased to 3 min to allow working longer on UPS power
Aaron Marcuse-Kubitza
05:36 PM Revision 14799: bugfix: inputs/CVS/plot_/postprocess.sql: locality: site_name should come before directions_to_place because it is at a higher level of granularity
Aaron Marcuse-Kubitza
05:08 PM Revision 14798: /README.TXT: To re-run geoscrubbing: `rm=1 inputs/.geoscrub/run`: should just need to reinstall the geoscrub_output table
Aaron Marcuse-Kubitza
05:06 PM Revision 14797: schemas/public_.sql: geoscrub_input_view_modify(): add unique constraint on the same columns as geoscrub.geoscrub_output, as a sanity check to assist future debugging
Aaron Marcuse-Kubitza
04:57 PM Revision 14796: bugfix: schemas/postgresql.conf: need to set extra_float_digits = 3 (the maximum) to enable verbatim export. this should fix issue #955.
Aaron Marcuse-Kubitza
12:37 PM Revision 14795: added inputs/CVS/verify/Review of CVS data in BIEN3-RKP2014Sept7.docx from Bob
Aaron Marcuse-Kubitza
08:18 AM Revision 14794: added config/dev_machine/com.apple.PowerManagement.plist from /Library/Preferences/SystemConfiguration/com.apple.PowerManagement.plist , so that this file can be easily restored when the system spuriously resets settings in it
Aaron Marcuse-Kubitza

10/02/2014

09:42 PM Revision 14793: /README.TXT: To re-run geoscrubbing: updated runtimes. note that these are faster on the new hardware.
Aaron Marcuse-Kubitza

10/01/2014

09:51 PM Revision 14792: fix: /README.TXT: To re-run geoscrubbing: `rm=1 inputs/.geoscrub/geoscrub_output/geoscrub.csv.run`: use a subshell to avoid closing screen on errexit
Aaron Marcuse-Kubitza
09:39 PM Revision 14791: fix: /README.TXT: Single datasource refresh: also back up DB after this
Aaron Marcuse-Kubitza
09:38 PM Revision 14790: /README.TXT: datasource removal: documented bien2_traits runtime
Aaron Marcuse-Kubitza
09:35 PM Revision 14789: added inputs/bien2_traits/_no_import since bien2_traits has been replaced by Cyrille_traits
Aaron Marcuse-Kubitza
09:32 PM Revision 14788: /README.TXT: added datasource removal instructions
Aaron Marcuse-Kubitza
09:22 PM Revision 14787: fix: /README.TXT: Single datasource refresh: place updated extract: generalized datasrc name
Aaron Marcuse-Kubitza

09/30/2014

07:45 AM Revision 14786: added inputs/Cyrille_traits/
Aaron Marcuse-Kubitza
07:36 AM Revision 14785: lib/sql_io.py: null_strs: added N/A and NA (this will remove a common abbr for North America, but we don't use the continent, so this is OK)
Aaron Marcuse-Kubitza
05:04 AM Revision 14784: mappings/VegCore.htm: regenerated from wiki. made verbatimLocality a synonym of locality since they are used to store the same data.
Aaron Marcuse-Kubitza
03:25 AM Revision 14783: bugfix: schemas/util.sql: col_rename(): also need to run util.name_truncate() on the names used in the "don't try to rename to itself" comparison
Aaron Marcuse-Kubitza
01:54 AM Revision 14782: fix: schemas/util.sql: col_rename(): don't try to rename a column to itself (this will cause an error)
Aaron Marcuse-Kubitza
01:22 AM Revision 14781: schemas/util.sql: set_col_names(): use util.col_rename() so that all renames uses this function
Aaron Marcuse-Kubitza
12:54 AM Revision 14780: schemas/util.sql: added col_rename()
Aaron Marcuse-Kubitza
12:02 AM Revision 14779: schemas/util.sql: added quote_ident() wrapper
Aaron Marcuse-Kubitza
12:01 AM Revision 14778: schemas/util.sql: added name_truncate()
Aaron Marcuse-Kubitza

09/26/2014

10:57 PM Revision 14777: fix: inputs/input.Makefile: $(nonHeaderSrcs): updated to exclude new header.txt
Aaron Marcuse-Kubitza
10:21 PM Revision 14776: lib/runscripts/table.run: added check_headers()
Aaron Marcuse-Kubitza
10:21 PM Revision 14775: bugfix: lib/runscripts/table.run: @srcs: missing [@]
Aaron Marcuse-Kubitza
10:08 PM Revision 14774: lib/runscripts/table.run: added header() and use it in header.txt()
Aaron Marcuse-Kubitza
09:50 PM Revision 14773: lib/runscripts/table.run: 1st_src(): use a variable for this instead, to avoid needing to run this function each time it's used, and to make @srcs available
Aaron Marcuse-Kubitza
09:22 PM Revision 14772: lib/sh/util.sh: wildcard.(): clarified that it only removes . .. when at then beginning of the list
Aaron Marcuse-Kubitza
07:10 PM Revision 14771: fix: schemas/public_.sql: view_full_occurrence_individual_view: materialize time: updated revision
Aaron Marcuse-Kubitza
06:45 PM Revision 14770: schemas/public_.sql: view_full_occurrence_individual_view: materialize time: updated (2 days)
Aaron Marcuse-Kubitza
06:32 PM Revision 14769: web/links/index.htm: updated to Firefox bookmarks: added bash shellshock links. LibreOffice: added steps to convert files from the command line.
Aaron Marcuse-Kubitza
02:31 AM Revision 14768: lib/runscripts/table.run: added header.txt()
Aaron Marcuse-Kubitza
02:31 AM Revision 14767: lib/runscripts/table.run: added 1st_src()
Aaron Marcuse-Kubitza
02:30 AM Revision 14766: inputs/input.Makefile: added %/list_srcs
Aaron Marcuse-Kubitza
02:30 AM Revision 14765: lib/runscripts/subdir.run: subdir_make(): use new $datasrc_dir
Aaron Marcuse-Kubitza
02:29 AM Revision 14764: lib/runscripts/subdir.run: added $datasrc_dir
Aaron Marcuse-Kubitza
02:29 AM Revision 14763: lib/sh/make.sh: make(): added support for $output_data mode which uses --silent
Aaron Marcuse-Kubitza
12:36 AM Revision 14762: fix: lib/sh/util.sh: already_exists_msg(): changed calling convention to avoid it seeming like `return 0` is run if already_exists_msg() throws an error, when in fact already_exists_msg() is just a command that should be run before returning/errexiting
Aaron Marcuse-Kubitza

09/25/2014

04:28 PM Revision 14761: fix: inputs/input.Makefile: need to escape $ in commands, including inside comments
Aaron Marcuse-Kubitza
03:28 PM Revision 14760: bugfix: lib/common.Makefile: $(wildcard/): need final pass with $(wildcard) to support inputs without wildcard chars
Aaron Marcuse-Kubitza
03:15 PM Revision 14759: bugfix: inputs/input.Makefile: `$(call add*,$(svnFiles))` must be invoked externally to clear the $(wildcard) cache before expanding $(svnFiles)
Aaron Marcuse-Kubitza
02:48 AM Revision 14758: /README.TXT: Installation: added instructions for inputs/download/live prompts
Aaron Marcuse-Kubitza
02:44 AM Revision 14757: /README.TXT: Installation: added instructions for MySQL installation prompts
Aaron Marcuse-Kubitza
02:18 AM Revision 14756: fix: /README.TXT: Installation: "Are you sure you want to continue connecting" prompt comes before "aaronmk@jupiter's password" prompt
Aaron Marcuse-Kubitza
02:13 AM Revision 14755: /Makefile: phppgadmin-Linux: removed no longer needed $(editApacheConfForPhppgadmin), as phpPgAdmin no longer uses this file (/etc/phppgadmin/apache.conf)
Aaron Marcuse-Kubitza
02:12 AM Revision 14754: /Makefile: phppgadmin-Linux: removed no longer needed $(editPhppgadminApacheConf)
Aaron Marcuse-Kubitza
01:58 AM Revision 14753: /Makefile: misc-Linux: added htop
Aaron Marcuse-Kubitza
01:58 AM Revision 14752: /Makefile: misc-Linux: added jedit
Aaron Marcuse-Kubitza
01:50 AM Revision 14751: /Makefile: postgres-Linux: added pgadmin3
Aaron Marcuse-Kubitza
01:45 AM Revision 14750: bugfix: /Makefile: $(postgresReload-*) calls: do not prepend $(MAKE) or - because these are multi-command functions
Aaron Marcuse-Kubitza
01:36 AM Revision 14749: bugfix: /Makefile: $(bien*Password): need to use = instead of := because these files are not available until config/download/live has run
Aaron Marcuse-Kubitza

09/24/2014

11:53 PM Revision 14748: fix: /README.TXT: Installation: added instructions for "aaronmk@jupiter's password" prompt
Aaron Marcuse-Kubitza
11:49 PM Revision 14747: /README.TXT: Installation: added step to open a terminal window
Aaron Marcuse-Kubitza
11:48 PM Revision 14746: fix: /README.TXT: Installation: added instructions for "Are you sure you want to continue connecting" prompt
Aaron Marcuse-Kubitza
11:34 PM Revision 14745: inputs/VegBank/run*.log: updated. this adds the function call context in addition to the function location.
Aaron Marcuse-Kubitza
11:28 PM Revision 14744: bugfix: /Makefile: $(uutils_install): need to exit after printing instructions instead of continuing
Aaron Marcuse-Kubitza
11:13 PM Revision 14743: fix: /README.TXT: Installation: need instructions for "reload PATH" prompt
Aaron Marcuse-Kubitza
11:10 PM Revision 14742: fix: /README.TXT: Installation: `apt-get install subversion`: need --yes
Aaron Marcuse-Kubitza
10:58 PM Revision 14741: bugfix: /Makefile: bin/install: uutils: need to reopen terminal window before can proceed with other installation steps
Aaron Marcuse-Kubitza
09:04 PM Revision 14740: /Makefile: python-Linux: removed no longer used installation of pp (Parallel Python). we use Python's multiprocessing package instead.
Aaron Marcuse-Kubitza
07:57 PM Revision 14739: bugfix: /Makefile: install: must be config/download/live, not config/download
Aaron Marcuse-Kubitza
07:52 PM Revision 14738: README.TXT: bin/sync_upload calls as root: don't need to set $USER because this is now set to the correct value in bin/sync_upload's scripts
Aaron Marcuse-Kubitza
07:50 PM Revision 14737: bugfix: lib/sh/local.sh: $sync_remote_url: jupiter user is always aaronmk, not the local user
Aaron Marcuse-Kubitza
07:41 PM Revision 14736: *{.sh,run}: use standard **WARNING** syntax for warning labels
Aaron Marcuse-Kubitza
07:32 PM Revision 14735: bugfix: /Makefile: bin/install: also need to install uutils
Aaron Marcuse-Kubitza
07:26 PM Revision 14734: *{.sh,run}: use standard **WARNING** syntax for warning labels
Aaron Marcuse-Kubitza
07:25 PM Revision 14733: fix: lib/sh/util.sh: verbosity_compat(): documented that this should not be run until right before executing an external command, so that it doesn't mess up the logging mechanism
Aaron Marcuse-Kubitza
07:23 PM Revision 14732: bugfix: bin/make: don't run verbosity_compat until right before executing the external command, so that it doesn't mess up the logging mechanism. this is run automatically by command(), so there is no need to do anything here. note that logging bugs like these can now be troubleshooted much more easily with pst() to narrow down which functions could be causing the problem.
Aaron Marcuse-Kubitza
06:55 PM Revision 14731: bugfix: lib/sh/util.sh: functions called by pst(): commented out/removed logging calls that would have caused infinite recursion when pst()'ing a logging function
Aaron Marcuse-Kubitza
06:38 PM Revision 14730: lib/sh/util.sh: echo_func(): get call context before wrapper(s), which is more useful for debugging. this uses skip_stack_frames()'s lookahead=1 mode.
Aaron Marcuse-Kubitza
06:37 PM Revision 14729: fix: lib/sh/util.sh: skip_stack_frames() callers: updated for new skip_stack_frames rather than get_stack_frame behavior
Aaron Marcuse-Kubitza
06:32 PM Revision 14728: lib/sh/util.sh: skip_stack_frames(): added lookahead support, which looks at entry *after* current to deterine whether to skip current. this is useful for skipping wrappers, by looking at the *calling* function's name.
Aaron Marcuse-Kubitza
06:30 PM Revision 14727: fix: lib/sh/util.sh: skip_stack_frames(): for new skip_stack_frames rather than get_stack_frame behavior, stack frames must be skipped in the caller to preserve the stack frame pointer
Aaron Marcuse-Kubitza
06:26 PM Revision 14726: lib/sh/util.sh: get_stack_frame_after(): renamed to skip_stack_frames() for clarity
Aaron Marcuse-Kubitza
06:25 PM Revision 14725: lib/sh/util.sh: added skip_stack_frame_in_caller, unskip_stack_frame_in_caller
Aaron Marcuse-Kubitza
06:24 PM Revision 14724: lib/sh/util.sh: added prev_stack_frame
Aaron Marcuse-Kubitza
07:04 AM Revision 14723: lib/sh/util.sh: echo_func(): use new format_stack_frame, which adds call context information to what was provided by func_loc
Aaron Marcuse-Kubitza
07:02 AM Revision 14722: fix: lib/sh/util.sh: format_stack_frame(): need to hide canon_rel_path() info using log+
Aaron Marcuse-Kubitza
07:01 AM Revision 14721: lib/sh/util.sh: added get_stack_frame_after()
Aaron Marcuse-Kubitza
06:59 AM Revision 14720: lib/sh/util.sh: added matches()
Aaron Marcuse-Kubitza
06:58 AM Revision 14719: lib/sh/util.sh: next_stack_frame: documented usage
Aaron Marcuse-Kubitza
04:24 AM Revision 14718: fix: lib/runscripts/util.run: runscript template: all(): moved example commands to target(), where they would more likely be located
Aaron Marcuse-Kubitza
02:35 AM Revision 14717: lib/sh/util.sh: format_stack_frame(): support including args
Aaron Marcuse-Kubitza
12:08 AM Revision 14716: lib/sh/util.sh: debugging: added pst() (print_stack_trace)
Aaron Marcuse-Kubitza
12:05 AM Revision 14715: lib/sh/util.sh: added stack_trace(), print_stack_trace()
Aaron Marcuse-Kubitza
12:04 AM Revision 14714: lib/sh/util.sh: added format_stack_frame()
Aaron Marcuse-Kubitza
12:03 AM Revision 14713: lib/sh/util.sh: added get_stack_frame() and helpers
Aaron Marcuse-Kubitza

09/23/2014

10:29 PM Revision 14712: lib/sh/util.sh: terminal: moved before errors so it can be used by it
Aaron Marcuse-Kubitza
10:25 PM Revision 14711: lib/sh/util.sh: errors, debugging: moved after datatype sections so their functions can use these
Aaron Marcuse-Kubitza

09/22/2014

05:45 PM Revision 14710: bugfix: lib/sh/util.sh: canon_rel_path() stub: proper no-op requires passing through original path
Aaron Marcuse-Kubitza
05:42 PM Revision 14709: lib/sh/util.sh: canon_rel_path(): fall back to original path if can't resolve, instead of errexiting
Aaron Marcuse-Kubitza
05:39 PM Revision 14708: bugfix: lib/sh/util.sh: canon_rel_path(): don't re-localize $path because this clears it
Aaron Marcuse-Kubitza
05:36 PM Revision 14707: lib/sh/util.sh: canon_rel_path(): import $1 to $path before function body, so that the function body can be moved to a nested function
Aaron Marcuse-Kubitza
03:48 PM Revision 14706: lib/sh/util.sh: added canon_rel_path() stub for use by debugging functions
Aaron Marcuse-Kubitza
03:39 PM Revision 14705: bugfix: /Makefile: install: run bin/install first since config/download depends on it
Aaron Marcuse-Kubitza
03:36 PM Revision 14704: lib/sh/util.sh: moved func_loc() to before debugging section so it can be used by debugging functions
Aaron Marcuse-Kubitza

09/20/2014

02:34 PM Revision 14703: bugfix: lib/sh/util.sh: command__exec(): need to restore $verbosity before calling die_e
Aaron Marcuse-Kubitza

09/19/2014

03:51 PM Revision 14702: bugfix: /Makefile: install: also need to run config/download to get the necessary passwords
Aaron Marcuse-Kubitza
03:43 PM Revision 14701: config/Makefile: added download target
Aaron Marcuse-Kubitza
03:11 PM Revision 14700: /Makefile: config: renamed to bin/install because config is the name of a directory
Aaron Marcuse-Kubitza
02:53 PM Revision 14699: /README.TXT: Installation: `make install`: added instructions for what to do at each prompt
Aaron Marcuse-Kubitza
02:25 PM Revision 14698: /README.TXT: Installation: Check out svn: need to install svn first as this does not come preinstalled on Ubuntu
Aaron Marcuse-Kubitza

09/18/2014

04:57 PM Revision 14697: fix: inputs/.geoscrub/geoscrub_output/geoscrub.csv.run: make(): added warning that this will truncate the geoscrub database tables
Aaron Marcuse-Kubitza

09/16/2014

05:35 PM Revision 14696: /README.TXT: to back up the local machine's hard drive: just do a single pass, to avoid the numerous different steps
Aaron Marcuse-Kubitza
05:25 PM Revision 14695: backups/*retention_policy*: on jupiter: changed to avoid retaining backups further back, as these consume significant disk space on jupiter and are not useful for anything
Aaron Marcuse-Kubitza
04:25 PM Revision 14694: fix: lib/sh/local.sh: $sync_remote_url: need $USER so user can be overridden when running as root
Aaron Marcuse-Kubitza
04:07 PM Revision 14693: fix: /README.TXT: to back up the local machine's settings: to jupiter: need `sudo -E` for new Documents/BIEN/vegbiendev*/
Aaron Marcuse-Kubitza
03:47 PM Revision 14692: /README.TXT: backups of ~/.dropbox/: just pause and resume Dropbox instead of quitting and restarting it
Aaron Marcuse-Kubitza
03:40 PM Revision 14691: /README.TXT: to back up the local machine's settings: to Dropbox: exclude gmvault-db/ to save space in Dropbox
Aaron Marcuse-Kubitza
03:36 PM Revision 14690: /README.TXT: to back up the local machine's settings: don't need to exclude ~/Library/Thunderbird/Profiles/9oo8rcyn.default/global-messages-db.sqlite because the disk that was corrupting this file has been replaced (#907)
Aaron Marcuse-Kubitza
03:33 PM Revision 14689: /README.TXT: to back up e-mails: don't need to also sync aaronmk@nceas.ucsb.edu because these e-mails are also in aaronmk.nceas@gmail.com (auto-forwarded)
Aaron Marcuse-Kubitza
03:16 PM Revision 14688: /README.TXT: Notes on system stability: removed no longer applicable warning about system upgrades, which is now incorrect because the disk space overrun bug (#887) was found *not* to have been caused by a system upgrade
Aaron Marcuse-Kubitza
02:57 PM Revision 14687: web/links/index.htm: updated to Firefox bookmarks: Roundtable: added links for Roundtable on "obstacles faced by researchers who reuse, share and manage data, and strategies for overcoming them"
Aaron Marcuse-Kubitza
02:46 PM Revision 14686: lib/Firefox_bookmarks.reformat.csv: label page's self-description as such: also support quotations enclosed in '
Aaron Marcuse-Kubitza
 

Also available in: Atom