Project

General

Profile

Statistics
| Revision:
  • svn:ignore: extern

# Date Author Comment
14408 08/02/2014 07:58 PM Aaron Marcuse-Kubitza

**: updated to use the local machine's new hostname, frenzy

14407 08/02/2014 07:13 PM Aaron Marcuse-Kubitza

lib/sh/util.sh: func_override(), copy_func(): added echo_func to facilitate debugging

14406 08/02/2014 07:12 PM Aaron Marcuse-Kubitza

bugfix: lib/sh/util.sh: stubs: log++ alias also needs to be moved to stub section

14405 08/01/2014 06:31 PM Aaron Marcuse-Kubitza

bugfix: lib/Firefox_bookmarks.reformat.csv: URLs: match only the uppercase tags used by Firefox, not any lowercase tags added by the user

14404 08/01/2014 05:42 PM Aaron Marcuse-Kubitza

fix: lib/Firefox_bookmarks.reformat.csv: page's self-description: updated comment to match regexp

14403 08/01/2014 05:39 PM Aaron Marcuse-Kubitza

bugfix: lib/Firefox_bookmarks.reformat.csv: page's self-description: updated "page's self-description: " prefix to remove

14402 08/01/2014 04:50 PM Aaron Marcuse-Kubitza

web/links/index.htm: updated to Firefox bookmarks: added links for SSD vs. HDD reliability

14401 08/01/2014 04:22 PM Aaron Marcuse-Kubitza

/README.TXT: added steps to restore from Time Machine

14400 08/01/2014 04:15 PM Aaron Marcuse-Kubitza

/README.TXT: added steps to back up the local machine's hard drive

14399 08/01/2014 04:13 PM Aaron Marcuse-Kubitza

/README.TXT: to synchronize a Mac's settings with my testing machine's: renamed to "to back up the local machine's settings"

14398 08/01/2014 04:11 PM Aaron Marcuse-Kubitza

/README.TXT: to synchronize a Mac's settings with my testing machine's: removed download section because we don't use this

14397 08/01/2014 06:01 AM Aaron Marcuse-Kubitza

added backups/vegbien.r14089.backup.md5

14396 08/01/2014 06:01 AM Aaron Marcuse-Kubitza

backups/TNRS.backup.md5: updated

14395 08/01/2014 05:47 AM Aaron Marcuse-Kubitza

bin/after_import: use new bin/make_backups

14394 08/01/2014 05:47 AM Aaron Marcuse-Kubitza

bugfix: bin/make_backups: need to `popd` when done

14393 08/01/2014 05:46 AM Aaron Marcuse-Kubitza

bugfix: bin/make_backups: need to `set +x` when done

14392 08/01/2014 05:44 AM Aaron Marcuse-Kubitza

bin/make_backups: run with initial "." so background processes will be owned by the invoking shell

14391 08/01/2014 04:40 AM Aaron Marcuse-Kubitza

added bin/make_backups

14390 08/01/2014 01:59 AM Aaron Marcuse-Kubitza

web/links/index.htm: updated to Firefox bookmarks: VirtualBox: performance: added that context-switching also imposes an overhead, in addition to sandboxing.

14389 08/01/2014 01:16 AM Aaron Marcuse-Kubitza

web/links/index.htm: updated to Firefox bookmarks: BIEN: added list of machines this has been tested on. VirtualBox: added links to performance considerations of running in a VM.

14388 07/28/2014 11:58 PM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: added new derived columns to derived views

14387 07/28/2014 11:58 PM Aaron Marcuse-Kubitza

fix: schemas/util.sql: view_def_to_orig(): need to support aliased columns (produced when a column is renamed)

14386 07/28/2014 05:59 PM Aaron Marcuse-Kubitza

schemas/util.sql: added aliased_col_re()

14385 07/28/2014 05:57 PM Aaron Marcuse-Kubitza

schemas/util.sql: added alias_re()

14384 07/28/2014 05:50 PM Aaron Marcuse-Kubitza

fix: schemas/util.sql: view_is_subset(): renamed to view_is_subset_or_renaming() because this also supports views that just rename columns, which should not be .*-ed by view_def_to_orig()

14383 07/28/2014 05:33 PM Aaron Marcuse-Kubitza

fix: schemas/util.sql: view_def_to_orig(): can't use FROM to alias util.col_re() because that prevents inlining the function

14382 07/28/2014 05:31 PM Aaron Marcuse-Kubitza

fix: schemas/util.sql: view_def_to_orig(): can't use FROM to alias util.col_re() because that prevents inlining the function

14381 07/28/2014 05:24 PM Aaron Marcuse-Kubitza

schemas/util.sql: view_def_to_orig(): use util.col_re() for clarity

14380 07/28/2014 05:20 PM Aaron Marcuse-Kubitza

schemas/util.sql: added col_re()

14379 07/28/2014 04:45 PM Aaron Marcuse-Kubitza

fix: schemas/util.sql: derived_col_update(): also need steps to drop column, because DROP __ CASCADE doesn't work when there are dependent views

14378 07/28/2014 04:33 PM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: _accepted_infraspecific{rank,epithet}: use array slice of new _accepted{genus,specific_epithet,infra_{rank,epithet}}, which is simpler than using remove_prefix() in __accepted_infraspecific_label

14377 07/28/2014 04:21 PM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: "[accepted_]genus__@DwC__@vegpath.org": don't need to use *Accepted_name anymore because _accepted{genus,specific_epithet,infra_{rank,epithet}} is now generated from *Accepted_name

14376 07/28/2014 04:02 PM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: taxon_match."__accepted_{genus,specific_epithet}": renamed to "__accepted_{genus,specific_epithet,infra_{rank,epithet}}" since this now includes these other ranks as well

14375 07/28/2014 03:48 PM Aaron Marcuse-Kubitza

bugfix: inputs/.TNRS/schema.sql: taxon_match."__accepted_{genus,specific_epithet}": use "*Accepted_name" instead of "Accepted_species[_binomial]__@TNRS__@vegpath.org" (from "*Accepted_name_species") because Accepted_name_species apparently sometimes does not match the Accepted_name and uses malformed Unicode characters

14374 07/28/2014 03:20 PM Aaron Marcuse-Kubitza

backups/README.TXT: added backup retention policy

14373 07/27/2014 03:19 PM Aaron Marcuse-Kubitza

bugfix: schemas/util.sql: derived_cols_export(): also need to first run util.derived_cols_remove() if changing the derived column order

14372 07/27/2014 03:15 PM Aaron Marcuse-Kubitza

schemas/util.sql: added derived_cols_remove(), which allows derived columns to be re-created in a different order

14371 07/27/2014 03:01 PM Aaron Marcuse-Kubitza

schemas/util.sql: added drop_derived_col(), which ensures that drop_column() only cascades to views

14370 07/27/2014 02:54 PM Aaron Marcuse-Kubitza

fix: schemas/util.sql: drop_column(): also need to recreate dependent views

14369 07/27/2014 02:26 PM Aaron Marcuse-Kubitza

schemas/util.sql: added drop_constraint()

14368 07/26/2014 10:16 PM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: taxon_match: `inputs/.TNRS/data.sql.run refresh`: documented runtime (1 min)

14367 07/26/2014 10:15 PM Aaron Marcuse-Kubitza

bugfix: inputs/.TNRS/schema.sql: taxon_match: use "Accepted_species[_binomial]__@TNRS__@vegpath.org" instead of "*Accepted_name_species". this fixes a bug in __accepted_infraspecific_label where Accepted_name_species with trailing whitespace could not be prefix-removed from names that contained just a species binomial.

14366 07/26/2014 09:57 PM Aaron Marcuse-Kubitza

fix: inputs/.TNRS/schema.sql: taxon_match: added derived column "Accepted_species[_binomial]__@TNRS__@vegpath.org", which removes trailing whitespace

14365 07/26/2014 08:58 PM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: added steps to remove a column and to add a non-derived column

14364 07/26/2014 08:48 PM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: taxon_match: to remove columns or add columns at the end: merged into "to add a new derived column"

14363 07/26/2014 08:44 PM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: to add columns in the middle: renamed to "to move a column to the middle" for clarity

14362 07/26/2014 08:38 PM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: to populate a new column: updated to use util.derived_col_update()

14361 07/26/2014 08:24 PM Aaron Marcuse-Kubitza

fix: inputs/.TNRS/schema.sql: taxon_match: to remove columns or add columns: also need to run util.recreate_view()

14360 07/26/2014 08:19 PM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: taxon_match: to remove columns or add columns at the end: don't need to run `rm=1 inputs/.TNRS/data.sql.run` because this is now run by `make schemas/remake`

14359 07/26/2014 08:13 PM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: added new derived columns to derived views

14358 07/26/2014 07:52 PM Aaron Marcuse-Kubitza

schemas/util.sql: remove_prefix(), remove_suffix(): support case-insensitive matching

14357 07/26/2014 07:43 PM Aaron Marcuse-Kubitza

bugfix: inputs/.TNRS/schema.sql: taxon_match.__accepted_infraspecific_label: need to use case-insensitive matching of the removed prefix because TNRS lowercases part of the Accepted_name

14356 07/26/2014 07:40 PM Aaron Marcuse-Kubitza

schemas/util.sql: remove_prefix(), remove_suffix(): support case-insensitive matching

14355 07/26/2014 06:54 PM Aaron Marcuse-Kubitza

schemas/util.sql: remove_prefix(), remove_suffix(): support case-insensitive matching

14354 07/26/2014 06:52 PM Aaron Marcuse-Kubitza

schemas/util.sql: added case-sensitive-optional versions of starts_with(), ends_with()

14353 07/26/2014 06:50 PM Aaron Marcuse-Kubitza

schemas/util.sql: added canon_case(str text, case_sensitive boolean)

14352 07/26/2014 06:36 PM Aaron Marcuse-Kubitza

schemas/util.sql: check_constraint_disable(): documented that we can't use ADD CONSTRAINT NOT VALID for this because it does not disable the constraint completely, but instead causes new rows to be validated against it. the ADD CONSTRAINT NOT VALID behavior does not work for the derived columns use case of this function.

14351 07/26/2014 06:17 PM Aaron Marcuse-Kubitza

schemas/public_.sql: *_view_modify(): added repopulate param, which is passed to rematerialize_view()

14350 07/26/2014 06:14 PM Aaron Marcuse-Kubitza

schemas/util.sql: rematerialize_view(): support updating just the table's schema, without populating it

14349 07/26/2014 05:37 PM Aaron Marcuse-Kubitza

schemas/util.sql: rematerialize_view(): don't need extra eval() around table_mod_sql because recreate() performs eval()

14348 07/26/2014 05:28 PM Aaron Marcuse-Kubitza

lib/sh/sync.sh: db_snapshot(): before backing up, trim bloated temp files (eg. from rolled back changes)

14347 07/26/2014 05:16 PM Aaron Marcuse-Kubitza

bugfix: inputs/.TNRS/schema.sql: taxon_match: use wrapper for util.remove_prefix() so CHECK constraints that use it don't get dropped when the util schema is reinstalled

14346 07/26/2014 04:32 PM Aaron Marcuse-Kubitza

schemas/public_.sql: *_view_modify(): use util.rematerialize_view(), which now supports table mods

14345 07/26/2014 03:47 PM Aaron Marcuse-Kubitza

schemas/util.sql: rematerialize_view(): added support for table mods to run after creating table

14344 07/26/2014 04:53 AM Aaron Marcuse-Kubitza

bugfix: schemas/util.sql: rematerialize_view(): don't populate unless recreate() can successfully recreate the dependent views, to avoid populating the entire table (which for some views can take hours) only to have the changes rolled back by a failing dependent view

14343 07/26/2014 04:42 AM Aaron Marcuse-Kubitza

schemas/util.sql: removed no longer used materialize_view(). use util.copy() instead.

14342 07/26/2014 04:41 AM Aaron Marcuse-Kubitza

schemas/util.sql: rematerialize_view(): call util.copy() directly instead of via util.materialize_view()

14341 07/26/2014 04:35 AM Aaron Marcuse-Kubitza

schemas/util.sql: removed no longer used copy_types_and_data(). use util.materialize_view() instead.

14340 07/26/2014 04:20 AM Aaron Marcuse-Kubitza

schemas/util.sql: to_freq(): use util.copy() instead of util.copy_types_and_data() to avoid a dependency on util.copy_types_and_data()

14339 07/25/2014 09:57 PM Aaron Marcuse-Kubitza

fix: schemas/util.sql: copy_data(): also need to ANALYZE table after loading data into it

14338 07/25/2014 09:13 PM Aaron Marcuse-Kubitza

schemas/public_.sql: analytical_stem_view: use viewFullOccurrence_individual_view to avoid duplicated code between the views. this moves the stem-related columns to the end of the view.

14337 07/25/2014 06:26 PM Aaron Marcuse-Kubitza

schemas/public_.sql: added viewFullOccurrence_individual_view

14336 07/25/2014 06:20 PM Aaron Marcuse-Kubitza

web/username_prefix.php: substitutions: also support "" because Postgres doubles " to escape them

14335 07/25/2014 06:17 PM Aaron Marcuse-Kubitza

web/username_prefix.php: added support for substitutions ( x."_y@url -> x.x_y@url ), which can be used when a table name is repeated in a column name

14334 07/25/2014 06:15 PM Aaron Marcuse-Kubitza

backups/TNRS.backup.md5: updated

14333 07/25/2014 02:31 PM Aaron Marcuse-Kubitza

schemas/util.sql: derived_col_constraint_initially_enabled(): clarified that this is always based on whether the existing constraint is enabled

14332 07/25/2014 02:21 PM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: taxon_match: COMMENT: added steps to port derived column changes to vegbiendev

14331 07/25/2014 02:12 PM Aaron Marcuse-Kubitza

schemas/util.sql: added derived_cols_export(), which creates SQL to port the derived cols to another DB

14330 07/25/2014 12:41 PM Aaron Marcuse-Kubitza

bugfix: inputs/.TNRS/schema.sql: taxon_match: derived columns: use new "matched~Name[_no_author]___@TNRS__@vegpath.org" instead of "*Name_matched" so that "No suitable matches found." is removed before concatenating with other fields

14329 07/25/2014 12:14 PM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: taxon_match: added derived column "matched~Name[_no_author]___@TNRS__@vegpath.org", which removes the "No suitable matches found." string

14328 07/22/2014 06:50 AM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: reordered derived columns in dependency order

14327 07/22/2014 06:46 AM Aaron Marcuse-Kubitza

bugfix: inputs/.TNRS/schema.sql: "[accepted_]morphospecies[_binomial]__@Brad__.TNRS@vegpath.org": need to use "[accepted_]genus__@DwC__@vegpath.org" rather than "*Accepted_name" for this for rank = genus

14326 07/22/2014 06:44 AM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: taxon_match: added derived column "[scrubbed_]morphospecies[_binomial]__@Brad__.TNRS@vegpath.org"

14325 07/22/2014 06:41 AM Aaron Marcuse-Kubitza

bugfix: inputs/.TNRS/schema.sql: "[accepted_]genus__@DwC__@vegpath.org": need to populate this for rank = genus

14324 07/22/2014 05:47 AM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: taxon_match: added derived column "[scrubbed_]taxonomicStatus__@DwC__@vegpath.org"

14323 07/22/2014 05:30 AM Aaron Marcuse-Kubitza

bugfix: inputs/.TNRS/schema.sql: derived columns: use "Accepted_family__@TNRS__@vegpath.org" instead of "*Accepted_name_family" because "*Accepted_name_family" is sometimes missing

14322 07/22/2014 05:24 AM Aaron Marcuse-Kubitza

bugfix: derived_col_constraints_enable(): also need to update col comments, in addition to table__fill_derived()

14321 07/22/2014 04:54 AM Aaron Marcuse-Kubitza

schemas/util.sql: check_constraint_enabled(): made it IMMUTABLE

14320 07/22/2014 04:48 AM Aaron Marcuse-Kubitza

bugfix: schemas/util.sql: derived_col_constraints_enable(): need to update table__fill_derived() w/ formatting changes from enabling constraints

14319 07/22/2014 04:40 AM Aaron Marcuse-Kubitza

bugfix: schemas/util.sql: derived_col_constraints_enable(): need to update table__fill_derived() w/ formatting changes from enabling constraints

14318 07/22/2014 04:12 AM Aaron Marcuse-Kubitza

fix: inputs/.TNRS/schema.sql: taxon_match: added derived column "Accepted_family__@TNRS__@vegpath.org", which is needed because "*Accepted_name_family" isn't always populated

14317 07/22/2014 04:01 AM Aaron Marcuse-Kubitza

bugfix: inputs/.TNRS/schema.sql: taxon_match: to add columns in the middle: also need to run util.derived_cols_repopulate() since the dependency order has changed

14316 07/22/2014 03:57 AM Aaron Marcuse-Kubitza

fix: schemas/util.sql: derived_cols_populate(): documented that this function will sometimes not repopulate columns when needed, such as after changing the column order. in these cases, it is necessary to run util.derived_cols_repopulate() manually.

14315 07/22/2014 03:53 AM Aaron Marcuse-Kubitza

schemas/util.sql: derived_cols_populate(): use new derived_cols_repopulate()

14314 07/22/2014 03:51 AM Aaron Marcuse-Kubitza

schemas/util.sql: added derived_cols_repopulate()

14313 07/22/2014 03:25 AM Aaron Marcuse-Kubitza

fix: inputs/.TNRS/schema.sql: taxon_match: COMMENT: to add columns in the middle: also need to run util.derived_cols_update()

14312 07/22/2014 03:23 AM Aaron Marcuse-Kubitza

fix: inputs/.TNRS/schema.sql: taxon_match: COMMENT: updated util.derived_cols_sync() to util.derived_cols_update()

14311 07/22/2014 03:20 AM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: reordered derived columns in dependency order

14310 07/22/2014 03:12 AM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: reordered derived columns in dependency order

14309 07/22/2014 02:44 AM Aaron Marcuse-Kubitza

bugfix: schemas/util.sql: derived_cols_trigger_update(): need to clear derived cols first so old values won't be used in calculations