Project

General

Profile

# Date Author Comment
13571 05/31/2014 08:03 PM Aaron Marcuse-Kubitza

schemas/Makefile: added back rename/%, which is used by `inputs/.TNRS/data.sql.run refresh`. updated it to use schema bundles.

13476 05/18/2014 11:48 PM Aaron Marcuse-Kubitza

schemas/Makefile: added vegbien/install, vegbien/uninstall which also handle TNRS

13475 05/17/2014 06:26 PM Aaron Marcuse-Kubitza

fix: schemas/Makefile: vegbien.sql: also remake inputs/.TNRS/schema.sql since its contents change along with vegbien.sql

13438 05/13/2014 02:53 AM Aaron Marcuse-Kubitza

schemas/Makefile: vegbien.sql: exclude the same set of Source tables excluded by inputs/.TNRS/schema.sql, so that reinstalling TNRS doesn't change the contents of this file

13420 05/09/2014 01:35 AM Aaron Marcuse-Kubitza

bugfix: schemas/Makefile: `%/install: public_.sql`: also need to replace `public` when preceded by ( , as it is in the validations queries

13154 04/17/2014 02:39 AM Aaron Marcuse-Kubitza

schemas/Makefile: vegbien.sql: also include geoscrub, TNRS schemas, as requested in the 2014-04-10 conference call (wiki.vegpath.org/2014-04-10_conference_call#VegBIEN-schema). this involves having a separate public_.sql file for restoring the public schema.

12600 03/06/2014 02:18 AM Aaron Marcuse-Kubitza

bugfix: schemas/Makefile: `%/install: vegbien.sql`: also need to match `public_validations` when used as a schema-qualifier (public_validations._), and after a cast (::) to a schema-qualified type. these occur in schema-qualified casts to the custom return type in the keys() functions.

12599 03/06/2014 01:59 AM Aaron Marcuse-Kubitza

bugfix: schemas/Makefile: `%/install: vegbien.sql`: sed expr: need to use '' instead of "" because $(*q) may contain "

12543 02/28/2014 07:56 PM Aaron Marcuse-Kubitza

bugfix: schemas/Makefile: `%/install: vegbien.sql`: don't enclose public_validations in "" because this causes a comment that says to search for `SET search_path = public_validations, pg_catalog;` to become mangled

12541 02/28/2014 07:34 PM Aaron Marcuse-Kubitza

fix: schemas/Makefile: moved comment about publishing a schema to %/publish

12146 02/08/2014 10:33 PM Aaron Marcuse-Kubitza

schemas/Makefile: vegbien.sql: support auxiliary schemas besides *_validation

12145 02/08/2014 10:03 PM Aaron Marcuse-Kubitza

fix: schemas/Makefile: %/publish: removed no longer applicable instructions about running `make schemas/rotate`. you should not publish a schema until you are satisfied that it can replace the previous public schema, so that the previous public schema doesn't need to be saved.

12143 02/08/2014 09:59 PM Aaron Marcuse-Kubitza

bugfix: schemas/Makefile: "public": dont

12142 02/08/2014 09:37 PM Aaron Marcuse-Kubitza

schemas/Makefile: %/publish: don't ignore errors if schema doesn't exist, because it should always exist if you are publishing it

12141 02/08/2014 09:36 PM Aaron Marcuse-Kubitza

schemas/Makefile: `%/uninstall: vegbien.sql`: use util.schema_bundle_rm() instead of public.rm(), because when the public schema is incompletely imported, public.rm() will not yet exist

12140 02/08/2014 09:34 PM Aaron Marcuse-Kubitza

schemas/Makefile: `%/install: vegbien.sql`: support auxiliary schemas besides *_validation

12139 02/08/2014 09:16 PM Aaron Marcuse-Kubitza

schemas/Makefile: %/uninstall, %/publish: use new public.rm(), publish(), which encapsulate the process of renaming multiple related schemas and also allow additional auxiliary schemas beyond just *_validation

12130 02/07/2014 06:58 PM Aaron Marcuse-Kubitza

bugfix: schemas/Makefile,vegbien.sql: renamed validation to public_validation to match the suffixed name applied by `make schemas/public/install`

12129 02/07/2014 05:58 PM Aaron Marcuse-Kubitza

schemas/Makefile: %/install, %/publish for public schema: added usage

12076 02/07/2014 01:24 AM Aaron Marcuse-Kubitza

schemas/Makefile: removed no longer used rename/%, rotate. use %/install, %/publish instead to manage public schema versions.

12075 02/07/2014 01:22 AM Aaron Marcuse-Kubitza

schemas/Makefile: removed no longer needed public/uninstall, which is handled more generally by `%/uninstall: vegbien.sql` instead

12074 02/07/2014 01:21 AM Aaron Marcuse-Kubitza

schemas/Makefile: `%/uninstall: vegbien.sql`: added support for *_validation schema

12073 02/07/2014 01:16 AM Aaron Marcuse-Kubitza

schemas/Makefile: %/uninstall: split into 2 rules like for %/install, so that different actions can easily be added for the public schema

12072 02/07/2014 01:13 AM Aaron Marcuse-Kubitza

schemas/Makefile: %/publish: support auxiliary *_validation schemas

12071 02/07/2014 01:12 AM Aaron Marcuse-Kubitza

bugfix: schemas/Makefile: `%/install: vegbien.sql`: need -e before each s/// expression

12070 02/06/2014 07:34 PM Aaron Marcuse-Kubitza

schemas/Makefile: `%/install: vegbien.sql`: create a custom _validation schema for *each public schema, rather than one for the most recently-created public schema. this allows validations to continue to be run against a previous version of the DB while a new version is being imported.

12043 02/05/2014 01:16 AM Aaron Marcuse-Kubitza

bugfix: schemas/Makefile: public/uninstall: need to uninstall the validation schema in addition to the public schema (deleting the public schema would only cascade to the contents of the validation schema)

12042 02/05/2014 01:02 AM Aaron Marcuse-Kubitza

schemas/vegbien.sql: added validation schema, which contains queries used in the aggregating validations. schemas/Makefile: include schemas that depend on `public` (eg. `validation`) so they are restored along with it.

12025 02/02/2014 09:30 PM Aaron Marcuse-Kubitza

fix: schemas/Makefile: %/uninstall: don't prompt to delete auxiliary schemas, as these do not contain data

11970 01/20/2014 11:33 AM Aaron Marcuse-Kubitza

moved everything into /trunk/ to create the standard svn layout, for use with tools that require this (eg. git-svn). IMPORTANT: do NOT do an `svn up`. instead, re-use your working copy's existing files with `svn switch` (http://svnbook.red-bean.com/en/1.6/svn.ref.svn.c.switch.html).

11822 12/04/2013 06:56 PM Aaron Marcuse-Kubitza

bugfix: schemas/Makefile: %/uninstall: always confirm before removing an existing schema, not just for public and r*, because an auxiliary schema might also be used as $version and reinstalled by bin/import_all

11793 11/27/2013 10:42 PM Aaron Marcuse-Kubitza

bugfix: schemas/Makefile: $(confirmRmPublicSchema): only prompt to delete the schema if it actually exists. this avoids prompting to remove a non-existent schema at the beginning of bin/import_all, which requires user attention. since bin/import_all is often run with a delayed start (e.g. to wait for a staging table reinstall to complete), the user may not be at the terminal when this message is displayed, and without this fix, the import would be prevented from running until they return.

11550 10/31/2013 10:27 AM Aaron Marcuse-Kubitza

schemas/Makefile: $(confirmRmPublicSchema0): use "any ... schema" instead of "the ... schema" because the schema in question may not exist

10983 09/15/2013 07:25 AM Aaron Marcuse-Kubitza

bugfix: schemas/Makefile: `%/install: vegbien.sql`: when replacing public with the specified schema name, only perform the replacement if the schema is named something other than public. this prevents text like "public schema" inside comments from being "-escaped.

10883 09/05/2013 04:14 PM Aaron Marcuse-Kubitza

bugfix: schemas/Makefile: enclose schema names in "" so that they won't be lowercased

10882 09/05/2013 03:56 PM Aaron Marcuse-Kubitza

bugfix: schemas/Makefile, lib/common.Makefile: enclose schema names in "" so that they won't be lowercased

10125 07/02/2013 10:57 AM Aaron Marcuse-Kubitza

*Makefile: removed $(psqlOpts), $(psqlAsAdmin), which are now set by lib/common.Makefile

10119 07/02/2013 10:29 AM Aaron Marcuse-Kubitza

*Makefile: removed $(asAdmin), which is now set by lib/common.Makefile

8183 03/27/2013 12:43 PM Aaron Marcuse-Kubitza

schemas/*functions.sql: Renamed to *util.sql because now that these schemas are used by the new-style import scripts, there can be more than just functions in them

7093 01/07/2013 04:47 PM Aaron Marcuse-Kubitza

schemas/Makefile: DDL generation: vegbien.sql: Unset $dump_opts so that pg_dump does not use env vars left after running import_all

7092 01/07/2013 04:44 PM Aaron Marcuse-Kubitza

schemas/Makefile: DDL generation: vegbien.sql: Unset $version so that pg_dump always uses the public schema, even after running import_all

6986 12/20/2012 12:13 PM Aaron Marcuse-Kubitza

schemas/Makefile: %/publish: Fixed bug where commands were not being run transactionally, because --single-transaction requires `--file -` to work properly

6982 12/20/2012 11:21 AM Aaron Marcuse-Kubitza

schemas/Makefile: Use $* instead of $(@D) for clarity. $(@D) is only needed when the dir part of the target includes a prefix in addition to the % stem.

6979 12/20/2012 10:14 AM Aaron Marcuse-Kubitza

schemas/Makefile: Fixed bug where need `SHELL := /bin/bash` for \$(confirmRmPublicSchema) to work correctly

6963 12/19/2012 02:02 PM Aaron Marcuse-Kubitza

schemas/Makefile: Installation: %/publish: Fixed bug where need quotes around source schema name

6955 12/19/2012 01:32 PM Aaron Marcuse-Kubitza

schemas/Makefile: Installation: py_functions/install: Removed `env public=`, which is not needed since $(psqlAsAdminVegbien) does not use psql_script_vegbien (which uses $public)

6952 12/19/2012 01:15 PM Aaron Marcuse-Kubitza

schemas/Makefile: Installation: $(schemas), $(schemasReversed) (used e.g. by `make schemas/reinstall`): Removed public so that when `make schemas/reinstall` is run before an import, it will not remove any active (published) import which resides in the public schema

6945 12/19/2012 12:25 PM Aaron Marcuse-Kubitza

schemas/Makefile: %/publish: Added instruction to run `unset version` after the command, to clear the $version shell variable which will be set by import_all

6936 12/19/2012 11:11 AM Aaron Marcuse-Kubitza

schemas/Makefile: Installation: rotate: Use just the version, without the "public." prefix

6935 12/19/2012 11:04 AM Aaron Marcuse-Kubitza

schemas/Makefile: Installation: `public/install public%/install`: Generalized to /install to allow public schema versions with any name. This requires moving `/install: %.sql` before it to override it.

6934 12/19/2012 11:00 AM Aaron Marcuse-Kubitza

schemas/Makefile: Installation: Merged public/install and public%/install

6933 12/19/2012 10:54 AM Aaron Marcuse-Kubitza

schemas/Makefile: Installation: Moved %/uninstall to beginning of section because it applies to all schemas

6932 12/19/2012 10:52 AM Aaron Marcuse-Kubitza

schemas/Makefile: Installation: public: Generalized public%/publish to %/publish so that public schema versions don't have to start with public_

6931 12/19/2012 10:34 AM Aaron Marcuse-Kubitza

schemas/Makefile: Installation: %/uninstall: Also display schema delete confirmation for schemas whose name is just the version suffix (r<revision #>)

6930 12/19/2012 10:32 AM Aaron Marcuse-Kubitza

schemas/Makefile: Merged public%/uninstall and %/uninstall

6928 12/19/2012 09:36 AM Aaron Marcuse-Kubitza

schemas/Makefile: Installation: public: public%/uninstall: Fixed bug where need to remove the specified version of the public schema, not public itself. Generalized $(confirmRmPublicSchema) so it could also be used for named versions of the public schema. Inlined $(rmPublicSchema) since it's now only used in one place.

6926 12/19/2012 09:25 AM Aaron Marcuse-Kubitza

schemas/Makefile: public%/install: schema comment: Include current date/time after version

6922 12/19/2012 08:51 AM Aaron Marcuse-Kubitza

schemas/Makefile: Installation: public: Added public%/publish to replace the current public schema with the given version

6921 12/19/2012 08:37 AM Aaron Marcuse-Kubitza

schemas/Makefile: Installation: public: public/uninstall: Added public%/uninstall as a target to allow uninstalling versions of the public schema

6920 12/19/2012 08:30 AM Aaron Marcuse-Kubitza

schemas/Makefile: Installation: public: public%/install: Add a comment on the schema containing the versioned schema name, so that if the schema is later renamed to just public (i.e. "published" as the current version), it will still be possible to tell which version the public schema came from

6919 12/19/2012 08:22 AM Aaron Marcuse-Kubitza

schemas/Makefile: Installation: public: Added public%/install, to install a version of the public schema

6918 12/19/2012 07:59 AM Aaron Marcuse-Kubitza

schemas/Makefile: Removed unused $(os)

6917 12/19/2012 07:58 AM Aaron Marcuse-Kubitza

schemas/Makefile: Removed unused $(SED)

6916 12/19/2012 06:22 AM Aaron Marcuse-Kubitza

Moved schemas-related commands from root Makefile to schemas/Makefile

6912 12/19/2012 05:50 AM Aaron Marcuse-Kubitza

schemas/Makefile: Include lib/common.Makefile

6029 11/06/2012 01:49 PM Aaron Marcuse-Kubitza

schemas/Makefile: DDLs: $(pg_dump): Turn off schema-only mode so that lookup table contents are included as well

4397 08/31/2012 08:32 PM Aaron Marcuse-Kubitza

schemas/Makefile: Removed no longer needed analytical_db, which has been replaced by bin/make_analytical_db

4394 08/31/2012 08:22 PM Aaron Marcuse-Kubitza

schemas/Makefile: Analytical DB: analytical_db: Time the creation of the analytical DB

4392 08/31/2012 08:15 PM Aaron Marcuse-Kubitza

schemas/Makefile: Added analytical_db target

2979 06/20/2012 08:04 PM Aaron Marcuse-Kubitza

schemas: Moved *.sql.make into Makefile to take advantage of % pattern matching

2978 06/20/2012 07:47 PM Aaron Marcuse-Kubitza

Removed no longer used schemas/vegbien_empty.sql

2620 06/05/2012 09:52 AM Aaron Marcuse-Kubitza

schemas/Makefile, py_functions.sql.make: Generate py_functions.sql from vegbien's py_functions schema

2094 05/07/2012 06:45 PM Aaron Marcuse-Kubitza

Added autogen schemas/functions.sql

1354 03/11/2012 04:17 PM Aaron Marcuse-Kubitza

Makefiles: Added .DELETE_ON_ERROR to delete target if recipe fails

1274 03/05/2012 02:38 PM Aaron Marcuse-Kubitza

Makefiles: Moved remake into main Makefile. Fixed remake to run `make all` in a new make so that cache of existing files is reset. Have main remake run clean and then all instead of forwarding remake to subdirs, so that everything is cleaned before everything is remade.

1260 03/05/2012 11:40 AM Aaron Marcuse-Kubitza

Makefiles: Use .SECONDARY with no prerequisites instead of setting a .PRECIOUS for each intermediate, to simplify turning off automatic deletion of intermediate files

809 02/03/2012 05:24 PM Aaron Marcuse-Kubitza

Added schemas/filter_ERD.csv and use it when generating vegbien.my.sql

785 01/31/2012 06:58 PM Aaron Marcuse-Kubitza

Makefiles: Added documentation labels to each section

692 01/28/2012 12:56 PM Aaron Marcuse-Kubitza

schemas/Makefile: Don't generate for_ERD DDLs because the ERD is now synced with the full schema

689 01/28/2012 12:44 PM Aaron Marcuse-Kubitza

schemas/Makefile: Generate MySQL version of vegbien.sql as well as vegbien.for_ERD.sql for eventual use in syncing the ERD with the whole schema

541 01/19/2012 04:12 PM Aaron Marcuse-Kubitza

Create schemas/vegbien.for_wiki.sql from schemas/vegbien.for_ERD.sql

538 01/19/2012 03:51 PM Aaron Marcuse-Kubitza

Removed no longer needed schemas/vegbien.my.sql

536 01/19/2012 01:34 PM Aaron Marcuse-Kubitza

Added schemas/vegbien.for_ERD.sql and generated MySQL

533 01/19/2012 01:22 PM Aaron Marcuse-Kubitza

Generate MySQL DDL schemas/vegbien.my.sql from vegbien.sql

423 01/09/2012 04:21 PM Aaron Marcuse-Kubitza

Makefiles: Added remake target to run clean and all

418 01/09/2012 02:47 PM Aaron Marcuse-Kubitza

Makefiles: Added empty rules for targets without a rule so that these rules wouldn't trigger the recursive subdir invocation for the default target

387 01/06/2012 12:34 PM Aaron Marcuse-Kubitza

Moved mappings/schemas to schemas