Project

General

Profile

Statistics
| Revision:
Name Size Revision Age Author Comment
  BIEN2 12779 over 10 years Aaron Marcuse-Kubitza *{.sh,run}: use new begin_target instead of `ec...
  _archive 11970 almost 11 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
  _license 14301 over 10 years Aaron Marcuse-Kubitza added derived/TNRS/Morphospecies and scope.eml*...
  backups 14817 about 10 years Aaron Marcuse-Kubitza fix: *Makefile: changed line endings to \n so t...
  bin 14732 about 10 years Aaron Marcuse-Kubitza bugfix: bin/make: don't run verbosity_compat un...
  config 14817 about 10 years Aaron Marcuse-Kubitza fix: *Makefile: changed line endings to \n so t...
  derived 14298 over 10 years Aaron Marcuse-Kubitza added derived/TNRS/Morphospecies and scope.eml*...
  downloads 13537 over 10 years Aaron Marcuse-Kubitza added downloads/
  exports 14685 about 10 years Aaron Marcuse-Kubitza fix: exports/native_status_resolver.csv.run: ad...
  inputs 14827 about 10 years Aaron Marcuse-Kubitza bugfix: inputs/input.Makefile: postprocess must...
  issues 12124 almost 11 years Aaron Marcuse-Kubitza **/LICENSE.TXT: corrected "it recommended" to "...
  lib 14826 about 10 years Aaron Marcuse-Kubitza lib/sql_io.py: cleanup_table(): trim(): documen...
  mappings 14817 about 10 years Aaron Marcuse-Kubitza fix: *Makefile: changed line endings to \n so t...
  planning 14678 about 10 years Aaron Marcuse-Kubitza added planning/workflow/staging_tables_installa...
  schemas 14817 about 10 years Aaron Marcuse-Kubitza fix: *Makefile: changed line endings to \n so t...
  validation 13963 over 10 years Aaron Marcuse-Kubitza validation/completeness/BIENDatesPopulated.xlsx...
  web 14815 about 10 years Aaron Marcuse-Kubitza bugfix: web/links/index.htm: updated to Firefox...
  wiki 13787 over 10 years Aaron Marcuse-Kubitza **/LICENSE.TXT: use lowercase when there is a s...
.htaccess 326 Bytes 11970 almost 11 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
.rsync_filter.upload 33 Bytes 11970 almost 11 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
.rsync_ignore 12 Bytes 11970 almost 11 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
LICENSE.TXT 6.17 KB 13787 over 10 years Aaron Marcuse-Kubitza **/LICENSE.TXT: use lowercase when there is a s...
Makefile 12.7 KB 14817 about 10 years Aaron Marcuse-Kubitza fix: *Makefile: changed line endings to \n so t...
README.TXT 39.2 KB 14824 about 10 years Aaron Marcuse-Kubitza /README.TXT: To re-run geoscrubbing: re-create ...
fix_perms 97 Bytes 11970 almost 11 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
map 1001 Bytes 11970 almost 11 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
new_terms.csv 80.2 KB 11970 almost 11 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
run 518 Bytes 12968 over 10 years Aaron Marcuse-Kubitza *{.sh,run}: runscript targets: use begin_target...
unmapped_terms.csv 33 KB 11970 almost 11 years Aaron Marcuse-Kubitza moved everything into /trunk/ to create the sta...
  • svn:ignore: extern

Latest revisions

# Date Author Comment
14827 10/14/2014 02:50 PM Aaron Marcuse-Kubitza

bugfix: inputs/input.Makefile: postprocess must be run after cleanup rather than before because it depends on the cleanup having been performed.

this bug was not previously detected because this is only a problem when refreshing a datasource to data in the same format: this would attempt to run an existing postprocess.sql, out of order, instead of starting with no postprocess.sql as we usually do....

14826 10/14/2014 12:36 PM Aaron Marcuse-Kubitza

lib/sql_io.py: cleanup_table(): trim(): documented that this also converts character varying fields to text

14825 10/14/2014 11:05 AM Aaron Marcuse-Kubitza

bugfix: inputs/input.Makefile: $(dbExports): also need to put data.sql before clean_up.sql, etc. previously, this ordering had to be done by naming clean_up.sql, etc so they would sort after data.sql alphabetically, but it can be confusing to have to remember to do this. this fixes a bug in the CVS refresh where cvs.~.clean_up.sql was being run before data.sql, causing some private columns to have been deleted before the data was imported into the tables, creating a column mismatch error.

14824 10/14/2014 10:34 AM Aaron Marcuse-Kubitza

/README.TXT: To re-run geoscrubbing: re-create public-schema views that were cascadingly deleted: listed which views these currently are

14823 10/14/2014 10:26 AM Aaron Marcuse-Kubitza

/README.TXT: To re-run geoscrubbing: updated runtimes

14822 10/14/2014 10:09 AM Aaron Marcuse-Kubitza

bugfix: lib/sql_io.py: null_strs_str_default: removed "NA" because this is the abbr for a Spanish province (Navarra). this fixes the 2nd bug of #955, geovalidation duplicated rows.

14821 10/14/2014 10:00 AM Aaron Marcuse-Kubitza

lib/sql_io.py: cleanup_table(): debug-print null_strs

14820 10/14/2014 09:56 AM Aaron Marcuse-Kubitza

lib/sql_io.py: null_strs: made it customizable from an env var, since the same list of null_strs doesn't work for all datasources (see #957)

14819 10/14/2014 09:54 AM Aaron Marcuse-Kubitza

inputs/Cyrille_traits/Makefile: set custom $(null_strs) which handles "NA"

14818 10/14/2014 09:49 AM Aaron Marcuse-Kubitza

inputs/input.Makefile: pass make var $(null_strs) to invoked commands so it can be used by lib/sql_io.py

View revisions

Also available in: Atom