Project

General

Profile

Statistics
| Revision:

# Date Author Comment
14366 07/26/2014 09:57 PM Aaron Marcuse-Kubitza

fix: inputs/.TNRS/schema.sql: taxon_match: added derived column "Accepted_species[_binomial]__@TNRS__@vegpath.org", which removes trailing whitespace

14329 07/25/2014 12:14 PM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: taxon_match: added derived column "matched~Name[_no_author]___@TNRS__@vegpath.org", which removes the "No suitable matches found." string

14328 07/22/2014 06:50 AM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: reordered derived columns in dependency order

14318 07/22/2014 04:12 AM Aaron Marcuse-Kubitza

fix: inputs/.TNRS/schema.sql: taxon_match: added derived column "Accepted_family__@TNRS__@vegpath.org", which is needed because "*Accepted_name_family" isn't always populated

14310 07/22/2014 03:12 AM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: reordered derived columns in dependency order

14279 07/21/2014 04:34 PM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: taxon_match: put matched-taxon derived columns before accepted-taxon derived columns

13870 06/26/2014 04:58 AM Aaron Marcuse-Kubitza

inputs/.TNRS/data.sql: refreshed

13867 06/26/2014 04:28 AM Aaron Marcuse-Kubitza

inputs/.TNRS/data.sql: refreshed

13853 06/25/2014 04:28 PM Aaron Marcuse-Kubitza

inputs/.TNRS/data.sql: refreshed

13591 06/02/2014 04:50 AM Aaron Marcuse-Kubitza

lib/tnrs.py: switched to downloading all matches per name, as is needed to implement #917. note that this will break the parts of the schema that use the tnrs table, until Brad's match-picking algorithm can be implemented, but this tradeoff is necessary to be able to begin scrubbing sooner (Martha; wiki.vegpath.org/2014-05-29_conference_call#TNRS)

13590 06/02/2014 04:35 AM Aaron Marcuse-Kubitza

schemas/vegbien.sql: tnrs_input_name: don't scrub accepted names, as using multiple matches per name no longer provides a single accepted name to scrub. instead, the Accepted_* fields can be whitespace-split to generate the same columns that would have been generated by the scrubbing (and without the overhead of the extra TNRS call).

13579 05/31/2014 10:28 PM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: tnrs: populate match_num

13574 05/31/2014 08:11 PM Aaron Marcuse-Kubitza

inputs/test_taxonomic_names/_scrub/*: updated to TNRS schema

12968 03/29/2014 04:06 AM Aaron Marcuse-Kubitza

*{.sh,run}: runscript targets: use begin_target instead of echo_func so the target name is properly echoed. note that this requires using with_rm so that $rm is properly progagated to applicable invoked targets. (previously, $rm was progagated to all invoked targets. note that with_rm only works inside a runscript target that starts with begin_target.)

11970 01/20/2014 11:33 AM Aaron Marcuse-Kubitza

moved everything into /trunk/ to create the standard svn layout, for use with tools that require this (eg. git-svn). IMPORTANT: do NOT do an `svn up`. instead, re-use your working copy's existing files with `svn switch` (http://svnbook.red-bean.com/en/1.6/svn.ref.svn.c.switch.html).

10786 08/27/2013 10:14 PM Aaron Marcuse-Kubitza

inputs/.TNRS/data.sql: re-ran TNRS using `inputs/test_taxonomic_names/test_scrub; rm=1 inputs/.TNRS/data.sql.run export_`

10412 07/25/2013 08:10 AM Aaron Marcuse-Kubitza

inputs/test_taxonomic_names/_scrub/TNRS_results.ppt: highlighted the sample row and related rows

10411 07/25/2013 08:04 AM Aaron Marcuse-Kubitza

inputs/test_taxonomic_names/_scrub/TNRS_results.xls: moved arrows to TNRS_results.ppt so they can be changed more easily

10410 07/25/2013 07:51 AM Aaron Marcuse-Kubitza

inputs/test_taxonomic_names/_scrub/TNRS_results.ppt: TNRS.tnrs: added diagram labels for the various names and steps

10409 07/25/2013 07:32 AM Aaron Marcuse-Kubitza

inputs/test_taxonomic_names/_scrub/TNRS_results.xls: use "Poa annua var. eriolepis"->"Poaceae Poa annua L." as the synonym example instead of "Poa annua fo. lanuginosa"->"Poaceae Poa annua var. annua" because the input name is simpler and it's closer to the beginning of the list

10408 07/25/2013 07:20 AM Aaron Marcuse-Kubitza

inputs/test_taxonomic_names/_scrub/run: exports/make(): tnrs.csv: include Name_matched instead of Genus_matched+Specific_epithet_matched because this also contains lower ranks, which are used in the TNRS synonymizing

10407 07/25/2013 07:06 AM Aaron Marcuse-Kubitza

inputs/test_taxonomic_names/_scrub/TNRS_results.ppt: added annotations explaining the import steps

10406 07/25/2013 06:36 AM Aaron Marcuse-Kubitza

added inputs/test_taxonomic_names/_scrub/TNRS_results.ppt, containing the *.png screenshots with tables labeled

10405 07/25/2013 06:35 AM Aaron Marcuse-Kubitza

added inputs/test_taxonomic_names/_scrub/*.png, screenshots of the TNRS_results.xls tabs (LibreOffice does not preserve the formatting when pasting a spreadsheet to a PowerPoint as a table, and the table editing options are limited)

10404 07/25/2013 06:31 AM Aaron Marcuse-Kubitza

added inputs/test_taxonomic_names/_scrub/TNRS_results.xls with formatted versions of the *.csv tables

10403 07/24/2013 05:15 PM Aaron Marcuse-Kubitza

inputs/test_taxonomic_names/_scrub/run: exports/make(): subset the columns to include only the most important to demo how the data is represented

10399 07/24/2013 04:38 PM Aaron Marcuse-Kubitza

inputs/test_taxonomic_names/_scrub/run: exports/make(): allow specifying an explicit columns list for each table using cols=... (initially set to all columns)

10398 07/24/2013 04:09 PM Aaron Marcuse-Kubitza

added inputs/test_taxonomic_names/_scrub/*.csv exports

10397 07/24/2013 04:09 PM Aaron Marcuse-Kubitza

added inputs/test_taxonomic_names/_scrub/run, which exports the test_scrub-populated tables to CSV

10395 07/24/2013 03:15 PM Aaron Marcuse-Kubitza

reran inputs/test_taxonomic_names/test_scrub, which generates the public.test_taxonomic_names sample schema

9972 06/20/2013 08:03 AM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: tnrs: added Is_homonym derived col (uses IRMNG.family_homonym_epithet, genus_homonym_epithet)

9762 06/06/2013 02:42 PM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql: updated for current TSV schema: renamed Accepted_species->Accepted_name_species, Accepted_family->Accepted_name_family

9529 05/23/2013 03:33 PM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql, data.sql: updated TNRS CSV columns to preserve Name_matched_accepted_family even though it isn't present in the current TNRS CSVs. this way, Name_matched_accepted_family can still be used for previously-scrubbed names, and family_matched can be added back to analytical_stem_view. (now that bin/tnrs_db uses an explicit columns list in COPY TO, the absence of a column in the CSV is no longer a problem.)

9493 05/21/2013 07:37 PM Aaron Marcuse-Kubitza

inputs/.TNRS/schema.sql, data.sql: updated for new TNRS CSV columns (see bug at https://pods.iplantcollaborative.org/jira/browse/TNRS-183). note that these columns may eventually change back (comment by Naim at https://pods.iplantcollaborative.org/jira/browse/TNRS-183#comment-34444).

5917 11/01/2012 05:15 AM Aaron Marcuse-Kubitza

Calls to `make inputs/.TNRS/cleanup`: Do `make inputs/.TNRS/tnrs_accepted/reinstall; make inputs/.TNRS/tnrs_other/reinstall` instead to use new split TNRS tables

5804 10/26/2012 03:44 PM Aaron Marcuse-Kubitza

inputs/test_taxonomic_names/_scrub/public.test_taxonomic_names.sql, TNRS.sql: Regenerated with schema and mappings changes

5742 10/23/2012 11:05 AM Aaron Marcuse-Kubitza

inputs/test_taxonomic_names/_scrub/public.test_taxonomic_names.sql, TNRS.sql: Regenerated with schema and mappings changes

5680 10/19/2012 05:19 PM Aaron Marcuse-Kubitza

inputs/test_taxonomic_names/test_scrub: Fixed bug where public.sql export did not include the "CREATE SCHEMA public" statement, because pg_dump doesn't add it to backups, by using new schemas/rename/% make target to first rename the public schema and then exporting it

5673 10/19/2012 04:23 PM Aaron Marcuse-Kubitza

inputs/test_taxonomic_names/_scrub/public.sql, TNRS.sql: Regenerated with schema changes

5606 10/17/2012 04:01 PM Aaron Marcuse-Kubitza

inputs/test_taxonomic_names/_scrub/public.sql, TNRS.sql: Regenerated with schema changes

5482 10/12/2012 02:41 PM Aaron Marcuse-Kubitza

inputs/test_taxonomic_names/_scrub/public.sql: Regenerated with schema changes

5474 10/12/2012 01:44 PM Aaron Marcuse-Kubitza

inputs/test_taxonomic_names/_scrub/public.sql: Regenerated with schema changes

5468 10/12/2012 12:33 PM Aaron Marcuse-Kubitza

inputs/test_taxonomic_names/_scrub/public.sql: Regenerated with schema changes

5423 10/10/2012 11:22 AM Aaron Marcuse-Kubitza

inputs/test_taxonomic_names/test_scrub: Also export the results to inputs/test_taxonomic_names/_scrub/