Project

General

Profile

# Date Author Comment
14674 09/09/2014 06:43 PM Aaron Marcuse-Kubitza

inputs/Makefile: install: install an empty VegBIEN schema instead of all the datasources, at Mark's request. this enables loading just a single datasource.

11970 01/20/2014 11:33 AM Aaron Marcuse-Kubitza

moved everything into /trunk/ to create the standard svn layout, for use with tools that require this (eg. git-svn). IMPORTANT: do NOT do an `svn up`. instead, re-use your working copy's existing files with `svn switch` (http://svnbook.red-bean.com/en/1.6/svn.ref.svn.c.switch.html).

10026 06/25/2013 01:12 PM Aaron Marcuse-Kubitza

inputs/Makefile: download-logs: use bin/sync_upload like upload/download

10024 06/25/2013 01:00 PM Aaron Marcuse-Kubitza

bugfix: inputs/Makefile: upload, download: need to exclude files in .rsync_ignore, so that large local-only files, such as inputs/GBIF/raw_occurrence_record_plants/table*.tsv, do not have to be synced before `make inputs/upload` can complete (the corresponding .gz gets extracted instead); and deleted temp files in inputs/VegBIEN/TWiki/, such as active sessions, are not added back to the live copy on vegbiendev. previously, fixing this required extracting the rsync command run by `make inputs/upload`, etc. and manually editing it to exclude the applicable .rsync_ignore files, each time `make inputs/upload`, etc. was run (including before every column-based import).

7081 01/07/2013 01:59 PM Aaron Marcuse-Kubitza

lib/common.Makefile: $(subMake): Removed `--makefile=../input.Makefile`, which is specific just to inputs/Makefile

6898 12/18/2012 11:06 PM Aaron Marcuse-Kubitza

inputs/Makefile: Input data: $(rsyncSrcs): Also include log files other than install.log.sql

6290 11/19/2012 03:45 PM Aaron Marcuse-Kubitza

inputs/Makefile: Import logs: $(rsyncLogs): Include log files at any depth in the directory tree rather than just 1-2 levels deep. This adds log files whose containing directories have been moved to _archive/ directories.

6118 11/09/2012 08:20 PM Aaron Marcuse-Kubitza

inputs/Makefile: Input data: $(rsyncLogs): Also include logs from the datasource's top-level logs/ dir, which contains make_analytical_db.log.sql

6051 11/08/2012 01:53 AM Aaron Marcuse-Kubitza

inputs/.TNRS/tnrs/tnrs.make: Moved log file to logs/tnrs.make.log.sql so it would automatically be synced along with the other import logs

6049 11/08/2012 01:40 AM Aaron Marcuse-Kubitza

inputs/Makefile: Import logs: $(rsyncLogs): Always download the TNRS daemon log, rather than requiring tnrs_log=1 to be specified to download it

5809 10/26/2012 04:24 PM Aaron Marcuse-Kubitza

inputs/Makefile: $(rsyncLogs): Use $(rsync) instead of $(rsync*) now that it supports excluding just temp files and .svn rather than all .*

5090 09/28/2012 08:29 AM Aaron Marcuse-Kubitza

inputs/Makefile: Import logs: Don't download .TNRS/tnrs/tnrs.make.log by default because it changes each time `make inputs/.TNRS/tnrs/tnrs-remake` is run, and any version downloaded for debugging should be preserved. It can still be downloaded by setting the tnrs_log env var.

5086 09/28/2012 07:57 AM Aaron Marcuse-Kubitza

inputs/Makefile: Import logs: Also download inputs/.TNRS/tnrs/tnrs.make.log

5085 09/28/2012 07:56 AM Aaron Marcuse-Kubitza

inputs/Makefile: Import logs: Use new $(rsync*) to also sync datasources starting with ., such as .TNRS

4435 09/05/2012 02:05 AM Aaron Marcuse-Kubitza

inputs/Makefile: Input data: $(rsyncSrcs): Also exclude logs subdirs located at more than one level below the root, which occurs for example when a table subdir is moved into _archive/

4182 08/22/2012 03:23 PM Aaron Marcuse-Kubitza

inputs: Move src subdir into main dir, using the steps at <https://projects.nceas.ucsb.edu/nceas/projects/bien/wiki/VegCSV_subfolders#Move-src-subdir-into-main-dir>

4126 08/21/2012 01:10 AM Aaron Marcuse-Kubitza

inputs/Makefile: Input data sync: Updated rsync filter for new subdirs layout

4123 08/21/2012 12:08 AM Aaron Marcuse-Kubitza

inputs/Makefile: Import logs: Fixed bug where excluded install logs needed to be renamed according to the new name format (from <https://projects.nceas.ucsb.edu/nceas/projects/bien/wiki/VegCSV_subfolders#Move-log-files-into-subfolders&gt;)

4122 08/20/2012 11:59 PM Aaron Marcuse-Kubitza

inputs: Moved log files into subfolders, using steps at <https://projects.nceas.ucsb.edu/nceas/projects/bien/wiki/VegCSV_subfolders#Move-log-files-into-subfolders>

3698 07/31/2012 08:46 PM Aaron Marcuse-Kubitza

inputs/Makefile: Added download-logs to download import logs onto local machine and added it to the "After a new import" steps

3697 07/31/2012 08:36 PM Aaron Marcuse-Kubitza

Moved generally useful targets and vars from inputs/Makefile to lib/common.Makefile and lib/forwarding.Makefile

3584 07/24/2012 07:31 AM Aaron Marcuse-Kubitza

inputs/Makefile: Input data: Added upload target

3375 07/13/2012 12:38 PM Aaron Marcuse-Kubitza

inputs/Makefile: Added download to download input data from vegbiendev

1628 03/26/2012 08:06 PM Aaron Marcuse-Kubitza

Makefiles: Let subdir's Makefile decide whether to delete on error

1594 03/24/2012 02:14 PM Aaron Marcuse-Kubitza

input.Makefile: Moved log and trace files to new import subdir. Moved subdir-adding code from inputs/Makefile to input.Makefile.

1591 03/24/2012 01:35 PM Aaron Marcuse-Kubitza

inputs/Makefile: Added %/-add to re-add existing dirs

1590 03/24/2012 01:29 PM Aaron Marcuse-Kubitza

inputs/Makefile: %-add: `svn mkdir` the datasource's standard subdirs

1354 03/11/2012 04:17 PM Aaron Marcuse-Kubitza

Makefiles: Added .DELETE_ON_ERROR to delete target if recipe fails

1260 03/05/2012 11:40 AM Aaron Marcuse-Kubitza

Makefiles: Use .SECONDARY with no prerequisites instead of setting a .PRECIOUS for each intermediate, to simplify turning off automatic deletion of intermediate files

874 02/07/2012 12:47 PM Aaron Marcuse-Kubitza

inputs/Makefile: Fixed forwarding of empty targets to subdirs

785 01/31/2012 06:58 PM Aaron Marcuse-Kubitza

Makefiles: Added documentation labels to each section

767 01/31/2012 03:40 PM Aaron Marcuse-Kubitza

inputs/Makefile: Added %-add target to add new inputs

625 01/24/2012 02:32 PM Aaron Marcuse-Kubitza

Makefiles: Recurse into outermost subdir rather than bypassing it and going directly to innermost subdir

623 01/24/2012 02:07 PM Aaron Marcuse-Kubitza

inputs/Makefile: Don't use subdir makefiles because they are no longer needed

416 01/09/2012 02:04 PM Aaron Marcuse-Kubitza

Makefiles: Added empty Makefile target so that Makefiles are not included in the targets recursively run on subdirs

410 01/09/2012 01:24 PM Aaron Marcuse-Kubitza

Added inputs/Makefile to run input targets recursively on each input