check in new datasource¶
from README.TXT > Datasource setup
- commit & upload:
make inputs/$datasrc/add # place files under version control svn di inputs/$datasrc/*/test.xml.ref # make sure the test outputs are correct svn st # make sure all non-data files are under version control svn ci -m "added inputs/$datasrc/" make inputs/upload # check that changes are as expected make inputs/upload live=1
- if you ran the mapping steps on the local machine, sync to vegbiendev:
- log in to vegbiendev:
ssh -t vegbiendev.nceas.ucsb.edu exec sudo -u aaronmk -i
- download:
svn up make inputs/download # check that changes are as expected make inputs/download live=1
- set vars as above
- perform pre-import actions:
inputs/$datasrc/run
- log in to vegbiendev:
import to VegBIEN¶
- log in to vegbiendev:
ssh -t vegbiendev.nceas.ucsb.edu exec sudo -u aaronmk -i
- set vars as above
- run column-based import: (from README.TXT > Single datasource refresh)
make inputs/$datasrc/reimport_scrub by_col=1 & tail -150 inputs/$datasrc/*/logs/public.log.sql # view progress
- see README.TXT > Single datasource refresh > steps after
reimport_scrub