Revision 11516
Added by Aaron Marcuse-Kubitza about 11 years ago
README.TXT | ||
---|---|---|
13 | 13 |
cd /home/bien/svn # should happen automatically at login |
14 | 14 |
|
15 | 15 |
Single datasource import: |
16 |
Follow the steps under Connecting to vegbiendev above |
|
16 | 17 |
(Re)import and scrub: make inputs/<datasrc>/reimport_scrub by_col=1 & |
17 | 18 |
(Re)import only: make inputs/<datasrc>/reimport by_col=1 & |
18 | 19 |
Note that these commands also work if the datasource is not yet imported |
... | ... | |
21 | 22 |
Full database import: |
22 | 23 |
WARNING: You must perform *every single* step listed below, to avoid |
23 | 24 |
breaking column-based import |
25 |
Follow the steps under Connecting to vegbiendev above |
|
26 |
Follow the steps under Connecting to vegbiendev above, using jupiter instead |
|
24 | 27 |
On jupiter: svn up --force |
25 | 28 |
On local machine: |
26 | 29 |
do steps under Maintenance > "to synchronize vegbiendev, jupiter, and |
... | ... | |
159 | 162 |
make backups/upload live=1 |
160 | 163 |
|
161 | 164 |
Datasource setup: |
165 |
On local machine: |
|
162 | 166 |
Example steps for a datasource: wiki.vegpath.org/Import_process_for_Madidi |
163 | 167 |
umask ug=rwx,o= # prevent files from becoming web-accessible |
164 | 168 |
Add a new datasource: make inputs/<datasrc>/add |
... | ... | |
317 | 321 |
to synchronize a Mac's settings with my testing machine's: |
318 | 322 |
download: |
319 | 323 |
WARNING: this will overwrite all your user's settings! |
324 |
on your machine: |
|
320 | 325 |
overwrite=1 swap=1 sync_local_dir=~/Library/ sync_remote_subdir=Library/ bin/sync_upload --exclude="/Saved Application State" |
321 | 326 |
then rerun with l=1 ... |
322 | 327 |
upload: |
... | ... | |
334 | 339 |
overwrite=1 sync_local_dir=~ sync_remote_subdir= bin/sync_upload ~/"VirtualBox VMs/**" |
335 | 340 |
then rerun with l=1 ... |
336 | 341 |
to backup files not in Time Machine: |
342 |
On local machine: |
|
337 | 343 |
pg_ctl. stop # stop the PostgreSQL server |
338 | 344 |
src=/ dest=/Volumes/Time\ Machine\ Backups/ sudo -E put Library/PostgreSQL/9.1/data/ |
339 | 345 |
then rerun with l=1 ... |
... | ... | |
342 | 348 |
Regularly, or whenever the VegCore data dictionary page |
343 | 349 |
(https://projects.nceas.ucsb.edu/nceas/projects/bien/wiki/VegCore) |
344 | 350 |
is changed, regenerate mappings/VegCore.csv: |
351 |
On local machine: |
|
345 | 352 |
make mappings/VegCore.htm-remake; make mappings/ |
346 | 353 |
svn di mappings/VegCore.tables.redmine |
347 | 354 |
If there are changes, update the data dictionary's Tables section |
... | ... | |
356 | 363 |
|
357 | 364 |
Backups: |
358 | 365 |
Archived imports: |
366 |
Follow the steps under Connecting to vegbiendev above |
|
359 | 367 |
Back up: make backups/<version>.backup & |
360 | 368 |
Note: To back up the last import, you must archive it first: |
361 | 369 |
make schemas/rotate |
... | ... | |
364 | 372 |
Remove: make backups/<version>.backup/remove |
365 | 373 |
Download: make backups/<version>.backup/download |
366 | 374 |
TNRS cache: |
375 |
Follow the steps under Connecting to vegbiendev above |
|
367 | 376 |
Back up: make backups/TNRS.backup-remake & |
368 | 377 |
runtime: 3 min ("real 2m48.859s") |
369 | 378 |
Restore: |
... | ... | |
373 | 382 |
yes|make schemas/public/reinstall |
374 | 383 |
Must come after TNRS restore to recreate tnrs_input_name view |
375 | 384 |
Full DB: |
385 |
Follow the steps under Connecting to vegbiendev above |
|
376 | 386 |
Back up: make backups/vegbien.<version>.backup & |
377 | 387 |
Test: make -s backups/vegbien.<version>.backup/test & |
378 | 388 |
Restore: make backups/vegbien.<version>.backup/restore & |
379 | 389 |
Download: make backups/vegbien.<version>.backup/download |
380 | 390 |
Import logs: |
391 |
On local machine: |
|
381 | 392 |
Download: make inputs/download-logs live=1 |
382 | 393 |
|
383 | 394 |
Datasource refreshing: |
384 | 395 |
VegBank: |
396 |
Follow the steps under Connecting to vegbiendev above |
|
385 | 397 |
make inputs/VegBank/vegbank.sql-remake |
386 | 398 |
make inputs/VegBank/reinstall quiet=1 & |
387 | 399 |
|
388 | 400 |
Schema changes: |
401 |
On local machine: |
|
389 | 402 |
When changing the analytical views, run sync_analytical_..._to_view() |
390 | 403 |
to update the corresponding table |
391 | 404 |
Remember to update the following files with any renamings: |
... | ... | |
479 | 492 |
On a development machine, you should put the following in your .profile: |
480 | 493 |
umask ug=rwx,o= # prevent files from becoming web-accessible |
481 | 494 |
export log= n=2 |
495 |
On local machine: |
|
482 | 496 |
Mapping process: make test |
483 | 497 |
Including column-based import: make test by_col=1 |
484 | 498 |
If the row-based and column-based imports produce different inserted |
... | ... | |
509 | 523 |
press Enter or click Clear Now |
510 | 524 |
|
511 | 525 |
WinMerge setup: |
526 |
In a Windows VM: |
|
512 | 527 |
Install WinMerge from <http://winmerge.org/> |
513 | 528 |
Open WinMerge |
514 | 529 |
Go to Edit > Options and click Compare in the left sidebar |
... | ... | |
519 | 534 |
|
520 | 535 |
Documentation: |
521 | 536 |
To generate a Redmine-formatted list of steps for column-based import: |
537 |
On local machine: |
|
522 | 538 |
make schemas/public/reinstall |
523 | 539 |
make inputs/ACAD/Specimen/logs/steps.by_col.log.sql |
524 | 540 |
To import and scrub just the test taxonomic names: |
541 |
Follow the steps under Connecting to vegbiendev above |
|
525 | 542 |
inputs/test_taxonomic_names/test_scrub |
526 | 543 |
|
527 | 544 |
General: |
Also available in: Unified diff
/README.TXT: for each task, documented which machine it's run on. for tasks run on vegbiendev, added pointer to "Connecting to vegbiendev" steps.