Project

General

Profile

« Previous | Next » 

Revision 11516

/README.TXT: for each task, documented which machine it's run on. for tasks run on vegbiendev, added pointer to "Connecting to vegbiendev" steps.

View differences:

README.TXT
13 13
	cd /home/bien/svn # should happen automatically at login
14 14

  
15 15
Single datasource import:
16
	Follow the steps under Connecting to vegbiendev above
16 17
	(Re)import and scrub: make inputs/<datasrc>/reimport_scrub by_col=1 &
17 18
	(Re)import only: make inputs/<datasrc>/reimport by_col=1 &
18 19
	Note that these commands also work if the datasource is not yet imported
......
21 22
Full database import:
22 23
	WARNING: You must perform *every single* step listed below, to avoid
23 24
		breaking column-based import
25
	Follow the steps under Connecting to vegbiendev above
26
	Follow the steps under Connecting to vegbiendev above, using jupiter instead
24 27
	On jupiter: svn up --force
25 28
	On local machine:
26 29
		do steps under Maintenance > "to synchronize vegbiendev, jupiter, and
......
159 162
		make backups/upload live=1
160 163

  
161 164
Datasource setup:
165
	On local machine:
162 166
	Example steps for a datasource: wiki.vegpath.org/Import_process_for_Madidi
163 167
	umask ug=rwx,o= # prevent files from becoming web-accessible
164 168
	Add a new datasource: make inputs/<datasrc>/add
......
317 321
	to synchronize a Mac's settings with my testing machine's:
318 322
		download:
319 323
			WARNING: this will overwrite all your user's settings!
324
			on your machine:
320 325
			overwrite=1 swap=1 sync_local_dir=~/Library/ sync_remote_subdir=Library/ bin/sync_upload --exclude="/Saved Application State"
321 326
				then rerun with l=1 ...
322 327
		upload:
......
334 339
				overwrite=1      sync_local_dir=~              sync_remote_subdir=             bin/sync_upload ~/"VirtualBox VMs/**"
335 340
					then rerun with l=1 ...
336 341
	to backup files not in Time Machine:
342
		On local machine:
337 343
		pg_ctl. stop # stop the PostgreSQL server
338 344
		src=/ dest=/Volumes/Time\ Machine\ Backups/ sudo -E put Library/PostgreSQL/9.1/data/
339 345
			then rerun with l=1 ...
......
342 348
		Regularly, or whenever the VegCore data dictionary page
343 349
			(https://projects.nceas.ucsb.edu/nceas/projects/bien/wiki/VegCore)
344 350
			is changed, regenerate mappings/VegCore.csv:
351
			On local machine:
345 352
			make mappings/VegCore.htm-remake; make mappings/
346 353
			svn di mappings/VegCore.tables.redmine
347 354
			If there are changes, update the data dictionary's Tables section
......
356 363

  
357 364
Backups:
358 365
	Archived imports:
366
		Follow the steps under Connecting to vegbiendev above
359 367
		Back up: make backups/<version>.backup &
360 368
			Note: To back up the last import, you must archive it first:
361 369
				make schemas/rotate
......
364 372
		Remove: make backups/<version>.backup/remove
365 373
		Download: make backups/<version>.backup/download
366 374
	TNRS cache:
375
		Follow the steps under Connecting to vegbiendev above
367 376
		Back up: make backups/TNRS.backup-remake &
368 377
			runtime: 3 min ("real 2m48.859s")
369 378
		Restore:
......
373 382
			yes|make schemas/public/reinstall
374 383
				Must come after TNRS restore to recreate tnrs_input_name view
375 384
	Full DB:
385
		Follow the steps under Connecting to vegbiendev above
376 386
		Back up: make backups/vegbien.<version>.backup &
377 387
		Test: make -s backups/vegbien.<version>.backup/test &
378 388
		Restore: make backups/vegbien.<version>.backup/restore &
379 389
		Download: make backups/vegbien.<version>.backup/download
380 390
	Import logs:
391
		On local machine:
381 392
		Download: make inputs/download-logs live=1
382 393

  
383 394
Datasource refreshing:
384 395
	VegBank:
396
		Follow the steps under Connecting to vegbiendev above
385 397
		make inputs/VegBank/vegbank.sql-remake
386 398
		make inputs/VegBank/reinstall quiet=1 &
387 399

  
388 400
Schema changes:
401
	On local machine:
389 402
	When changing the analytical views, run sync_analytical_..._to_view()
390 403
		to update the corresponding table
391 404
	Remember to update the following files with any renamings:
......
479 492
	On a development machine, you should put the following in your .profile:
480 493
		umask ug=rwx,o= # prevent files from becoming web-accessible
481 494
		export log= n=2
495
	On local machine:
482 496
	Mapping process: make test
483 497
		Including column-based import: make test by_col=1
484 498
			If the row-based and column-based imports produce different inserted
......
509 523
					press Enter or click Clear Now
510 524

  
511 525
WinMerge setup:
526
	In a Windows VM:
512 527
	Install WinMerge from <http://winmerge.org/>
513 528
	Open WinMerge
514 529
	Go to Edit > Options and click Compare in the left sidebar
......
519 534

  
520 535
Documentation:
521 536
	To generate a Redmine-formatted list of steps for column-based import:
537
		On local machine:
522 538
		make schemas/public/reinstall
523 539
		make inputs/ACAD/Specimen/logs/steps.by_col.log.sql
524 540
	To import and scrub just the test taxonomic names:
541
		Follow the steps under Connecting to vegbiendev above
525 542
		inputs/test_taxonomic_names/test_scrub
526 543

  
527 544
General:

Also available in: Unified diff