Project

General

Profile

1
Installation:
2
	Check out svn: svn co https://code.nceas.ucsb.edu/code/projects/bien
3
	cd bien/
4
	Install: make install
5
		WARNING: This will delete the current public schema of your VegBIEN DB!
6
	Uninstall: make uninstall
7
		WARNING: This will delete your entire VegBIEN DB!
8
		This includes all archived imports and staging tables.
9

    
10
Maintenance:
11
	on a live machine, you should put the following in your .profile:
12
		umask ug=rwx,o= # prevent files from becoming web-accessible
13
		unset TMOUT # TMOUT causes screen to exit even with background processes
14
	if http://vegbiendev.nceas.ucsb.edu/phppgadmin/ goes down:
15
		on vegbiendev: make postgres-Linux
16
	to synchronize vegbiendev, jupiter, and your local machine:
17
		WARNING: pay careful attention to all files that will be deleted or
18
			overwritten!
19
		install put if needed:
20
			download https://uutils.googlecode.com/svn/trunk/bin/put to ~/bin/ and `chmod +x` it
21
		when changes are made on vegbiendev:
22
			on vegbiendev, upload:
23
				overwrite=1 bin/sync_upload
24
					then rerun with l=1 ...
25
			on your machine, download:
26
				overwrite=1 swap=1 src=. dest='aaronmk@jupiter:~/bien' put --exclude=.svn inputs/VegBIEN/TWiki
27
					then rerun with l=1 ...
28
				overwrite=1 swap=1 bin/sync_upload
29
					then rerun with l=1 ...
30
				overwrite=1 sync_remote_url=~/Dropbox/svn/ bin/sync_upload --existing --size-only # just update mtimes/perms
31
					then rerun with l=1 ...
32
	to synchronize a Mac's settings with my testing machine's:
33
		download:
34
			WARNING: this will overwrite all your user's settings!
35
			overwrite=1 swap=1 sync_local_dir=~/Library/ sync_remote_subdir=Library/ bin/sync_upload --exclude="/Saved Application State"
36
				then rerun with l=1 ...
37
		upload:
38
			do step when changes are made on vegbiendev > on your machine, download
39
			on jupiter: (cd ~/Dropbox/svn/; svn up)
40
			on your machine:
41
				overwrite=1 del= sync_local_dir=~/Dropbox/svn/ sync_remote_subdir=Dropbox/svn/ bin/sync_upload --size-only # just update mtimes
42
					then rerun with l=1 ...
43
				overwrite=1      sync_local_dir=~              sync_remote_subdir=             bin/sync_upload --exclude="/Library/Saved Application State" --exclude="/.Trash" --exclude="/bin" --exclude="/bin/pg_ctl" --exclude="/bin/unzip" --exclude="/Dropbox/home"
44
					then rerun with l=1 ...
45
				overwrite=1      sync_local_dir=~              sync_remote_url=~/Dropbox/home  bin/sync_upload --exclude="/Library/Saved Application State" --exclude="/.Trash" --exclude="/.dropbox" --exclude="/Documents/BIEN" --exclude="/Dropbox" --exclude="/software" --exclude="/VirtualBox VMs/**.sav" --exclude="/VirtualBox VMs/**.vdi" --exclude="/VirtualBox VMs/**.vmdk"
46
					then rerun with l=1 ...
47
		upload just the VirtualBox VMs:
48
			on your machine:
49
				overwrite=1      sync_local_dir=~              sync_remote_subdir=             bin/sync_upload ~/"VirtualBox VMs/**"
50
					then rerun with l=1 ...
51
	to backup files not in Time Machine:
52
		stop the PostgreSQL server
53
		src=/ dest=/Volumes/Time\ Machine\ Backups/ sudo put Library/PostgreSQL/9.1/data/
54
			then rerun with l=1 ...
55
		start the PostgreSQL server
56
	VegCore data dictionary:
57
		Regularly, or whenever the VegCore data dictionary page
58
			(https://projects.nceas.ucsb.edu/nceas/projects/bien/wiki/VegCore)
59
			is changed, regenerate mappings/VegCore.csv:
60
			make mappings/VegCore.htm-remake; make mappings/
61
			svn di mappings/VegCore.tables.redmine
62
			If there are changes, update the data dictionary's Tables section
63
			When moving terms, check that no terms were lost: svn di
64
			svn ci -m 'mappings/VegCore.htm: regenerated from wiki'
65
	Important: Whenever you install a system update that affects PostgreSQL or
66
		any of its dependencies, such as libc, you should restart the PostgreSQL
67
		server. Otherwise, you may get strange errors like "the database system
68
		is in recovery mode" which go away upon reimport, or you may not be able
69
		to access the database as the postgres superuser. This applies to both
70
		Linux and Mac OS X.
71

    
72
Single datasource import:
73
	(Re)import and scrub: make inputs/<datasrc>/reimport_scrub by_col=1
74
	(Re)import only: make inputs/<datasrc>/reimport by_col=1
75
	(Re)scrub: make inputs/<datasrc>/rescrub by_col=1
76
	Note that these commands also work if the datasource is not yet imported
77

    
78
Full database import:
79
	WARNING: You must perform *every single* step listed below, to avoid
80
		breaking column-based import
81
	On jupiter: svn up --force
82
	On local machine:
83
		./fix_perms
84
		do steps under Maintenance > "to synchronize vegbiendev, jupiter, and
85
			your local machine" above
86
		make inputs/upload
87
		make inputs/upload live=1
88
		make test by_col=1
89
			if you encounter errors, they are most likely related to the
90
				PostgreSQL error parsing in /lib/sql.py parse_exception()
91
			See note under Testing below
92
	On vegbiendev:
93
	Ensure there are no local modifications: svn st
94
	svn up
95
	make inputs/download
96
	make inputs/download live=1
97
	For each newly-uploaded datasource above: make inputs/<datasrc>/reinstall
98
	Update the auxiliary schemas: make schemas/reinstall
99
		The public schema will be installed separately by the import process
100
	Delete imports before the last so they won't bloat the full DB backup:
101
		make backups/vegbien.<version>.backup/remove
102
		To keep a previous import other than the public schema:
103
			export dump_opts='--exclude-schema=public --exclude-schema=<version>'
104
	Make sure there is at least 300GB of disk space on /: df -h
105
		The import schema is 255GB, and may use additional space for temp tables
106
		To free up space, remove backups that have been archived on jupiter:
107
			List backups/ to view older backups
108
			Check their MD5 sums using the steps under On jupiter below
109
			Remove these backups
110
	Remove any leftover TNRS lockfile: rm inputs/.TNRS/tnrs/tnrs.make.lock
111
		Usually, the PID in it would not exist, but sometimes it now refers to
112
			a different, active process which blocks tnrs.make
113
	screen
114
	Press ENTER
115
	set -o ignoreeof #prevent Ctrl+D from exiting `screen` to keep attached jobs
116
	unset TMOUT # TMOUT causes screen to exit even with background processes
117
	unset version
118
	Start column-based import: . bin/import_all
119
		To use row-based import: . bin/import_all by_col=
120
		To stop all running imports: . bin/stop_imports
121
		WARNING: Do NOT run import_all in the background, or the jobs it creates
122
			won't be owned by your shell.
123
		Note that import_all will take up to an hour to import the NCBI backbone
124
			and other metadata before returning control to the shell.
125
	Wait (overnight) for the import to finish
126
	To recover from a closed terminal window: screen -r
127
	To restart an aborted import for a specific table:
128
		export version=<version>
129
		make inputs/<datasrc>/<table>/import_scrub by_col=1 continue=1 &
130
		bin/after_import $! & # $! can also be obtained from `jobs -l`
131
	Get $version: echo $version
132
	Set $version in all vegbiendev terminals: export version=<version>
133
	When there are no more running jobs, exit the screen
134
	Upload logs (run on vegbiendev): make inputs/upload live=1
135
	On local machine: make inputs/download-logs live=1
136
	In PostgreSQL:
137
		Check that the provider_count and source tables contain entries for all
138
			inputs
139
	Check that TNRS ran successfully:
140
		tail -100 inputs/.TNRS/tnrs/logs/tnrs.make.log.sql
141
		If the log ends in an AssertionError
142
			"assert sql.table_col_names(db, table) == header":
143
			Figure out which TNRS CSV columns have changed
144
			On local machine:
145
				Make the changes in inputs/.TNRS/schema.sql
146
				rm inputs/.TNRS/tnrs/header.csv
147
				make inputs/.TNRS/reinstall schema_only=1
148
				make schemas/public/reinstall
149
				If there are errors "column ... does not exist", etc.:
150
					Make the necessary changes in schemas/vegbien.sql
151
					make schemas/public/reinstall
152
				make schemas/remake
153
				inputs/test_taxonomic_names/test_scrub
154
				In inputs/test_taxonomic_names/_scrub/TNRS.sql, copy the
155
					"COPY tnrs ..." statement to inputs/.TNRS/data.sql
156
				Commit
157
			On vegbiendev:
158
				If dropping a column, save the dependent views
159
				Make the same changes in the live TNRS.tnrs table on vegbiendev
160
				If dropping a column, recreate the dependent views
161
				Restart the TNRS client: make scrub by_col=1 &
162
	tail inputs/{.,}*/*/logs/$version.log.sql
163
	In the output, search for "Command exited with non-zero status"
164
	For inputs that have this, fix the associated bug(s)
165
	If many inputs have errors, discard the current (partial) import:
166
		make schemas/$version/uninstall
167
	Otherwise, continue
168
	Publish the new import:
169
		WARNING: Before proceeding, be sure you have done *every single*
170
			verification step listed above. Otherwise, a previous valid import
171
			could incorrectly be overwritten with a broken one.
172
		make schemas/$version/publish
173
	unset version
174
	backups/fix_perms
175
	make backups/upload live=1
176
	On jupiter:
177
		cd /data/dev/aaronmk/bien/backups
178
		For each newly-archived backup:
179
			make -s <backup>.md5/test
180
			Check that "OK" is printed next to the filename
181
	On nimoy:
182
		cd /home/bien/svn/
183
		svn up
184
		export version=<version>
185
		make backups/analytical_stem.$version.csv/download
186
		In the bien_web DB:
187
			Create the analytical_stem_<version> table using its schema
188
				in schemas/vegbien.my.sql
189
		make -s backups/analytical_stem.$version.csv.md5/test
190
		Check that "OK" is printed next to the filename
191
		table=analytical_stem_$version bin/publish_analytical_db \
192
			backups/analytical_stem.$version.csv
193
	If desired, record the import times in inputs/import.stats.xls:
194
		Open inputs/import.stats.xls
195
		If the rightmost import is within 5 columns of column IV:
196
			Copy the current tab to <leftmost-date>~<rightmost-date>
197
			Remove the previous imports from the current tab because they are
198
				now in the copied tab instead
199
		Insert a copy of the leftmost "By column" column group before it
200
		export version=<version>
201
		bin/import_date inputs/{.,}*/*/logs/$version.log.sql
202
		Update the import date in the upper-right corner
203
		bin/import_times inputs/{.,}*/*/logs/$version.log.sql
204
		Paste the output over the # Rows/Time columns, making sure that the
205
			row counts match up with the previous import's row counts
206
		If the row counts do not match up, insert or reorder rows as needed
207
			until they do. Get the datasource names from the log file footers:
208
			tail inputs/{.,}*/*/logs/$version.log.sql
209
		Commit: svn ci -m "inputs/import.stats.xls: Updated import times"
210
	To run TNRS:
211
		To use an import other than public: export version=<version>
212
		make scrub &
213
		To view progress:
214
			tail -100 inputs/.TNRS/tnrs/logs/tnrs.make.log.sql
215
	To remake analytical DB:
216
		To use an import other than public: export version=<version>
217
		bin/make_analytical_db &
218
		To view progress:
219
			tail -150 inputs/analytical_db/logs/make_analytical_db.log.sql
220
	To back up DB (staging tables and last import):
221
		To use an import *other than public*: export version=<version>
222
		dump_opts=--exclude-schema=public make backups/vegbien.$version.backup/test &
223
			If after renaming to public, instead set dump_opts='' and replace
224
			$version with the appropriate revision
225

    
226
Backups:
227
	Archived imports:
228
		Back up: make backups/<version>.backup &
229
			Note: To back up the last import, you must archive it first:
230
				make schemas/rotate
231
		Test: make -s backups/<version>.backup/test &
232
		Restore: make backups/<version>.backup/restore &
233
		Remove: make backups/<version>.backup/remove
234
		Download: make backups/<version>.backup/download
235
	TNRS cache:
236
		Back up: make backups/TNRS.backup-remake &
237
			runtime: 3 min ("real 2m48.859s")
238
		Restore:
239
			yes|make inputs/.TNRS/uninstall
240
			make backups/TNRS.backup/restore &
241
				runtime: 5.5 min ("real 5m35.829s")
242
			yes|make schemas/public/reinstall
243
				Must come after TNRS restore to recreate tnrs_input_name view
244
	Full DB:
245
		Back up: make backups/vegbien.<version>.backup &
246
		Test: make -s backups/vegbien.<version>.backup/test &
247
		Restore: make backups/vegbien.<version>.backup/restore &
248
		Download: make backups/vegbien.<version>.backup/download
249
	Import logs:
250
		Download: make inputs/download-logs live=1
251

    
252
Datasource setup:
253
	umask ug=rwx,o= # prevent files from becoming web-accessible
254
	Add a new datasource: make inputs/<datasrc>/add
255
		<datasrc> may not contain spaces, and should be abbreviated.
256
		If the datasource is a herbarium, <datasrc> should be the herbarium code
257
			as defined by the Index Herbariorum <http://sweetgum.nybg.org/ih/>
258
	For MySQL inputs (exports and live DB connections):
259
		For .sql exports:
260
			Place the original .sql file in _src/ (*not* in _MySQL/)
261
			Follow the steps starting with Install the staging tables below.
262
				This is for an initial sync to get the file onto vegbiendev.
263
			On vegbiendev:
264
				Create a database for the MySQL export in phpMyAdmin
265
				Give the bien user all database-specific privileges *except*
266
					UPDATE, DELETE, ALTER, DROP. This prevents bugs in the
267
					import scripts from accidentally deleting data.
268
				bin/mysql_bien database <inputs/<datasrc>/_src/export.sql &
269
		mkdir inputs/<datasrc>/_MySQL/
270
		cp -p lib/MySQL.{data,schema}.sql.make inputs/<datasrc>/_MySQL/
271
		Edit _MySQL/*.make for the DB connection
272
			For a .sql export, use server=vegbiendev and --user=bien
273
		Skip the Add input data for each table section
274
	For MS Access databases:
275
		Place the .mdb or .accdb file in _src/
276
		Download and install Access To PostgreSQL from
277
			http://www.bullzip.com/download.php
278
		Use Access To PostgreSQL to export the database:
279
			Export just the tables/indexes to inputs/<datasrc>/<file>.schema.sql
280
			Export just the data to inputs/<datasrc>/<file>.data.sql
281
		In <file>.schema.sql, make the following changes:
282
			Replace text "BOOLEAN" with "/*BOOLEAN*/INTEGER"
283
			Replace text "DOUBLE PRECISION NULL" with "DOUBLE PRECISION"
284
		Skip the Add input data for each table section
285
	Add input data for each table present in the datasource:
286
		For .sql exports, you must use the name of the table in the DB export
287
		For CSV files, you can use any name. It's recommended to use a table
288
			name from <https://projects.nceas.ucsb.edu/nceas/projects/bien/wiki/VegCSV#Suggested-table-names>
289
		Note that if this table will be joined together with another table, its
290
			name must end in ".src"
291
		make inputs/<datasrc>/<table>/add
292
			Important: DO NOT just create an empty directory named <table>!
293
				This command also creates necessary subdirs, such as logs/.
294
		If the table is in a .sql export: make inputs/<datasrc>/<table>/install
295
			Otherwise, place the CSV(s) for the table in
296
			inputs/<datasrc>/<table>/ OR place a query joining other tables
297
			together in inputs/<datasrc>/<table>/create.sql
298
		Important: When exporting relational databases to CSVs, you MUST ensure
299
			that embedded quotes are escaped by doubling them, *not* by
300
			preceding them with a "\" as is the default in phpMyAdmin
301
		If there are multiple part files for a table, and the header is repeated
302
			in each part, make sure each header is EXACTLY the same.
303
			(If the headers are not the same, the CSV concatenation script
304
			assumes the part files don't have individual headers and treats the
305
			subsequent headers as data rows.)
306
		Add <table> to inputs/<datasrc>/import_order.txt before other tables
307
			that depend on it
308
	Install the staging tables:
309
		make inputs/<datasrc>/reinstall quiet=1 &
310
		For a MySQL .sql export:
311
			At prompt "[you]@vegbiendev's password:", enter your password
312
			At prompt "Enter password:", enter the value in config/bien_password
313
		To view progress: tail -f inputs/<datasrc>/<table>/logs/install.log.sql
314
		View the logs: tail -n +1 inputs/<datasrc>/*/logs/install.log.sql
315
			tail provides a header line with the filename
316
			+1 starts at the first line, to show the whole file
317
		For every file with an error 'column "..." specified more than once':
318
			Add a header override file "+header.<ext>" in <table>/:
319
				Note: The leading "+" should sort it before the flat files.
320
					"_" unfortunately sorts *after* capital letters in ASCII.
321
				Create a text file containing the header line of the flat files
322
				Add an ! at the beginning of the line
323
					This signals cat_csv that this is a header override.
324
				For empty names, use their 0-based column # (by convention)
325
				For duplicate names, add a distinguishing suffix
326
				For long names that collided, rename them to <= 63 chars long
327
				Do NOT make readability changes in this step; that is what the
328
					map spreadsheets (below) are for.
329
				Save
330
		If you made any changes, re-run the install command above
331
	Auto-create the map spreadsheets: make inputs/<datasrc>/
332
	Map each table's columns:
333
		In each <table>/ subdir, for each "via map" map.csv:
334
			Open the map in a spreadsheet editor
335
			Open the "core map" /mappings/Veg+-VegBIEN.csv
336
			In each row of the via map, set the right column to a value from the
337
				left column of the core map
338
			Save
339
		Regenerate the derived maps: make inputs/<datasrc>/
340
	Accept the test cases:
341
		make inputs/<datasrc>/test
342
			When prompted to "Accept new test output", enter y and press ENTER
343
			If you instead get errors, do one of the following for each one:
344
			-	If the error was due to a bug, fix it
345
			-	Add a SQL function that filters or transforms the invalid data
346
			-	Make an empty mapping for the columns that produced the error.
347
				Put something in the Comments column of the map spreadsheet to
348
				prevent the automatic mapper from auto-removing the mapping.
349
			When accepting tests, it's helpful to use WinMerge
350
				(see WinMerge setup below for configuration)
351
		make inputs/<datasrc>/test by_col=1
352
			If you get errors this time, this always indicates a bug, usually in
353
				the VegBIEN unique constraints or column-based import itself
354
	Add newly-created files: make inputs/<datasrc>/add
355
	Commit: svn ci -m "Added inputs/<datasrc>/" inputs/<datasrc>/
356
	Update vegbiendev:
357
		On jupiter: svn up
358
		On local machine:
359
			./fix_perms
360
			make inputs/upload
361
			make inputs/upload live=1
362
		On vegbiendev:
363
			svn up
364
			make inputs/download
365
			make inputs/download live=1
366
			Follow the steps under Install the staging tables above
367

    
368
Datasource refreshing:
369
	VegBank:
370
		make inputs/VegBank/vegbank.sql-remake
371
		make inputs/VegBank/reinstall quiet=1 &
372

    
373
Schema changes:
374
	When changing the analytical views, run sync_analytical_..._to_view()
375
		to update the corresponding table
376
	Remember to update the following files with any renamings:
377
		schemas/filter_ERD.csv
378
		mappings/VegCore-VegBIEN.csv
379
		mappings/verify.*.sql
380
	Regenerate schema from installed DB: make schemas/remake
381
	Reinstall DB from schema: make schemas/public/reinstall schemas/reinstall
382
		WARNING: This will delete the current public schema of your VegBIEN DB!
383
	Reinstall staging tables:
384
		On local machine:
385
			sudo -E -u postgres psql <<<'ALTER DATABASE vegbien RENAME TO vegbien_prev'
386
			make db
387
			. bin/reinstall_all
388
			Fix any bugs and retry until no errors
389
			make schemas/public/install
390
				This must be run *after* the datasources are installed, because
391
				views in public depend on some of the datasources
392
			sudo -E -u postgres psql <<<'DROP DATABASE vegbien_prev'
393
		On vegbiendev: repeat the above steps
394
			WARNING: Do not run this until reinstall_all runs successfully on
395
			the local machine, or the live DB may be unrestorable!
396
	Sync ERD with vegbien.sql schema:
397
		Run make schemas/vegbien.my.sql
398
		Open schemas/vegbien.ERD.mwb in MySQLWorkbench
399
		Go to File > Export > Synchronize With SQL CREATE Script...
400
		For Input File, select schemas/vegbien.my.sql
401
		Click Continue
402
		In the changes list, select each table with an arrow next to it
403
		Click Update Model
404
		Click Continue
405
		Note: The generated SQL script will be empty because we are syncing in
406
			the opposite direction
407
		Click Execute
408
		Reposition any lines that have been reset
409
		Add any new tables by dragging them from the Catalog in the left sidebar
410
			to the diagram
411
		Remove any deleted tables by right-clicking the table's diagram element,
412
			selecting Delete '<table name>', and clicking Delete
413
		Save
414
		If desired, update the graphical ERD exports (see below)
415
	Update graphical ERD exports:
416
		Go to File > Export > Export as PNG...
417
		Select schemas/vegbien.ERD.png and click Save
418
		Go to File > Export > Export as SVG...
419
		Select schemas/vegbien.ERD.svg and click Save
420
		Go to File > Export > Export as Single Page PDF...
421
		Select schemas/vegbien.ERD.1_pg.pdf and click Save
422
		Go to File > Print...
423
		In the lower left corner, click PDF > Save as PDF...
424
		Set the Title and Author to ""
425
		Select schemas/vegbien.ERD.pdf and click Save
426
		Commit: svn ci -m "schemas/vegbien.ERD.mwb: Regenerated exports"
427
	Refactoring tips:
428
		To rename a table:
429
			In vegbien.sql, do the following:
430
				Replace regexp (?<=_|\b)<old>(?=_|\b) with <new>
431
					This is necessary because the table name is *everywhere*
432
				Search for <new>
433
				Manually change back any replacements inside comments
434
		To rename a column:
435
			Rename the column: ALTER TABLE <table> RENAME <old> TO <new>;
436
			Recreate any foreign key for the column, removing CONSTRAINT <name>
437
				This resets the foreign key name using the new column name
438
	Creating a poster of the ERD:
439
		Determine the poster size:
440
			Measure the line height (from the bottom of one line to the bottom
441
				of another): 16.3cm/24 lines = 0.679cm
442
			Measure the height of the ERD: 35.4cm*2 = 70.8cm
443
			Zoom in as far as possible
444
			Measure the height of a capital letter: 3.5mm
445
			Measure the line height: 8.5mm
446
			Calculate the text's fraction of the line height: 3.5mm/8.5mm = 0.41
447
			Calculate the text height: 0.679cm*0.41 = 0.28cm
448
			Calculate the text height's fraction of the ERD height:
449
				0.28cm/70.8cm = 0.0040
450
			Measure the text height on the *VegBank* ERD poster: 5.5mm = 0.55cm
451
			Calculate the VegBIEN poster height to make the text the same size:
452
				0.55cm/0.0040 = 137.5cm H; *1in/2.54cm = 54.1in H
453
			The ERD aspect ratio is 11 in W x (2*8.5in H) = 11x17 portrait
454
			Calculate the VegBIEN poster width: 54.1in H*11W/17H = 35.0in W
455
			The minimum VegBIEN poster size is 35x54in portrait
456
		Determine the cost:
457
			The FedEx Kinkos near NCEAS (1030 State St, Santa Barbara, CA 93101)
458
				charges the following for posters:
459
				base: $7.25/sq ft
460
				lamination: $3/sq ft
461
				mounting on a board: $8/sq ft
462

    
463
Testing:
464
	On a development machine, you should put the following in your .profile:
465
		umask ug=rwx,o= # prevent files from becoming web-accessible
466
		export log= n=2
467
	Mapping process: make test
468
		Including column-based import: make test by_col=1
469
			If the row-based and column-based imports produce different inserted
470
			row counts, this usually means that a table is underconstrained
471
			(the unique indexes don't cover all possible rows).
472
			This can occur if you didn't use COALESCE(field, null_value) around
473
			a nullable field in a unique index. See sql_gen.null_sentinels for
474
			the appropriate null value to use.
475
	Map spreadsheet generation: make remake
476
	Missing mappings: make missing_mappings
477
	Everything (for most complete coverage): make test-all
478

    
479
Debugging:
480
	"Binary chop" debugging:
481
		(This is primarily useful for regressions that occurred in a previous
482
		revision, which was committed without running all the tests)
483
		svn up -r <rev>; make inputs/.TNRS/reinstall; make schemas/public/reinstall; make <failed-test>.xml
484
	.htaccess:
485
		mod_rewrite:
486
			IMPORTANT: whenever you change the DirectorySlash setting for a
487
				directory, you *must* clear your browser's cache to ensure that
488
				a cached redirect is not used. this is because RewriteRule
489
				redirects are (by default) temporary, but DirectorySlash
490
				redirects are permanent.
491
				for Firefox:
492
					press Cmd+Shift+Delete
493
					check only Cache
494
					press Enter or click Clear Now
495

    
496
WinMerge setup:
497
	Install WinMerge from <http://winmerge.org/>
498
	Open WinMerge
499
	Go to Edit > Options and click Compare in the left sidebar
500
	Enable "Moved block detection", as described at
501
		<http://manual.winmerge.org/Configuration.html#d0e5892>.
502
	Set Whitespace to Ignore change, as described at
503
		<http://manual.winmerge.org/Configuration.html#d0e5758>.
504

    
505
Documentation:
506
	To generate a Redmine-formatted list of steps for column-based import:
507
		make schemas/public/reinstall
508
		make inputs/ACAD/Specimen/logs/steps.by_col.log.sql
509
	To import and scrub just the test taxonomic names:
510
		inputs/test_taxonomic_names/test_scrub
511

    
512
General:
513
	To see a program's description, read its top-of-file comment
514
	To see a program's usage, run it without arguments
515
	To remake a directory: make <dir>/remake
516
	To remake a file: make <file>-remake
(5-5/10)