Project

General

Profile

1 702 aaronmk
Installation:
2 8458 aaronmk
	Check out svn: svn co https://code.nceas.ucsb.edu/code/projects/bien
3
	cd bien/
4
	Install: make install
5
		WARNING: This will delete the current public schema of your VegBIEN DB!
6
	Uninstall: make uninstall
7
		WARNING: This will delete your entire VegBIEN DB!
8
		This includes all archived imports and staging tables.
9 554 aaronmk
10 3674 aaronmk
Maintenance:
11 9399 aaronmk
	on a live machine, you should put the following in your .profile:
12
		umask ug=rwx,o= # prevent files from becoming web-accessible
13 9400 aaronmk
		unset TMOUT # TMOUT causes screen to exit even with background processes
14 8459 aaronmk
	to synchronize vegbiendev, jupiter, and your local machine:
15 8460 aaronmk
		install put if needed:
16
			download https://uutils.googlecode.com/svn/trunk/bin/put to ~/bin/ and `chmod +x` it
17 8459 aaronmk
		when changes are made on vegbiendev:
18
			on vegbiendev, upload:
19 8723 aaronmk
				env overwrite=1             src=. dest='aaronmk@jupiter:~/bien' put --no-group --exclude=.svn --exclude=install.log.sql --exclude='*.backup' --exclude='/backups/analytical_aggregate.*.csv' --exclude='inputs/GBIF/**.data.sql' --exclude='bin/dotlockfile'
20 8459 aaronmk
					then rerun with env l=1 ...
21 8723 aaronmk
				env overwrite=1 del=        src=. dest='aaronmk@jupiter:~/bien' put --no-group --exclude=.svn --exclude=install.log.sql --exclude='inputs/GBIF/**.data.sql'
22 8459 aaronmk
					then rerun with env l=1 ...
23
			on your machine, download:
24 8945 aaronmk
				env overwrite=1      swap=1 src=. dest='aaronmk@jupiter:~/bien' put            --exclude=.svn inputs/VegBIEN/TWiki
25
					then rerun with env l=1 ...
26 8723 aaronmk
				env overwrite=1 del= swap=1 src=. dest='aaronmk@jupiter:~/bien' put            --exclude=.svn --exclude=install.log.sql --exclude='*.backup' --exclude='/backups/analytical_aggregate.*.csv' --exclude='inputs/GBIF/**.data.sql' --exclude='bin/dotlockfile'
27 8459 aaronmk
					then rerun with env l=1 ...
28 8462 aaronmk
	to synchronize a Mac's settings with my testing machine's:
29
		download:
30
			WARNING: this will overwrite all your user's settings!
31 8718 aaronmk
			env overwrite=1 swap=1 src=~/Library/ dest='aaronmk@jupiter:~/Library/' put --exclude="/Saved Application State"
32 8462 aaronmk
				then rerun with env l=1 ...
33
		upload:
34 8719 aaronmk
			do step when changes are made on vegbiendev > on your machine, download
35 8724 aaronmk
			env overwrite=1        src=~ dest='aaronmk@jupiter:~' put --exclude="/Library/Saved Application State" --exclude="/.Trash" --exclude="/bin" --exclude="/bin/pg_ctl" --exclude="/bin/unzip" --exclude="/Documents/BIEN/large_files" --exclude="/Documents/BIEN/svn/backups/*.backup" --exclude="/Documents/BIEN/svn/backups/analytical_aggregate.*.csv" --exclude="/Dropbox/home"
36 8462 aaronmk
				then rerun with env l=1 ...
37 8719 aaronmk
			env overwrite=1        src=~ dest=~/Dropbox/home      put --exclude="/Library/Saved Application State" --exclude="/.Trash" --exclude="/.dropbox" --exclude="/Documents/BIEN" --exclude="/Dropbox" --exclude="/software" --exclude="/VirtualBox VMs/**.sav" --exclude="/VirtualBox VMs/**.vdi" --exclude="/VirtualBox VMs/**.vmdk"
38 8717 aaronmk
				then rerun with env l=1 ...
39 8720 aaronmk
	to backup files not in Time Machine:
40
		env inplace=1 src=/ dest=/Volumes/Time\ Machine\ Backups/ put Users/aaronmk/VirtualBox\ VMs/
41
			then rerun with env l=1 ...
42
		stop the PostgreSQL server
43
		sudo env src=/ dest=/Volumes/Time\ Machine\ Backups/ put Library/PostgreSQL/9.1/data/
44
			then rerun with env l=1 ...
45
		start the PostgreSQL server
46 8458 aaronmk
	VegCore data dictionary:
47
		Regularly, or whenever the VegCore data dictionary page
48
			(https://projects.nceas.ucsb.edu/nceas/projects/bien/wiki/VegCore)
49
			is changed, regenerate mappings/VegCore.csv:
50
			make mappings/VegCore.htm-remake; make mappings/
51
			svn di mappings/VegCore.tables.redmine
52
			If there are changes, update the data dictionary's Tables section
53
			When moving terms, check that no terms were lost: svn di
54
			svn ci -m "mappings/VegCore.htm: Regenerated from wiki"
55
	Important: Whenever you install a system update that affects PostgreSQL or
56
		any of its dependencies, such as libc, you should restart the PostgreSQL
57
		server. Otherwise, you may get strange errors like "the database system
58
		is in recovery mode" which go away upon reimport, or you may not be able
59
		to access the database as the postgres superuser. This applies to both
60
		Linux and Mac OS X.
61 3674 aaronmk
62 7287 aaronmk
Single datasource import:
63 8458 aaronmk
	(Re)import and scrub: make inputs/<datasrc>/reimport_scrub by_col=1
64
	(Re)import only: make inputs/<datasrc>/reimport by_col=1
65
	(Re)scrub: make inputs/<datasrc>/rescrub by_col=1
66
	Note that these commands also work if the datasource is not yet imported
67 7287 aaronmk
68
Full database import:
69 8458 aaronmk
	On jupiter: svn up
70
	On local machine:
71
		./fix_perms
72
		make inputs/upload
73
		make test by_col=1
74
			See note under Testing below
75
	On vegbiendev:
76
	Ensure there are no local modifications: svn st
77
	svn up
78
	make inputs/download
79
	For each newly-uploaded datasource above: make inputs/<datasrc>/reinstall
80
	Update the auxiliary schemas: make schemas/reinstall
81
		The public schema will be installed separately by the import process
82
	Delete imports before the last so they won't bloat the full DB backup:
83
		make backups/vegbien.<version>.backup/remove
84
		To keep a previous import other than the public schema:
85
			export dump_opts='--exclude-schema=public --exclude-schema=<version>'
86
	Make sure there is at least 150GB of disk space on /: df -h
87
		The import schema is 100GB, and may use additional space for temp tables
88
		To free up space, remove backups that have been archived on jupiter:
89
			List backups/ to view older backups
90
			Check their MD5 sums using the steps under On jupiter below
91
			Remove these backups
92
	unset version
93 9401 aaronmk
	unset TMOUT # TMOUT causes screen to exit even with background processes
94 8458 aaronmk
	screen
95
	Press ENTER
96
	Start column-based import: . bin/import_all by_col=1
97
		To use row-based import: . bin/import_all
98
		To stop all running imports: . bin/stop_imports
99
		WARNING: Do NOT run import_all in the background, or the jobs it creates
100
			won't be owned by your shell.
101
		Note that import_all will take up to an hour to import the NCBI backbone
102
			and other metadata before returning control to the shell.
103
	Wait (overnight) for the import to finish
104
	To recover from a closed terminal window: screen -r
105
	When there are no more running jobs, exit the screen
106
	Get $version: echo $version
107
	Set $version in all vegbiendev terminals: export version=<version>
108
	Upload logs (run on vegbiendev): make inputs/upload
109
	On local machine: make inputs/download-logs
110
	In PostgreSQL:
111
		Check that the provider_count and source tables contain entries for all
112
			inputs
113
	tail inputs/{.,}*/*/logs/$version.log.sql
114
	In the output, search for "Command exited with non-zero status"
115
	For inputs that have this, fix the associated bug(s)
116
	If many inputs have errors, discard the current (partial) import:
117
		make schemas/$version/uninstall
118
	Otherwise, continue
119
	make schemas/$version/publish
120
	unset version
121
	backups/fix_perms
122
	make backups/upload
123
	On jupiter:
124
		cd /data/dev/aaronmk/bien/backups
125
		For each newly-archived backup:
126
			make -s <backup>.md5/test
127
			Check that "OK" is printed next to the filename
128
	On nimoy:
129
		cd /home/bien/svn/
130
		svn up
131
		export version=<version>
132
		make backups/analytical_stem.$version.csv/download
133
		In the bien_web DB:
134
			Create the analytical_stem_<version> table using its schema
135
				in schemas/vegbien.my.sql
136
		make -s backups/analytical_stem.$version.csv.md5/test
137
		Check that "OK" is printed next to the filename
138
		env table=analytical_stem_$version bin/publish_analytical_db \
139
			backups/analytical_stem.$version.csv
140
	If desired, record the import times in inputs/import.stats.xls:
141
		Open inputs/import.stats.xls
142
		If the rightmost import is within 5 columns of column IV:
143
			Copy the current tab to <leftmost-date>~<rightmost-date>
144
			Remove the previous imports from the current tab because they are
145
				now in the copied tab instead
146
		Insert a copy of the leftmost "By column" column group before it
147
		export version=<version>
148
		bin/import_date inputs/{.,}*/*/logs/$version.log.sql
149
		Update the import date in the upper-right corner
150
		bin/import_times inputs/{.,}*/*/logs/$version.log.sql
151
		Paste the output over the # Rows/Time columns, making sure that the
152
			row counts match up with the previous import's row counts
153
		If the row counts do not match up, insert or reorder rows as needed
154
			until they do. Get the datasource names from the log file footers:
155
			tail inputs/{.,}*/*/logs/$version.log.sql
156
		Commit: svn ci -m "inputs/import.stats.xls: Updated import times"
157
	To run TNRS: make scrub by_col=1 &
158
		export version=<version>
159
		To view progress:
160
			tail -100 inputs/.TNRS/tnrs/logs/tnrs.make.log.sql
161
	To remake analytical DB: bin/make_analytical_db &
162
		export version=<version>
163
		To view progress:
164
			tail -100 inputs/analytical_db/logs/make_analytical_db.log.sql
165
	To back up DB (staging tables and last import):
166
		export version=<version>
167
		If before renaming to public: export dump_opts=--exclude-schema=public
168
		make backups/vegbien.$version.backup/test &
169 3381 aaronmk
170 3545 aaronmk
Backups:
171 8458 aaronmk
	Archived imports:
172
		Back up: make backups/<version>.backup &
173
			Note: To back up the last import, you must archive it first:
174
				make schemas/rotate
175
		Test: make -s backups/<version>.backup/test &
176
		Restore: make backups/<version>.backup/restore &
177
		Remove: make backups/<version>.backup/remove
178
		Download: make backups/download
179
	TNRS cache:
180
		Back up: make backups/TNRS.backup-remake &
181
		Restore:
182
			yes|make inputs/.TNRS/uninstall
183
			make backups/TNRS.backup/restore &
184
			yes|make schemas/public/reinstall
185
				Must come after TNRS restore to recreate tnrs_input_name view
186
	Full DB:
187
		Back up: make backups/vegbien.<version>.backup &
188
		Test: make -s backups/vegbien.<version>.backup/test &
189
		Restore: make backups/vegbien.<version>.backup/restore &
190
		Download: make backups/download
191
	Import logs:
192
		Download: make inputs/download-logs
193 554 aaronmk
194 1773 aaronmk
Datasource setup:
195 8469 aaronmk
	umask ug=rwx,o= # prevent files from becoming web-accessible
196 8458 aaronmk
	Add a new datasource: make inputs/<datasrc>/add
197
		<datasrc> may not contain spaces, and should be abbreviated.
198
		If the datasource is a herbarium, <datasrc> should be the herbarium code
199
			as defined by the Index Herbariorum <http://sweetgum.nybg.org/ih/>
200
	For MySQL inputs (exports and live DB connections):
201
		For .sql exports:
202
			Place the original .sql file in _src/ (*not* in _MySQL/)
203
			Follow the steps starting with Install the staging tables below.
204
				This is for an initial sync to get the file onto vegbiendev.
205
			On vegbiendev:
206
				Create a database for the MySQL export in phpMyAdmin
207
				bin/mysql_bien database <inputs/<datasrc>/_src/export.sql &
208
		mkdir inputs/<datasrc>/_MySQL/
209
		cp -p lib/MySQL.{data,schema}.sql.make inputs/<datasrc>/_MySQL/
210
		Edit _MySQL/*.make for the DB connection
211
			For a .sql export, use server=vegbiendev and --user=bien
212
		Skip the Add input data for each table section
213
	For MS Access databases:
214
		Place the .mdb or .accdb file in _src/
215
		Download and install Access To PostgreSQL from
216
			http://www.bullzip.com/download.php
217
		Use Access To PostgreSQL to export the database:
218
			Export just the tables/indexes to inputs/<datasrc>/<file>.schema.sql
219
			Export just the data to inputs/<datasrc>/<file>.data.sql
220
		In <file>.schema.sql, make the following changes:
221
			Replace text "BOOLEAN" with "/*BOOLEAN*/INTEGER"
222
			Replace text "DOUBLE PRECISION NULL" with "DOUBLE PRECISION"
223
		Skip the Add input data for each table section
224
	Add input data for each table present in the datasource:
225
		For .sql exports, you must use the name of the table in the DB export
226
		For CSV files, you can use any name. It's recommended to use a table
227
			name from <https://projects.nceas.ucsb.edu/nceas/projects/bien/wiki/VegCSV#Suggested-table-names>
228
		Note that if this table will be joined together with another table, its
229
			name must end in ".src"
230
		make inputs/<datasrc>/<table>/add
231
			Important: DO NOT just create an empty directory named <table>!
232
				This command also creates necessary subdirs, such as logs/.
233
		If the table is in a .sql export: make inputs/<datasrc>/<table>/install
234
			Otherwise, place the CSV(s) for the table in
235
			inputs/<datasrc>/<table>/ OR place a query joining other tables
236
			together in inputs/<datasrc>/<table>/create.sql
237
		Important: When exporting relational databases to CSVs, you MUST ensure
238
			that embedded quotes are escaped by doubling them, *not* by
239
			preceding them with a "\" as is the default in phpMyAdmin
240
		If there are multiple part files for a table, and the header is repeated
241
			in each part, make sure each header is EXACTLY the same.
242 8466 aaronmk
			(If the headers are not the same, the CSV concatenation script
243
			assumes the part files don't have individual headers and treats the
244
			subsequent headers as data rows.)
245 8458 aaronmk
		Add <table> to inputs/<datasrc>/import_order.txt before other tables
246
			that depend on it
247
	Install the staging tables:
248
		make inputs/<datasrc>/reinstall quiet=1 &
249
		For a MySQL .sql export:
250
			At prompt "[you]@vegbiendev's password:", enter your password
251
			At prompt "Enter password:", enter the value in config/bien_password
252
		To view progress: tail -f inputs/<datasrc>/<table>/logs/install.log.sql
253
		View the logs: tail -n +1 inputs/<datasrc>/*/logs/install.log.sql
254
			tail provides a header line with the filename
255
			+1 starts at the first line, to show the whole file
256
		For every file with an error 'column "..." specified more than once':
257
			Add a header override file "+header.<ext>" in <table>/:
258
				Note: The leading "+" should sort it before the flat files.
259
					"_" unfortunately sorts *after* capital letters in ASCII.
260
				Create a text file containing the header line of the flat files
261
				Add an ! at the beginning of the line
262
					This signals cat_csv that this is a header override.
263
				For empty names, use their 0-based column # (by convention)
264
				For duplicate names, add a distinguishing suffix
265
				For long names that collided, rename them to <= 63 chars long
266
				Do NOT make readability changes in this step; that is what the
267
					map spreadsheets (below) are for.
268
				Save
269
		If you made any changes, re-run the install command above
270
	Auto-create the map spreadsheets: make inputs/<datasrc>/
271
	Map each table's columns:
272
		In each <table>/ subdir, for each "via map" map.csv:
273
			Open the map in a spreadsheet editor
274
			Open the "core map" /mappings/Veg+-VegBIEN.csv
275
			In each row of the via map, set the right column to a value from the
276
				left column of the core map
277
			Save
278
		Regenerate the derived maps: make inputs/<datasrc>/
279
	Accept the test cases:
280
		make inputs/<datasrc>/test
281
			When prompted to "Accept new test output", enter y and press ENTER
282
			If you instead get errors, do one of the following for each one:
283
			-	If the error was due to a bug, fix it
284
			-	Add a SQL function that filters or transforms the invalid data
285
			-	Make an empty mapping for the columns that produced the error.
286
				Put something in the Comments column of the map spreadsheet to
287
				prevent the automatic mapper from auto-removing the mapping.
288
			When accepting tests, it's helpful to use WinMerge
289
				(see WinMerge setup below for configuration)
290
		make inputs/<datasrc>/test by_col=1
291
			If you get errors this time, this always indicates a bug, usually in
292
				the VegBIEN unique constraints or column-based import itself
293
	Add newly-created files: make inputs/<datasrc>/add
294
	Commit: svn ci -m "Added inputs/<datasrc>/" inputs/<datasrc>/
295
	Update vegbiendev:
296
		On jupiter: svn up
297
		On local machine:
298
			./fix_perms
299
			make inputs/upload
300
		On vegbiendev:
301
			svn up
302
			make inputs/download
303
			Follow the steps under Install the staging tables above
304 1773 aaronmk
305 6484 aaronmk
Datasource refreshing:
306 8458 aaronmk
	VegBank:
307
		make inputs/VegBank/vegbank.sql-remake
308
		make inputs/VegBank/reinstall quiet=1 &
309 6484 aaronmk
310 702 aaronmk
Schema changes:
311 8458 aaronmk
	When changing the analytical views, run sync_analytical_..._to_view()
312
		to update the corresponding table
313
	Remember to update the following files with any renamings:
314
		schemas/filter_ERD.csv
315
		mappings/VegCore-VegBIEN.csv
316
		mappings/verify.*.sql
317
	Regenerate schema from installed DB: make schemas/remake
318
	Reinstall DB from schema: make schemas/public/reinstall schemas/reinstall
319
		WARNING: This will delete the current public schema of your VegBIEN DB!
320 8837 aaronmk
	Reinstall staging tables:
321
		On local machine:
322 8840 aaronmk
			sudo -E -u postgres psql <<<'ALTER DATABASE vegbien RENAME TO vegbien_prev'
323 8845 aaronmk
			make db
324 8837 aaronmk
			. bin/reinstall_all
325
			Fix any bugs and retry until no errors
326 8846 aaronmk
			make schemas/public/install
327
				This must be run *after* the datasources are installed, because
328
				views in public depend on some of the datasources
329 8842 aaronmk
			sudo -E -u postgres psql <<<'DROP DATABASE vegbien_prev'
330 8841 aaronmk
		On vegbiendev: repeat the above steps
331 8837 aaronmk
			WARNING: Do not run this until reinstall_all runs successfully on
332
			the local machine, or the live DB may be unrestorable!
333 8458 aaronmk
	Sync ERD with vegbien.sql schema:
334
		Run make schemas/vegbien.my.sql
335
		Open schemas/vegbien.ERD.mwb in MySQLWorkbench
336
		Go to File > Export > Synchronize With SQL CREATE Script...
337
		For Input File, select schemas/vegbien.my.sql
338
		Click Continue
339
		In the changes list, select each table with an arrow next to it
340
		Click Update Model
341
		Click Continue
342
		Note: The generated SQL script will be empty because we are syncing in
343
			the opposite direction
344
		Click Execute
345
		Reposition any lines that have been reset
346
		Add any new tables by dragging them from the Catalog in the left sidebar
347
			to the diagram
348
		Remove any deleted tables by right-clicking the table's diagram element,
349
			selecting Delete '<table name>', and clicking Delete
350
		Save
351
		If desired, update the graphical ERD exports (see below)
352
	Update graphical ERD exports:
353
		Go to File > Export > Export as PNG...
354
		Select schemas/vegbien.ERD.png and click Save
355
		Go to File > Export > Export as SVG...
356
		Select schemas/vegbien.ERD.svg and click Save
357
		Go to File > Export > Export as Single Page PDF...
358
		Select schemas/vegbien.ERD.1_pg.pdf and click Save
359
		Go to File > Print...
360
		In the lower left corner, click PDF > Save as PDF...
361
		Set the Title and Author to ""
362
		Select schemas/vegbien.ERD.pdf and click Save
363
		Commit: svn ci -m "schemas/vegbien.ERD.mwb: Regenerated exports"
364
	Refactoring tips:
365
		To rename a table:
366
			In vegbien.sql, do the following:
367
				Replace regexp (?<=_|\b)<old>(?=_|\b) with <new>
368
					This is necessary because the table name is *everywhere*
369
				Search for <new>
370
				Manually change back any replacements inside comments
371
		To rename a column:
372
			Rename the column: ALTER TABLE <table> RENAME <old> TO <new>;
373
			Recreate any foreign key for the column, removing CONSTRAINT <name>
374
				This resets the foreign key name using the new column name
375
	Creating a poster of the ERD:
376
		Determine the poster size:
377
			Measure the line height (from the bottom of one line to the bottom
378
				of another): 16.3cm/24 lines = 0.679cm
379
			Measure the height of the ERD: 35.4cm*2 = 70.8cm
380
			Zoom in as far as possible
381
			Measure the height of a capital letter: 3.5mm
382
			Measure the line height: 8.5mm
383
			Calculate the text's fraction of the line height: 3.5mm/8.5mm = 0.41
384
			Calculate the text height: 0.679cm*0.41 = 0.28cm
385
			Calculate the text height's fraction of the ERD height:
386
				0.28cm/70.8cm = 0.0040
387
			Measure the text height on the *VegBank* ERD poster: 5.5mm = 0.55cm
388
			Calculate the VegBIEN poster height to make the text the same size:
389
				0.55cm/0.0040 = 137.5cm H; *1in/2.54cm = 54.1in H
390
			The ERD aspect ratio is 11 in W x (2*8.5in H) = 11x17 portrait
391
			Calculate the VegBIEN poster width: 54.1in H*11W/17H = 35.0in W
392
			The minimum VegBIEN poster size is 35x54in portrait
393
		Determine the cost:
394
			The FedEx Kinkos near NCEAS (1030 State St, Santa Barbara, CA 93101)
395
				charges the following for posters:
396
				base: $7.25/sq ft
397
				lamination: $3/sq ft
398
				mounting on a board: $8/sq ft
399 203 aaronmk
400 1459 aaronmk
Testing:
401 8458 aaronmk
	On a development machine, you should put the following in your .profile:
402 8469 aaronmk
		umask ug=rwx,o= # prevent files from becoming web-accessible
403 8458 aaronmk
		export log= n=2
404
	Mapping process: make test
405
		Including column-based import: make test by_col=1
406
			If the row-based and column-based imports produce different inserted
407
			row counts, this usually means that a table is underconstrained
408
			(the unique indexes don't cover all possible rows).
409
			This can occur if you didn't use COALESCE(field, null_value) around
410
			a nullable field in a unique index. See sql_gen.null_sentinels for
411
			the appropriate null value to use.
412
	Map spreadsheet generation: make remake
413
	Missing mappings: make missing_mappings
414
	Everything (for most complete coverage): make test-all
415 702 aaronmk
416 7183 aaronmk
Debugging:
417 8458 aaronmk
	"Binary chop" debugging:
418
		(This is primarily useful for regressions that occurred in a previous
419
		revision, which was committed without running all the tests)
420
		svn up -r <rev>; make inputs/.TNRS/reinstall; make schemas/public/reinstall; make <failed-test>.xml
421 8470 aaronmk
	.htaccess:
422
		mod_rewrite:
423 8471 aaronmk
			IMPORTANT: whenever you change the DirectorySlash setting for a
424
				directory, you *must* clear your browser's cache to ensure that
425
				a cached redirect is not used. this is because RewriteRule
426
				redirects are (by default) temporary, but DirectorySlash
427
				redirects are permanent.
428 8470 aaronmk
				for Firefox:
429
					press Cmd+Shift+Delete
430
					check only Cache
431
					press Enter or click Clear Now
432 7183 aaronmk
433 3783 aaronmk
WinMerge setup:
434 8458 aaronmk
	Install WinMerge from <http://winmerge.org/>
435
	Open WinMerge
436
	Go to Edit > Options and click Compare in the left sidebar
437
	Enable "Moved block detection", as described at
438
		<http://manual.winmerge.org/Configuration.html#d0e5892>.
439
	Set Whitespace to Ignore change, as described at
440
		<http://manual.winmerge.org/Configuration.html#d0e5758>.
441 3783 aaronmk
442 3133 aaronmk
Documentation:
443 8458 aaronmk
	To generate a Redmine-formatted list of steps for column-based import:
444
		make schemas/public/reinstall
445
		make inputs/ACAD/Specimen/logs/steps.by_col.log.sql
446
	To import and scrub just the test taxonomic names:
447
		inputs/test_taxonomic_names/test_scrub
448 3133 aaronmk
449 702 aaronmk
General:
450 8458 aaronmk
	To see a program's description, read its top-of-file comment
451
	To see a program's usage, run it without arguments
452
	To remake a directory: make <dir>/remake
453
	To remake a file: make <file>-remake