Revision 5881
Added by Aaron Marcuse-Kubitza over 12 years ago
| README.TXT | ||
|---|---|---|
| 105 | 105 |
This command also creates necessary subdirs, such as logs/. |
| 106 | 106 |
Place the CSV for the table in inputs/<datasrc>/<table>/ |
| 107 | 107 |
OR place a query joining other tables together in |
| 108 |
inputs/<datasrc>/<table>/create.sql and svn add this file
|
|
| 108 |
inputs/<datasrc>/<table>/create.sql |
|
| 109 | 109 |
Important: When exporting relational databases to CSVs, you MUST ensure |
| 110 | 110 |
that embedded quotes are escaped by doubling them, *not* by |
| 111 | 111 |
preceding them with a "\" as is the default in phpMyAdmin |
| ... | ... | |
| 116 | 116 |
subsequent headers as data rows.) |
| 117 | 117 |
Add <table> to inputs/<datasrc>/import_order.txt before other tables |
| 118 | 118 |
that depend on it |
| 119 |
Auto-create the map spreadsheets: |
|
| 120 |
make inputs/<datasrc>/ |
|
| 121 |
svn add inputs/<datasrc>/*/{,.}{header,map,*terms,VegBIEN}.csv{,.*}
|
|
| 119 |
Auto-create the map spreadsheets: make inputs/<datasrc>/ |
|
| 122 | 120 |
Install the staging tables: |
| 123 | 121 |
make inputs/<datasrc>/reinstall quiet=1 & |
| 124 | 122 |
To view progress: tail -f inputs/<datasrc>/<table>/logs/install.log.sql |
| ... | ... | |
| 138 | 136 |
Do NOT make readability changes in this step; that is what the |
| 139 | 137 |
map spreadsheets (below) are for. |
| 140 | 138 |
Save |
| 141 |
svn add inputs/<datasrc>/<table>/<header_override> |
|
| 142 | 139 |
If you made any changes, re-run the install command above |
| 143 | 140 |
Map each table's columns: |
| 144 | 141 |
In each <table>/ subdir, for each "via map" map.csv: |
| ... | ... | |
| 162 | 159 |
make inputs/<datasrc>/test by_col=1 |
| 163 | 160 |
If you get errors this time, this always indicates a bug, usually in |
| 164 | 161 |
either the unique constraints or column-based import itself |
| 165 |
svn add inputs/<datasrc>/*/test.xml.ref
|
|
| 162 |
Add newly-created files: make inputs/<datasrc>/add
|
|
| 166 | 163 |
Commit: svn ci -m "Added inputs/<datasrc>/" inputs/<datasrc>/ |
| 167 | 164 |
Update vegbiendev: |
| 168 | 165 |
On vegbiendev: svn up |
Also available in: Unified diff
README.TXT: Datasource setup: Replaced manual `svn add` commands with one `make inputs/<datasrc>/add` before committing to add newly-created files