Project

General

Profile

« Previous | Next » 

Revision 11493

Added by Paul Sarando almost 11 years ago

Added geoscrub.sh script.

This script runs the load-geoscrub-input.sh, geonames.sql, and
geovalidate.sql scripts in order to load and scrub vegbien input data.
Updated README to explain the new script.
Minor updates to load-geoscrub-input.sh.

View differences:

README.txt
37 37 
WARNING: deletes any previous geoscrubbing results!
38 38 
runtime: ~5.5 h
39 39 
cd <svn_biengeo_root>
40 
4. load-geoscrub-input.sh
41 
   - dumps geoscrub_input from vegbien and loads it into the geoscrub db
42 
5. geonames.sql
43 
sudo -u postgres psql -e --set ON_ERROR_STOP=1 -d geoscrub < geonames.sql
44 
   - contains SQL statements that scrub asserted names and (to the
45 
     extent possible) map them to GADM2
46 
6. geovalidate.sql
47 
runtime: 5.5 h
48 
sudo -u postgres psql -e --set ON_ERROR_STOP=1 -d geoscrub < geovalidate.sql
49 
   - contains (postgis-extended) SQL statements that score the validity
50 
     of GADM2-scrubbed names against given point coordinates
40 
4. geoscrub.sh
41 
   - runs the following scripts in order to load and scrub vegbien input data:
42 
   * load-geoscrub-input.sh
43 
     - dumps geoscrub_input from vegbien and loads it into the geoscrub db
44 
   * geonames.sql
45 
     - contains SQL statements that scrub asserted names and (to the
46 
       extent possible) map them to GADM2
47 
   * geovalidate.sql
48 
     runtime: 5.5 h
49 
     - contains (postgis-extended) SQL statements that score the validity
50 
       of GADM2-scrubbed names against given point coordinates
51 51 

  		




  52
  52
  
    
[Also see comments embedded in specific scripts in this directory.]


  		




  53
  53
  
    

  		




  54
  
  
    
The bash and SQL statements contained in the files as ordered below


  		




  
  54
  
    
The bash and SQL statements contained in the files as ordered above


  		




  55
  55
  
    
should be applied to carry out geographic name scrubbing and


  		




  56
  56
  
    
geovalidation on a given corpus of BIEN location records.


  		




  57
  57
  
    

  		












Also available in:  Unified diff