Project

General

Profile

« Previous | Next » 

Revision 14651

Added by Aaron Marcuse-Kubitza over 10 years ago

/README.TXT: Single datasource refresh: moved to top since these steps are performed more often

View differences:

trunk/README.TXT
12 12 
	ssh -t vegbiendev.nceas.ucsb.edu exec sudo -u aaronmk -i
13 13 
	cd /home/bien # should happen automatically at login
14 14 

  		




  
  15
  
    
Single datasource refresh:


  		




  
  16
  
    
	# -> Maintenance > to back up the vegbiendev databases


  		




  
  17
  
    
	ssh -t vegbiendev.nceas.ucsb.edu exec sudo -u aaronmk -i


  		




  
  18
  
    
	rm=1 inputs/<datasrc>/run # reload staging tables


  		




  
  19
  
    
	make inputs/<datasrc>/reimport_scrub by_col=1 &


  		




  
  20
  
    
		# this works whether or not datasource is already imported


  		




  
  21
  
    
	# -> Full database import > To re-run geoscrubbing


  		




  
  22
  
    
	# -> Full database import > To remake analytical DB


  		




  
  23
  
    
	# -> Maintenance > to back up the vegbiendev databases


  		




  
  24
  
    

  		




  15
  25
  
    
Notes on system stability:


  		




  16
  26
  
    
	**WARNING**: when shutting down the VM, always first stop Postgres:


  		




  17
  27
  
    
		sudo service postgresql stop


  		




  ......




  38
  48
  
    
		while an import is in progress will not crash the import (see


  		




  39
  49
  
    
		http://vegpath.org/links/#**%20modifying%20a%20running%20shell%20script)


  		




  40
  50
  
    

  		




  41
  
  
    
Single datasource refresh:


  		




  42
  
  
    
	# -> Maintenance > to back up the vegbiendev databases


  		




  43
  
  
    
	ssh -t vegbiendev.nceas.ucsb.edu exec sudo -u aaronmk -i


  		




  44
  
  
    
	rm=1 inputs/<datasrc>/run # reload staging tables


  		




  45
  
  
    
	make inputs/<datasrc>/reimport_scrub by_col=1 &


  		




  46
  
  
    
		# this works whether or not datasource is already imported


  		




  47
  
  
    
	# -> Full database import > To re-run geoscrubbing


  		




  48
  
  
    
	# -> Full database import > To remake analytical DB


  		




  49
  
  
    
	# -> Maintenance > to back up the vegbiendev databases


  		




  50
  
  
    

  		




  51
  51
  
    
Full database import:


  		




  52
  52
  
    
	**WARNING**: You must perform *every single* step listed below, to avoid


  		




  53
  53
  
    
		breaking column-based import


  		












Also available in:  Unified diff