Updated MOD06 compile script to process the tiles in parallel using GRASS. This brings processing time for 10 year archive for oregon from 48 hours to ~2 hours on 24 cores. Also added several exploratory analysis to the data_summary script.

Added cloud flag to outputs

First 10-year processing of daily mean tifs

First full processing of daily mean tifs

MOD06 processing runs well in sequence, but not parallel

Reorganization: moved mindmap to it's own directory to isolate temporary files created when exporting to other formats

Add initial version of the 'mind map' for the interpolation project. This file contains an outline of the various stages of the project and links back to issues and code in the blessed repository.
Created during Benoit's visit to Yale May 21-22.

Adding some MOD06 (cloud product) processing routines. Still a work in progress

Initial commit

simplified code by using 'a' flag for r.neighbors (improves 3abda63)

reorganized AML terrain scripts to reduce superficial redundancy

renamed script to multiscalesmooth.R

numerous comment, format, and variable name changes

now actually refining before smoothing (GRASS version)

reversed order of refine-and-smooth step

added GRASS/Python implementation of multiscale smoother

added R script to run multiscalesmooth example on Oregon SRTM

switched to more accurate chisq test

enhanced smoother to accept sd as a raster, not just a constant

tweaked var names to match Gallant pub; added comments

fixed vwg step

continued R translation of multiscale smoother

initial R translation of multiscale smoother

added test script for days missing from our MOD11A1 OR holdings

added old GLCNMO land-cover AML scripts (Tien Ming Lee)

added old Oregon topo AML scripts (Tien Ming Lee, John Gallant)

renamed layers 'experimental' area to 'commons'

added repository README file

finished organisms->layers content migration

documented migration of aster gdem1 and gtopo materials

folded Nunokawa backup file changes into vrt script file

cleaned up file permissions

added in various previously uncommitted scripts

added organisms->layers content migration 'script'

reorganized terrain-related files

removed obsolete/preliminary DEM 60N assessment scripts

removed obsolete/preliminary DEM 60N mosaicing scripts

removed obsolete/preliminary DEM regional mosaicing scripts

added old R script to assess our SRTM holdings

tweaked aster-check script to work from anywhere

added R script to compare ASTER tile names to locations

added PDF of boundary assessment doc sent to the group

final minor edits before posting to the group

just minor tweaks to code comments

added histogram plot of ASTER-SRTM differences

removed placeholder cruft from flowdir correlation plots

spell-checked boundary analysis doc (aspell)

more boundary analysis updates, especially discussion of stats

added correlations/RMSE discussion, plus many new edits

numerous changes and revisions to boundary assessment doc

switched plot to bin by SRTM elev rather than ASTER

added ASTER vs SRTM elevation comparision plots

revamped aspect/flowdir boundary assessments to use circular statistics

split the dem-fusion code snippets into separate script files

minor cleanup of code comments

added multiresolution spline fused layer as terraflow input

added prose text to boundary document, and (partly) refactored figures

early version of 60N boundary assessment report

updated boundary assessment code to use multires spline results

fixed critical typo in post-processing enblended layer

added GRASS commands to run terraflow on Canada boundary DEMs

added R code to create various boundary assessment figures

added R code to 'enblend' DEMs (multires splines, Burt & Adelson, 1983)

superficial tweaks to DEM fusion R code

added code to profile aspect near 60N boundary (just like slope code)

separated out code to profile slope near 60N boundary

added GRASS/R code to run/compare flow analysis on Oregon test area

added GRASS terraflow code plus basic R diagnostics for 60N test case

added slope boundary descrepancy plotting code

added GDAL/R code for fusing and correcting DEMs near Canadian border

Set of shell scripts used to create prototype terrain mosaic layers from CGIR SRTM and ASTER GDEM data tiles.
Two prototypes generated: 3 ArcSecond and 30 ArcSecond resolution. There are some minor inconsistencies in these scripts; however, the mosaic layer components that they generate appear to be valid, except for some...

First version of this script; dKc constant is not optimally set yet. Need more experimentation.

Version of pixel pair plotting script that adds 'Lowess Lines' to center of each scatterplot.

Note: Loess lines feature has only been tested with the input file "pixelPairs36000_5_8EvenSortCol1.csv", used in the script.
Some table column names are hard-coded into the script.

This version has improved, vertically-stacked plots.

First version of 'image blending' solution that employs a linear decay function to blend ASTER and SRTM pixel values south of 60 degree N Latitude line.

First version of ASTER/SRTM boundary adjustment R script that tests a prototype 'exponential decay' function on a sub image of the DEM imaage mosaic.

First version of R script that adjusts the boundary between ASTER and SRTM components of DEM image mosaic created for Environment and Organisms project. This prototype version uses a set of 'narrow' test images, applies a linear ramp function. Later versions will use more sophisticated functions.

this table created using the latest and best-aligned versions of the 'boundary validation' (ASTER/SRTM/CDEM) subimages. Input to the script: CreateImageDiffPlotsOverlayNewPlots.r

Added option: write individual plots (not trplets - yet) to separate JPG files. New command line argument: JpgPlotFileFlag

Table used by CreateImageDiffPlotsOverlayNewPlots.r
to create latest set of (normalized) difference scatterplots

This version used to create the large (36000 row) table used to generate latest bounday analysis scatterplots.

This version creates the (normalized) difference image plots
that Rick, Jim, and Mark are reviewing as part of the final 'ASTER/SRTM boundary analysis' work.
The input file pixelPairs36000_5_8EvenSortCol1.csv also checked in.

The first version of 'CreateImageDiffPlotsOverlay.r' that produces the 'three-panel' plot containing the boundary differences for ASTER / Border / SRTM.

Latest version of Elevation Difference Image Analysis plot generator: Plots remain on screen until end of script (user presses 'final' <cr>

TODO: Add legend to plots.

correct CDEM image values

With correct CEDM input image filename.

Uses correct, even boundary input images

made with latest version of makeImagePairTable w/correct images.

created with latest version of code 5/15

Tested Sunday 5/15 - produces table tableForRic2000_5_8.csv

In header, better 'to run' instructions.

input table for the R script: MosaicCdemDifferencePlots.r
Created by the R script: makeImagePairFiles.

First working version - very simple - just 'source' the file and press <CR> to walk through the plots.

Next version: 'panel plots' and improved plot axes.

Very first version of plot making script. Plots need consolidation into 'panel plots', and plot labels need to be improved.

Uses input file:
tableForMark4000_5_8_SortColID.csv, also checked in.

These scripts are complete but may not run correctly due to conflicts in the extents of the input raster files. Recheck inputs.

Version runs correctly, though the CDEM edge input image might not be the latest and best. Recheck inputs

ReadMe file describes how to use shell scripts (also checked in) to create example Srtm/Aster DEM image mosaic of Western Canada region spanning 60 deg N Latitude boundary

Sample output file from R script makeMarkTable.r - sample of 4000 random columns, row 5 through row 8 straddling 60 degree boundary.

Producing valid table, but from column samples taken entirely from mosaic. Next step: take them from Aster and Cgiar images.

First version, has issues with column indexing, I am fixing tonight.