05/16/2011

04:11 PM Revision 8fd072d3: The first version of 'CreateImageDiffPlotsOverlay.r' that produces the 'three-panel' plot containing the boundary differences for ASTER / Border / SRTM.

Rick Reeves

10:07 AM Revision 49c441dd: Latest version of Elevation Difference Image Analysis plot generator: Plots remain on screen until end of script (user presses 'final' <cr>

TODO: Add legend to plots. Rick Reeves

05/15/2011

01:29 PM Revision 218022c8: correct CDEM image values

Rick Reeves

01:29 PM Revision 3db72d58: With correct CEDM input image filename.

Rick Reeves

12:26 PM Revision 9d19fb11: Uses correct, even boundary input images

Rick Reeves

12:25 PM Revision b81f0431: made with latest version of makeImagePairTable w/correct images.

Rick Reeves

11:39 AM Revision ce53f1db: created with latest version of code 5/15

Rick Reeves

11:39 AM Revision 27c37be1: Tested Sunday 5/15 - produces table tableForRic2000_5_8.csv

Rick Reeves

05/13/2011

03:33 PM Revision 4b8cd90f: In header, better 'to run' instructions.

Rick Reeves

03:21 PM Revision a0267fb3: input table for the R script: MosaicCdemDifferencePlots.r

Created by the R script: makeImagePairFiles. Rick Reeves

03:19 PM Revision 80390607: First working version - very simple - just 'source' the file and press <CR> to walk through the plots.

Next version: 'panel plots' and improved plot axes. Rick Reeves

02:38 PM Revision d732553c: Very first version of plot making script. Plots need consolidation into 'panel plots', and plot labels need to be improved.

Uses input file:
tableForMark4000_5_8_SortColID.csv, also checked in. Rick Reeves

10:56 AM Task #207: Produce global fused DEM layer

Here is an example of the workflows that generate fused digital terrain data layers
for one of the four Earth 'quadr... Rick Reeves

05/12/2011

11:05 PM Task #215: Establish file organization and possible 'tiling' scheme for Fused Global Terrain data set

I am using this scheme; have created the directory structure, and have constructed
the first prototype fused global... Rick Reeves

05/10/2011

05:05 PM Revision f028b3dc: These scripts are complete but may not run correctly due to conflicts in the extents of the input raster files. Recheck inputs.

Rick Reeves

05:04 PM Revision 5c833657: Version runs correctly, though the CDEM edge input image might not be the latest and best. Recheck inputs

Rick Reeves

03:12 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

5/10/2011
Rick R -
To (finally) completely respond to Rob G's request:
(Work was delayed because of unexpected p... Rick Reeves

02:20 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

... Rick Reeves

05/09/2011

05:20 PM Task #207: Produce global fused DEM layer

Using a subset of the ASTER 'master tile list' (supplied by Bob Crippen at JPL) containing only the image tile file n... Rick Reeves

05/06/2011

04:10 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

Jim, I agree. You can in fact see the 1/2 pixel 'offset' in the screenshots that I captured
of the magnified ArcMap ... Rick Reeves

09:02 AM Task #212: Validate fused DEM at SRTM/ASTER boundary

... Rick Reeves

07:40 AM Task #212: Validate fused DEM at SRTM/ASTER boundary

Two points regarding DEM raster extents and alignments:
* At least for SRTM, the pixel _*centers*_ are lined up al... Jim Regetz

03:57 PM Task #219: Good News: JPL provides comprehensive Global List of ALL ASTER DEM files

I re-read Bob's email; he notes that the file list for the GDEM2 data set should be 'the same or close' to
the GDEM... Rick Reeves

03:52 PM Task #219 (Rejected): Good News: JPL provides comprehensive Global List of ALL ASTER DEM files

I asked the technical POC for the ASTER Data Product if a master list of ASTER DEM files/tiles
was available for us... Rick Reeves

08:55 AM Task #207: Produce global fused DEM layer

Here, for the team's comment and feedback, is my proposed plan for producing the global Fused 1 Km Terrain layer.
... Rick Reeves

05/05/2011

02:36 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

I have created and checked in a readme file which documents the steps I used to
generate one of the first image mos... Rick Reeves

02:29 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

... Rick Reeves

01:09 PM Revision f9dbcec6: ReadMe file describes how to use shell scripts (also checked in) to create example Srtm/Aster DEM image mosaic of Western Canada region spanning 60 deg N Latitude boundary

Rick Reeves

11:05 AM Revision 0f948be9: Sample output file from R script makeMarkTable.r - sample of 4000 random columns, row 5 through row 8 straddling 60 degree boundary.

Rick Reeves

11:02 AM Revision ad35c236: Producing valid table, but from column samples taken entirely from mosaic. Next step: take them from Aster and Cgiar images.

Rick Reeves

05/04/2011

05:47 PM Revision b67964e8: First version, has issues with column indexing, I am fixing tonight.

Rick Reeves

05:08 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

At Rob's request, I used R Raster package hist() function to generate histograms
for the images used in the image bo... Rick Reeves

01:43 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

... Rick Reeves

11:31 AM Task #212: Validate fused DEM at SRTM/ASTER boundary

I retrieved the Wilson and Gallant text from UCSB Library, and reviewed several of the chapters.
At the very least,... Rick Reeves

05/02/2011

04:41 PM Revision 230f2a79: Added collection of Linux shell scripts and R scripts that I used in my initial analysis of SRTM/CGIAR, CDEM, and ASTER GDEM digital terrain data sets.

Rick Reeves

02:23 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

Rick Reeves wrote:
>
> Preliminary visual review of these files, using ArcMap GIS zoom and variable transparency... Mark Schildhauer

01:49 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

I am reporting report 30 hours spent on this task since April 25.
Email on 5/02 to Rob Guranick:
Re: Border a... Rick Reeves

05/01/2011

11:52 AM Task #212: Validate fused DEM at SRTM/ASTER boundary

... Rick Reeves

11:46 AM Task #212: Validate fused DEM at SRTM/ASTER boundary

Here is the output from a set of 'image difference' calculations made using the R script 'SampleDemDiffCols.r",
whic... Rick Reeves

04/29/2011

04:36 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

Was:
gdalwarp -te -135.9880605 58.4644470 -101.3377799 61.5793224 -r bilinear CanadaDemMosTuesdayClip.tif
CDem... Rick Reeves

04:02 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

I am (finally) working through the 'image difference' analysis that Jim sketched out earlier this week.
And the firs... Rick Reeves

02:47 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

Jim:
As I mentioned, after I completed my initial 'screen based' review of the boundary area, I intend to perform t... Rick Reeves

09:17 AM Task #212: Validate fused DEM at SRTM/ASTER boundary

A few comments:
Rick Reeves wrote:
> By superimposing the images and increasing the magnification
> on the lower le... Jim Regetz

11:05 AM Task #210: Produce global aspect layer

Take a look at the "@gdaldem@":http://www.gdal.org/gdaldem.html command-line utility. It includes an _aspect_ mode th... Jim Regetz

11:04 AM Task #209: Produce global slope layer

Take a look at the "@gdaldem@":http://www.gdal.org/gdaldem.html command-line utility. It includes a _slope_ mode that... Jim Regetz

04/28/2011

09:52 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

Yes, the book IS the Wilson and Gallant book. This book is a decade old, and new techniques no doubt have been develo... Rick Reeves

01:25 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

Presumably "the book" refers *Terrain Analysis* (2000) by Wilson and Gallant? Has the state of terrain analysis not ... Mark Schildhauer

11:26 AM Task #212: Validate fused DEM at SRTM/ASTER boundary

The book is on order, and should arrive at UCSB Library in 3 to 5 working days.
It will come in handy in several par... Rick Reeves

08:17 AM Task #212: Validate fused DEM at SRTM/ASTER boundary

Jim:
I think that Robert pointed me in the correct direction, but I took some steps to quantify the error and tes... Rick Reeves

04:33 PM Task #207: Produce global fused DEM layer

I have moved the "ReevesSpatialSoftwareStack.txt" file to the "Documents" section of Redmine, where it will be more o... Mark Schildhauer

04:13 PM Document: Data Portals used in Terrain Analysis

Data Portals currently used by Rick Reeves to create Fused Terrain Data Layer:
Data Search platforms:
http...

11:47 AM Revision 7c3027e7: added empty dir structure for terrestrial work

Jim Regetz

07:46 AM Task #208: Evaluate existing E&O AML scripts

By May 4, I should have reviewed and tested the AML scripts that produce the terrain-derived data layers. In the abse... Rick Reeves

04/27/2011

11:23 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

Rick -- I just noticed your "r-sig-geo":https://stat.ethz.ch/pipermail/r-sig-geo/2011-April/011578.html exchange with... Jim Regetz

10:42 PM Task #207: Produce global fused DEM layer

Mark, Jim, and I met today to review progress on the tasks related to Fused Terrain Layer construction
and to discus... Rick Reeves

10:14 PM Task #207: Produce global fused DEM layer

The first set of ASTER GDEM data search results for the Northern Hemisphere
that I downloaded using the NASA WIST d... Rick Reeves

04/26/2011

05:23 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

Overlapping with Jim's notes (aboveon our discussions today:
I have created two images corresponding to southern ... Rick Reeves

05:20 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

Rick -- this is a restatement of what I sketched out on the board earlier as one way of quantifying the boundary beha... Jim Regetz

04/22/2011

02:28 PM Task #215: Establish file organization and possible 'tiling' scheme for Fused Global Terrain data set

I propose dividing the globe into four quadrants:
Northwest Hemisphere, Southwest Hemisphere, Northeast Hemisphere,... Rick Reeves

02:20 PM Task #212 (In Progress): Validate fused DEM at SRTM/ASTER boundary

Rick Reeves

09:38 AM Task #212: Validate fused DEM at SRTM/ASTER boundary

I have assembled a good sample region, in Western British Colombia along the 60 degree latitude line
where SRTM and ... Rick Reeves

11:51 AM Task #208: Evaluate existing E&O AML scripts

Thank you Ming, more good information.
I do intend to assemble a workflow document of some type next week.
I will s... Rick Reeves

11:45 AM Task #208 (In Progress): Evaluate existing E&O AML scripts

I reviewed all of the AML scripts a second time and am ready to test them within ArcMap GIS. Next week I will do so r... Rick Reeves

04/21/2011

02:28 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

As part of the fused digital terrain layer validation we are looking for 'edge discontinuities' at the boundary betwe... Rick Reeves

10:59 AM Task #207: Produce global fused DEM layer

I see your point re: cell resolution, if we stay in the realm of arc-seconds.
Yes, we are in agreement about produc... Rick Reeves

04/20/2011

04:05 PM Task #207: Produce global fused DEM layer

Also, when you're simply combining tiles, you can get big efficiency gains by using the VRT format with GDAL, rather ... Jim Regetz

03:48 PM Task #207: Produce global fused DEM layer

Thanks Rick. Regarding pixel sizes (cell resolution), what we've been calling "1km" is just shorthand for 30 arcsecon... Jim Regetz

02:10 PM Task #207: Produce global fused DEM layer

(continuing from previous update)
Digital Terrain File data sources:
CGIAR / SRTM 90 meter Digital Elevation Da... Rick Reeves

09:47 AM Task #207 (In Progress): Produce global fused DEM layer

Jim Regetz

09:43 AM Task #207: Produce global fused DEM layer

I have downlowded the complete set (872 files) of CGIAR / SRTM 90 meter data tiles and most if not all (2780) availa... Rick Reeves

04/19/2011

09:48 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

Part of the process of constructing and testing the resampling/mosaicing scripts
for constructing the fused terrain... Rick Reeves

04/18/2011

01:36 PM Task #215 (Rejected): Establish file organization and possible 'tiling' scheme for Fused Global Terrain data set

The size and scope of the global fused DEM terrain layer makes it impractical
to distribute and use the layer (and ... Rick Reeves

01:12 PM Task #213 (Resolved): Confirm with Project Scientists: CGIAR Level 4 SRTM project supports planned Terrain Analysis

Review is complete, based on Rob G's response (below) and on
Based also upon discussions with Mark Sand Jim R on Apr... Rick Reeves

12:32 PM Task #208: Evaluate existing E&O AML scripts

Description of ten existing scripts (nine AML, one Python):
Aggregate.aml: Executes the aggregate (resampling) fun... Rick Reeves