05/20/2011

04:45 PM Task #207: Produce global fused DEM layer

Progress during week of 5/16:
> 1) Located and downloaded most if not all ASTER GDEM data tiles for Northern Hemisph... Rick Reeves

01:20 PM Task #225: Organize and document SRTM input DEM files

h4. Re: Different CGIAR SRTM 3" source data
Rick and I have been discussing the two different sets of CGIAR SRTM r... Jim Regetz

05/19/2011

10:26 AM Task #225: Organize and document SRTM input DEM files

Yes, last week I created a new folder structure to contain the batch files and output files
for the next set of 'pr... Rick Reeves

05/18/2011

11:42 AM Revision ec0af318: this table created using the latest and best-aligned versions of the 'boundary validation' (ASTER/SRTM/CDEM) subimages. Input to the script: CreateImageDiffPlotsOverlayNewPlots.r

Rick Reeves

11:10 AM Revision 4101796f: Added option: write individual plots (not trplets - yet) to separate JPG files. New command line argument: JpgPlotFileFlag

Rick Reeves

05/17/2011

05:33 PM Task #225 (In Progress): Organize and document SRTM input DEM files

_[Updated ticket description on 04-Aug-2011 to focus specifically on SRTM]_
SRTM DEM tiles and associated files ha... Jim Regetz

12:13 PM Revision db78f686: Table used by CreateImageDiffPlotsOverlayNewPlots.r

to create latest set of (normalized) difference scatterplots Rick Reeves

12:12 PM Revision cc196a45: This version used to create the large (36000 row) table used to generate latest bounday analysis scatterplots.

Rick Reeves

12:11 PM Revision acf2afb2: This version creates the (normalized) difference image plots

that Rick, Jim, and Mark are reviewing as part of the final 'ASTER/SRTM boundary analysis' work.
The input file pixel... Rick Reeves

10:47 AM Task #207: Produce global fused DEM layer

Today I received an email from Rob G regarding progress on data layer construction; among the items in the email was ... Rick Reeves

05/16/2011

04:11 PM Revision 8fd072d3: The first version of 'CreateImageDiffPlotsOverlay.r' that produces the 'three-panel' plot containing the boundary differences for ASTER / Border / SRTM.

Rick Reeves

10:07 AM Revision 49c441dd: Latest version of Elevation Difference Image Analysis plot generator: Plots remain on screen until end of script (user presses 'final' <cr>

TODO: Add legend to plots. Rick Reeves

05/15/2011

01:29 PM Revision 218022c8: correct CDEM image values

Rick Reeves

01:29 PM Revision 3db72d58: With correct CEDM input image filename.

Rick Reeves

12:26 PM Revision 9d19fb11: Uses correct, even boundary input images

Rick Reeves

12:25 PM Revision b81f0431: made with latest version of makeImagePairTable w/correct images.

Rick Reeves

11:39 AM Revision ce53f1db: created with latest version of code 5/15

Rick Reeves

11:39 AM Revision 27c37be1: Tested Sunday 5/15 - produces table tableForRic2000_5_8.csv

Rick Reeves

05/13/2011

03:33 PM Revision 4b8cd90f: In header, better 'to run' instructions.

Rick Reeves

03:21 PM Revision a0267fb3: input table for the R script: MosaicCdemDifferencePlots.r

Created by the R script: makeImagePairFiles. Rick Reeves

03:19 PM Revision 80390607: First working version - very simple - just 'source' the file and press <CR> to walk through the plots.

Next version: 'panel plots' and improved plot axes. Rick Reeves

02:38 PM Revision d732553c: Very first version of plot making script. Plots need consolidation into 'panel plots', and plot labels need to be improved.

Uses input file:
tableForMark4000_5_8_SortColID.csv, also checked in. Rick Reeves

10:56 AM Task #207: Produce global fused DEM layer

Here is an example of the workflows that generate fused digital terrain data layers
for one of the four Earth 'quadr... Rick Reeves

05/12/2011

11:05 PM Task #215: Establish file organization and possible 'tiling' scheme for Fused Global Terrain data set

I am using this scheme; have created the directory structure, and have constructed
the first prototype fused global... Rick Reeves

05/10/2011

05:05 PM Revision f028b3dc: These scripts are complete but may not run correctly due to conflicts in the extents of the input raster files. Recheck inputs.

Rick Reeves

05:04 PM Revision 5c833657: Version runs correctly, though the CDEM edge input image might not be the latest and best. Recheck inputs

Rick Reeves

03:12 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

5/10/2011
Rick R -
To (finally) completely respond to Rob G's request:
(Work was delayed because of unexpected p... Rick Reeves

02:20 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

... Rick Reeves

05/09/2011

05:20 PM Task #207: Produce global fused DEM layer

Using a subset of the ASTER 'master tile list' (supplied by Bob Crippen at JPL) containing only the image tile file n... Rick Reeves

05/06/2011

04:10 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

Jim, I agree. You can in fact see the 1/2 pixel 'offset' in the screenshots that I captured
of the magnified ArcMap ... Rick Reeves

09:02 AM Task #212: Validate fused DEM at SRTM/ASTER boundary

... Rick Reeves

07:40 AM Task #212: Validate fused DEM at SRTM/ASTER boundary

Two points regarding DEM raster extents and alignments:
* At least for SRTM, the pixel _*centers*_ are lined up al... Jim Regetz

03:57 PM Task #219: Good News: JPL provides comprehensive Global List of ALL ASTER DEM files

I re-read Bob's email; he notes that the file list for the GDEM2 data set should be 'the same or close' to
the GDEM... Rick Reeves

03:52 PM Task #219 (Rejected): Good News: JPL provides comprehensive Global List of ALL ASTER DEM files

I asked the technical POC for the ASTER Data Product if a master list of ASTER DEM files/tiles
was available for us... Rick Reeves

08:55 AM Task #207: Produce global fused DEM layer

Here, for the team's comment and feedback, is my proposed plan for producing the global Fused 1 Km Terrain layer.
... Rick Reeves

05/05/2011

02:36 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

I have created and checked in a readme file which documents the steps I used to
generate one of the first image mos... Rick Reeves

02:29 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

... Rick Reeves

01:09 PM Revision f9dbcec6: ReadMe file describes how to use shell scripts (also checked in) to create example Srtm/Aster DEM image mosaic of Western Canada region spanning 60 deg N Latitude boundary

Rick Reeves

11:05 AM Revision 0f948be9: Sample output file from R script makeMarkTable.r - sample of 4000 random columns, row 5 through row 8 straddling 60 degree boundary.

Rick Reeves

11:02 AM Revision ad35c236: Producing valid table, but from column samples taken entirely from mosaic. Next step: take them from Aster and Cgiar images.

Rick Reeves

05/04/2011

05:47 PM Revision b67964e8: First version, has issues with column indexing, I am fixing tonight.

Rick Reeves

05:08 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

At Rob's request, I used R Raster package hist() function to generate histograms
for the images used in the image bo... Rick Reeves

01:43 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

... Rick Reeves

11:31 AM Task #212: Validate fused DEM at SRTM/ASTER boundary

I retrieved the Wilson and Gallant text from UCSB Library, and reviewed several of the chapters.
At the very least,... Rick Reeves

05/02/2011

04:41 PM Revision 230f2a79: Added collection of Linux shell scripts and R scripts that I used in my initial analysis of SRTM/CGIAR, CDEM, and ASTER GDEM digital terrain data sets.

Rick Reeves

02:23 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

Rick Reeves wrote:
>
> Preliminary visual review of these files, using ArcMap GIS zoom and variable transparency... Mark Schildhauer

01:49 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

I am reporting report 30 hours spent on this task since April 25.
Email on 5/02 to Rob Guranick:
Re: Border a... Rick Reeves

05/01/2011

11:52 AM Task #212: Validate fused DEM at SRTM/ASTER boundary

... Rick Reeves

11:46 AM Task #212: Validate fused DEM at SRTM/ASTER boundary

Here is the output from a set of 'image difference' calculations made using the R script 'SampleDemDiffCols.r",
whic... Rick Reeves

04/29/2011

04:36 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

Was:
gdalwarp -te -135.9880605 58.4644470 -101.3377799 61.5793224 -r bilinear CanadaDemMosTuesdayClip.tif
CDem... Rick Reeves

04:02 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

I am (finally) working through the 'image difference' analysis that Jim sketched out earlier this week.
And the firs... Rick Reeves

02:47 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

Jim:
As I mentioned, after I completed my initial 'screen based' review of the boundary area, I intend to perform t... Rick Reeves

09:17 AM Task #212: Validate fused DEM at SRTM/ASTER boundary

A few comments:
Rick Reeves wrote:
> By superimposing the images and increasing the magnification
> on the lower le... Jim Regetz

11:05 AM Task #210: Produce global aspect layer

Take a look at the "@gdaldem@":http://www.gdal.org/gdaldem.html command-line utility. It includes an _aspect_ mode th... Jim Regetz

11:04 AM Task #209: Produce global slope layer

Take a look at the "@gdaldem@":http://www.gdal.org/gdaldem.html command-line utility. It includes a _slope_ mode that... Jim Regetz

04/28/2011

09:52 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

Yes, the book IS the Wilson and Gallant book. This book is a decade old, and new techniques no doubt have been develo... Rick Reeves

01:25 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

Presumably "the book" refers *Terrain Analysis* (2000) by Wilson and Gallant? Has the state of terrain analysis not ... Mark Schildhauer

11:26 AM Task #212: Validate fused DEM at SRTM/ASTER boundary

The book is on order, and should arrive at UCSB Library in 3 to 5 working days.
It will come in handy in several par... Rick Reeves

08:17 AM Task #212: Validate fused DEM at SRTM/ASTER boundary

Jim:
I think that Robert pointed me in the correct direction, but I took some steps to quantify the error and tes... Rick Reeves

04:33 PM Task #207: Produce global fused DEM layer

I have moved the "ReevesSpatialSoftwareStack.txt" file to the "Documents" section of Redmine, where it will be more o... Mark Schildhauer

04:13 PM Document: Data Portals used in Terrain Analysis

Data Portals currently used by Rick Reeves to create Fused Terrain Data Layer:
Data Search platforms:
http...

11:47 AM Revision 7c3027e7: added empty dir structure for terrestrial work

Jim Regetz

07:46 AM Task #208: Evaluate existing E&O AML scripts

By May 4, I should have reviewed and tested the AML scripts that produce the terrain-derived data layers. In the abse... Rick Reeves

04/27/2011

11:23 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

Rick -- I just noticed your "r-sig-geo":https://stat.ethz.ch/pipermail/r-sig-geo/2011-April/011578.html exchange with... Jim Regetz

10:42 PM Task #207: Produce global fused DEM layer

Mark, Jim, and I met today to review progress on the tasks related to Fused Terrain Layer construction
and to discus... Rick Reeves

10:14 PM Task #207: Produce global fused DEM layer

The first set of ASTER GDEM data search results for the Northern Hemisphere
that I downloaded using the NASA WIST d... Rick Reeves

04/26/2011

05:23 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

Overlapping with Jim's notes (aboveon our discussions today:
I have created two images corresponding to southern ... Rick Reeves

05:20 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

Rick -- this is a restatement of what I sketched out on the board earlier as one way of quantifying the boundary beha... Jim Regetz

04/22/2011

02:28 PM Task #215: Establish file organization and possible 'tiling' scheme for Fused Global Terrain data set

I propose dividing the globe into four quadrants:
Northwest Hemisphere, Southwest Hemisphere, Northeast Hemisphere,... Rick Reeves

02:20 PM Task #212 (In Progress): Validate fused DEM at SRTM/ASTER boundary

Rick Reeves

09:38 AM Task #212: Validate fused DEM at SRTM/ASTER boundary

I have assembled a good sample region, in Western British Colombia along the 60 degree latitude line
where SRTM and ... Rick Reeves

11:51 AM Task #208: Evaluate existing E&O AML scripts

Thank you Ming, more good information.
I do intend to assemble a workflow document of some type next week.
I will s... Rick Reeves

11:45 AM Task #208 (In Progress): Evaluate existing E&O AML scripts

I reviewed all of the AML scripts a second time and am ready to test them within ArcMap GIS. Next week I will do so r... Rick Reeves

04/21/2011

02:28 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

As part of the fused digital terrain layer validation we are looking for 'edge discontinuities' at the boundary betwe... Rick Reeves

10:59 AM Task #207: Produce global fused DEM layer

I see your point re: cell resolution, if we stay in the realm of arc-seconds.
Yes, we are in agreement about produc... Rick Reeves