Project

General

Profile

Activity

From 04/20/2011 to 05/19/2011

05/19/2011

10:26 AM Task #225: Organize and document SRTM input DEM files
Yes, last week I created a new folder structure to contain the batch files and output files
for the next set of 'pr...
Rick Reeves

05/18/2011

11:42 AM Revision ec0af318: this table created using the latest and best-aligned versions of the 'boundary validation' (ASTER/SRTM/CDEM) subimages. Input to the script: CreateImageDiffPlotsOverlayNewPlots.r
Rick Reeves
11:10 AM Revision 4101796f: Added option: write individual plots (not trplets - yet) to separate JPG files. New command line argument: JpgPlotFileFlag
Rick Reeves

05/17/2011

05:33 PM Task #225 (In Progress): Organize and document SRTM input DEM files
_[Updated ticket description on 04-Aug-2011 to focus specifically on SRTM]_
SRTM DEM tiles and associated files ha...
Jim Regetz
12:13 PM Revision db78f686: Table used by CreateImageDiffPlotsOverlayNewPlots.r
to create latest set of (normalized) difference scatterplots Rick Reeves
12:12 PM Revision cc196a45: This version used to create the large (36000 row) table used to generate latest bounday analysis scatterplots.
Rick Reeves
12:11 PM Revision acf2afb2: This version creates the (normalized) difference image plots
that Rick, Jim, and Mark are reviewing as part of the final 'ASTER/SRTM boundary analysis' work.
The input file pixel...
Rick Reeves
10:47 AM Task #207: Produce global fused DEM layer
Today I received an email from Rob G regarding progress on data layer construction; among the items in the email was ... Rick Reeves

05/16/2011

04:11 PM Revision 8fd072d3: The first version of 'CreateImageDiffPlotsOverlay.r' that produces the 'three-panel' plot containing the boundary differences for ASTER / Border / SRTM.
Rick Reeves
10:07 AM Revision 49c441dd: Latest version of Elevation Difference Image Analysis plot generator: Plots remain on screen until end of script (user presses 'final' <cr>
TODO: Add legend to plots. Rick Reeves

05/15/2011

01:29 PM Revision 218022c8: correct CDEM image values
Rick Reeves
01:29 PM Revision 3db72d58: With correct CEDM input image filename.
Rick Reeves
12:26 PM Revision 9d19fb11: Uses correct, even boundary input images
Rick Reeves
12:25 PM Revision b81f0431: made with latest version of makeImagePairTable w/correct images.
Rick Reeves
11:39 AM Revision ce53f1db: created with latest version of code 5/15
Rick Reeves
11:39 AM Revision 27c37be1: Tested Sunday 5/15 - produces table tableForRic2000_5_8.csv
Rick Reeves

05/13/2011

03:33 PM Revision 4b8cd90f: In header, better 'to run' instructions.
Rick Reeves
03:21 PM Revision a0267fb3: input table for the R script: MosaicCdemDifferencePlots.r
Created by the R script: makeImagePairFiles. Rick Reeves
03:19 PM Revision 80390607: First working version - very simple - just 'source' the file and press <CR> to walk through the plots.
Next version: 'panel plots' and improved plot axes. Rick Reeves
02:38 PM Revision d732553c: Very first version of plot making script. Plots need consolidation into 'panel plots', and plot labels need to be improved.
Uses input file:
tableForMark4000_5_8_SortColID.csv, also checked in.
Rick Reeves
10:56 AM Task #207: Produce global fused DEM layer
Here is an example of the workflows that generate fused digital terrain data layers
for one of the four Earth 'quadr...
Rick Reeves

05/12/2011

11:05 PM Task #215: Establish file organization and possible 'tiling' scheme for Fused Global Terrain data set
I am using this scheme; have created the directory structure, and have constructed
the first prototype fused global...
Rick Reeves

05/10/2011

05:05 PM Revision f028b3dc: These scripts are complete but may not run correctly due to conflicts in the extents of the input raster files. Recheck inputs.
Rick Reeves
05:04 PM Revision 5c833657: Version runs correctly, though the CDEM edge input image might not be the latest and best. Recheck inputs
Rick Reeves
03:12 PM Task #212: Validate fused DEM at SRTM/ASTER boundary
5/10/2011
Rick R -
To (finally) completely respond to Rob G's request:
(Work was delayed because of unexpected p...
Rick Reeves
02:20 PM Task #212: Validate fused DEM at SRTM/ASTER boundary
... Rick Reeves

05/09/2011

05:20 PM Task #207: Produce global fused DEM layer
Using a subset of the ASTER 'master tile list' (supplied by Bob Crippen at JPL) containing only the image tile file n... Rick Reeves

05/06/2011

04:10 PM Task #212: Validate fused DEM at SRTM/ASTER boundary
Jim, I agree. You can in fact see the 1/2 pixel 'offset' in the screenshots that I captured
of the magnified ArcMap ...
Rick Reeves
09:02 AM Task #212: Validate fused DEM at SRTM/ASTER boundary
... Rick Reeves
07:40 AM Task #212: Validate fused DEM at SRTM/ASTER boundary
Two points regarding DEM raster extents and alignments:
* At least for SRTM, the pixel _*centers*_ are lined up al...
Jim Regetz
03:57 PM Task #219: Good News: JPL provides comprehensive Global List of ALL ASTER DEM files
I re-read Bob's email; he notes that the file list for the GDEM2 data set should be 'the same or close' to
the GDEM...
Rick Reeves
03:52 PM Task #219 (Rejected): Good News: JPL provides comprehensive Global List of ALL ASTER DEM files
I asked the technical POC for the ASTER Data Product if a master list of ASTER DEM files/tiles
was available for us...
Rick Reeves
08:55 AM Task #207: Produce global fused DEM layer
Here, for the team's comment and feedback, is my proposed plan for producing the global Fused 1 Km Terrain layer.
...
Rick Reeves

05/05/2011

02:36 PM Task #212: Validate fused DEM at SRTM/ASTER boundary
I have created and checked in a readme file which documents the steps I used to
generate one of the first image mos...
Rick Reeves
02:29 PM Task #212: Validate fused DEM at SRTM/ASTER boundary
... Rick Reeves
01:09 PM Revision f9dbcec6: ReadMe file describes how to use shell scripts (also checked in) to create example Srtm/Aster DEM image mosaic of Western Canada region spanning 60 deg N Latitude boundary
Rick Reeves
11:05 AM Revision 0f948be9: Sample output file from R script makeMarkTable.r - sample of 4000 random columns, row 5 through row 8 straddling 60 degree boundary.
Rick Reeves
11:02 AM Revision ad35c236: Producing valid table, but from column samples taken entirely from mosaic. Next step: take them from Aster and Cgiar images.
Rick Reeves

05/04/2011

05:47 PM Revision b67964e8: First version, has issues with column indexing, I am fixing tonight.
Rick Reeves
05:08 PM Task #212: Validate fused DEM at SRTM/ASTER boundary
At Rob's request, I used R Raster package hist() function to generate histograms
for the images used in the image bo...
Rick Reeves
01:43 PM Task #212: Validate fused DEM at SRTM/ASTER boundary
... Rick Reeves
11:31 AM Task #212: Validate fused DEM at SRTM/ASTER boundary
I retrieved the Wilson and Gallant text from UCSB Library, and reviewed several of the chapters.
At the very least,...
Rick Reeves

05/02/2011

04:41 PM Revision 230f2a79: Added collection of Linux shell scripts and R scripts that I used in my initial analysis of SRTM/CGIAR, CDEM, and ASTER GDEM digital terrain data sets.
Rick Reeves
02:23 PM Task #212: Validate fused DEM at SRTM/ASTER boundary
Rick Reeves wrote:
>
> Preliminary visual review of these files, using ArcMap GIS zoom and variable transparency...
Mark Schildhauer
01:49 PM Task #212: Validate fused DEM at SRTM/ASTER boundary

I am reporting report 30 hours spent on this task since April 25.
Email on 5/02 to Rob Guranick:
Re: Border a...
Rick Reeves

05/01/2011

11:52 AM Task #212: Validate fused DEM at SRTM/ASTER boundary
... Rick Reeves
11:46 AM Task #212: Validate fused DEM at SRTM/ASTER boundary
Here is the output from a set of 'image difference' calculations made using the R script 'SampleDemDiffCols.r",
whic...
Rick Reeves

04/29/2011

04:36 PM Task #212: Validate fused DEM at SRTM/ASTER boundary
Was:
gdalwarp -te -135.9880605 58.4644470 -101.3377799 61.5793224 -r bilinear CanadaDemMosTuesdayClip.tif
CDem...
Rick Reeves
04:02 PM Task #212: Validate fused DEM at SRTM/ASTER boundary
I am (finally) working through the 'image difference' analysis that Jim sketched out earlier this week.
And the firs...
Rick Reeves
02:47 PM Task #212: Validate fused DEM at SRTM/ASTER boundary
Jim:
As I mentioned, after I completed my initial 'screen based' review of the boundary area, I intend to perform t...
Rick Reeves
09:17 AM Task #212: Validate fused DEM at SRTM/ASTER boundary
A few comments:
Rick Reeves wrote:
> By superimposing the images and increasing the magnification
> on the lower le...
Jim Regetz
11:05 AM Task #210: Produce global aspect layer
Take a look at the "@gdaldem@":http://www.gdal.org/gdaldem.html command-line utility. It includes an _aspect_ mode th... Jim Regetz
11:04 AM Task #209: Produce global slope layer
Take a look at the "@gdaldem@":http://www.gdal.org/gdaldem.html command-line utility. It includes a _slope_ mode that... Jim Regetz

04/28/2011

09:52 PM Task #212: Validate fused DEM at SRTM/ASTER boundary
Yes, the book IS the Wilson and Gallant book. This book is a decade old, and new techniques no doubt have been develo... Rick Reeves
01:25 PM Task #212: Validate fused DEM at SRTM/ASTER boundary
Presumably "the book" refers *Terrain Analysis* (2000) by Wilson and Gallant? Has the state of terrain analysis not ... Mark Schildhauer
11:26 AM Task #212: Validate fused DEM at SRTM/ASTER boundary
The book is on order, and should arrive at UCSB Library in 3 to 5 working days.
It will come in handy in several par...
Rick Reeves
08:17 AM Task #212: Validate fused DEM at SRTM/ASTER boundary
Jim:
I think that Robert pointed me in the correct direction, but I took some steps to quantify the error and tes...
Rick Reeves
04:33 PM Task #207: Produce global fused DEM layer
I have moved the "ReevesSpatialSoftwareStack.txt" file to the "Documents" section of Redmine, where it will be more o... Mark Schildhauer
04:13 PM Document: Data Portals used in Terrain Analysis

Data Portals currently used by Rick Reeves to create Fused Terrain Data Layer:
Data Search platforms:
http...
11:47 AM Revision 7c3027e7: added empty dir structure for terrestrial work
Jim Regetz
07:46 AM Task #208: Evaluate existing E&O AML scripts
By May 4, I should have reviewed and tested the AML scripts that produce the terrain-derived data layers. In the abse... Rick Reeves

04/27/2011

11:23 PM Task #212: Validate fused DEM at SRTM/ASTER boundary
Rick -- I just noticed your "r-sig-geo":https://stat.ethz.ch/pipermail/r-sig-geo/2011-April/011578.html exchange with... Jim Regetz
10:42 PM Task #207: Produce global fused DEM layer
Mark, Jim, and I met today to review progress on the tasks related to Fused Terrain Layer construction
and to discus...
Rick Reeves
10:14 PM Task #207: Produce global fused DEM layer
The first set of ASTER GDEM data search results for the Northern Hemisphere
that I downloaded using the NASA WIST d...
Rick Reeves

04/26/2011

05:23 PM Task #212: Validate fused DEM at SRTM/ASTER boundary
Overlapping with Jim's notes (aboveon our discussions today:
I have created two images corresponding to southern ...
Rick Reeves
05:20 PM Task #212: Validate fused DEM at SRTM/ASTER boundary
Rick -- this is a restatement of what I sketched out on the board earlier as one way of quantifying the boundary beha... Jim Regetz

04/22/2011

02:28 PM Task #215: Establish file organization and possible 'tiling' scheme for Fused Global Terrain data set
I propose dividing the globe into four quadrants:
Northwest Hemisphere, Southwest Hemisphere, Northeast Hemisphere,...
Rick Reeves
02:20 PM Task #212 (In Progress): Validate fused DEM at SRTM/ASTER boundary
Rick Reeves
09:38 AM Task #212: Validate fused DEM at SRTM/ASTER boundary
I have assembled a good sample region, in Western British Colombia along the 60 degree latitude line
where SRTM and ...
Rick Reeves
11:51 AM Task #208: Evaluate existing E&O AML scripts
Thank you Ming, more good information.
I do intend to assemble a workflow document of some type next week.
I will s...
Rick Reeves
11:45 AM Task #208 (In Progress): Evaluate existing E&O AML scripts
I reviewed all of the AML scripts a second time and am ready to test them within ArcMap GIS. Next week I will do so r... Rick Reeves

04/21/2011

02:28 PM Task #212: Validate fused DEM at SRTM/ASTER boundary
As part of the fused digital terrain layer validation we are looking for 'edge discontinuities' at the boundary betwe... Rick Reeves
10:59 AM Task #207: Produce global fused DEM layer
I see your point re: cell resolution, if we stay in the realm of arc-seconds.
Yes, we are in agreement about produc...
Rick Reeves

04/20/2011

04:05 PM Task #207: Produce global fused DEM layer
Also, when you're simply combining tiles, you can get big efficiency gains by using the VRT format with GDAL, rather ... Jim Regetz
03:48 PM Task #207: Produce global fused DEM layer
Thanks Rick. Regarding pixel sizes (cell resolution), what we've been calling "1km" is just shorthand for 30 arcsecon... Jim Regetz
02:10 PM Task #207: Produce global fused DEM layer
(continuing from previous update)
Digital Terrain File data sources:
CGIAR / SRTM 90 meter Digital Elevation Da...
Rick Reeves
09:47 AM Task #207 (In Progress): Produce global fused DEM layer
Jim Regetz
09:43 AM Task #207: Produce global fused DEM layer
I have downlowded the complete set (872 files) of CGIAR / SRTM 90 meter data tiles and most if not all (2780) availa... Rick Reeves
 

Also available in: Atom