Activity
From 05/17/2012 to 06/15/2012
06/14/2012
- 12:34 PM Task #430: Estimate total storage size of daily 1970-2010 1km dataset
- And this is for just one variable. So multiply by three for tmax, tmin, and ppt. And add more if we add any pixel-by...
- 12:32 PM Task #430 (New): Estimate total storage size of daily 1970-2010 1km dataset
- I was curious how big the daily 1970-2010 1km dataset was going to be, so I did a back-of-the-envelope calculation as...
- 12:28 PM Revision b7b786b1: Minor updates to dataset size calculation
06/13/2012
- 02:43 PM Revision 64821c96: Initial commit adding UML flowchart
- 02:35 PM Revision 4f97017d: added processing for 'very cloudy days'
06/06/2012
- 01:54 PM Revision 44799b5f: Added PRISM comparison to MOD06_summary and added script to calculate 'back-of-the-envelope' estimates of total daily climate layer sizes
- 09:35 AM Document: Tasking for climate change
06/05/2012
- 11:23 AM Task #363: Assemble all GHCN data into a single database
- I did a 30 year query during the night for the 1980-2010 period for the Oregon study area. I just checked the results...
- 12:35 AM Task #363: Assemble all GHCN data into a single database
- A short R script was added to select stations data from the postgres database created by Jim. The user must provide a...
- 12:27 AM Task #364: Integrate spatial variables and structure in the GAM methodology
- Two stage regression: the GAM+Kriging script was updated to integrate specific and general diagnostics:
general diag... - 12:06 AM Revision 95d521f9: GHNCD station data selection using Postgres database, initial commit, task #363
06/04/2012
- 11:57 PM Revision 328689cf: GAM LST, added specific and general diagnostic measures (e.g.MAE) GAM+Kriging, task #364 and #406
- 01:56 PM Revision c33d3b68: Updated MOD06 compile script to process the tiles in parallel using GRASS. This brings processing time for 10 year archive for oregon from 48 hours to ~2 hours on 24 cores. Also added several exploratory analysis to the data_summary script.
- 07:56 AM Revision 0c74b1da: Added cloud flag to outputs
06/01/2012
- 12:54 PM Task #423 (New): Develop stratified station sampling procedure
- We need to develop a procedure to sample representative stations to use in fitting and validation. In many areas (in...
- 12:43 PM Task #415: Process MOD06_L2 Cloud data
- I've downloaded and processed the full 10 archive for Oregon and generated monthly climatologies for "Cloud Optical T...
- 09:57 AM Task #363: Assemble all GHCN data into a single database
- Finished loading the new TMAX, TMIN, and PRCP data (just under 12 hours) and creating the station index (just over 13...
05/31/2012
- 06:56 AM Revision 08d8290d: First 10-year processing of daily mean tifs
- 06:55 AM Revision e23e9664: First full processing of daily mean tifs
05/30/2012
- 04:30 PM Revision 38eccf20: GAM LST, adding lines to summarize samling RMSE using plots, task #409
- 04:19 PM Revision 51050314: GAM LST, first code to test effect of sampling on GAM, task #409
- 04:10 PM Revision 8d91ca4a: GAM LST, added model and modified summary plots, run on 365 dates GAM+Kriging, task #364 and #406
- 04:03 PM Revision ab8957ca: GAM LST, modify code to generalize number of models and assessment,GAM+Kriging task #364
- 03:52 PM Revision c9e2af49: GAM LST, major modifications to create GAM+Kriging code, task #364
- 03:38 PM Task #363: Assemble all GHCN data into a single database
- I wrote and ran a little bash script to download the latest GHCN data and generate a basic log file for future refere...
- 03:34 PM Revision 75151566: GAM LST, adding lines to assess RMSE per month over 365 dates, task #406
- 02:46 PM Revision f042de0f: GAM LST, added model with forest only term -364 dates assessment, task #406
- 02:37 PM Revision 9c848d7a: GAM LST, added section to save training and test residuals in shapefiles, task #361
- 02:28 PM Revision f31f59cc: GAM LST, changed triple nesting lat,long,Elev to double, 365 dates run, task #406 and #361
- 12:02 PM Revision fb35e17b: added bash script used to download new GHCN data (29-May-2012)
- 11:19 AM Revision 63d8201d: GAM LST, used monthly LST average instead of daily, task #361
- 11:11 AM Revision 80402fdf: GAM LST, adding new model with grass land cover, task #361
- 10:56 AM Revision 24eedf3a: GAM using LST as input variable task #361
- 10:27 AM Revision 90913004: augmented test script to reproduce 8-day LST *counts* from daily LST
- 10:01 AM Revision e84c3d48: tucked misc procedural code into a main function
05/29/2012
- 04:49 PM Revision fbc95c44: GAM, modification of nesting of models and clean up, task #361
- 04:16 PM Revision 328528e2: Kriging, adding LST for co-kriging: task #364
- 03:53 PM Revision eec8b7e0: Kriging, slight modification and clean up, task #364
- 03:37 PM Revision 88248d6c: Kriging, modification to save kriged surfaces in geotiff and png files, task #364
- 03:24 PM Revision 3be0f72b: Kriging, modifying code to save training and testing samples in shapefiles: task #364
- 03:07 PM Revision 7da7872a: Kriging for OR, this is the first script, task #364
- 12:56 PM Revision 15a39f25: GWR modified code to save plots and images, task #364
- 12:49 PM Revision defe53e5: GWR assessment by visualizing residuals using kriging
- 12:16 PM Revision 5f312940: GWR in adding loop for 10 dates
- 11:57 AM Revision 23ed3053: GWR first script for one date in OR, task #364
05/25/2012
- 03:21 PM Task #363: Assemble all GHCN data into a single database
- The daily data files currently in the database were obtained back in Oct 2010. Benoit and I discussed simply augmenti...
- 09:05 AM Task #419 (In Progress): Assessment of results in the context of the literature: Literature review and accuracy
- Documenting the new products will necessitate assembling a list of references on climate interpolation to place the r...
05/24/2012
05/23/2012
- 01:55 PM Revision 2a6b57de: Reorganization: moved mindmap to it's own directory to isolate temporary files created when exporting to other formats
- 01:44 PM Revision 5891fba5: Add initial version of the 'mind map' for the interpolation project. This file contains an outline of the various stages of the project and links back to issues and code in the blessed repository.
- Created during Benoit's visit to Yale May 21-22.
- 01:43 PM Revision 147da66d: Adding some MOD06 (cloud product) processing routines. Still a work in progress
- 01:35 PM Revision ee6357dc: Initial commit
05/22/2012
- 10:14 AM Task #363: Assemble all GHCN data into a single database
- If useful for some specific purpose, we could generate relevant synoptic views or subsetted table dumps pivoted back ...
- 08:25 AM Task #363: Assemble all GHCN data into a single database
- Perhaps it would make sense to keep the data in the "one-row-per-month" format in the database and transform it on th...
- 07:52 AM Task #418 (New): Explore Landcover - LST interactions
- Use the full gridded datasets (rather than just station locations) to explore relationships between LST and various (...
05/17/2012
- 11:38 PM Task #416: Scope out workflow for calculating monthly LST climatologies
- I've now written some Python+GRASS code to do a good bit of what I think we want. For a user-specified _tile_, _year_...
- 03:05 PM Task #416 (In Progress): Scope out workflow for calculating monthly LST climatologies
- Assess feasibility of running LST climatologies ourselves by implementing a basic scripted workflow and estimating ov...
- 03:44 PM Task #375: Assemble monthly mean MODIS LST values for the complete record (2000-2012) for Oregon
- See task #416 for progress on developing and evaluating a procedure for doing this ourselves.
But I will add a com... - 02:16 PM Revision 01b3830e: added function documentation and removed two obsolete functions
- 02:04 PM Revision a05f49eb: automated determination of which days to aggregate for any given month
- 01:53 PM Revision 96a70efc: tweaked climatology calc function to return list of GRASS map names
- 01:43 PM Revision bd9bc508: switched from truncating to rounding mean LST back to integer
- 12:31 PM Revision 5fb982c8: wrote function to download HDF files for given tile/year/day-range
- 10:05 AM Revision b9e1a7f9: wrote function to look up local HDF files for given tile/year/day-range
- 09:12 AM Revision eaf6c10b: wrote function to encapsulate LST loading and QC-adjustment
- 08:45 AM Revision 47cdfebe: added initial Python+GRASS code to download and aggregate daily LST
- 08:45 AM Revision 934d6ab7: added script to reproduce calculation of 8-day LST from daily LST
Also available in: Atom