Project

General

Profile

Activity

From 05/20/2012 to 06/18/2012

06/18/2012

05:55 PM Revision f2b2e7d5: Added initial version of LST_Landcover exploration (not finished). Also moved prior version of interpolation procedure (bayesian krig) into repository.
Adam M. Wilson

06/14/2012

12:34 PM Task #430: Estimate total storage size of daily 1970-2010 1km dataset
And this is for just one variable. So multiply by three for tmax, tmin, and ppt. And add more if we add any pixel-by... Adam Wilson
12:32 PM Task #430 (New): Estimate total storage size of daily 1970-2010 1km dataset
I was curious how big the daily 1970-2010 1km dataset was going to be, so I did a back-of-the-envelope calculation as... Adam Wilson
12:28 PM Revision b7b786b1: Minor updates to dataset size calculation
Adam M. Wilson

06/13/2012

02:43 PM Revision 64821c96: Initial commit adding UML flowchart
Adam M. Wilson
02:35 PM Revision 4f97017d: added processing for 'very cloudy days'
Adam M. Wilson

06/06/2012

01:54 PM Revision 44799b5f: Added PRISM comparison to MOD06_summary and added script to calculate 'back-of-the-envelope' estimates of total daily climate layer sizes
Adam M. Wilson
09:35 AM Document: Tasking for climate change
Brian McGill
09:35 AM Climate_Tasking_May1_notes_final.docx
Brian McGill

06/05/2012

11:23 AM Task #363: Assemble all GHCN data into a single database
I did a 30 year query during the night for the 1980-2010 period for the Oregon study area. I just checked the results... Benoit Parmentier
12:35 AM Task #363: Assemble all GHCN data into a single database
A short R script was added to select stations data from the postgres database created by Jim. The user must provide a... Benoit Parmentier
12:27 AM Task #364: Integrate spatial variables and structure in the GAM methodology
Two stage regression: the GAM+Kriging script was updated to integrate specific and general diagnostics:
general diag...
Benoit Parmentier
12:06 AM Revision 95d521f9: GHNCD station data selection using Postgres database, initial commit, task #363
Benoit Parmentier

06/04/2012

11:57 PM Revision 328689cf: GAM LST, added specific and general diagnostic measures (e.g.MAE) GAM+Kriging, task #364 and #406
Benoit Parmentier
01:56 PM Revision c33d3b68: Updated MOD06 compile script to process the tiles in parallel using GRASS. This brings processing time for 10 year archive for oregon from 48 hours to ~2 hours on 24 cores. Also added several exploratory analysis to the data_summary script.
Adam M. Wilson
07:56 AM Revision 0c74b1da: Added cloud flag to outputs
Adam M. Wilson

06/01/2012

12:54 PM Task #423 (New): Develop stratified station sampling procedure
We need to develop a procedure to sample representative stations to use in fitting and validation. In many areas (in... Adam Wilson
12:43 PM Task #415: Process MOD06_L2 Cloud data
I've downloaded and processed the full 10 archive for Oregon and generated monthly climatologies for "Cloud Optical T... Adam Wilson
09:57 AM Task #363: Assemble all GHCN data into a single database
Finished loading the new TMAX, TMIN, and PRCP data (just under 12 hours) and creating the station index (just over 13... Jim Regetz

05/31/2012

06:56 AM Revision 08d8290d: First 10-year processing of daily mean tifs
Adam M. Wilson
06:55 AM Revision e23e9664: First full processing of daily mean tifs
Adam M. Wilson

05/30/2012

04:30 PM Revision 38eccf20: GAM LST, adding lines to summarize samling RMSE using plots, task #409
Benoit Parmentier
04:19 PM Revision 51050314: GAM LST, first code to test effect of sampling on GAM, task #409
Benoit Parmentier
04:10 PM Revision 8d91ca4a: GAM LST, added model and modified summary plots, run on 365 dates GAM+Kriging, task #364 and #406
Benoit Parmentier
04:03 PM Revision ab8957ca: GAM LST, modify code to generalize number of models and assessment,GAM+Kriging task #364
Benoit Parmentier
03:52 PM Revision c9e2af49: GAM LST, major modifications to create GAM+Kriging code, task #364
Benoit Parmentier
03:38 PM Task #363: Assemble all GHCN data into a single database
I wrote and ran a little bash script to download the latest GHCN data and generate a basic log file for future refere... Jim Regetz
03:34 PM Revision 75151566: GAM LST, adding lines to assess RMSE per month over 365 dates, task #406
Benoit Parmentier
02:46 PM Revision f042de0f: GAM LST, added model with forest only term -364 dates assessment, task #406
Benoit Parmentier
02:37 PM Revision 9c848d7a: GAM LST, added section to save training and test residuals in shapefiles, task #361
Benoit Parmentier
02:28 PM Revision f31f59cc: GAM LST, changed triple nesting lat,long,Elev to double, 365 dates run, task #406 and #361
Benoit Parmentier
12:02 PM Revision fb35e17b: added bash script used to download new GHCN data (29-May-2012)
Jim Regetz
11:19 AM Revision 63d8201d: GAM LST, used monthly LST average instead of daily, task #361
Benoit Parmentier
11:11 AM Revision 80402fdf: GAM LST, adding new model with grass land cover, task #361
Benoit Parmentier
10:56 AM Revision 24eedf3a: GAM using LST as input variable task #361
Benoit Parmentier
10:27 AM Revision 90913004: augmented test script to reproduce 8-day LST *counts* from daily LST
Jim Regetz
10:01 AM Revision e84c3d48: tucked misc procedural code into a main function
Jim Regetz

05/29/2012

04:49 PM Revision fbc95c44: GAM, modification of nesting of models and clean up, task #361
Benoit Parmentier
04:16 PM Revision 328528e2: Kriging, adding LST for co-kriging: task #364
Benoit Parmentier
03:53 PM Revision eec8b7e0: Kriging, slight modification and clean up, task #364
Benoit Parmentier
03:37 PM Revision 88248d6c: Kriging, modification to save kriged surfaces in geotiff and png files, task #364
Benoit Parmentier
03:24 PM Revision 3be0f72b: Kriging, modifying code to save training and testing samples in shapefiles: task #364
Benoit Parmentier
03:07 PM Revision 7da7872a: Kriging for OR, this is the first script, task #364
Benoit Parmentier
12:56 PM Revision 15a39f25: GWR modified code to save plots and images, task #364
Benoit Parmentier
12:49 PM Revision defe53e5: GWR assessment by visualizing residuals using kriging
Benoit Parmentier
12:16 PM Revision 5f312940: GWR in adding loop for 10 dates
Benoit Parmentier
11:57 AM Revision 23ed3053: GWR first script for one date in OR, task #364
Benoit Parmentier

05/25/2012

03:21 PM Task #363: Assemble all GHCN data into a single database
The daily data files currently in the database were obtained back in Oct 2010. Benoit and I discussed simply augmenti... Jim Regetz
09:05 AM Task #419 (In Progress): Assessment of results in the context of the literature: Literature review and accuracy
Documenting the new products will necessitate assembling a list of references on climate interpolation to place the r... Benoit Parmentier

05/24/2012

01:59 PM Revision 979e2d4c: MOD06 processing runs well in sequence, but not parallel
Adam M. Wilson

05/23/2012

01:55 PM Revision 2a6b57de: Reorganization: moved mindmap to it's own directory to isolate temporary files created when exporting to other formats
Adam M. Wilson
01:44 PM Revision 5891fba5: Add initial version of the 'mind map' for the interpolation project. This file contains an outline of the various stages of the project and links back to issues and code in the blessed repository.
Created during Benoit's visit to Yale May 21-22. Adam M. Wilson
01:43 PM Revision 147da66d: Adding some MOD06 (cloud product) processing routines. Still a work in progress
Adam M. Wilson
01:35 PM Revision ee6357dc: Initial commit
Adam Wilson

05/22/2012

10:14 AM Task #363: Assemble all GHCN data into a single database
If useful for some specific purpose, we could generate relevant synoptic views or subsetted table dumps pivoted back ... Jim Regetz
08:25 AM Task #363: Assemble all GHCN data into a single database
Perhaps it would make sense to keep the data in the "one-row-per-month" format in the database and transform it on th... Adam Wilson
07:52 AM Task #418 (New): Explore Landcover - LST interactions
Use the full gridded datasets (rather than just station locations) to explore relationships between LST and various (... Adam Wilson
 

Also available in: Atom