Project

General

Profile

Statistics
| Branch: | Revision:

# Date Author Comment
f27d277d 04/10/2013 10:57 AM Adam Wilson

Simplified MOD35 script and converted output to single band p(Clear) rather than multiple bands

71560f46 04/10/2013 07:37 AM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

710f7456 04/10/2013 07:36 AM Adam Wilson

Added initial validation via NDP-026D dataset

35d59dc1 04/10/2013 07:35 AM Adam Wilson

Simplifications to Climatology Script

3133718a 03/27/2013 12:59 PM Adam Wilson

Added new script to process daily MOD35 files

a6ed5f30 03/08/2013 11:08 AM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

f27b378d 03/08/2013 11:08 AM Adam Wilson

Updates to MOD06 Climatology Script and MDO06 processing to isolate the effects of the MOD35 -landcover bias

a6d44f2d 03/08/2013 11:01 AM Adam Wilson

Added script to process NDP-026D station cloud climatologies

65cc18e7 02/19/2013 06:34 PM Adam Wilson

Adjusted handling of cloud flag to 'hopefully' improve missing data problem in MOD06 climatology

3eb8b23f 02/19/2013 07:53 AM Adam Wilson

restructured MOD06 processing routine to eliminate functions for more transparent (linear) processing. Also updated to run on either pleiades or litoria

a0ca1036 02/19/2013 06:46 AM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

4ef959c2 02/19/2013 06:27 AM Adam Wilson

Adding intial code to process the NDP-026D station cloud climatology dataset

9c8b4de6 02/14/2013 11:44 AM Adam Wilson

Updated submit script to process multiple tiles and days in the same batch. Also separated the daily processing from the climatologies

0f1fce3f 01/16/2013 10:45 AM Adam Wilson

Merging with Pleiades copy

165c04fb 01/16/2013 10:38 AM Adam Wilson

Merging with Pleiades copies

f9d40a14 01/16/2013 10:37 AM Adam Wilson

Adding Climatology script to process daily files to climatologies

0e5b55f4 12/18/2012 12:42 PM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

b6e392da 12/18/2012 12:42 PM Adam Wilson

Identified problem in handling of missing values of MOD06 product. In some areas limiting quality control to the highest quality results in ~90% NAs.

86629ea0 12/18/2012 12:37 PM Adam Wilson

initial script to handle modified netcdf files from Pleiades.R script

659f6fea 12/17/2012 07:48 AM Adam Wilson

Merging GAM_LST script from bp/interp to aw/precip

de333435 12/17/2012 07:02 AM Adam Wilson

Merging with remote branch"

88d29728 12/17/2012 07:00 AM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

e1df6e22 12/17/2012 07:00 AM Adam Wilson

Updated summary script to work with netcdf output files

07f76f37 12/04/2012 01:02 PM Adam Wilson

MOD06 processing running successfully using Pleiades environment set up by Andrew Michaelis at NASA.

0bddce86 11/12/2012 06:59 AM Adam Wilson

Script now runs except ncap2 is missing from the nco module

2c238837 10/31/2012 06:21 AM Adam Wilson

Currently submission hangs using mqueue when loading rgdal library. Will attempt to add a separate submission script that first loads modules before running Rscript on the slaves

827b4b87 10/22/2012 07:32 AM Adam Wilson

MOD06_L2 now running properly but Rmpi is not running due to (probably) incompatability between Rmpi and the version of sgi-mpi available on Pleiades

92fd8a10 10/16/2012 09:21 AM Adam Wilson

Updated script to accurately set paths for HEG tool to facilitate parallel processing of gridding procedure using swtif. Multicore package is used to parallelize which limits processing to a single node. Next step is to explore use of foreach package to allow multiple nodes

3959e686 10/04/2012 01:42 PM Adam Wilson

Updated MOD06 process to output NetCDF files instead of geotif for faster post-processing

cf724805 10/04/2012 03:46 AM Adam Wilson

Resolved problem with temporary directory for Rscript call.

807fa48c 10/03/2012 12:06 PM Adam Wilson

Script is successfully running and producing the summary files, though the output looks strange. Maybe a problem with sinusoidal output of HEG? Use Pleiades.R to drive the submission and MOD06_L2_process as the processing script

9d52d7e0 09/17/2012 06:33 PM Adam Wilson

Successfully running MOD06 processing on Pleiades as an array job (though submissions are limited to < 365 jobs so will have to find another way to submit them)

3682f238 08/29/2012 01:53 PM Adam Wilson

Started working with script to process MOD05 on NASA's Pleiades

0924578a 08/24/2012 01:28 PM Adam Wilson

Added script to evaluate climatic stationarity (Task #479)

858fd2e7 07/24/2012 06:07 PM Adam Wilson

Updates to run 12 months of mean daily precipitation using a variety of models. Includes using gamm() to incorporate spatial effects in addition to the smooth parameters. Not all clean and cozy yet, uploading as a work-in-progress...

41cf46ba 07/19/2012 12:51 PM Adam Wilson

Further updates to interpolation procedures including:

1) bugfix in MOD06_L2_data_compile. Root access is needed to run swtif in its current directory (bad design!).
2) Switched to UTM output from swtif (from sinusoidal) becuase it looked like gdal was struggling with integerized sinusoidal...

4c29b739 07/06/2012 01:48 PM Adam M. Wilson

Modified GAM.R interpolation script to 1) simplify validation results, 2) add full prediction (rather than just stations) and 3) some other (hopefully) simplifications and improvements.

2b88b158 07/05/2012 01:00 PM Adam M. Wilson

Updated GHCN_stations script to:

1) draw station location information from postgres database and perform merge/join query within database rather than r
2) add function to buffer region of interest to include stations outside region (to minimize edge effects)

ee7bfbd8 07/03/2012 08:57 AM Adam M. Wilson

Merging with bp/interp to use some of Benoit's code for precip interpolation

516a5849 07/03/2012 08:56 AM Adam M. Wilson

Merge branch 'bp/interp' into aw/precip

c7192b5a 07/03/2012 06:28 AM Adam M. Wilson

More updates to output plots

e0d23f1c 06/27/2012 05:31 PM Benoit Parmentier

OR data preparation, initial commit for extraction of covariates from raster stack

b8bf4042 06/27/2012 05:21 PM Benoit Parmentier

OR data preparation task#363, modified code for ghcn to create a shapefile

f2b2e7d5 06/18/2012 05:55 PM Adam M. Wilson

Added initial version of LST_Landcover exploration (not finished). Also moved prior version of interpolation procedure (bayesian krig) into repository.

b7b786b1 06/14/2012 12:28 PM Adam M. Wilson

Minor updates to dataset size calculation

4f97017d 06/13/2012 02:35 PM Adam M. Wilson

added processing for 'very cloudy days'

44799b5f 06/06/2012 01:54 PM Adam M. Wilson

Added PRISM comparison to MOD06_summary and added script to calculate 'back-of-the-envelope' estimates of total daily climate layer sizes

95d521f9 06/05/2012 12:06 AM Benoit Parmentier

GHNCD station data selection using Postgres database, initial commit, task #363

328689cf 06/04/2012 11:57 PM Benoit Parmentier

GAM LST, added specific and general diagnostic measures (e.g.MAE) GAM+Kriging, task #364 and #406

c33d3b68 06/04/2012 01:56 PM Adam M. Wilson

Updated MOD06 compile script to process the tiles in parallel using GRASS. This brings processing time for 10 year archive for oregon from 48 hours to ~2 hours on 24 cores. Also added several exploratory analysis to the data_summary script.

0c74b1da 06/04/2012 07:56 AM Adam M. Wilson

Added cloud flag to outputs

08d8290d 05/31/2012 06:56 AM Adam M. Wilson

First 10-year processing of daily mean tifs

38eccf20 05/30/2012 04:30 PM Benoit Parmentier

GAM LST, adding lines to summarize samling RMSE using plots, task #409

51050314 05/30/2012 04:19 PM Benoit Parmentier

GAM LST, first code to test effect of sampling on GAM, task #409

8d91ca4a 05/30/2012 04:10 PM Benoit Parmentier

GAM LST, added model and modified summary plots, run on 365 dates GAM+Kriging, task #364 and #406

ab8957ca 05/30/2012 04:03 PM Benoit Parmentier

GAM LST, modify code to generalize number of models and assessment,GAM+Kriging task #364

c9e2af49 05/30/2012 03:52 PM Benoit Parmentier

GAM LST, major modifications to create GAM+Kriging code, task #364

75151566 05/30/2012 03:34 PM Benoit Parmentier

GAM LST, adding lines to assess RMSE per month over 365 dates, task #406

f042de0f 05/30/2012 02:46 PM Benoit Parmentier

GAM LST, added model with forest only term -364 dates assessment, task #406

9c848d7a 05/30/2012 02:37 PM Benoit Parmentier

GAM LST, added section to save training and test residuals in shapefiles, task #361

f31f59cc 05/30/2012 02:28 PM Benoit Parmentier

GAM LST, changed triple nesting lat,long,Elev to double, 365 dates run, task #406 and #361

63d8201d 05/30/2012 11:19 AM Benoit Parmentier

GAM LST, used monthly LST average instead of daily, task #361

80402fdf 05/30/2012 11:11 AM Benoit Parmentier

GAM LST, adding new model with grass land cover, task #361

24eedf3a 05/30/2012 10:56 AM Benoit Parmentier

GAM using LST as input variable task #361

fbc95c44 05/29/2012 04:49 PM Benoit Parmentier

GAM, modification of nesting of models and clean up, task #361

328528e2 05/29/2012 04:16 PM Benoit Parmentier

Kriging, adding LST for co-kriging: task #364

eec8b7e0 05/29/2012 03:53 PM Benoit Parmentier

Kriging, slight modification and clean up, task #364

88248d6c 05/29/2012 03:37 PM Benoit Parmentier

Kriging, modification to save kriged surfaces in geotiff and png files, task #364

3be0f72b 05/29/2012 03:24 PM Benoit Parmentier

Kriging, modifying code to save training and testing samples in shapefiles: task #364

7da7872a 05/29/2012 03:07 PM Benoit Parmentier

Kriging for OR, this is the first script, task #364

15a39f25 05/29/2012 12:56 PM Benoit Parmentier

GWR modified code to save plots and images, task #364

defe53e5 05/29/2012 12:49 PM Benoit Parmentier

GWR assessment by visualizing residuals using kriging

5f312940 05/29/2012 12:16 PM Benoit Parmentier

GWR in adding loop for 10 dates

23ed3053 05/29/2012 11:57 AM Benoit Parmentier

GWR first script for one date in OR, task #364

979e2d4c 05/24/2012 01:59 PM Adam M. Wilson

MOD06 processing runs well in sequence, but not parallel

2a6b57de 05/23/2012 01:55 PM Adam M. Wilson

Reorganization: moved mindmap to it's own directory to isolate temporary files created when exporting to other formats

5891fba5 05/23/2012 01:44 PM Adam M. Wilson

Add initial version of the 'mind map' for the interpolation project. This file contains an outline of the various stages of the project and links back to issues and code in the blessed repository.
Created during Benoit's visit to Yale May 21-22.

147da66d 05/23/2012 01:43 PM Adam M. Wilson

Adding some MOD06 (cloud product) processing routines. Still a work in progress

ee6357dc 05/23/2012 01:35 PM Adam Wilson

Initial commit

aac7c36c 05/11/2012 10:03 AM Benoit Parmentier

Added 3 new models and nesting to GAM, task #361

0d1cde0a 05/10/2012 03:03 PM Benoit Parmentier

Changes in the diagnostics plots, barplots.

25a68ae3 05/10/2012 02:49 PM Benoit Parmentier

Transform aspect in Eastness and Northness variables in the GAM.

4180b123 05/10/2012 02:42 PM Benoit Parmentier

Transformed the aspect variable and added GAM model closer to PRISM

2a89fa5f 05/10/2012 02:28 PM Benoit Parmentier

GAM prediction added to the loop with RMSE calculation

ec229367 05/10/2012 02:13 PM Benoit Parmentier

Streamlining and slight changes to the loop to create subset dataset for different dates

af42291a 05/10/2012 02:07 PM Benoit Parmentier

Additional changes to the loop and format

bc59c6bb 05/10/2012 01:47 PM Benoit Parmentier

Start of Task #361, modified code to subset for 10 dates

d7b0ef36 05/10/2012 11:59 AM Benoit Parmentier

Minor format changes and clean up to code

e2d673e4 05/10/2012 11:18 AM Benoit Parmentier

Corrected errors in RMSE calculation and added plots to view results

92c36e33 04/19/2012 01:56 PM Benoit Parmentier

made minor changes to PRISM variables

3f649df0 04/19/2012 01:51 PM Benoit Parmentier

changed RMSE and AIC code in GAM script

7f643c83 04/19/2012 01:39 PM Benoit Parmentier

updated GAM script for tmax

89c6eee2 04/19/2012 01:23 PM Benoit Parmentier

added initial R script with GAM regression for tmax (one date)

7967a0d1 03/20/2012 04:47 PM Jim Regetz

added test script for days missing from our MOD11A1 OR holdings

69190fde 03/10/2012 02:17 PM Jim Regetz

cleaned up file permissions

7526fb1c 03/10/2012 02:16 PM Jim Regetz

added in various previously uncommitted scripts