Project

General

Profile

Statistics
| Branch: | Revision:

# Date Author Comment
f27b378d 03/08/2013 11:08 AM Adam Wilson

Updates to MOD06 Climatology Script and MDO06 processing to isolate the effects of the MOD35 -landcover bias

65cc18e7 02/19/2013 06:34 PM Adam Wilson

Adjusted handling of cloud flag to 'hopefully' improve missing data problem in MOD06 climatology

3eb8b23f 02/19/2013 07:53 AM Adam Wilson

restructured MOD06 processing routine to eliminate functions for more transparent (linear) processing. Also updated to run on either pleiades or litoria

a0ca1036 02/19/2013 06:46 AM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

4ef959c2 02/19/2013 06:27 AM Adam Wilson

Adding intial code to process the NDP-026D station cloud climatology dataset

9c8b4de6 02/14/2013 11:44 AM Adam Wilson

Updated submit script to process multiple tiles and days in the same batch. Also separated the daily processing from the climatologies

0f1fce3f 01/16/2013 10:45 AM Adam Wilson

Merging with Pleiades copy

165c04fb 01/16/2013 10:38 AM Adam Wilson

Merging with Pleiades copies

f9d40a14 01/16/2013 10:37 AM Adam Wilson

Adding Climatology script to process daily files to climatologies

0e5b55f4 12/18/2012 12:42 PM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

b6e392da 12/18/2012 12:42 PM Adam Wilson

Identified problem in handling of missing values of MOD06 product. In some areas limiting quality control to the highest quality results in ~90% NAs.

86629ea0 12/18/2012 12:37 PM Adam Wilson

initial script to handle modified netcdf files from Pleiades.R script

de333435 12/17/2012 07:02 AM Adam Wilson

Merging with remote branch"

88d29728 12/17/2012 07:00 AM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

e1df6e22 12/17/2012 07:00 AM Adam Wilson

Updated summary script to work with netcdf output files

07f76f37 12/04/2012 01:02 PM Adam Wilson

MOD06 processing running successfully using Pleiades environment set up by Andrew Michaelis at NASA.

0bddce86 11/12/2012 06:59 AM Adam Wilson

Script now runs except ncap2 is missing from the nco module

2c238837 10/31/2012 06:21 AM Adam Wilson

Currently submission hangs using mqueue when loading rgdal library. Will attempt to add a separate submission script that first loads modules before running Rscript on the slaves

827b4b87 10/22/2012 07:32 AM Adam Wilson

MOD06_L2 now running properly but Rmpi is not running due to (probably) incompatability between Rmpi and the version of sgi-mpi available on Pleiades

92fd8a10 10/16/2012 09:21 AM Adam Wilson

Updated script to accurately set paths for HEG tool to facilitate parallel processing of gridding procedure using swtif. Multicore package is used to parallelize which limits processing to a single node. Next step is to explore use of foreach package to allow multiple nodes

3959e686 10/04/2012 01:42 PM Adam Wilson

Updated MOD06 process to output NetCDF files instead of geotif for faster post-processing

cf724805 10/04/2012 03:46 AM Adam Wilson

Resolved problem with temporary directory for Rscript call.

807fa48c 10/03/2012 12:06 PM Adam Wilson

Script is successfully running and producing the summary files, though the output looks strange. Maybe a problem with sinusoidal output of HEG? Use Pleiades.R to drive the submission and MOD06_L2_process as the processing script

9d52d7e0 09/17/2012 06:33 PM Adam Wilson

Successfully running MOD06 processing on Pleiades as an array job (though submissions are limited to < 365 jobs so will have to find another way to submit them)

3682f238 08/29/2012 01:53 PM Adam Wilson

Started working with script to process MOD05 on NASA's Pleiades

858fd2e7 07/24/2012 06:07 PM Adam Wilson

Updates to run 12 months of mean daily precipitation using a variety of models. Includes using gamm() to incorporate spatial effects in addition to the smooth parameters. Not all clean and cozy yet, uploading as a work-in-progress...

41cf46ba 07/19/2012 12:51 PM Adam Wilson

Further updates to interpolation procedures including:

1) bugfix in MOD06_L2_data_compile. Root access is needed to run swtif in its current directory (bad design!).
2) Switched to UTM output from swtif (from sinusoidal) becuase it looked like gdal was struggling with integerized sinusoidal...

f2b2e7d5 06/18/2012 05:55 PM Adam M. Wilson

Added initial version of LST_Landcover exploration (not finished). Also moved prior version of interpolation procedure (bayesian krig) into repository.

4f97017d 06/13/2012 02:35 PM Adam M. Wilson

added processing for 'very cloudy days'

44799b5f 06/06/2012 01:54 PM Adam M. Wilson

Added PRISM comparison to MOD06_summary and added script to calculate 'back-of-the-envelope' estimates of total daily climate layer sizes

c33d3b68 06/04/2012 01:56 PM Adam M. Wilson

Updated MOD06 compile script to process the tiles in parallel using GRASS. This brings processing time for 10 year archive for oregon from 48 hours to ~2 hours on 24 cores. Also added several exploratory analysis to the data_summary script.

0c74b1da 06/04/2012 07:56 AM Adam M. Wilson

Added cloud flag to outputs

08d8290d 05/31/2012 06:56 AM Adam M. Wilson

First 10-year processing of daily mean tifs

979e2d4c 05/24/2012 01:59 PM Adam M. Wilson

MOD06 processing runs well in sequence, but not parallel

147da66d 05/23/2012 01:43 PM Adam M. Wilson

Adding some MOD06 (cloud product) processing routines. Still a work in progress

ee6357dc 05/23/2012 01:35 PM Adam Wilson

Initial commit

69190fde 03/10/2012 02:17 PM Jim Regetz

cleaned up file permissions

7526fb1c 03/10/2012 02:16 PM Jim Regetz

added in various previously uncommitted scripts