Started process of adding sensor zenith filter to MOD35 Processing
Updates to MOD06 Climatology Script and MDO06 processing to isolate the effects of the MOD35 -landcover bias
Updated submit script to process multiple tiles and days in the same batch. Also separated the daily processing from the climatologies
Adding Climatology script to process daily files to climatologies
Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip
Identified problem in handling of missing values of MOD06 product. In some areas limiting quality control to the highest quality results in ~90% NAs.
Updated summary script to work with netcdf output files
MOD06 processing running successfully using Pleiades environment set up by Andrew Michaelis at NASA.
Script now runs except ncap2 is missing from the nco module
Currently submission hangs using mqueue when loading rgdal library. Will attempt to add a separate submission script that first loads modules before running Rscript on the slaves
MOD06_L2 now running properly but Rmpi is not running due to (probably) incompatability between Rmpi and the version of sgi-mpi available on Pleiades
Updated script to accurately set paths for HEG tool to facilitate parallel processing of gridding procedure using swtif. Multicore package is used to parallelize which limits processing to a single node. Next step is to explore use of foreach package to allow multiple nodes
Updated MOD06 process to output NetCDF files instead of geotif for faster post-processing
Resolved problem with temporary directory for Rscript call.
Script is successfully running and producing the summary files, though the output looks strange. Maybe a problem with sinusoidal output of HEG? Use Pleiades.R to drive the submission and MOD06_L2_process as the processing script
Successfully running MOD06 processing on Pleiades as an array job (though submissions are limited to < 365 jobs so will have to find another way to submit them)
Started working with script to process MOD05 on NASA's Pleiades
