Project

General

Profile

Statistics
| Branch: | Revision:

# Date Author Comment
ca0865a8 01/15/2014 12:22 PM Adam M. Wilson

Rearranging files

f07e0e66 01/13/2014 03:09 PM Adam Wilson

udpates to validation and addition of initial biodiversity script

1dc46eb9 01/08/2014 09:35 AM Adam Wilson

Updating figures

8009a075 01/07/2014 08:17 AM Adam Wilson

Updating validation to use new cloud data

e7503f8e 01/05/2014 10:25 AM Adam Wilson

Finished second complete ee download of mod09 cloud mask using python tiler

ba7057c4 01/03/2014 01:29 PM Adam Wilson

Separated ee download from compile script. Switched to use of vrt as intermediate file form

41d291a6 12/20/2013 08:40 AM Adam Wilson

Added multiple tries to python GEE script

c8be7255 12/16/2013 01:34 PM Adam Wilson

Updated EE compiler

6e83c57e 12/13/2013 02:17 PM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

f5ef0596 12/13/2013 02:17 PM Adam Wilson

Updated EE script to run in parallel and minor edits to post-processing

b4e7cfc8 12/12/2013 08:03 AM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

aa55cdc8 12/12/2013 08:03 AM Adam Wilson

Updating Pleiades script

d6ddb3e2 11/23/2013 12:45 PM Adam Wilson

udpating validation to full globe

d86b0a4a 11/20/2013 02:07 PM Adam Wilson

updates to MOD09 visualizations

d7dc526e 11/19/2013 11:13 AM Adam Wilson

Updating visualization and validation of MOD09 cloud product

9a19743f 11/11/2013 07:09 PM Adam Wilson

addied initial MOD09 visualization script and updates to NDP script to use the new mod09 data

bce95cb5 11/08/2013 01:38 PM Adam Wilson

First global mod09 run. Updated cloud flag function

15936a3e 11/08/2013 11:15 AM Adam Wilson

updated EE script to loop over regions (currently global quarters) and check if uncorrupted files exist before downloading

6fc314e2 11/07/2013 11:41 AM Adam Wilson

cleaning up comments

065013d8 11/07/2013 07:24 AM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

58d05081 11/07/2013 07:23 AM Adam Wilson

Adding ee.MOD09.py script to process and download data from Google Earth Engine

f4772881 10/18/2013 06:17 PM Adam M. Wilson

merging

4f171339 10/18/2013 06:14 PM Adam M. Wilson

Old code

fe4c013a 10/11/2013 01:41 PM Adam Wilson

Changed bias metric to % change rather than p-value

2bca6aaa 10/11/2013 12:21 PM Adam Wilson

Updated cloud climatology evaluation

84d4d760 10/07/2013 12:55 PM Adam Wilson

Exploring evalution options for mod35c5

58adefad 09/17/2013 07:35 PM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

57d44dd9 09/17/2013 07:35 PM Adam Wilson

Added routine to process identify regions of concern in modis cloud data

7ff106f6 09/13/2013 01:56 PM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

d91f0663 09/13/2013 01:56 PM Adam Wilson

nearly finished first global run of MOD35 cloud frequency

e12ca15c 09/11/2013 01:48 PM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

60478708 09/11/2013 01:48 PM Adam Wilson

Removing random shapefile

555815c9 09/11/2013 01:47 PM Adam Wilson

Updated C5 MOD35 Processing Path code and C5MOD35_Evaluation in preparation for publication

be0ef101 08/23/2013 01:07 PM Adam Wilson

Added script to extract each separate cloud test from MOD35. This is done to explore which tests are leading to coastal artefacts in the summarized data

848e34fd 08/22/2013 07:19 AM Adam Wilson

Submitted global run for 2009

e5c2e69b 08/16/2013 02:03 PM Adam Wilson

found and fixed bug in r.out.gdal export of netcdf files with no missing data. The missing data value was set to 0 instead of the 255 that was specified. This resulted in all 0s to be removed from these day-tiles. Fixed by deleting and resetting the attribute _FillValue using ncatted.

95354b03 08/15/2013 01:37 PM Adam Wilson

Updated to use new swtif and remove additional QC that identified strips introduced by old swtif. Some tiling artifacts still present.

3414d8a7 08/13/2013 01:57 PM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

3bb88310 08/13/2013 01:57 PM Adam Wilson

updated to use new swtif

d39ab57e 07/26/2013 11:15 AM Adam Wilson

Submitted MOD35-landcover bias paper with code from this commit. Also added short script to test swtif program.

03669795 07/17/2013 12:43 PM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

d2dbbe0c 07/17/2013 12:43 PM Adam Wilson

Adding initial version of MOD09 processing script

598244e1 07/17/2013 11:42 AM Adam Wilson

updating figures

3e0e9337 07/16/2013 08:13 AM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

52ae84b1 07/16/2013 08:12 AM Adam Wilson

Adding script to upload covariate data to Pleiades

cb7cd210 06/27/2013 02:08 PM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

14ad4a96 06/27/2013 02:08 PM Adam Wilson

Updating figures for C5MOD35 Manuscript

e4e30b86 06/26/2013 02:10 PM Adam Wilson

updated swtif error checking to use r.neighbor instead of r.mapcalc. Submitted job for northern block of tiles

9b5125b9 06/24/2013 11:06 AM Adam Wilson

Finished function to make raster extent for any modis tile

6f44b9ed 06/24/2013 08:33 AM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

905db3dc 06/24/2013 08:32 AM Adam Wilson

Update MOD35 process path extraction to use sensor angle

d3dd2b2e 06/24/2013 08:29 AM Adam Wilson

Add first version of script to develop global modis MODLAND grid

171a4e16 06/22/2013 05:36 AM Adam Wilson

added function to flag bad pixels introduced by bug in HEG software

304a60d2 06/17/2013 12:28 PM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

5f212fe8 06/17/2013 12:28 PM Adam Wilson

Added script to test functionality of HEG tool which reveals that v2.12 segfaults when multiple bands are selected for processing. Also updated MOD35_ExtractProcessPath to process one-band-at-a-time instead of in batches.

8553f079 06/14/2013 09:45 AM Adam Wilson

Adding sensor zenith to quality calculation and improving the filter used to select daily data

a981dca4 06/13/2013 08:08 PM Adam Wilson

Adding sensor zenith to quality calculation and improving the filter used to select daily data

e0f4e7ec 06/11/2013 01:50 PM Adam Wilson

Started process of adding sensor zenith filter to MOD35 Processing

1f299994 06/11/2013 09:51 AM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

5af36cdd 06/11/2013 09:51 AM Adam Wilson

Separated daily products into a 'day' and 'night' cloudiness based on day flag

a57c4e3d 06/07/2013 02:32 PM Adam Wilson

Updated profile plots of transect figure

0a930ed3 06/05/2013 01:58 PM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

be7b1081 06/05/2013 01:57 PM Adam Wilson

Added script to make GHCN station shapefile for global station gap analysis

7bc7266c 05/30/2013 07:18 PM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

b3344197 05/30/2013 07:17 PM Adam Wilson

Move file outputs to /nobackupp1 instead of lou due to quota increase. First full 2009 summary

f7f9f131 05/15/2013 02:13 PM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

ddd9a810 05/15/2013 02:13 PM Adam Wilson

Updated script to process MOD35 Processing Path using HEG to interpolate sensor zenith observations. Also working on figures for MOD35 C5 vs C6 comparison in MOD35C5_Evaluation script

be64daa8 05/08/2013 12:52 PM Adam Wilson

Updated swath-grid section of MOD35 processing to add buffer and (hopefully) reduce edge artifacts in tiles

667c5cab 05/07/2013 08:25 AM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

aba23d60 05/07/2013 08:25 AM Adam Wilson

updated MOD35 processing script to work in separate temporary directories and transfer daily cloud data to lou for archiving in preparation for global processing (which cannot be done in personal directory). Also set up MOD35_Climatology script to be submitted to LDAN queue to run on lou rather than Pleiades. However environment still not set up correctly and script fails when reading netcdf files. Andrew is working on it.

99b3508d 05/03/2013 07:24 PM Adam Wilson

Added script to extract MOD35 processing path from swath level data and another to summarize MOD35 data. Also updated NDP-026D script to use new MOD35/09 summaries from Earth Engine

4eaaac57 04/23/2013 01:29 PM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

b3f5074e 04/23/2013 01:29 PM Adam Wilson

Added initial code to make KML of cloud climatologies

c24e32a8 04/22/2013 01:04 PM Adam Wilson

Fixed the 'missing stripes' problem in the climatology script. Source of problem was related to the _FillValue attribute being incorrectly set to a short integer when the data was saved as byte. Changing both the attribute and the data to type 'byte' appears to have fixed the problem.

78f94710 04/18/2013 10:01 AM Adam Wilson

Discovered possible cause of weird missing data stripes due to identifying missing data as 225.0 rather than 255s

b83b17ae 04/18/2013 08:06 AM Adam Wilson

Explored 30-day moving average

a9a1a67f 04/17/2013 08:01 AM Adam Wilson

Merging with Pleiades copy

1523a1e7 04/17/2013 07:44 AM Adam Wilson

minor clean up to MOD35 Climatology

b716a3f0 04/17/2013 07:43 AM Adam Wilson

Removed some unsed code from MOD35_climatology. Still having problem of missing data stripes in February means.

c1352601 04/12/2013 10:35 AM Adam Wilson

Updated MOD35_Climatology to use percentages instead of classes, but there are too many zeros in result

f27d277d 04/10/2013 10:57 AM Adam Wilson

Simplified MOD35 script and converted output to single band p(Clear) rather than multiple bands

71560f46 04/10/2013 07:37 AM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

710f7456 04/10/2013 07:36 AM Adam Wilson

Added initial validation via NDP-026D dataset

35d59dc1 04/10/2013 07:35 AM Adam Wilson

Simplifications to Climatology Script

3133718a 03/27/2013 12:59 PM Adam Wilson

Added new script to process daily MOD35 files

a6ed5f30 03/08/2013 11:08 AM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

f27b378d 03/08/2013 11:08 AM Adam Wilson

Updates to MOD06 Climatology Script and MDO06 processing to isolate the effects of the MOD35 -landcover bias

a6d44f2d 03/08/2013 11:01 AM Adam Wilson

Added script to process NDP-026D station cloud climatologies

65cc18e7 02/19/2013 06:34 PM Adam Wilson

Adjusted handling of cloud flag to 'hopefully' improve missing data problem in MOD06 climatology

3eb8b23f 02/19/2013 07:53 AM Adam Wilson

restructured MOD06 processing routine to eliminate functions for more transparent (linear) processing. Also updated to run on either pleiades or litoria

a0ca1036 02/19/2013 06:46 AM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

4ef959c2 02/19/2013 06:27 AM Adam Wilson

Adding intial code to process the NDP-026D station cloud climatology dataset

9c8b4de6 02/14/2013 11:44 AM Adam Wilson

Updated submit script to process multiple tiles and days in the same batch. Also separated the daily processing from the climatologies

0f1fce3f 01/16/2013 10:45 AM Adam Wilson

Merging with Pleiades copy

165c04fb 01/16/2013 10:38 AM Adam Wilson

Merging with Pleiades copies

f9d40a14 01/16/2013 10:37 AM Adam Wilson

Adding Climatology script to process daily files to climatologies

0e5b55f4 12/18/2012 12:42 PM Adam Wilson

Merge branch 'aw/precip' of code.nceas.ucsb.edu:environmental-layers into aw/precip

b6e392da 12/18/2012 12:42 PM Adam Wilson

Identified problem in handling of missing values of MOD06 product. In some areas limiting quality control to the highest quality results in ~90% NAs.

86629ea0 12/18/2012 12:37 PM Adam Wilson

initial script to handle modified netcdf files from Pleiades.R script

659f6fea 12/17/2012 07:48 AM Adam Wilson

Merging GAM_LST script from bp/interp to aw/precip