Activity
From 05/11/2012 to 06/09/2012
06/05/2012
- 11:23 AM Task #363: Assemble all GHCN data into a single database
- I did a 30 year query during the night for the 1980-2010 period for the Oregon study area. I just checked the results...
- 12:35 AM Task #363: Assemble all GHCN data into a single database
- A short R script was added to select stations data from the postgres database created by Jim. The user must provide a...
- 12:27 AM Task #364: Integrate spatial variables and structure in the GAM methodology
- Two stage regression: the GAM+Kriging script was updated to integrate specific and general diagnostics:
general diag...
06/01/2012
- 12:54 PM Task #423 (New): Develop stratified station sampling procedure
- We need to develop a procedure to sample representative stations to use in fitting and validation. In many areas (in...
- 12:43 PM Task #415: Process MOD06_L2 Cloud data
- I've downloaded and processed the full 10 archive for Oregon and generated monthly climatologies for "Cloud Optical T...
- 09:57 AM Task #363: Assemble all GHCN data into a single database
- Finished loading the new TMAX, TMIN, and PRCP data (just under 12 hours) and creating the station index (just over 13...
05/30/2012
- 03:38 PM Task #363: Assemble all GHCN data into a single database
- I wrote and ran a little bash script to download the latest GHCN data and generate a basic log file for future refere...
05/25/2012
- 03:21 PM Task #363: Assemble all GHCN data into a single database
- The daily data files currently in the database were obtained back in Oct 2010. Benoit and I discussed simply augmenti...
- 09:05 AM Task #419 (In Progress): Assessment of results in the context of the literature: Literature review and accuracy
- Documenting the new products will necessitate assembling a list of references on climate interpolation to place the r...
05/22/2012
- 10:14 AM Task #363: Assemble all GHCN data into a single database
- If useful for some specific purpose, we could generate relevant synoptic views or subsetted table dumps pivoted back ...
- 08:25 AM Task #363: Assemble all GHCN data into a single database
- Perhaps it would make sense to keep the data in the "one-row-per-month" format in the database and transform it on th...
- 07:52 AM Task #418 (New): Explore Landcover - LST interactions
- Use the full gridded datasets (rather than just station locations) to explore relationships between LST and various (...
05/17/2012
- 11:38 PM Task #416: Scope out workflow for calculating monthly LST climatologies
- I've now written some Python+GRASS code to do a good bit of what I think we want. For a user-specified _tile_, _year_...
- 03:05 PM Task #416 (In Progress): Scope out workflow for calculating monthly LST climatologies
- Assess feasibility of running LST climatologies ourselves by implementing a basic scripted workflow and estimating ov...
- 03:44 PM Task #375: Assemble monthly mean MODIS LST values for the complete record (2000-2012) for Oregon
- See task #416 for progress on developing and evaluating a procedure for doing this ourselves.
But I will add a com...
05/16/2012
- 12:01 PM Task #207: Produce global fused DEM layer
- A global 90m product is now available, though the individual pieces have not been mosaiced together due to file size....
- 06:40 AM Task #415: Process MOD06_L2 Cloud data
- See presentation on current progress here [[https://projects.nceas.ucsb.edu/nceas/documents/18]]
- 06:40 AM Task #415 (New): Process MOD06_L2 Cloud data
- Download and process the MODIS cloud product (MOD06_L2) and produce monthly 1km summaries of key variables.
05/15/2012
- 11:22 AM Task #411 (In Progress): Insert DEM adaptive smoothing procedure into terrain workflow
- I developed two alternative implementations of the adaptive DEM smoothing procedure (@multiscalesmooth9a_clean.aml@):...
- 09:52 AM Task #411 (In Progress): Insert DEM adaptive smoothing procedure into terrain workflow
- The original Oregon terrain processing workflow, implemented as a set of AML scripts, included the application of Joh...
- 09:57 AM Task #208: Evaluate existing E&O AML scripts
- I recently reorganized all AML scripts into a single directory in the code repo, here:
source:terrain/research/orego...
05/14/2012
- 10:00 AM Task #363: Assemble all GHCN data into a single database
- Quick example comparing SQLite vs PostgreSQL timings on a simple aggregate query that doesn't use any indexes. SQLite...
05/13/2012
- 11:16 PM Task #363: Assemble all GHCN data into a single database
- Vaguely concerned about performance and manageability of such a large SQLite database, I wrote a second script to loa...
- 11:14 PM Task #363: Assemble all GHCN data into a single database
- Belated update. The TMIN/TMAX data loaded in ~6 hours total, yielding a 25GB SQLite file with nearly 600 million rows.
Also available in: Atom