Forecasting Biodiversity: How Confident Should We Be?

The majority of research into the impacts of global change has focused on abiotic factors such as warming temperatures and increased concentration of carbon dioxide (IPCC-WGII 2007). However, it is becoming clear that the consequences of biodiversity loss on vital ecosystem functions including primary productivity and decomposition are comparable in magnitude to the major abiotic stressors (Hooper et al. 2012, Figure 1). It is thus vital that we understand the drivers of biodiversity loss, which are numerous, interacting, and spatially heterogeneous. Various methods have been employed to understand how environmental change will impact biodiversity, including models of species distributions (e.g. Franklin et al. 2012) and demographic processes (e.g. Jenouvrier et al. 2012).

Figure 1: Changes in primary production as a function of percent local species loss. Effects of species loss on primary production from 62 studies (379 observations). Thick red line, lower productivity as species richness decreases; grey bands and black error bars, 95% confidence intervals. The thin red line shows the inverse of the thick red line to allow comparison of effect magnitudes with environmental changes with positive effects. Dotted grey lines show the mean effect of each environmental change for comparison with the effect of richness. Right axis, effects of other environmental changes. Blue is for increases and red for decreases in productivity. Reprinted by permission from Macmillan Publishers Ltd: Nature (doi:10.1038/nature11118), © 2012

Typically, practitioners 1) fit a model using historical explanatory data, which often includes interpolated climate data and/or remotely sensed products and then 2) use that model to project into the future using climate model output. In other words, models constructed to forecast biodiversity often use ‘output’ from other models as ‘input’ data. However, in most cases the uncertainties presented in the results are derived only from the biological model and ignore uncertainties in the source datasets. Statistically, this is a reasonable approach with the important caveat that the results are conditional on the input datasets. But for policy purposes, it is important that the uncertainties represent the overall confidence in the forecast. The IPCC, for example, has standardized how uncertainties should be handled and described throughout their publications (Mastrandrea et al. 2010) and other disciplines, such as hydrology, have taken this problem seriously (e.g. Liu and Gupta, 2007). Thus ecologists are faced with the important challenge of propagating uncertainties inherent in source datasets through new models to the final results. Unfortunately, this is difficult to achieve with traditional modeling frameworks. Here I will explore some of the implications of failing to propagate uncertainties and offer suggestions of how to improve our ability to improve forecasts.

Uncertainty in source datasets: what difference does it make?

Previous work has revealed that the choice of environmental data can make a significant impact on the results of biodiversity analysis. For example, Soria-Auza, et al. (2010) used the MaxEnt framework (Phillips, Anderson, and Schapire, 2006) to compare estimated the geographic distributions of several bird and fern species using climate data available via WorldClim (Hijmans et al., 2005) and SAGA (Böhner, 2005). Even though the differences these datasets were relatively minor, the authors reported significant differences in the predictions in some regions. In a related study, Peterson and Nakazawa (2008) compared six different sources of environmental datasets (primarily climatic variables) and found significant differences in the predicted potential range of an invasive fire ant (Solenopsis invicta) using the various climatic data sets. In particular, the commonly used WorldClim dataset (Hijmans et al., 2005) failed to accurately predict the full invasive range. In both of these studies, the authors used additional information to assess the relative merit of the predictions derived from various input data sets. However it is common in biodiversity modeling studies that no independent data are available and thus ecologists are faced with either arbitrarily choosing a environmental dataset or making predictions with multiple climate datasets and noting the differences. The situation is similar to the use of GCM output. Typically the output from multiple GCMs are treated independently in ecological analysis (e.g. Beaumont et al., 2008; Lawler et al., 2009) and the differences are explored by comparing the resulting predictions. This is analogous to the independent comparisons of different climate interpolations mentioned above. There has been some effort to develop probabilistic climate projections by treating output from different GCMs as ‘samples’ from a ‘true’ (in the statistical sense) future climate which would allow probabilistic ecological projections (Tebaldi and Knutti, 2007). This approach has not yet been widely adopted, in part because the uncertainties in the output from GCM ensembles are difficult to quantify due to lack of verification and model dependence, bias, and tuning. In interesting explorations of the implications of this type of uncertainty, Conlisk et al. (2012) and Diniz-Filho et al. (2009) used sensitivity analyses to partition the variability of projections made using different niche (or niche-population) models between various sources such as niche model design, general circulation models (GCMs), and emission scenario. They both identified that the choice of niche model was the single largest source of uncertainty. However, the methods were not able to produce a single projection accounting for the various uncertainties.

A solution: Hierarchical models…

Recent developments in Hierarchical Bayesian (HB) statistics have made it possible to incorporate covariate data into the model as a random variable and thus account for the uncertainty of the data in the results (Clark 2005). Propagating uncertainty in this way could be achieved relatively easily by considering the environmental data to have distributions (rather than single values) at each location. For example, Kang, Cressie, and Sain (2012) developed a “consensus climate signal” across six regional climate models using a HB model. The output from that process incorporates the uncertainty across models and could be used for for further ecological analysis. See Chakraborty et al. (2011) for an example of a species distribution model that could incorporate this type of climatic uncertainty into model fitting or projection. A similar approach has been recently explored in epidemiological models that combine algorithmic models with stochastic exposure simulators to estimate human exposure to toxins (Gelfand and Sahu, 2010). This framework could have wide application for developing biodiversity models capable of incorporating data uncertainty into a model and propagating the results through to the model output and results. This would likely lead to projections with wider prediction intervals that we can be more confident in. But regardless of modeling framework, it is important that we improve our quantification of uncertainty because policy and management decisions depend on them.

References 
Beaumont, L.J., L. Hughes, and AJ Pitman. “Why Is the Choice of Future Climate Scenarios for Species Distribution Modelling Important?” Ecology Letters 11, no. 11 (2008): 1135–1146

Böhner, J. Advancements and New Approaches in Climate Spatial Prediction and Environmental Modelling. Berlin, Germany: Arbeitsberichte des Geographischen Instituts der HU, 2005.

Chakraborty, Avishek, Alan E Gelfand, Adam M. Wilson, Andrew M Latimer, and John A. Silander. “Point Pattern Modeling for Degraded Presence-Only Data over Large Regions.” Journal of the Royal Statistical Society. Series C (Applications) 60, no. 5 (2011): 757–776.

Clark, J S. “Why Environmental Scientists Are Becoming Bayesians.” Ecology Letters 8, no. 1 (2005): 2–14.

Conlisk, Erin, Alexandra D. Syphard, Janet Franklin, Lorraine Flint, Alan Flint, and Helen Regan. “Uncertainty in Assessing the Impacts of Global Change with Coupled Dynamic Species Distribution and Population Models.” Global Change Biology (2012): n/a–n/a. doi:10.1111/gcb.12090.

Diniz-Filho, J. A. F., L. Mauricio Bini, T. Fernando Rangel, R. D. Loyola, C. Hof, D. Nogués-Bravo, and M. B. Araújo. “Partitioning and Mapping Uncertainties in Ensembles of Forecasts of Species Turnover Under Climate Change.” Ecography 32, no. 6 (2009): 897–906.

Franklin, J., F. W. Davis, M. Ikegami, A. D. Syphard, L. E. Flint, A. L. Flint, and L. Hannah. “Modeling Plant Species Distributions Under Future Climates: How Fine Scale Do Climate Projections Need to Be?” Global Change Biology (2012): 1–11.

Gelfand, A.E., and S.K. Sahu. “Combining Monitoring Data and Computer Model Output in Assessing Environmental Exposure.” In The Oxford Handbook of Applied Bayesian Analysis, 896. USA: Oxford University Press, 2010. http://www.oup.com/us/catalog/general/subject/Mathematics/ProbabilitySta….

Hijmans, R J, S E Cameron, J L Parra, P G Jones, A. Jarvis, and Others. “Very High Resolution Interpolated Climate Surfaces for Global Land Areas.” International Journal of Climatology 25, no. 15 (2005): 1965–1978

Hooper, David U., E. Carol Adair, Bradley J. Cardinale, Jarrett E. K. Byrnes, Bruce A. Hungate, Kristin L. Matulich, Andrew Gonzalez, J. Emmett Duffy, Lars Gamfeldt, and Mary I. O’Connor. “A Global Synthesis Reveals Biodiversity Loss as a Major Driver of Ecosystem Change.” Nature 486, no. 7401 (June 7, 2012): 105–108. doi:10.1038/nature11118.

IPCC-WGII. “Ecosystems, Their Properties, Goods and Services.” In Climate Change 2007: Impacts, Adaptation and Vulnerability. New York, New York: Intergovernmental Panel on Climate Change, Cambridge University Press, 2007.

Jenouvrier, S., M. Holland, J. Stroeve, C. Barbraud, H. Weimerskirch, M. Serreze, and H. Caswell. “Effects of Climate Change on an Emperor Penguin Population: Analysis of Coupled Demographic and Climate Models.” Global Change Biology (2012). http://onlinelibrary.wiley.com/doi/10.1111/j.1365-2486.2012.02744.x/full.

Kang, Emily L., Noel Cressie, and Stephan R. Sain. “Combining Outputs from the North American Regional Climate Change Assessment Program by Using a Bayesian Hierarchical Model.” Journal of the Royal Statistical SocietySeries C (Applied Statistics) 61, no. 2 (2012): 291–313. doi:10.1111/j.1467-9876.2011.01010.x.

Lawler, Joshua J., Sarah L. Shafer, Denis White, Peter Kareiva, Edwin P. Maurer, Andrew R. Blaustein, and Patrick J. Bartlein. “Projected Climate-induced Faunal Change in the Western Hemisphere.” Ecology 90, no. 3 (2009): 588–597. doi:10.1890/08-0823.1.

Liu, Yuqiong, and Hoshin V. Gupta. “Uncertainty in Hydrologic Modeling: Toward an Integrated Data Assimilation Framework.” Water Resources Research 43, no. 7 (2007): n/a–n/a. doi:10.1029/2006WR005756.

Mastrandrea, M. D., C. B. Field, T. F. Stocker, O. Edenhofer, K. L. Ebi, D. J. Frame, H. Held, et al. Guidance Note for Lead Authors of the IPCC Fifth Assessment Report on Consistent Treatment of Uncertainties. IPCC Cross-Working Group Meeting on Consistent Treatment of Uncertainties. Jasper Ridge, CA, USA: Intergovernmental Panel on Climate Change, 2010. http://193.194.138.236/pdf/supporting-material/uncertainty-guidance-note….

Peterson, AT, and Y. Nakazawa. “Environmental Data Sets Matter in Ecological Niche Modelling: An Example with Solenopsis Invicta and Solenopsis Richteri.” Global Ecology and Biogeography 17, no. 1 (2008): 135.
Phillips, S. J., R. P. Anderson, and R. E. Schapire. “Maximum Entropy Modeling of Species Geographic Distributions.” Ecological Modelling 190, no. 3 (2006): 231–259.

Soria-Auza, R.W., M. Kessler, K. Bach, P.M. Barajas-Barbosa, M. Lehnert, S.K. Herzog, and J. Böhner. “Impact of the Quality of Climate Models for Modelling Species Occurrences in Countries with Poor Climatic Documentation: a Case Study from Bolivia.” Ecological Modelling 221, no. 8 (2010): 1221–1229.

Tebaldi, C., and R. Knutti. “The Use of the Multi-model Ensemble in Probabilistic Climate Projections.” Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 365, no. 1857 (2007): 2053–2075.