Click here for the PDF version

TRANSATLANTIC UNCERTAINTY COLLOQUIUM (TAUC):

MAKING ENVIRONMENTAL DECISIONS IN SPITE OF UNCERTAINTY


M B Beck, K H Reckhow, and K A Oye

1          OBJECTIVES 

Problem Context

Making a decision under uncertainty is ubiquitous. Its formal study has been extensive and intensive, for over several decades (Berger, 1985; Morgan and Henrion, 1990; Funtowicz and Ravetz, 1990; Freeman, 1993; Pratt et al, 1995; Clemen, 1996; Cullen and Frey, 1999; Reichert and Borsuk, 2005; Krayer von Krauss et al, 2005). While labels may differ, three broadly different categories of uncertainty are generally recognized for the archetypal outcome of an uncertain (future) event: (i) Statistical Uncertainty, in which the possible outcomes of the event are known, as well as the numerical probabilities of occurrence of each; (ii) Scenario Uncertainty, where the outcomes are known, but not all of their respective probabilities; and (iii) Ignorance, where neither all of the outcomes, nor (self-evidently) their respective probabilities, are known. We might loosely associate aleatory uncertainty with the first of these, while epistemic uncertainty would tend to be better aligned with the last. Studies on how environmental regulatory decisions are made in the face of epistemic uncertainty are sparse indeed.

The social (and cultural) context of making environmental decisions entails rather different kinds of uncertainty. Members of the different social solidarities of Cultural Theory (Thompson et al, 1990), for example, will generally hold quite heterogeneous views on the consequences of action. Broad categories of stakeholder outlooks on the man-environment relationship — the solidarities of Cultural Theory (Thompson et al, 1990; Thompson, 1997) — map across to Holling’s “Myths of Nature”, as drawn from Systems Ecology (see, for example, Holling et al, 2002). Thus, the entrepreneurial “market-oriented”, or “individualist”, stakeholder understands nature as being benign, able to recover stability in its functions following all manner of largely unfettered insults and injury; the “government-oriented”, or “hierarchist”, stakeholder sees nature as generally tolerant, but perverse on occasion and, therefore, in need of curbs on man’s activities; while a member of the “civil-society, non-governmental activist”, or “egalitarian”, social solidarity views the behavior of nature as ephemeral, likely to be plunged into disaster and radical, undesirable change at the least interference from man and his technological innovations. In a healthy democracy, such a diversity of aspirations for the future is to be celebrated. Stakeholders will embrace attitudes towards risk that are more variegated than those formally accounted for in utility theory. Consensus, as the mechanism for negotiating the outcome of the rule-making process, is unlikely to succeed, or be maximally effective.

Arguing that “a commitment to democracy does not demand the attainment of consensus over policy decisions”, Coglianese (2001) has pointed to imprecision and ambiguity as one of several pitfalls of the device. Evidence indicates it does not diminish the rate of legal challenges to rulings. Other modes of engaging the public’s participation in negotiating regulatory decisions may be just as effective as the device of consensus-seeking, if not more so. But they leave uncertain the level of dissatisfaction with the outcome at which stakeholders might challenge the rule once expressed (Coglianese, 2001). Even when policy formulation does not rely literally on the attainment of consensus — as is true under most US regulations written under the Administrative Procedures Act — policy-makers are well advised to achieve broad credibility for making sound decisions. An examination of generally credible organizations, e.g., the National Research Council and the Health Effects Institute in the US, shows the crucial importance of demonstrating that the issues have not been pre-determined before the analysis is performed, that key parts of the assessment process are open to all interested groups, and that the selection of analysts is made with an eye toward scientific standing, not political placement (McCray, 2004).

We live and work in times of abundant global communication. Within the space of one month in 2003 a Workshop was held in Rockville, Maryland, on Uncertainty, Sensitivity, and Parameter Estimation for Multimedia Environmental Modeling (Nicholson et al, 2004), while another Workshop — of the European Union (EU) Harmoni-CA project (Modeling in Support of the EU Water Framework Directive; www.Harmoni-CA.info) — was held at the Royal Netherlands Academy of Arts and Sciences, Amsterdam. Scientists and engineers on the two sides of the Atlantic were proceeding on parallel fronts, notably in respect of the computational analysis of uncertainty and the assurance of quality in models used in a regulatory decision-making situation, yet seemingly unaware of each others’ work on these subjects. In 2004 a project on Adaptive Implementation of the Total Maximum Dail Load (TMDL) program under the US Clean Water Act was begun (Reckhow et al, 2004); in 2005 a project on Adaptive Approaches to Integrated Water Resources Management, under the EU Water Framework Directive, was also begun (NeWater; Pahl-Wostl and Kabat, 2004). Both seek to address issues of uncertainty in a management context; yet there are no formal links whatsoever between the two projects.

There is much to be gained from exploiting the resulting variety, and therefore richness, of traditions in handling uncertainty on the two sides of the Atlantic and then channeling this previous experience onto enquiry addressing both epistemic uncertainty (or ignorance), negotiating procedures, and the plurality of social solidarities (Thompson et al, 1990) — beyond the conventional duality of “markets” and “hierarchies” — in the making of regulatory environmental decisions.

Objectives

The purposes of the proposed project are to:

1          Identify the key issues preventing a more appropriate, effective application of incomplete, insecure science in guiding the promulgation and assessment of regulatory actions in an increasingly open, disputatious, participatory form of environmental stewardship.

2          Establish (and launch) an ongoing, multi-disciplinary, transatlantic network of experts working at the intersection of environmental science, policy-making, and law, within the context of dealing with uncertainty, i.e., the TransAtlantic Uncertainty Colloquium (TAUC).

“Effective application” under objective (1) will cover the use of models for generating foresight, as much as procedures for handling epistemic uncertainty in a legal setting. Defining will be enquiry into the nature of uncertainty from the greatest possible variety of disciplinary backgrounds: from anthropology, law, and economics, to engineering and the natural and mathematical sciences. In contexts where there is “disputation” — precisely because of the diversity of perspectives on the man-environment relationship — TAUC and its related activities will have the longer-term objective (beyond the span of this proposal) of avoiding polarization where possible, moving instead towards debate on the basis of a shared formalism for handling uncertainty.

2          BACKGROUND

It is clear that the word “uncertainty” will be understood in many different ways. Our goal in this project is to embrace this spectrum of understandings, to digest and consolidate it, and assess the trends and gaps in the way that uncertainty is handled in the making of environmental decisions. Given the breadth of our purview, the following discussion of the proposal’s background is necessarily lengthy. This, however, is essential to appreciation of the work program and approach set out subsequently in Section 3, designed to meet the foregoing objectives, in the light of their highly inter-disciplinary character. 


Science and Society

In December, 1999, the journal Nature published a specially commissioned supplement entitled Impacts of Foreseeable Science. One of its articles bears the title “Science’s New Social Contract with Society” (Gibbons, 1999). It argues we must now ensure that scientific knowledge is “socially robust”, not merely “reliable”, as in the past; and that its production be seen by society to be both transparent and participatory: 

‘[S]ocially robust’ knowledge has three aspects. First, it is valid not only inside but also outside the laboratory. Second, this validity is achieved through involving an extended group of experts, including lay ‘experts’. And third, because ‘society’ has participated in its genesis, such knowledge is less likely to be contested than that which is merely ‘reliable’.

The complete case is argued in the book Re-Thinking Science (Nowotny et al, 2001), with the subtitle “Knowledge and the Public in an Age of Uncertainty”.

This change should hardly surprise us. It is the culmination of a steady drift over the decades: away, specifically in the environmental sciences, from an accompanying management stance of command-and-control, to one of participation and democracy (Darier et al, 1999). The intellectual history of working on the science and policy of environmental management reflects the same evolution: from its genesis within Operations Research (OR), i.e., application of the scientific principles of laboratory experimentation to military and subsequently civil operations; through Applied Systems Analysis (ASA), with its focus on the singular, largely technocratic environmental decision-maker (Beck, 1997); thus to Integrated Assessment (IA), with its (re-)introduction of the human dimension and its accompanying plurality of perspectives on the man-environment relationship (van Asselt and Rotmans, 1996; Thompson, 1997). In the early 1990s, we saw the rise of Post-Normal Science (Funtowicz and Ravetz, 1993; Ravetz and Funtowicz, 1999); born of an earlier enquiry into the nature of Uncertainty and Quality in Science for Policy (Funtowicz and Ravetz, 1990); and a form of science which, when implemented in the conduct of integrated environmental assessments and decision-making, would entail the democratization of knowledge by an extension of the peer-community for quality assurance. Now we have the newly minted notion of Sustainability Science (Kates et al, 2001), which calls for a way of doing science marked by social learning and participation.

It was not the case, of course, that uncertainty was not a consideration in the earlier OR and ASA stages in the evolution of environmental stewardship, but rather that the technocrats at the helm may not have been held accountable for addressing the uncertainty suffusing the context of their proposed rule-makings and management actions.


Policy and Administration

At the most strategic of levels we see two trends: one towards the growing recognition of “uncertainty”; the other towards a greatly widening circle of persons with an acknowledged stake in scrutinizing the knowledge base and the process of making decisions on the prosperity of the man-environment relationship, including regulatory decision-making. For the time-being the participatory character of the latter is less litigious in the countries of the EU than in the US. It could well be argued, nevertheless, that the EU ought to benefit from something of what one now sees in the US of the implications of the Government Performance and Results Act (GPRA), the Data Quality Act (DQA), and their oversight from the Office of Management and Budget (OMB) of the White House. Specifically, the EPA’s Council on Regulatory Environmental Modeling (CREM) has been established and this, in turn, has set in motion the current reviews of the Council’s draft Guidance Document on the Selection and Use of Models (Pascual et al, 2004) and associated considerations of uncertainty. One such review is being conducted by the EPA’s Science Advisory Board (SAB), another by the National Research Council (NRC). Driven by much the same trends (again in the US) — that the demand for economic analysis of policy is growing, including assessment of the accuracy/uncertainty of associated economic forecasts (Harrington et al, 1999) — evaluation of models under uncertainty was a core theme in the February, 2005, Workshop of the US EPA’s Office of Water on “Water Quality Modeling for National-scale Economic Benefit Assessment”. Significantly, the driver of such economic benefit assessment is the general public’s perception of what constitutes improvements in the “swimmable”, “fishable”, or “aquatic health” status of surface water bodies, with all the uncertainty (and diversity) thereto attaching (Viscusi et al, 2004).

In the European context, the government and civil service of the Netherlands has long been a leader in developing the formal means of handling uncertainty in science for environmental policy (since the 1980s). The then “philosophical” ideas of Funtowicz and Ravetz, likewise emerging from the 1980s (Funtowicz and Ravetz, 1990), have been brought to very practical fruition in the now formally announced (January, 2005) Netherlands Environmental Assessment Agency (MNP) Guidance for Uncertainty Assessment and Communication (see van der Sluijs et al (2003), for example). Development of this (Dutch) Guidance, though international in authorship, has been fundamentally European in its origins. Little of its heritage, other than the notion of “model pedigree” (Funtowicz and Ravetz, 1990; van der Sluijs et al, 2005), which imposes a succinct matrix of judgements on the summary outcomes of peer review of the knowledge base of a domain of science, has made it across the Atlantic (pedigree surfaces in the US EPA’s CREM draft Guidance Document). The extended peer review envisaged in the (European) work on Post Normal Science is championed in the US by Sheila Jasanoff (Jasanoff, 1994). She does so essentially single-handedly, most recently in exchanges over US OMB Guidelines on peer review, and, in particular, in respect of the distinction between peer review of conventional laboratory science and peer review of science for policy and regulatory decision-making.

Two governments, those of the US and the Netherlands, have for two decades led the way in engaging formally with the issue of uncertainty in science for environmental policy, with but remarkably little engagement — on this matter — with each other. 


Technology and Risk

Important aspects of making environmental decisions in spite of uncertainty have to do with new technologies and novel substances and materials. Anyone responsible for stewardship of the environment will wish to pursue the fine line between the risks of promulgating rules and regulations that, on the one hand, leave the environment inadequately protected, or, on the other hand, impose undue burdens on society, the economy, and industry, in meeting the said regulations. Benchmark publications on the subject of risk assessment appeared in the 1980s, most notably the NRC’s so-called “Red Book” (NRC, 1983), with its UK counterparts (Royal Society, 1983, 1985). Taking stock of developments in risk assessment and management in the US over the twenty years since publication of the Red Book, Finkel (2003) argued that practice was still falling far short of the 1983 book’s standards — for acknowledging and managing model uncertainty in a transparent and consistent manner — all the valiant efforts of both the US EPA and US Occupational Safety and Health Administration (OSHA) notwithstanding. Indeed, Finkel’s paper enters into an extraordinarily detailed analysis of the logic for when and how default models (with conservative assumptions, erring on the side of being overly protective) should be replaced by other models arising out of scientific progress.

There are cultural distinctions of some complexity and subtlety to be noted here. At a recent (2004) symposium in Copenhagen, Denmark, on “Uncertainty and Precaution in Environmental Management” (UPEM I), a former Danish Minister of the Environment was heard to complain about the difficulties the “Anglo Saxons” have in embracing the precautionary principle. This was an international symposium, of central relevance to this proposal (as we shall see), yet one where participation was dominated by the Europeans, with but a small representation from North America, and almost no participants from other parts of the world. There can be worthy cultural reasons for treating UK and US attitudes as identical, but in other significant respects, they differ. In particular, there is a penchant for quantification and explicit procedural terms and conditions in the latter; in the UK, however, there has been a history of a more implicit, more verbal, less quantitative approach to agreements and definitions, including perspectives on risk assessment.

Juxtaposed thus with the Red Book of the early 1980s, Brown’s book on Environmental Threats: Perception, Analysis and Management (Brown, 1989) emerged from research supported by the UK’s Economic and Social Research Council (ESRC). One key contribution asked whether there was any difference between Engineering and Anthropology (Thompson, 1989). It argued the case against the “mathematization” of risk assessments, since this sought to re-cast Engineering as an experimental, laboratory-type enterprise. This, it asserted, was to deny the basis and origins of Engineering as a discipline distinct from Science, wherein balancing attitudes towards risk in engineering design and analysis had become “internalized” over the centuries. It is what engineers have been taught as the quintessentially distinctive, non-quantitative, process of “engineering judgement”: the matter of balancing perspectives roughly between the two social solidarities gathered around “markets” (reflecting unfettered risk-taking entrepreneurship) and “hierarchies” (from which derive procedural controls by governments for protecting society and the environment). The contemporary challenge for Engineering, Thompson wrote, was to recognize a third social solidarity — the “egalitarian” solidarity (closely associated, as already observed, with civil society actors, such as Greenpeace and Friends of the Earth) — which had risen to prominence in the closing decades of the twentieth century, altering thus radically the process of balancing differing social and individual attitudes towards risk. Understanding how to move forward, in the presence of this plurality of perspectives on the man-environment relationship, could not solely be reduced to insights gained from a quantitative fault-tree, or computational, predictive exposure analysis, according to Thompson (1989).

There is another dimension to matters of risk and technology, most readily apparent in the context of foresight and decision-making under uncertainty in respect of the prospective consequences of climate change (a cluster of Centers was established in 2004 by the NSF to address this problem). A significant response there will require large-scale changes in the system by which we produce and consume energy, in order to reduce carbon emissions to the atmosphere. Substantial uncertainties in both the costs and benefits of such technology investments (from both the public and private sectors) derive from underlying uncertainties in the likelihood of research discoveries, the ultimate cost of producing and using innovations, future interest-rate fluctuations, and so on. Existing research for guiding decision-making in this setting (for example, Ringuest et al, 1999), to inform preferred strategies for managing technology R&D portfolios, is surprisingly limited.


Models and Methods of Analysis


The need to account for the uncertainty in models of the behavior of environmental systems has become widely recognized over the past thirty years (see, for example, Beck, 2002). The field of sensitivity analysis and the analysis of uncertainty has shifted remarkably rapidly from the fringes of research (Saltelli et al, 2000) to the everyday accessibility of a primer (Saltelli et al, 2004). Where once the goal of model-building might have presumed the eventual homing in on the singular “truth of the matter” (a view implicit, for instance, in Beck, 1987), this is not so today (Beck, 2005). The structure of the model — the conceptual model of the system’s behavior, that is — is acknowledged as inherently flawed, with elucidation of the associated structural error/uncertainty, and quantification of its consequences for forecasts with a bearing on decision-making, becoming central issues for research (Beck, 2005; Krayer von Krauss et al, 2005). In a Bayesian context, thinking has shifted from working with a single model to working with a plurality of differently-structured, candidate models, each a candidate predictor of the consequences of actions of management and capable of yielding a so-called Bayesian average forecast (Neuman and Wieringa, 2003). In general, there are the first signs of a strategic movement, away from the notion of models as “truth-generating machines”, towards the view of models as tools designed, just like hammers or screwdrivers, to fulfil a designated task, for example, to generate — under gross uncertainty — predictive high-end exposures of novel substances yet to be released into the environment (Beck and Chen, 2000). This simple change of perspective enables new questions to be asked about the legitimacy of the model in the given context: is it well- or ill-designed for its intended purpose?


In this evolving setting, wherein it is now much more readily apparent that science-based models often fail to embrace state variables (or outcomes) of vital importance to the public’s perception of the environment, the potential for employing Belief Networks (Varis, 2002), or Bayesian Networks (Borsuk et al, 2003), as models has begun to be exploited. The tentative conclusion is that the field has been transferring its attention away from Statistical Uncertainty, and accounts of uncertainty as randomness, towards Scenario Uncertainty (with probabilities of outcomes rising and falling in a Bayesian updating sense) and Ignorance, (components of which may be anything but random), even to the notion of designing models specifically for the discovery of ignorance (Beck, 2002, 2005). Indeed, there has been a trend towards exploring the consequences of a plurality of cultural/social perspectives, not only (as one might expect) on the normative goals for desirable states of the environment, but also on the scientific composition of a model. Provocative though this may seem — to suggest that a member of Cultural Theory’s egalitarian social solidarity (within the group of public stakeholders) would incorporate into a model of the climate system bits of the science/knowledge base different from those of his/her counterparts in the hierarchist or individualist social solidarities — this has been done (van Asselt and Rotmans, 1996).


In the US, then, we can see a comprehensive government-wide concern for handling uncertainty in environmental simulation models, including in the extremely challenging computational context of the inexorable drift towards virtual realities (Nicholson et al, 2004). In the EU we see something of the same, but more distinctively a growing interest in addressing uncertainties deriving from stakeholder perceptions and aspirations (Pahl-Wostl and Kabat, 2004).
 

Adaptive Management


The National Research Council’s (NRC) review of the US TMDL program made much of the issue of uncertainty in the underlying science base (NRC, 2001) and the current Adaptive Implementation project (Reckhow et al, 2004) is a direct outgrowth of the challenges in dealing with the issue. By implication, such “adaptivity” must also be an approach to be deployed in making environmental decisions in spite of uncertainty.

We know what adaptive management is (Holling, 1978). And we know its time must have come when the NRC issues a report entitled “Adaptive Management for Water Resources Planning”, as its response to the charge of assessing the methods of the US Army Corps of Engineers in this domain (NRC, 2004). In essence, policy therein fulfils two functions: to probe the behavior of the environmental system in a manner designed to reduce uncertainty about that behavior, i.e., to enhance learning about the nature of the physical system; and to bring about some form of desired behavior in that system. It is possible, however, to conceive of going beyond adaptive management thus defined, in what has been called adaptive community learning (Beck et al, 2002; Beck, 2002). If, in the more open, participatory setting of environmental stewardship, one were to start from eliciting the aspirations of stakeholders for the future of their cherished piece of the environment — both their hopes and fears — what meaningful questions can formal computational analyses with models address, under such conditions of gross uncertainty about the longer-term future and dissonance amongst the plurality of stakeholder aspirations? The procedure of adaptive community learning is one response to such a question. It enfolds the prospect of generating foresight by tapping into {stakeholder imagination & scientific models}, this being the complement of the more familiar use of {scientific empirical observations & scientific opinion}. It holds out the prospect too of identifying priorities for purchasing further science, as necessary, that are robust against a lack of consensus about the community’s future aspirations. In particular, adaptive community learning ought both to subsume the principles of adaptive management (as defined above) and include actions, or a process of decision-making, whereby the community of stakeholders experiences learning about itself, its relationship with the valued piece of the environment, i.e., the community-environment relationship, and the functioning of the physical environment (Beck et al, 2002). Just as adaptive management celebrates a prudent measure of experimentation, so does adaptive community learning (Norton and Steinemann, 2001). The process will be iterative and continuous, one of “always learning, never getting it right” (Price and Thompson, 1997).

The public record on the recent use of adaptive strategies among the US regulatory agencies shows, furthermore, how hard it is to introduce them in practice. Despite strong and steady encouragements from a string of both Democratic and Republican Administrations since the late 1970s, it is extremely rare that public agencies have been able to adapt existing rules to new knowledge as it emerges (Finkel, 2003; McCray, forthcoming). In fact, the single prominent example of a program that introduces routine adjustments in the light of new science is in setting the particulates standards in the US EPA’s air pollution program. We still need to understand those factors — among the interest groups and the policy programs themselves — that seem to thwart the simple idea of policy being routinely adapted to accommodate new science.

Whether in North America, where adaptive community learning and its embedded notion of the computational analysis of reachable futures echoes some of the ideas of Robinson (2003), or in the EU, where it is reflected in the work of Kieken (2002), can environmental regulations really entail the dual functions of adaptive management: to manage and to learn from one and the same policy action? It is not hard to imagine a legal challenge, to the effect that government would be playing “fast and loose” with the environment, if it were to promulgate “experimental” actions.
 

Legal Context

When decision stakes are high, there is discord amongst the social groupings, and incomplete, insecure, or immature science has to be mobilized in a context of policy proximity and data poverty — all conditions very different from the setting in which science is conventionally undertaken — the making of environmental decisions will be subject to challenge, and frequently so in a legal context. The legal process, more so than coming to a view in the scientific community on the pedigree of a theory, must come to a summary judgement on whether the inferences drawn — to make the decision — are justified given the evidence. Regulatory agencies can be asked to explain their science in court; courts can determine whether regulatory decisions were supported on a rational basis (as opposed to being arbitrary or capricious); and they can rule on whether scientific evidence is to be admitted into a trial. Where such distillation has to be achieved, down to the very essence of a yes/no judgement on the legitimacy of a complex assembly of uncertain, disparate bits of the science bases, often under the prospect of looking into the future (as opposed to past misdemeanors), the legal process will demand the sharpest of thinking about all of the foregoing. Moreover, it will require some assessment of what might lie in the realm of Ignorance, or epistemic uncertainty (Pascual, 2005).

In their review of thirty years of judicial challenges to US EPA rule-makings, McGarity and Wagner (2003) concluded that “with respect to the judicial review of modeling exercises, the DQA [Data Quality Act] is likely to have a limited effect, at most”. The length of their paper and the number of cases cited suggest an already high rate of challenges, as also apparent a decade earlier, in respect of groundwater models (Bair, 1994). While models are by no means the same as all of science, rule-makings about environmental protection must so often address issues of a forward look into the future that they cannot be made without the use of models. Indeed, there is a paradox here (Beck et al, 1997). The greater the degree of extrapolation from past conditions, so the greater must be the reliance on a model as the instrument of prediction; hence, the greater is the desirability of being able to quantify the validity (or reliability) of the model, yet the greater the degree of difficulty in doing just this.

Finkel (2003) pays thus much attention to the issue of how agencies, such as the US OSHA and EPA, should evaluate new models, as candidates for employment in the assessment of risk, against criteria such as “scientific support”, “goodness of fit” (to history), and “replicability”, all of whose application — he notes — will be subjective. Three things are important here. First, the legal approach to standards of evidence, or burdens of proof, are brought to bear on thinking about model evaluation; second, as we have seen above, the key is acceptance or rejection, in effect, of competing entire assemblies of theories about the behavior of complex systems; and third, Finkel’s discussion of what happens as time passes, where default models are retained or replaced by better alternatives, is redolent of the Bayesian updating framework in statistics. And this last, of course, recalls the role of Bayesian nets in the work of Borsuk et al (2003) and their employment in facilitating court discussions as to when to accept competing theories for explaining whether crimes have, or have not, been committed (Pascual, 2005; see also similar insights from McNally, 2003).

3          APPROACH

If the trend has been away from a primary concern hitherto with Statistical Uncertainty (aleatory uncertainty) towards epistemic uncertainty (Ignorance); if the monolith of society (stakeholders) has now been differentiated and fractionated into the more subtle pluralities of understandings and perspectives of Cultural Theory (Thompson et al, 1990); if this plurality will have an increasing bearing on the negotiations of rule-making and judgements about scientific reliability; and if there has been but little cross-fertilization of ideas between Europe and the US, especially between governmental agencies, then approaches to the making of environmental decisions in spite of uncertainty may be on the cusp of substantial change. It is the purpose of this proposal to debate all of these macroscopic assertions, in particular, to draw this debate together from across the many disciplinary fields in which it is taking place, thus to frame the issues for the future of environmental decision-making in spite of uncertainty, and to establish a collaborative network (TAUC) for their further elaboration and resolution.

Our work program is divided between the two Objectives set out in Section 1, according to the schedule of Figure 1. 

Program of Work # 1: To Identify Key Issues for Future Research Agenda

A majority of the requested funding will be associated with the mid-project Workshop (task (f) in the following sequence), to be hosted in the US in month 9.

 (a)       Establish Workshop Organizing Committee. Composition of the Committee must strike balances between membership from the US and EU, between members representing government agencies and academia, and amongst the many contributing disciplines. Membership will include senior US EPA policy officers and their counterparts in the EU, for instance, from the European Commission’s Directorates General for the Environment and for Research and Development, the European Environment Agency, the RIVM/MNP of the Netherlands, the UK Environment Agency, support staff from the EU Parliament, and the Organization for Economic Cooperation and Development (OECD). Such commitments — in effect, from these key agencies — will be the basis on which to compose the subsequent Steering Committee of TAUC (see below under Program of Work #2).

 (b)       Assemble Inventory of Understandings of Uncertainty. Each PI will assume responsibility for surveying two out of the six subject domains listed in Section 2, as follows: PI Beck, Technology and Risk and Models and Methods of Analysis; PI Reckhow, Policy and Administration and Adaptive Management; PI Oye, Science and Society and Legal Context. The purpose here will be to identify key contributing individuals, identify similarities and differences of approach on the two sides of the Atlantic, and ensure that the framework of the inventory meshes disciplinary contributions together in a seamless fashion. The three PIs will together be responsible for preparing a first draft of a synthesis/overview paper (tasks (e), (f) and (g) below).

 (c)       Commission Background Papers. Given the rounded context created by task (b), specific individuals will be assigned responsibilities to prepare domain review papers for presentation at the Workshop and subsequent publication in the open, peer-reviewed literature. These papers will be key to defining the content of the Workshop and to establishing the initial work program of TAUC. The Workshop Organizing Committee and, especially, the PIs will oversee preparation of these papers, through teleconferencing.

 (d)       Contact/assemble Workshop Participants. The Workshop is to be by invitation only. Authors of the literature cited herein are prima facie candidates (amongst others) for participation. A number of policy-related persons, drawn from the agencies listed under task (a) above, have likewise already been identified for participation.

 (e)       Design Workshop. The Organizing Committee is to design the Workshop, using a mix of formal presentations and discussions and breakout sessions, with very special attention paid to achieving synthesis across disciplinary contributions. Four criteria will be uppermost in the design process, that: (i) all participants should emerge with a sound understanding of the whole of the subject; (ii) issues for future research should be readily identifiable; (iii) attention can be focused on shaping the TAUC network (see Program of Work #2); and (iv) a path towards promoting TAUC within the setting of the second IWA Symposium on “Uncertainty and Precaution in Environmental Management” (UPEM II) is apparent (see also Program of Work #2). To realize (i) and (ii), the six domain review papers will be presented in plenary sessions, reflecting thus the six themes identified previously in the Background (Section 2) of this proposal. Two previously designated respondents will be allocated to each of the six review papers, with respondents drawn from subject domains different from that of the paper. Breakout sessions, followed by reports in plenary session, will be deployed in realizing (iii) and (iv). Participants in each breakout session will be allocated beforehand to preserve balanced mixes of disciplines and policy/research personnel, once more in the interests of achieving seamless integration of the whole of the subject matter and maximizing the inter-disciplinary “literacy” of participants. Avenues for funding of TAUC beyond this proposal will be express objects of discussion in the breakout session associated with (iii). One breakout session and accompanying plenary session will be devoted to the task of assembling identified future issues for research into a synthesis paper. A central goal of the Workshop will be to achieve a comparative assessment of procedures and strategies in the US and EU.

 (f)        Workshop. Convenience for international participation and agency presence may best be served by having the Workshop in Washington, DC; however, hosting it on the campus of the University of Georgia would be cheaper. A budgetary-based decision on location will be made early in the project. Current plans are for project funds to cover entirely 20-24 participants (depending on location), with as many as up to 10-15 additional persons participating with support from other sources, if deemed appropriate (including participants from “affiliate countries”, such as China, Japan, South Africa, and Brazil, for example). Three products are sought: (i) a brief position paper for Science (in the manner of Kates et al (2001), ideally with the collective authorship of all Workshop participants); (ii) publication of the set of domain review papers and synthesis paper, which latter will enfold the Workshop discussion; and (iii) publication (eventually) of the TAUC Manifesto (under Program of Work #2).

 (g)       Publish Workshop Proceedings and Position Paper. Submission for publication of the revised domain review papers and the (Science) position paper within six months of the workshop is planned. The Workshop discussion will be used to provide feedback on the review papers; further internal review prior to submission will be the responsibility of the Workshop Organizing Committee. The PIs will assume responsibility for drafting the (short) position paper and the synthesis paper. The latter will be an expression of a future agenda for research — a set of “grand challenges” in making environmental decisions in spite of uncertainty — hence the key outcome of this first Work Program.

 Program of Work # 2: To Establish An Enduring Sustainable Network of Experts (TAUC)

The goal of this second Program is to launch TAUC and promote it within the wider context of UPEM II (and beyond).

 (a)       Facilitate (US) Agency to (EU) Agency Cooperation. Our purpose will be to establish the foundations of an enduring (government) agency-to-agency collaboration. Implementation will be through a visit of EPA officers (and the PIs) to Europe, possibly to institutions at several sites, but preferably as a single meeting at just one location (London, Brussels, or Copenhagen). The meeting/visit should conclude with the setting up of an Interim Steering Committee for the TAUC network. A further important outcome will be a commitment from the EU partners to match the funds sought in this proposal and to deploy them in support of the initial work program of TAUC (beyond the time-span of this proposal).

 (b)       Initiate Preparations for UPEM II. The option of a UPEM II, under the auspices of the International Water Association (IWA), while informally mentioned in Copenhagen (UPEM I, 2004), currently remains merely a possibility. Since the IWA Secretariat is in London, this approach — proposing to formalize and proceed with convening UPEM II (roughly within 24 months of the start of this proposal) — could be undertaken in conjunction with the foregoing task (a). Given private discussions at UPEM I, the European Commission’s Joint Research Centre (JRC) at Ispra, Italy, may have a strong interest in hosting UPEM II. This may also have implications for the funding decisions of task (a).

 (c)       Formalize “Articles of Association” and Establish Work Program for TAUC. Other models of the successful governance of networks are available for review, most notably the European Forum for Integrated Environmental Assessment (EFIEA) and the Resilience Alliance Network of Holling. The Interim Steering Committee will also be charged with assessing what to include in an initial portfolio of network activities, such as: preparation of proposals for subsequent funding; designing vehicles for providing advice to governments; setting up and monitoring case studies in making environmental decisions in spite of uncertainty; aligning TAUC functions so as to create synergies with other NSF programs, notably CLEANER and the Centers for Decision Making Under Uncertainty (in response to climate change); and designing Master Classes for training of young professionals in handling uncertainty at the interfaces among Science, Technology, Policy, Law, and Society.

 (d)       Publish TAUC Manifesto. The Manifesto will be a direct response to the grand challenges set out in the synthesis paper on future research (the product of Program of Work #1).

 (e)       Promote TAUC and Disseminate Its Vision at UPEM II. To ensure that due attention is given to this, we shall be looking to the allocation of EU matching funds (see task (a) above) specifically to support the TAUC contribution to UPEM II. This closing task must also effect the transition from the Interim Steering Committee to the form of governance for TAUC drawn up under the foregoing task (c).

 4          EXPECTED RESULTS AND SIGNIFICANCE

There is currently great interest in the challenges of handling uncertainty in the making of decisions in matters of environmental stewardship. Despite this, there is little cross-fertilization of thinking between the quantitative approaches to the analysis of uncertainty in the engineering, mathematical, and statistical sciences and the non-quantitative approaches residing in the subjects of, for example, law, anthropology, and psychology (Ayton and Fischer, 2005). Issues of uncertainty as “epistemic uncertainty”, or as “ignorance”, are becoming recognized as predominant and recalcitrant in the latter subjects and in the more philosophical treatments of environmental policy-making. Yet even the word “ignorance” can be highly disquieting to many in the community of engineers and natural scientists, many of whom barely accept the presence of uncertainty. In short, a coherent treatment of the subject of uncertainty in a fully well-rounded manner is absent. Just as conspicuous by its absence — in these times of global communication — is effective cross-fertilization between the US and EU countries of their respective experiences of handling uncertainty at the intersection between environmental science, policy, law and society.

An agenda for the future grand challenges of research in environmental decision-making in spite of uncertainty and the launching of a multi-disciplinary network of experts designed to begin responding to this agenda (as one of several possible responses) will be the two most important results of this project. This research agenda will be fashioned primarily according to the increasingly urgent needs of hard practice — not conceptual conjecture — from policy-making as it is presently occurring, and in its associated legal context. The network will be designated the TransAtlantic Uncertainty Colloquium (TAUC). Its backbone will be that of (US) Agency to (EU) Agency cooperation, thus to ensure it is policy-focused and, therefore, of both practical and conceptual significance. The importance of TAUC is that it must be a vehicle for regulator to speak to regulator, and for regulators to talk productively to policy and engineering/science researchers.


 5          GENERAL PROJECT INFORMATION

The curiosity and capacity to move amongst a variety of disciplines, and the skills of building, sustaining, and focusing cooperative, international networks on specific outcomes, lie at the heart of this proposal. PI Beck is based at the University of Georgia, but has a visiting appointment at the Imperial College of Science, Technology, and Medicine in London, UK, from where he leads an industry-focused network project on “Engineering for Sustainable Development”. He has also maintained long-term associations with the International Water Association (IWA) — whose Leading-Edge Program on Sustainability in the Water Sector he currently leads — and the International Institute for Applied Systems Analysis (IIASA; Laxenburg, Austria), for whom he co-chairs the Dynamics Systems Network Project on “Control Theory and Environmental Systems”. Beck led the International Task Force on “Forecasting Environmental Change” (1992-1998), which culminated in the monograph Environmental Foresight and Models: A Manifesto (Beck, 2002). Suffice it to say in the present context that PI Beck has substantial and extensive experience of participating in, initiating, and leading inter-disciplinary, internationally networked activities.

Likewise, PI Reckhow works at the interface between statistics, decision-theory, policy, and the environment, almost single-handedly bringing the issues of uncertainty to the attention of a very wide audience of stakeholders through his chairing of the 2001 NRC Committee reviewing the science base of the TMDL Program. He currently leads a similarly networked team of theoreticians and practitioners who will this year (2005) deliver a White Paper on Adaptive Implementation of watershed management within the context of the Clean Water Act. In his capacity as Director of the North Carolina Water Resources Research Institute he led one of the most successful of all such (virtual) networked state entities. In addition, Reckhow has been a primary motivating force in preparing the ground for implementing some of the NSF’s most substantial research networks (CLEANER and the Hydrologic Observatories). PI Oye formally combines an inter-disciplinary outlook in his joint appointment as Associate Professor of Political Science and of Engineering Systems at MIT. He has served two terms as Director of the MIT Center for International Studies, is now forming a Political Economy and Technology Policy Program within the Center, has been a guest scholar at the Brookings Institution, and has served as a consultant to the Institute for International Economics and the U.S. Trade Policy Coordinating Committee. Continuing in this international seeting, he is currently working with a team from the EU, Japan and the US on regulatory strategies of private firms.

PI Oye’s collaboration with Lawrence McCray — on knowledge assessment in areas marked by controversy and scientific uncertainty and on improving the adaptive capacity of public institutions — brings very considerable added value to this proposal. McCray is now working on Knowledge and Policy-making at MIT, having previously been head of regulatory reform at EPA, director of reform projects at the Executive Office of the President, and in senior management at the National Academy of Sciences/National Research Council, where — significantly — he served as project director for the NRC Red Book (1983).


Current NSF Support

PI Reckhow is Co-PI on “Development of a Plan to Achieve a CLEANER Neuse River Basin in North Carolina” (01/01/04 through 12/31/05).

PI Oye is Co-PI on the MIT IGERT “Assessing Implications of Emerging Technologies” (01/01/04 through 12/31/09).

Month

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

Program #1

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

(a) Establish Workshop Organizing Committee.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

(b) Assemble Inventory of Understandings of Uncertainty.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

(c) Commission Background Papers.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

(d) Contact/assemble Workshop Participants.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

(e) Design Workshop.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

(f) Workshop.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

(g) Publish Workshop Proceedings and Position Paper.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Program #2

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

(a) Facilitate (US) Agency to (EU) Agency Cooperation.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

(b) Initiate Preparations for UPEM II.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

(c) Formalize "Articles of Association" and Establish Work Program for TAUC.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

(d) Publish TAUC Manifesto.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

(e) Promote TAUC and Disseminate Its Vision at UPEM II.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 Figure 1: Project time-table, programs, and tasks

 © 2006 All rights reserved