Model Averaging Webinar Workshop Announcement
EPA’s National Center for Environmental Assessment (NCEA) hosted a public workshop on model averaging methods for dose-response analysis. The workshop was held by webinar in two half-day increments (12:00 PM–4:00 PM EST) on December 10-11, 2015.
04/15/2016: EPA has reviewed and approved for release the Model Averaging Workshop Report. The report includes the pre-meeting written responses from discussants, discussants' comments during the workshop to the EPA discussion questions, and their responses to questions asked by workshop audience participants.
- Workshop Overview
- Conference Link and Participation Guide
- Public Participation
The purpose of this workshop is to obtain expert peer consultation on model averaging methods for dose-response analysis. To facilitate the workshop, EPA will provide invited workshop consultants with background and support materials for consideration, including a document describing methods that are consistent with published recommendations and software that illustrates how those existing methods could be implemented.
Workshop consultants will examine EPA’s background and support material and provide written comments prior to the workshop. Discussions and conclusions reached during the workshop will form the basis of a workshop report that EPA will consider for the identification of the model averaging method(s) that offer(s) the greatest potential for the development of chemical health assessments.
While the workshop support material and software describe candidate methods for use in evaluating continuous response measures, participants will also be asked to comment on the potential for extension of any preferred method(s) identified to dichotomous response measures.
Conference Link and Participation Guide
You can connect to the webinar by selecting this Adobe Connect address: http://epawebconferencing.acms.com/modelaveragingworkshop/ (opens in a new browser window).
You can download a 2-page Virtual Participation Guide from the Workshop Support Materials page. It contains basic information on how to use Adobe Connect for this conference.
This workshop will be held only by webinar. The workshop will be open to attendance by interested public attendees and/or speakers on a first-come, first-served basis up to the limits of available webinar room.
This workshop will be held December 10-11, 2015 from 12:00 pm - 4:00 pm EST.
Instructions for workshop registration are described on the Workshop Registration tab. Interested parties with expertise in this field of study are invited to provide their perspective by registering for the workshop and preparing a brief presentation (≤ 5 minutes) for the workshop consultants. Instructions for requesting to make a presentation at the workshop are provided on the Workshop Registration tab.
The benchmark dose (BMD) method is a key component of chemical risk assessments performed by EPA, other U.S Federal and State Agencies, and multiple international organizations. The BMD method is used to establish toxicity values such as EPA reference doses and cancer slope factors for chemicals expected to have human health effects. Existing BMD methods involve the selection of a single dose-response model from among a suite of models with little biological basis, based largely on a comparison of model fits to the data. As such, they have been criticized for not adequately accounting for model uncertainty and biological considerations. Model averaging is a well-recognized and published scientific approach that can assist in the characterization of model uncertainty, and has the potential for incorporating biological considerations. Bayesian methods can be applied to allow prior information, including biological considerations, to influence model averaging results. Given these potential benefits, model averaging and several model averaging approaches are being investigated and tested by EPA.
|University of Arizona
|National Institute for Occupational Safety and Health (NIOSH)
A PDF version of the discussants' response to the discussion questions is available for download from the Model Averaging Workshop Support Materials page.
Thursday, December 10, 2015
12:00 – 12:20
Welcome and Opening Remarks
12:20 – 1:00
1:00 – 1:20
Discussion Question 1: Overall approach to model-averaging
Are there other model averaging methods that EPA should consider?
1:20 – 2:00
Discussion Question 2, 5: Completeness of suite of models
Are there other parametric models that should be included in model-averaging? If so, do you recommend testing performance of the new suite?
2:00 – 2:15
2:15 – 3:00
Discussion Question 3: Implementation of methods
Do you agree with the approaches used to implement the methods reviewed in the workshop support material?
3:00 – 3:30
Discussion Question 4: Testing approach
Should additional testing be performed to identify a model averaging approach for dose-response analyses that offers the greatest advantage for the development of chemical health assessments?
3:30 – 4:00
Day 1 Audience Questions and Day 1 Wrap-Up
Friday, December 11, 2015
12:00 – 12:20
Welcome and Day 1 Recap
12:20 – 1:45
Discussion Question 6: Motives for using model averaging in health assessments
a. How useful is model averaging for characterizing model uncertainty?
b. How useful is model averaging for incorporating prior information?
Discussion Question 7: Should alternatives or complements to model averaging be investigated? Examples: Isotonic regression; Non-parametric and semi-parametric (Bayesian and frequentist) modeling; Full Bayesian model averaging; Flexible parametric models
1:45 – 2:00
2:00 – 2:40
Discussion Question 8: Dichotomous Data
Describe any major concerns for the application of methods described in this report to dichotomous data. How do the results of the present background paper on models for continuous data compare to published work on model averaging for dichotomous models?
2:40 – 3:10
Discussion Question 9: Is Model Averaging Ready for Use in Chemical Health Assessment?
Is model averaging as implemented in the workshop support material suitable for use in chemical health assessments, possibly with some reservations or precautions? Can you identify circumstances when model averaging may be helpful and informative or misleading?
3:10 – 3:30
Discussion Question 10: Conclusions
Do you agree with the conclusions made in Section 4.1 of the workshop support material?
3:30 – 4:00
Audience Questions and Final Wrap-Up
To register for the workshop, please send your name, title, affiliation, contact information, and if you are interested in making a brief (≤ 5 minutes) presentation to EPA_MA_Workshop@icfi.com. Registration will remain open, as permitted by webinar capacity, through the duration of the workshop.
If you are requesting to make a brief presentation, you will be sent instructions for the preparation and submission of presentation materials. To promote transparency, if you request to make a presentation, please also disclose: (1) The nature of any financial relationships (e.g., consulting agreements, expert witness support, or research funding) you may have with any organization(s) or entities having an interest in issues under discussion; and (2) The extent to which your comments were reviewed by an interested party prior to submission.
Please direct questions regarding workshop registration or logistics to Susan Blaine at EPA_MA_Workshop@icfi.com or by phone at 703-225-2471. To obtain clarification or provide comments on the workshop support materials, contact Jeff Gift, Ph.D., at email@example.com or by phone at 919-541-4828.
Supporting Materials for the Workshop
- Model Averaging Webinar Workshop Support Materials. This page includes links to the following PDF documents:
- Report: Background and Support Materials for Peer Consultation Webinar Workshop on Model Averaging Methods for Dose-Response Analysis
- Discussion Questions
- Discussant Responses to the Discussion Questions
- Model Averaging Workshop Virtual Participation Guide
- Model Averaging Workshop Agenda
- Model Averaging Application With Graphical User Interface (ZIP)(2 MB,
- Requires Windows XP or better. A sample data file and instructions are included.
- Software for performing model runs on multiple datasets in batch (ZIP)(5 MB)
- Real and simulated data for Model Averaging test runs (ZIP)(4 MB)