EPA Quality Management Tools for Projects

You will need Adobe Reader to view some of the files on this page. See EPA’s About PDF page to learn more.EPA has developed or adapted several quality management tools to assist in implementing its quality system. The tools and scope of activities supporting the EPA Quality System differ at each level of the organization.

See the EPA's Terminology Search Web service for definitions of common terms used in the context of EPA's Quality System. 


Data Quality Assessment

Data Quality Assessment is used to assess the

  • type,
  • quantity,
  • and quality

of data in order to verify that the

  • planning objectives,
  • Quality Assurance Project Plan components,
  • and sample collection procedures

were satisfied and that the data are suitable for its intended purpose. Data Quality Assessment is a five-step procedure for determining statistically whether or not a data set is suitable for its intended purpose.

This assessment is a scientific and statistical evaluation of data to determine if it is of the

  • type,
  • quantity,
  • and quality

needed and may be performed either during a project to check the process of data collection or at the end of a project to check if objectives were met.

Top of Page


References

Top of Page


Training

Visit our Training Courses on Quality Assurance and Control Activities page to review the courses below and many more.

  • Introduction to Data Quality Assessment - This one-day course demonstrates how to perform a data quality assessment to evaluate data and provides detailed information on graphical and statistical tools. This course will familiarize participants with the process for performing a data quality assessments. It does not involve detailed instructions on the statistics involved in the process.
     
  • Interpreting Monitoring Data - This half day course teaches participants how to deal with monitoring data using statistics. At the end of the course the participants will
    • understand the need to incorporate systematic planning into monitoring activities,
    • realize the importance of representativeness,
    • be able to graphically view the data,
    • and gain an insight into the complexities of statistical analyses of monitoring data.

     
  • Interpreting Multivariate Analysis - This half day course covers multivariate analysis techniques to explore relationships among several variables in an effort to understanding an environmental problem. A prerequisite of the course is a general understanding of data collection and elementary statistical analysis.

Top of Page


Examples and Other On-line Resources

  • Software - EPA has a site license for SAS for EPA employees - information on the EPA Intranet at the EPA SAS Support Home Page.

Top of Page


QA Project Plans

A Quality Assurance Project Plan documents the

  • planning,
  • implementation,
  • and assessment procedures

for a particular project, as well as any specific quality assurance and quality control activities. It integrates all the technical and quality aspects of the project in order to provide a "blueprint" for obtaining the type and quality of environmental data and information needed for a specific decision or use.

All work performed or funded by EPA that involves the acquisition of environmental data must have an approved Quality Assurance Project Plan.

Top of Page


References

Top of Page


Training

Visit our Training Courses on Quality Assurance and Control Activities page to review the courses below and many more.

  • Introduction to Quality Assurance Project Plans - This one-day course is designed for individuals who write, review, and/or approve Quality Assurance Project Plan and is designed with a "how-to" approach. Participants are expected to have some basic grounding in quality assurance principles.
     
  • Introduction to Data Quality Indicators - This one-day course discusses the principal data quality indicators (DQIs):
    • precision,
    • bias (accuracy),
    • representativeness,
    • comparability,
    • completeness,
    • and sensitivity.
    It also includes information on
    • verification,
    • validation,
    • and integrity
    which, although not classified as indicators, directly influence data quality. This course may also be taught in a half-day by following the instructions in the speakers guide.

Top of Page


Examples and Other On-line Resources

  • The Uniform Federal Policy for Quality Assurance Project Plans
    The Intergovernmental Data Quality Task Force developed a policy and guidance document to fulfill the project-specific requirements of Part B of ANSI/ASCQ E4, to ensure that Federal departments and agencies will produce consistent quality assurance project plans (QAPPs) that reflect a systematic planning approach to collection and use of environmental data.

Top of Page


Quality Assurance for Environmental Technology Design, Construction, and Operation

Environmental technology is an all-inclusive term used to describe

  • pollution control devices and systems,
  • waste treatment processes and storage facilities,
  • and site remediation technologies and their components

that may be utilized to remove pollutants or contaminants from or prevent them from entering the environment.

Environmental technology is utilized in many configurations and is applied to many environmental problems, including devices and systems used in environmental programs to duplicate environmental conditions for test purposes or to

  • control,
  • prevent,
  • treat,
  • or remediate

waste in process discharges (e.g., emissions, effluents) or the ambient environment. Usually, this term will apply to hardware-based systems; however, it can also apply to general methods or techniques used for

  • pollution prevention,
  • source reduction,
  • or containment

of contamination to prevent further movement of the contaminants.

Users applying environmental technology to these problems should have an understanding of the basic quality assurance (QA) and quality control (QC) practices that may be needed in

  • planning,
  • implementing,
  • and assessing

the

  • design,
  • construction,
  • and operation

of environmental technology. The needs of the user community may vary from applying QA and QC to design activities to the construction and fabrication of equipment systems to the testing and operation of completed systems.

Project managers should understand when and how QA and QC practices should be applied to engineering work, based on the range and scope of the needed environmental technology and its application.

The QA and QC practices necessary for environmental technology design and development are similar in function to those tools used for environmental data collection and use, but there are important differences in order to ensure that environmental technology performs as needed to resolve environmental problems.

Top of Page


References

  • Guidance on Quality Assurance for Environmental Technology Design, Construction, and Operation (QA/G-11) - January 2005, EPA/240/B-05/001. Guidance provides users with an understanding of the basic quality assurance (QA) and quality control (QC) procedures that may be used in planning, implementing, and assessing the: design, construction, and operation of environmental technology, and complements the requirements defined in the American National Standard Specifications and Guidelines for Quality Systems for Environmental Data Collection and Environmental Technology Programs (ANSI/ASQ E4-1994) Exit by providing basic guidance on applicable QA and QC practices; outlining engineering planning, construction, and operation processes that may require QA and QC elements; and identifying resources and references that may be utilized by environmental professionals in the application of engineering-based technologies to environmental problems.

This document is not a manual on engineering but is a guide for project managers in environmental programs to help them to understand when and how QA and QC practices should be applied to engineering work.

This guidance is not written expressly for engineers but may be used by managers with non-engineering backgrounds. As a further aid, the guidance uses and refers to good engineering principles/practices (GEPs) when discussing the application of QA and QC during a project design, construction, or operation.

  • ANSI/ASQ E4-2004, Quality Systems for Environmental Data and Technology Programs - Requirements with Guidance for Use. American Society for Quality (August 2004). American National Standard for quality management systems for environmental sector applications.

Top of Page


Examples and Other On-line Resources

American Society for Quality/Design and Construction Division Exit

American Society for Quality/Energy and Environmental Division Exit

EPA's Environmental Technology Verification Program Exit

Top of Page


Standard Operating Procedures

Standard Operating Procedures are written documents that describe, in great detail, the routine procedures to be followed for a specific

  • operation,
  • analysis,
  • or action.

Consistent use of an approved Standard Operating Procedure ensures

  • conformance with organizational practices,
  • reduced work effort,
  • reduction in error occurrences,
  • and improved data comparability, credibility, and defensibility.

Standard Operating Procedures also serve as resources for training and for ready reference and documentation of proper procedures.

Top of Page


ReferencesYou will need Adobe Reader to view some of the files on this page. See EPA’s About PDF page to learn more.

Top of Page


Examples and Other On-line Resources
  

Top of Page


Systematic Planning

EPA uses systematic planning to plan projects and link goals, cost and schedule, and quality criteria with the final outputs. Systematic planning ensures that all participants understand the needs and expectations of the customer and the product or results to be provided by the supplier. 

Top of Page


Resources

Top of Page


Examples of Systematic Planning Processes

Top of Page


Software

  • Visual Sample Plan (Pacific Northwest National Laboratory) Exit is a simple, defensible tool for defining an optimal, technically defensible sampling scheme for site characterization. VSP is applicable for any two-dimensional sampling plan including surface soil, building surfaces, water bodies, or other similar applications.

Top of Page


Technical Audits

Technical audits are systematic and objective examinations of a program or project to determine whether environmental data collection activities and related results comply with the project's Quality Assurance Project Plan and other planning documents, are implemented effectively, and are suitable to achieve its data quality goals.

Technical audits are not management assessments nor are they data verification/validation processes, which occur during the assessment phase of the project. Technical audits include

  • readiness reviews,
  • technical systems audits,
  • surveillance,
  • and performance evaluations.

Top of Page


References You will need Adobe Reader to view some of the files on this page. See EPA’s About PDF page to learn more.

Top of Page


Examples and Other On-line Resources

Top of Page


Verification and Validation

Data verification and validation is used to evaluate whether data has been generated according to specifications, satisfy acceptance criteria, and are appropriate and consistent with their intended use. Data verification is a systematic process for evaluating performance and compliance of a set of data when compared to a set of standards to ascertain its

  • completeness,
  • correctness,
  • and consistency

using the methods and criteria defined in the project documentation. Data validation follows the data verification process and uses information from the project documentation to ascertain the usability of the data in light of its measurement quality objectives and to ensure that results obtained are scientifically defensible.

Top of Page


References

Top of Page


Examples and Other On-line Resources

Top of Page