DET | Testing and Evaluation

Testing And Evaluation Principles

  • Execution of test is independent of the developer however developer may have a role in helping to create the test plan
  • A formal test plan is developed, defining all of the important aspects of the testing and evaluation
  • Focus of test depends on the questions that are of interest
  • Module being used Variables of interest Many cases evaluated for statistical significance
    • Not just a few case studies
    • Multiple seasons
  • Meaningful stratifications
    • Location/region
    • Season
    • Other user-based criteria

Components of a Test Plan

  • Goals
  • Experiment design
    • Codes
    • Model output
    • Forecast periods
    • Post-processing
    • Verification
    • Graphics generation and display
  • Data archival and dissemination of results
  • Computer resources Deliverables