Exercise and Training Evaluator

Position Summary:

Applied Training Solutions, LLC is seeking an experienced exercise and training evaluators. The Exercise and Training Evaluator is responsible for assessing the design, delivery, and effectiveness of training programs and operational exercises. This role evaluates participant performance, organizational readiness, and capability outcomes to support continuous improvement, compliance, and preparedness objectives. The Evaluator works closely with planners, instructors, and stakeholders to document strengths, identify gaps, and recommend corrective actions.

Responsibilities:

• Observe and evaluate exercises including seminars, workshops, tabletop, functional, and full-scale exercises in accordance with HSEEP doctrine
• Assess participant performance against exercise objectives, core capabilities, and critical tasks
• Evaluate participant actions, decision-making, communications, and adherence to plans, procedures, and doctrine
• Use HSEEP-compliant evaluation tools, including Evaluator Guides, data collection forms, and performance measures
• Apply established evaluation criteria, exercise objectives, and performance measures (e.g., capabilities, core competencies)
• Collect data through observation, evaluator worksheets, interviews, hot washes, and after-action discussions
• Analyze findings to identify strengths, areas for improvement, and root causes
• Develop After-Action Reports (AARs) and Improvement Plans (IPs) in accordance with applicable HSEEP standards
• Track corrective actions and support continuous improvement efforts
• Coordinate with exercise planners and training staff to ensure evaluation objectives align with exercise goals
• Maintain objectivity and confidentiality throughout the evaluation process
• Support accreditation, compliance, and readiness reporting requirements
• Maintain accurate logs and records for use in after-action reporting and future planning

Basic Qualifications:

• experience evaluating training programs, drills, or exercises
• Knowledge of exercise design and evaluation methodologies
• Strong observation, analytical, and documentation skills
• Ability to produce clear, concise, and actionable reports
• Familiarity with Homeland Security Exercise and Evaluation Program (HSEEP)
• Must be a U.S. citizen

Preferred Qualifications:

• 5+ years of experience in emergency management or planning roles
• EMA HSEEP training (e.g., IS-120, IS-130, IS-139, or equivalent)
• Experience with core capabilities, THIRA/SPR, or capability-based planning
• Experience evaluating multi-agency, multi-jurisdictional exercises
• Advanced ICS training (ICS-300, ICS-400, and E/L/G-449 or equivalent)
• Knowledge of FEMA, EMAC, and mutual aid coordination processes
• MEPP qualified (Master Exercise Practitioner Program) or demonstrated equivalent experience supporting complex, multi-agency HSEEP-compliant exercises

Other Requirements:

• U.S. Citizenship Required: Yes
• Performance Location: On-site while on assignment (various locations within the Commonwealth of Virginia)
• Relocation Assistance: Not applicable
• Clearance Required: None
• Travel Required: Yes – up to 100% while on assignment

Working Environment:

The work environment will include EOCs, field sites, or office locations depending on assignment. The position may require extended work hours beyond 12 hours per day, working under high operational tempo, and travel to locations throughout the Commonwealth of Virginia.

About Applied Training Solutions, LLC:

Applied Training Solutions, LLC is a leading simulations company providing innovative systems, products, and solutions to government and commercial customers.
We are committed to hiring and retaining a diverse workforce. We are an Equal Opportunity Employer and make all employment decisions without regard to race, color, religion, sex, national origin, age, veteran status, disability, or any other protected class. U.S. citizenship is required for most positions.