Lead Exercise and Training Evaluator

Position Summary:

Applied Training Solutions, LLC is seeking an experienced lead exercise and training evaluators. The Lead exercise and training evaluator is responsible for overseeing and leading the entire evaluation effort, assessing the design, delivery, and effectiveness of training programs and operational exercises. This role evaluates participant performance, organizational readiness, and capability outcomes to support continuous improvement, compliance, and preparedness objectives. The Evaluator works closely with planners, instructors, and stakeholders to document strengths, identify gaps, and recommend corrective actions.

Responsibilities:

• Serve as the Lead Evaluator for seminars, workshops, tabletop, functional, and full-scale exercises conducted in accordance with HSEEP doctrine
• Lead and coordinate evaluator teams to ensure consistent, objective, and HSEEP-compliant evaluation practices
• Evaluate participant actions, decision-making, communications, and adherence to plans, procedures, and doctrine
• Develop and use HSEEP-compliant evaluation tools, including Evaluator Guides, data collection forms, and performance measures as needed
• Apply established evaluation criteria, exercise objectives, and performance measures (e.g., capabilities, core competencies)
• Collect data through observation, evaluator worksheets, interviews, hot washes, and after-action discussions
• Analyze findings to identify strengths, areas for improvement, and root causes
• Collect, validate, and synthesize data from evaluator observations, worksheets, interviews, hot washes, and after-action discussions
• Develop After-Action Reports (AARs) and Improvement Plans (IPs) in accordance with applicable HSEEP standards
• Conduct AARs and brief Improvement Plans as needed
• Lead development, review, and finalization of After-Action Reports (AARs) and Improvement Plans (IPs) in accordance with HSEEP standards
• Track corrective actions and support continuous improvement and corrective action planning efforts
• Coordinate with exercise planners and training staff to ensure evaluation objectives align with exercise design and goals
• Brief leadership and stakeholders on evaluation findings and improvement priorities as required
• Maintain objectivity, evaluator discipline, and confidentiality throughout the evaluation process
• Maintain accurate logs and records for after-action reporting, grant compliance, and future planning

Basic Qualifications:

• Demonstrated experience serving as a Lead Evaluator or senior evaluator for HSEEP-compliant exercises
• Strong knowledge of exercise design, evaluation methodologies, and HSEEP doctrine
• Proven ability to lead evaluator teams and manage complex evaluation efforts
• Ability to produce clear, concise, and actionable reports
• Familiarity with Homeland Security Exercise and Evaluation Program (HSEEP)
• Must be a U.S. citizen

Preferred Qualifications:

• 5+ years of experience in emergency management or planning roles
• FEMA HSEEP training (e.g., IS-120, IS-130, IS-139, or equivalent)
• Experience with core capabilities, THIRA/SPR, or capability-based planning
• Experience evaluating multi-agency, multi-jurisdictional exercises
• Advanced ICS training (ICS-300, ICS-400, and E/L/G-449 or equivalent)
• Knowledge of FEMA, EMAC, and mutual aid coordination processes

Other Requirements:

• U.S. Citizenship Required: Yes
• Performance Location: On-site while on assignment (various locations within the Commonwealth of Virginia)
• Relocation Assistance: Not applicable
• Clearance Required: None
• Travel Required: Yes – up to 100% while on assignment

Working Environment:

The work environment will include EOCs, field sites, or office locations depending on assignment. The position may require extended work hours beyond 12 hours per day, working under high operational tempo, and travel to locations throughout the Commonwealth of Virginia.

About Applied Training Solutions, LLC:

Applied Training Solutions, LLC is a leading simulations company providing innovative systems, products, and solutions to government and commercial customers.
We are committed to hiring and retaining a diverse workforce. We are an Equal Opportunity Employer and make all employment decisions without regard to race, color, religion, sex, national origin, age, veteran status, disability, or any other protected class. U.S. citizenship is required for most positions.