Imagineeer is a fast-growing SBA 8(a) Small Disadvantaged Business headquartered in Arlington, VA, delivering federal AI modernization across health, defense, homeland security, and transportation. We design, test, and deploy secure, AI-ready systems that move agencies from pilots to production without breaking governance, compliance, or mission continuity. Our Mission Studio model creates shared environments where policy, data, security, and operations come together. We are capability-driven and competitive by design, not program-dependent. Our leadership has operated inside the federal systems we now transform, bringing institutional knowledge that accelerates delivery and reduces risk. If real delivery motivates you more than slides, and you want your work to compound across programs and agencies, Imagineeer is growing and we are building the team to match. About the role Imagineeer is seeking a QA/Pilot Test Lead to design and run a comparative pilot of two commercial acquisition tools for a federal civilian department. Both tools are tested in parallel against common baselines, and your measurements will be the evidence behind the client's implementation decision. Key Responsibilities: • Design baseline measures (e.g., cycle time, errors and rework, workforce burden) with the Pilot Test Engineer. • Author the tool-agnostic Pilot Test Plan by Day 105 and update it with tool-specific content within 10 business days of tool selection. • Support vendor capability demonstrations using a common synthetic dataset and scoring rubric. • Lead quantitative and qualitative data collection for both tools and compare results to baseline. • Validate configurations before and during the pilot and during implementation. • Contribute pilot results to biweekly pilot status reports and the Pilot Results and Implementation Recommendations Report. • Work with The contractor-provided sandbox in a FedRAMP-authorized cloud region, with mock AMS/PRISM, FPDS-NG, and SAM.gov interfaces and synthetic data Qualifications and Skills: • Bachelor's degree in computer science, engineering, or a related field. • 6 or more years of software testing or QA experience, including test planning and leading test teams. • Experience designing baseline and performance measures for technology pilots or user acceptance testing. • Experience testing commercial SaaS products and integrations. Desired Skills and Competencies: • ISTQB Advanced Level Test Manager or equivalent certification. • Experience with comparative or side-by-side product evaluations in federal settings. • Experience testing acquisition or financial management systems. Additional Information: Employment for this position is contingent upon the candidate being a United States citizen and having the ability to successfully obtain and maintain a Public Trust clearance, in accordance with applicable federal regulations. We use AI to review resumes. All hiring decisions will be made in compliance with applicable federal, state, and local laws and regulations Equal Opportunity Employer: We are an Equal Opportunity Employer and do not discriminate in employment decisions on the basis of race, color, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, age, disability, genetic information, veteran status, or any other status protected by applicable federal, state, or local laws. All employment decisions are based on business needs, job requirements, and individual qualifications.