Back to jobs
Senior Manager for Test Development (100% Remote-U.S.)
American College Credit ScholarsAnywherePosted 2w ago
test
Full-time
Remote
Apply on company siteCraft my tailored resume free
Free to start · No card · 5 credits the moment you sign up
Job description
Senior Manager for Test Development
About ACCS
ACCS is a nonprofit organization dedicated to creating rigorous college-level courses for high school students with a commitment to gold standard scholarship and academic excellence.
Position Summary
ACCS is seeking an experienced Senior Manager of Test Development to lead the design, development, and maintenance of high-stakes assessments for high school students seeking college credit. This individual will serve as an expert across the full assessment development lifecycle — from blueprint design through item development, forms development, range finding, and standard setting — while managing and mentoring a distributed team of assessment professionals. This is a senior, hands-on leadership role requiring both deep technical assessment expertise and strong people-management skills. Reports directly to the CEO.
PLEASE NOTE: This is a specialized assessment-development position. Candidates must have substantial professional experience in academic testing and assessment development, including direct experience developing high-stakes assessments. Applicants without professional assessment/test-development experience will not be considered.
Key Responsibilities
Assessment Development Leadership
Lead the development and maintenance of test blueprints, test specifications, and item specifications aligned to content standards and program requirements.Oversee the development of a full range of item types, including multiple-choice items, technology-enhanced items (TEIs), short constructed-response items, document-based items, and long essay/extended-response items.Ensure all assessment materials meet rigorous standards for validity, reliability, fairness, and accessibility.Guide item and passage selection, review, and revision processes, ensuring alignment to blueprints and adherence to bias/sensitivity and universal design guidelines.Psychometric & Technical Coordination
Support test forms construction, ensuring forms meet blueprint, statistical, and content balancing requirements.Participate in range finding activities for constructed-response and essay items supporting content staff.Collaborate with psychometric staff on the review and interpretation of item statistics (e.g., difficulty, discrimination, DIF) to inform item revision, retention, or retirement decisions.Participate in and help prepare materials for standard-setting studies.Team Leadership & Management
Build, lead, and mentor a remote team of test development staff and consultants (e.g., item writers, content specialists, editors), fostering a collaborative and high-performing team culture.Set clear goals, manage workflows, and monitor progress against project timelines and deliverables across multiple concurrent assessment programs.Provide coaching, performance feedback, and professional development opportunities for team members.Recruit, onboard, and train new team members and external contractors (e.g., item writers, educator committee members) as needed.Project & Stakeholder Management
Manage assessment development timelines, budgets, and deliverables in coordination with senior staff and external partners.Serve as an assessment expert and primary point of contact for clients, state agencies, or partner organizations on test development matters.Facilitate and/or support content and bias/sensitivity reviews.Prepare clear, well-organized documentation, reports, and presentations for internal leadership, clients, and external stakeholders.Quality Assurance & Continuous Improvement
Establish and enforce quality control processes throughout the item and test development lifecycle.Stay current with industry best practices, professional standards (e.g., Standards for Educational and Psychological Testing), and emerging trends in assessment design, including innovations in item types, technology-enhanced assessment, and AI scoring.Identify opportunities to improve development processes, tools, and workflows for efficiency and quality.Required Qualifications
Minimum 10 years of experience in assessment/test development, with demonstrated expertise across all major phases of the assessment development lifecycle, including:Test blueprint and test specification developmentItem specification developmentItem development across multiple formats: multiple-choice, technology-enhanced items, short constructed-response, document-based items, and long essay/extended-response itemsScoring rubric development and range findingReview and application of item statisticsTest forms constructionStandard settingDemonstrated experience leading and managing teams, including remote/distributed staffStrong written and verbal communication skills, with the ability to communicate effectively with internal teams, external partners, and content committeesExperience working with high-stakes, large-scale assessment programs (state, national, or credentialing-level preferred)Proven ability to manage multiple projects simultaneously in a deadline-driven environment.Strong organizational skills and attention to detail, particularly regarding content accuracy, alignment, and compliance with specifications.Work Environment
This is a fully remote, full-time position. Some travel may be required for in-person committee meetings, range finding sessions, standard-setting studies, or team gatherings, typically 5% travel maximum. We offer competitive salary and benefits, commensurate with experience
How to Apply
Please submit your application and résumé through LinkedIn. Selected candidates will be contacted directly through LinkedIn regarding next steps.
American College Credit Scholars is an equal opportunity employer and does not discriminate based on race, sex, religion, national origin, and age.