<p>Job Description</p> <p>40% - Manage and develop a team of ELA content development professionals. Examples of the work performed may include:</p> <ul> <li>Coaching team members in the areas of validity evidence drawn from test content, psychometric concepts, and cyclical development processes. </li><li>Coaching team members in relevant curricular standards and how they are reflected in standardized assessments to reveal student cognition. </li><li>Estimating and documenting staffing needs and administrative procedures for test development projects. </li><li>Working collaboratively with leadership, test development program leads, other test development managers, project coordinators, partner state liaisons and other stakeholders within ATLAS to ensure work progresses toward key milestones and deliverables. </li></ul> <p>35% - Lead test development efforts for multiple assessment programs with the primary focus on English Language Arts. Examples of job activities include:</p> <ul> <li>Leading the development of comprehensive, multi-layer blueprints, item specifications and construct definitions grounded in ECD principles. </li><li>Leading content teams in developing assignments for item writers to ensure the construction of high quality, aligned test items. </li><li>Contributing to plans for item pool development based on test blueprints. </li><li>Ensuring that internal content reviews result in polished, accurate items that tightly align to close reading of curricular standards. </li><li>Coaching content teams in the facilitation of external reviews of items and stimuli to elicit high quality feedback from educators that meaningfully contributes to the improvement of items. </li></ul> <p>15% - In coordination with Test Development Program Leads, develop allocation plans for internal resources to support assessment projects. Examples of work performed may include:</p> <ul> <li>Implementing the establishment of a work plan across assessment programs. </li><li>Implementing the production and review of technical reports for multiple assessment programs. </li><li>Collaborating with the assistant director of test development, the test development program leads, the implementation team and the psychometric team on identifying deliverables for a content area. </li></ul> <p>5% - Communicate with external audiences including researchers, state education agency staff, and professional organizations. Examples of job activities include:</p> <ul> <li>Contributing to presentations for technical and non-technical audiences. </li><li>Providing consultation and collaboration on all aspects of test design, scope, development, and validity evidence drawn from test content to state education agency staff. </li><li>Responding to client requests and coordinating communication with the partner state liaisons. </li><li>Contributing to the development of responses to RFPs. </li><li>Collaborating with center staff on proposals for externally funded research projects. </li></ul> <p>5% - Other duties as assigned.</p> <p>Required Qualifications</p> <ul> <li>Bachelor's degree and seven (7) years of large-scale assessment development experience or master's degree and five (5) years of large-scale assessment development experience. </li><li>Two (2) years or more of experience applying a variety of theoretical approaches to validity and current research within a large-scale assessment context. </li><li>Two (2) years or more of experience, primary responsibility for a content area and/or multiple grade levels within a testing program. </li><li>Two (2) years or more of experience managing and/or mentoring content development professionals and contributing to their professional growth. </li><li>Two (2) years or more of experience leading projects focused on the next generation curricular standards (such as Common Core State Standards or the Next Generation Science Standards) in at least one content area, and familiarity with standards for multiple content areas. </li><li>Two (2) years or more of experience in project management, including on-time delivery of products. </li><li>One (1) year or more of experience developing and implementing work plans for assessment development that includes blueprints, test and content specifications, construct definitions, and item development, review, and quality control, and are reflective of an end-to-end development cycle. </li><li>One (1) year or more of experience developing technical reports for assessment programs and developing text for validity study reports, cognitive lab reports, or similar. </li><li>Excellent written communication skills as evidenced by application materials. </li></ul> <p>Preferred Qualifications</p> <ul> <li>Two (2) years or more of experience applying Evidence Centered Design principles to enhance validity of a large-scale assessment. </li><li>Experience with assessments measuring curricular standards for students with significant cognitive disabilities. </li><li>Experience managing relationships across multiple teams within an organization as evidenced by application materials. </li><li>Experience with providing user input and collecting requirements for assessment software development. </li><li>Record of published research or dissemination on large-scale assessment. </li></ul> <p>Position Requirements</p> <p>Due to complex state employment laws, the University of Kansas may be unable to hire fully remote workers for this position outside of Kansas. Specifically, we cannot currently offer employment to candidates residing in the following states: California and Delaware. We appreciate your understanding and invite interested individuals from eligible states to apply.</p>