Description

ARRT is seeking a Director of Assessments to lead our assessment department in a meaningful, mission-driven role. This position is ideal for a leader with expertise in certification and licensure exams, assessment strategy, and exam quality, along with a passion for guiding teams.  This role is hybrid, based on site at our St. Paul, Minnesota office, with partial work from home within the Minneapolis/St. Paul metro area.

The Director- Assessments is responsible for the development and psychometric components of the ARRT’s certification programs. Responsibilities listed are those of the Assessments Department. No distinction is made between activities directly performed and those delegated since the Director of Assessments is ultimately responsible for their performance. This includes responsibility for the quality of the processes as well as the quality of products.

The Director of Assessments reports to the Chief Assessments Officer regarding organization policy and is responsible for directing the activities of personnel of the assessment development and psychometrics teams within the Assessments Department.

The Director of Assessments works with the Assessments Department to maintain the integrity of ARRT’s certification programs by overseeing the development and psychometrics of ARRT assessments through quality control and best practices. The Director of Assessments also drives the ARRT’s strategic initiatives priorities for:

o   Structuring the ARRT certification program to the needs of the future.

o   Advocating high-quality care through ARRT credentials.

o   Increasing participation and partnerships with ARRT.

o   Promoting innovation and foresight.

o   Committing to operational excellence. 

Duties and Responsibilities: 

Assessment Development

• Provide leadership, staff consultation, technical support, and project management for assessment development initiatives.
• Oversee and monitor ARRT assessment development processes (e.g., practice analysis, item development, standard setting).
• Resolve or assist with settling escalated or complex issues involving assessment development.
• Partner with the assessment publisher to understand their workflows and maintain quality, consistency, and collaborative relationships throughout the publication lifecycle.
• Develop/revise content specifications and competency/clinical experience requirements based upon practice analysis results.
• Develop responses to external assessment development and/or scoring Requests for Proposal (RFP).

Assessment Assembly

• Assemble assessment forms and other materials for committee meetings.
• Schedule meeting dates, plan, and coordinate activities for committee meetings
• Conduct meetings of committees.
• Conduct quality control checks on electronic assessment forms assembled by CBT vendor.
• Work closely with Director of Program Accreditation for the production and publication of assessments.
• Maintain item banks.
• Maintain Assessment Development Procedures Manual.

Psychometric Support

• Provide leadership, staff consultation, technical support, and project management in the analysis, scoring, and reporting of all assessment programs.
• Oversee and provide support of practice analysis activities.
• Oversee and provide support of standard setting activities.
• Review item analysis and examinee comments.
• Run programs and interpret data to process exam results.
• Maintain quality control checks on overall process.
• Analyze data and write reports for Board of Trustees (BoT) and/or other executive staff.
• Create and respond to National Commission for Certifying Agencies (NCCA) accreditation inquiries.
• Assist other staff with efforts to investigate issues related to continued competence and maintenance of certification.
• Maintain Assessment Processing Manual which covers procedures for which Psychometrics Services is responsible.

Assessment Security

• Maintain the validity of the assessments by employing the latest procedures to identify:

o   Those using others to complete the exam for them

o   Examinees with pre-knowledge of the assessment content

o   Copyright infringement

• Develop policy recommendations and is responsible for the executing security policy for all content contained in examinations and structured self-assessments (SSAs).
• Perform as Chair of the Assessment Security Team (AST).
• Recommend corrective action for security incidents based on AST investigations.
• Execute policies for procuring legal protection for ARRT intellectual property (copyright of item bank and trade secrets).
• Maintain confidential and accurate records when engaged in legal action.
• Effectively represent ARRT in depositions and/or when asked to testify in a court of law.

Communications

• Communicate effectively both verbally and in writing with external and internal customers in response to questions or complaints regarding assessment development related policies, procedures, and quality control.
• Serve as the subject matter expert on communications regarding assessment development.

Research

• Collect, analyze, and report data as input into decision making processes.
• Provide technical assistance in research design and data analysis to staff.
• Participate in scholarly research as time permits.
• Keep informed of issues and new developments in certification and licensure testing.

General Managerial Responsibilities

• Monitor work responsibilities of staff. Ensure coverage for departmental responsibilities.
• Oversee staff schedules, approve leave, review, and finalize pay period timesheets.
• Develop and coach staff through one-on-one meetings and additional methods, respond to   staff needs and suggestions, and provide ongoing feedback.
• Orient and train new staff. Assess the need for, and provide or coordinate, ongoing training.
• Enforce staff policies as set in ARRT Employee Handbook or portal.
• Manage staff performance, correlate job descriptions with performance management, participate in talent acquisition process, and participate in salary review sessions.
• Work with staff to develop an effective teamwork environment.
• Maintain and elevate working relationships with other ARRT departments. Mentor the team on effective ways to communicate and work as a group.
• Participate in ARRT projects as assigned.
• Participate in professional development activities.
• Authorize procurement of goods and services for the division within budgetary and procedural guidelines.
• Provide budgetary information for department activities to Chief Assessments Officer.
• Assist Chief Assessments Officer in identifying future needs/directions for department.
• Coordinate efforts to implement strategic priorities and initiatives into department operations.

Miscellaneous

• Keep Chief Executive Officer and Chief Assessments Officer informed of departmental activities via regular weekly meetings or immediately in case of serious or potentially serious situations.
• Assure procedural integrity for the administration of ARRT assessment requirements.
• Work with Strategic Communications to develop informational materials (i.e., articles, news releases, slide shows, Certification Handbooks (Primary Pathways, Post-Primary Pathways, and Registered Radiologist Assistant), Handbook for State Licensing Examinees, Examinee Handbook for Limited Scope, Item Writing Manual) on examination development, assembly, scoring analysis and reporting.
• Prepare project and technical reports on assessment development, assembly, scoring, analysis and reporting.
• Respond to questions/complaints on assessment development, assembly, scoring, analysis, and reporting.
• Identify issues requiring Board policy decisions on assessment development, assembly, scoring, analysis and reporting.
• Interact with Information Technology Department on development and maintenance of computer programs for assessment services.
• Perform other duties as required and modified as business needs arise.

Requirements

Minimum Qualifications:

• Bachelor’s degree 
• 5 years of management experience in credentialing or certification

Preferred Qualifications:   

• Master’s degree   
• ICE-CCP certification
• CAE certification   

Skills and Abilities:

• Demonstrated intermediate level skills in Microsoft Office applications, including Outlook, Word, Excel, PowerPoint, Teams, SharePoint, and other related software applications.
• High level of attention to detail; ability to think creatively, strategically, and analytically.
• Excellent interpersonal skills, cultural responsiveness, and the ability to work collaboratively with multiple groups to build and maintain relationships.
• Proven strong verbal and written communication skills, along with the ability to adapt style and approach to various levels and audiences.
• Demonstrated initiative, resourcefulness, and adaptability.
• Project management skills, with the ability to effectively manage multiple simultaneous projects.
• Strong application of ethics and confidentiality.
• Ability to organize, prioritize, and delegate.
• Demonstrated ability to work both independently and collaboratively.
• Operate with a sense of urgency and professionalism.
• Ability and experience coaching others.
• Ability to understand complex business processes, identify improvement opportunities, and develop innovative solutions to enhance operational efficiency.
• Strong technical capabilities include comfort learning and working within software platforms and technologies such as databases, reporting software, video conferencing and presenting platforms, and other technology.

Review a full job description, which includes additional information and physical demands.  

This role is hybrid, based on site at our St. Paul, Minnesota office, with partial work from home within the Minneapolis/St. Paul metro area.  Relocation assistance may be available.

The annual salary range is $141,287-$176,609.  Visit www.arrt.org for more information and for details on our robust benefit offerings including health, dental, vision, and life insurance options, 401(k) 6% match plus annual contributions, paid time off, paid holidays, and more.

Please contact your recruiter or email resumes@arrt.org with any questions or requests for reasonable accommodations during the interview process.