Assessment Program Supervisor – School Of Medicine

Job Summary

The Assessment Program Supervisor is responsible for managing the assessment program to generate and optimally utilize assessment data at the Kaiser Permanente Bernard J. Tyson School of Medicine (KPSOM). This includes informing decisions about student achievement, supporting students in their academic progress, and providing insights into curriculum and assessment strengths and gaps to faculty, administrators, and students. This role trains faculty on assessment data, conduct analysis, promotes equity, inclusion and diversity in the assessment program and support educational scholarship This role will interface with Information Technology(IT) in the design and maintenance of analytics to support assessment-related efforts.

Essential Responsibilities

• Provide support for faculty development through assessment data interpretation and utilizing assessment data and dashboards in the Curriculum as a Whole review, Phase Reviews, and other curricular evaluation efforts
• Coordinate and execute Competency Committee Review Processes for each Phase, including faculty development, data preparation and presentation, process review, and meeting facilitation
• In collaboration with IT, contribute to the ongoing development and maintenance of assessment related dashboards, including ensuring the creation and integrity of data flowing into the system from the Learning Management System (LMS) and other sources, and participating in the design of new dashboards and enhancements to the existing system
• Provide staff and faculty development to support the creation of accurate and aligned assessment data
• Researches and monitors trends in health professions and medical education assessment design and methodologies, and communicates findings to the Office of Assessment and Evaluation (OAE) leadership.
• Monitor project plan execution, addressing barriers and collaborating with OAE leadership to ensure necessary resources and timely completion, escalating concerns as needed
• Collaborate on the writing and production of the Medical Student Performance Evaluation letters (MSPE) and ensure effective project management
• Manage OAE support for National Board of Medical Examiners (NBME) products, including exams, testing blueprints, conduct web-based item review meetings with faculty, and inform course reviews process
• Oversee the preparation and provision of assessment data for reviews of courses, Phases and the Curriculum as a Whole
• Conduct analyses of assessment data as directed by OAE leadership for equity, validity, reliability, time trends, and curricular evaluation
• Coordinate and present student performance data, analyses, and visualizations for various academic and oversight teams, committees, and curricular governance bodies
• Oversee the timely in-house cataloguing and analysis of NBME score reports and annual summaries, and the uploading of NBME program level assessment data into the Learning Management System
• Ensure data management systems comply with regulatory requirements and institutional data governance guidelines
• Provide consultation and support as able to Objective Structured Clinical Examination (OSCE) assessment system and data analysis
• Supervises and coordinates daily activities of designated work team by monitoring the execution and completion of action items and work assignments; ensures all policies and procedures are followed.
• Aligns team efforts and standards, and measures progress in achieving results; determines and carries out processes and methodologies; resolves escalated issues as appropriate.
• Solicits and acts on performance feedback; provides team members with feedback; and mentors and coaches to drive performance improvement
• Pursues professional growth; provides training and development to talent for growth opportunities; supports execution of performance management guidelines and expectations. Implements, adapts, and stays up to date with organizational change, challenges, feedback, best practices, and processes.
• Participates in curriculum and planning meetings, as needed, presenting relevant assessment data
• Serve on other KPSOM workgroups and committees