Data Analyst

Job description

Position Overview

The Psychometrics and Data Analysis (PADA) unit is seeking a Data Analyst to join our team. Activities of the Data Analyst role include scoring (calibration, equating, scaling/norming) and score reporting for operational and developing assessment programs, carrying out quality control measures, use of R and R Markdown programming and other technical procedures, user acceptance testing (UAT) for software and score report development, developing survey questionnaires, and collaborating with other NBME units on strategic initiatives.

This role has been designated as primarily remote which means it generally does not require onsite work more than an average of 2-3 times per month and may require additional prescheduled onsite work. Employees will have the ability to select their primary work location (remote/on-site/hybrid) based on their preference. We're open to considering candidates in the following states: PA, NJ, DE and MD.

Diversity, Equity, and Inclusion Statement

At NBME, we continue to innovate and improve how we fulfill the evolving needs of the health care community. This commitment starts and ends with the people at NBME. By recruiting and empowering talented individuals from various disciplines and backgrounds, which includes professionals with diverse life experiences, abilities, and perspectives, NBME can take a well-informed, robust approach to advancing medical education and assessment for years to come. We also continue to focus on ensuring that our DEI work is impactful and ingrained in everything we do, including with our staff, workplace culture, products and services, the Philadelphia community and the broader medical education landscape.


  • Carry out score calculation, analyses, and score reporting for assessments such as the United States Medical Licensing Exam (USMLE) and other assessments for health care professions under the direction of a psychometrician
  • Plan and coordinate timelines and perform analytical and data management tasks
  • Perform quality control procedures to identify and resolve inconsistencies in all aspects of data analysis and score reporting to maintain integrity of scores
  • Develop, revise, and update data and analytical procedures using the most appropriate technology (R, SPSS, etc. )
  • Design data collection tools including survey questionnaires and support quantitative and/or qualitative analysis of internal data
  • Collaborate with internal IT unit on a variety of NBME projects (planning timelines, defining requirements, UAT)
  • Serve as a subject matter expert (SME) in specific areas of work on the Data Analysis team


Skills and Abilities

  • Solid knowledge and experience with R programming and R Markdown; experience writing R code preferred
  • Familiarity with data management, basic SQL, and statistical packages (SPSS, SAS, etc.)
  • Programming experience highly desirable (coding, debugging, testing)
  • Understanding of database structure for accessing complex data
  • Sufficient knowledge of statistical procedures to work independently on most aspects of score calculation and reporting
  • High level of quantitative and logical reasoning ability
  • Prior experience performing quality control, quantitative data analysis, data interpretation and educational measurement is preferred
  • Knowledge of MS Office applications (e.g., Outlook, MS Word, and Excel)
  • Attentive to detail
  • Ability to handle multiple tasks and deadlines simultaneously; manage competing priorities
  • Strong interpersonal communication, organizational and project management skills
  • Desired: Experience creating survey questionnaires and analyzing survey data
  • Desired: Familiarity with qualitative analysis methods


  • Minimum of 1 year of experience in a professional or academic environment with R programming (preferred in a measurement education environment)


  • Bachelor's degree (Master's Degree preferred) or a combination of equivalent education and experience

About NBME:

NBME offers a versatile selection of high-quality assessments and educational services for students, professionals, educators, regulators and institutions dedicated to the evolving needs of medical education and health care. To ensure our assessments meet the highest standards of quality, stay relevant and align to the current curriculum in medical schools and training programs, we rely on a wide network of collaborators. These include the volunteers who help develop our exam questions, the committees and panels who represent various groups within the medical education community, external researchers and health profession organizations.

We are committed to meeting the needs of educators and learners globally with assessment products and expert services such as NBME® Subject Examinations , Customized Assessment Services , Self-Assessments , the International Foundations of Medicine® Program and Item Writing Workshops . Together with the Federation of State Medical Boards, NBME develops and manages the United States Medical Licensing Examination® , which measures the ability to apply knowledge and skills that form the basis of safe and effective patient care. Our Competency-based Assessment unit is focused on new methods as well as the optimization of assessment in the workplace and education.

As a result of leadership in ongoing research, innovative measurement practices and the exploration of forward-thinking assessment modalities and improvements, NBME advances assessment science. Our grant and funding opportunities further support this dedication to medical education and assessment science. We help develop the next generation of assessment professionals through our Summer Psychometric Internship Program . Through the Stemmler Fund , Strategic Educators Enhancement Fund and Latin America Grants Program , researchers and educators can continue to improve the assessment of health care professionals around the world.

NBME views diversity, equity and inclusion (DEI) as foundational and enduring to our strategy and vision. We continue to focus on ensuring that our DEI work is impactful and ingrained in everything we do, including with our staff, culture, products and services, the Philadelphia community and the broader medical education landscape. Our commitment manifests in our hiring and staff development, recruitment for committees, grants programs, design and review of our assessments, and involvement in our local and national communities .

Learn more about NBME at NBME.org .

The NBME offers competitive salaries, excellent benefits, and a rewarding work environment. Excellent Benefits include: Healthcare, Dental, Prescription, and Vision plans; 401(k) w/match, Tuition Reimbursement Plan, Commuter Benefit: Public Transit or Parking options. Remote Friendly Workplace.

NBME is an equal opportunity employer as defined by the EEOC.

Current NBME regular employees should click the following link to apply: https://nbme.applicantpro.com/internaljobs/ (Please do not send the following posting link to Referrals.)

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.