Title: Senior Psychometrician - Statistical, Reporting and Analytics

Location: US Remote

About PSI

We are PSI Services. We power world leading tests. Delivered with trusted science and the very best test taker experience. PSI supports test-takers on their journey to pursuing dreams and gaining certifications that are important to them. They believe that their dreams are worth working for; that their dreams are worth the effort. And we believe that too. This is our core purpose, to empower people to achieve their dreams. We do this by being the best provider of workforce solutions, which foster both technology and science to deliver the best solutions for our test takers.

We are searching for top talent to join our PSI team and help grow our products and services. We have a creative, supportive and inclusive culture where we empower people in their careers to be their authentic self and make the most of their great talent.

At PSI, we are committed to helping people meet their potential and we believe that promoting diversity, equity and inclusion is critical to our success. That's why you'll find these ideals are intrinsic to our company culture and applied throughout the employee lifecycle.

Learn more about what we do at:

The Senior Psychometrician - Statistical, Reporting, and Analytics is responsible for the statistical maintenance and validation of large-scale high-stakes examinations for credentialing programs at PSI. This position is occupied by a senior individual contributor who engages in advanced psychometric analysis to support the development of fair, reliable, and valid examinations. The person in this role is expected to have advanced training and expertise in measurement including Item Response Theory (IRT), research methodology, and data analytics.

This is a full-time permanent role, with flexible hours around core office availability Monday to Friday. The role can be performed remotely, with occasional travel required for meetings, events, and workshops.

• Performs assignments related to the construction, maintenance, and validation of credentialing assessments.
• Conducts statistical analyses of test items and examinations (e.g., item calibration, form assembly, equating, scaling and psychometric monitoring) using CTT and IRT (Rasch, 2PL, and 3PL) methods.
• Very experienced with Winsteps, BILOG-MG, Parscale, Polyequate, and other software packages used to complete IRT Analysis.
• Reformats data to be able to run standard and custom measurement-based analysis.
• Evaluates test items and exams to identify potential test integrity issues.
• Completes analysis to evaluate assessments for fairness, including Differential Item Functioning (DIF) analyses.
• Queries and format datasets from multiple test delivery platforms.
• Recognizes inconsistencies and initiate resolution of data problems.
• Develops process documentation to provide on-going support.
• Performs ad hoc analysis and generates outputs according to requirements, sometimes on short notice and with short lead times.
• Ensures high quality in examinations and practices that comply with professional standards and legal guidelines.
• Manages projects to ensure milestones and deliverables are met with quality and timelines.
• Implements continuous improvement of procedures and processes.
• Offers training on updated software, procedures, and processes.
• Advises internal and external clients regarding psychometric and test development methods and best practices.
• Communicates results and presents findings to internal and external clients and stakeholders clearly and concisely.
• Writes technical reports and documentation.
• Performs specialized research studies related to test construction and validation (e.g., LOFT, AIG).
• Represents PSI in the professional testing community and at conferences (ATP, COTS, SIOP, NCME, ICE).
• Mentors and provides guidance to other psychometricians across the group.

• Master's degree or D. in Educational Measurement & Statistics, Quantitative Research Methods, Industrial/Organizational Psychology, Psychometrics, or highly related discipline.
• Minimum of 5 - 7 years of experience in psychometrics, test equating, measurement-based methodologies and analyses, and advanced statistics.
• Proven experience maintaining IRT programs over multiple test development cycles.
• Graduate training and experience in psychometrics, measurement theory, test development, validation, item bias, standard setting.
• Skill in using statistical and data science software (R, SAS, SPSS, Python), Excel, and Word required.
• Experience in using of IRT software programs (i.e. Winsteps, Parscale, BILOG) and CTT applications strongly preferred.
• Experience with large-scale testing programs, including Certification and/or Licensure applications preferred.
• Experience with NCCA and ISO 17024 accreditation standards strongly preferred.

Benefits & Culture

At PSI, our culture is to be transparent and fair. That's why all of our roles have been benchmarked at a competitive rate against the local market they are based in. To be transparent all of our adverts now include the salary so you can see if we align with your expectations when looking for your next role.

In addition to a competitive salary, we offer a comprehensive benefits package and supportive culture when you join us. This includes;

• 401k/Pension/Retirement Plan - with country specific employer %
• Enhanced PTO/Annual Leave
• Medical insurance - country specific
• Dental, Vision, Life and Short Term Disability for US
• Flexible Spending Accounts - for the US
• Medical Cashback plan covering vision, dental and income protection for UK
• Employee Assistance Programme
• Commitment and understanding of work/life balance
• Dedicated DE&I group that drive core people initiatives
• A culture of embracing wellness, including regular global initiatives
• Access to supportive and professional mechanisms to help you plan for your future
• Volunteer Day and a culture of giving back to our community and industry through volunteering opportunities