Title: Data Forensics Manager

Location: US Remote

About PSI

We are PSI Services. We power world leading tests. Delivered with trusted science and the very best test taker experience. PSI supports test-takers on their journey to pursuing dreams and gaining certifications that are important to them. They believe that their dreams are worth working for; that their dreams are worth the effort. And we believe that too. This is our core purpose, to empower people to achieve their dreams. We do this by being the best provider of workforce solutions, which foster both technology and science to deliver the best solutions for our test takers.

We are searching for top talent to join our PSI team and help grow our products and services. We have a creative, supportive and inclusive culture where we empower people in their careers to be their authentic self and make the most of their great talent.

At PSI, we are committed to helping people meet their potential and we believe that promoting diversity, equity and inclusion is critical to our success. That's why you'll find these ideals are intrinsic to our company culture and applied throughout the employee lifecycle.

Learn more about what we do at:

The Data Forensics Manager is responsible for the detection of fraudulent test taking behaviours using advanced statistical methods and web crawling procedures. The person in this role is expected to have advanced training and expertise in measurement, research methodology, and data analytics. This person will manage a portfolio of clients and manage a team of Data Forensics Psychometricians providing guidance, training, and oversight of their assigned duties. The Data Forensics Manager will also engage opportunities to present PSI's data forensics offering to existing and prospective clients and assist with special initiatives.

This is a full-time permanent role, with flexible hours around core office availability Monday to Friday. The role can be performed remotely, with occasional travel required for meetings, events, and workshops.

• Provide training, guidance, and oversight of Data Forensics Psychometricians and Senior Data Forensics Psychometrics assigned duties.
• Facilitate goal setting and participate in performance evaluation for assigned team members.
• Coordinate team member activities and tasks and provide support to meet deliverables.
• Participate in load forecasting and client program assignment process.
• Participate in internal process development and improvement initiatives.
• Maintain awareness of industry standards and research in the area of data forensics and web crawling procedures for the purpose of test security.
• Design and conduct data analytics to support the security and integrity of high stakes examination programs.
• Design and conduct R&D studies to evaluate, validate, and optimize the use of secure test delivery modes and technologies (including AI), while preserving validity and fairness of assessments.
• Develop and implement frameworks for data forensic analyses to detect test fraud (cheating, IP harvesting/theft, exposure, breach, drift, and other testing anomalies).
• Support investigations of potential test fraud at the candidate, test site, school, and other aggregate levels.
• Design and generate exam program surveillance reports, summarize and interpret findings and make recommendations.
• Evaluate test items and exams to identify potential test integrity issues.
• Assess the potential impact of test security breaches, cheating, and related issues.
• Develop test scoring (rescoring) solutions to address security-related anomalies.
• Conduct ad hoc analyses to investigate test security-related issues and special inquiries.
• Comply with industry best practices, standards and guidelines for test security analytics and forensics monitoring (e.g., ATP).
• Write technical reports.
• Present findings to key stakeholders.
• Represent PSI in the professional testing community (e.g., ATP, COTS, NCME, ICE).

• Master's degree or D. in Educational Measurement & Statistics, Quantitative Research Methods, Industrial/Organizational Psychology, Psychometrics, or highly related discipline.
• Minimum of 5 - 7 years of experience in psychometrics, test equating, measurement-based methodologies and analyses, and advanced statistics.
• Two years of experience managing the work of others.
• Experience in Data Forensics including operational implementation and usage of analysis results to guide investigations preferred.

• Graduate training and experience in psychometrics, measurement theory, test development, validation, item bias, standard setting.
• Skill in using statistical and data science software (R, SAS, SPSS, Python), Excel, and Word required.
• Experience in using of IRT software programs (i.e. Winsteps, Parscale, BILOG) and CTT applications strongly preferred.
• Experience with large-scale testing programs, including Certification and/or Licensure applications preferred.
• Experience with NCCA and ISO 17024 accreditation standards strongly preferred.

Benefits & Culture

At PSI, our culture is to be transparent and fair. That's why all of our roles have been benchmarked at a competitive rate against the local market they are based in. To be transparent all of our adverts now include the salary so you can see if we align with your expectations when looking for your next role.

In addition to a competitive salary, we offer a comprehensive benefits package and supportive culture when you join us. This includes;

• 401k/Pension/Retirement Plan - with country specific employer %
• Enhanced PTO/Annual Leave
• Medical insurance - country specific
• Dental, Vision, Life and Short Term Disability for US
• Flexible Spending Accounts - for the US
• Medical Cashback plan covering vision, dental and income protection for UK
• Employee Assistance Programme
• Commitment and understanding of work/life balance
• Dedicated DE&I group that drive core people initiatives
• A culture of embracing wellness, including regular global initiatives
• Access to supportive and professional mechanisms to help you plan for your future
• Volunteer Day and a culture of giving back to our community and industry through volunteering opportunities