This self-learning module will focus on the following learning outcomes.

At the end of this self-learning module, the learner should be able to:

• Calculate and interpret common reliability indices.
  
• Discuss elements in a post-hoc analysis, developing a basic framework for exam performance matrix.
  
• Calculate and interpret a set of examination results for a commonly used study design using Generalizability theory.
  
• Calculate and interpret a set of examination results for a commonly used study design using RASCH analysis.
  

The module consists of the following videos and it may take approximately 6 hours and 35 minutes of your time to complete. The videos are:

Part 1 - Introduction to post-exam psychometrics

• Introduction to post-exam psychometrics – what and why we do it (~18 mins)
  
• What is classical test theory (~3 mins)
  
• Definition and interpretation of reliability indices –  Cronbach alpha, KR-20, alpha if item deleted, SEM (~30 mins)
  
• Hands-on activity: Calculation through Jamovi (~36 mins)

Part 2 - Item analysis

• Introduction to Difficulty and Discriminatory index (~34 mins)
  
• Interpretation of item analysis of correct answers (~54 mins)
• Distractor analysis (~21 mins)

Part 3 - Generalizability theory

• Generalizability theory (~46 mins)
• Hands-on activity (~41 mins)
• Questions and answer (~5 mins)

Part 4 - RASCH analysis

• Item response theory (~46 mins)
• Hands-on theory (~60 mins)