MERIT India Presents

July Workshop: Agreement and Rater Reliability Analysis for Categorical Data using JAMOVI

🗓️ Date: 25th July 2025 (Friday)
🕒 Time: 2:00 PM – 5:00 PM
🖥️ Platform: Online via Zoom
👨‍🏫 Software Used: JAMOVI (Free, user-friendly)

🎓Who Should Attend?

1. Researchers conducting tool validation studies
2. Health professionals involved in diagnostic agreement
3. Students/Scholars handling categorical outcome data
4. Anyone working with multiple raters or interview-based tools

⚠️ We request you all to join using a laptop to ensure smooth hands-on learning.

🔍Learning Objectives

1. Difference between agreement and reliability
2. When to use Kappa statistics, Krippendorff’s Alpha, or Percentage Agreement
3. Hands-on use of JAMOVI to calculate:
   1. Cohen’s Kappa
   2. Fleiss Kappa
   3. Light’s Kappa
   4. Krippendorff’s Alpha
4. Overview of why ICC is not appropriate for categorical data
5. Reporting agreement statistics effectively in research

🧠What You Will Learn

1. Choosing the right agreement statistic
2. Setting up rater data in JAMOVI
3. Hands-on calculations of Kappa, Krippendorff’s Alpha
4. Avoiding common errors in agreement studies
5. Interpreting and reporting results effectively

🔍Research Scenarios – Is This Workshop for You?

1. Two nurses categorizing patient triage levels — are their decisions consistent?
2. Three evaluators rating counseling skills on a checklist — is the tool reliable?
3. Comparing classification agreement between two diagnostic tests
4. Validating a scoring tool used by multiple field workers
5. Measuring agreement among faculty grading viva answers with a rubric

📩For Any Queries

Email: support@meritindia.org
WhatsApp: +91 7980084450