Inter-rater reliability

Moderators: statman, Analyst Techy, andris, Fierce, GerineL, Smash

michalkessel
Posts: 3
Joined: Mon Sep 19, 2011 1:12 pm

Inter-rater reliability

Postby michalkessel » Mon Sep 19, 2011 1:16 pm

Hi everyone!
I have a problem, hopefully you can help me. I'm doing a content analysis of a few websites. The variances are mostly nominal, such as "1"=chocholate, "2"=ice cream, "3"=marshmallow etc. The problem is I had to judges do the analysis for me and now I have two data sheets.
I was wondering, a. how do I check inter-rater reliability? is there some kind of test I can run? using SPSS of course.
b. What do I do next? I can't compute these two variables into one using mean because they're nominal, and later on I have to report the percentages, for instance, 20% of the websites advertise chocolate. Then how do I mix these two together into one coherent statistics chapter??
Thank you!!
statman
Administrator
Posts: 2757
Joined: Tue Jun 12, 2007 12:08 pm
Location: Florida, USA

Re: Inter-rater reliability

Postby statman » Mon Sep 19, 2011 1:56 pm

See the Note below
See the note below

NOTE: Please read the Posting Guidelines and always tell us your OS, the SPSS version and information about your study and data!

Statman
Statistical Services
michalkessel
Posts: 3
Joined: Mon Sep 19, 2011 1:12 pm

Re: Inter-rater reliability

Postby michalkessel » Mon Sep 19, 2011 2:03 pm

Sorry! Using windows 7, IBM SPSS 19.
statman
Administrator
Posts: 2757
Joined: Tue Jun 12, 2007 12:08 pm
Location: Florida, USA

Re: Inter-rater reliability

Postby statman » Mon Sep 19, 2011 8:43 pm

These data are categorical not scale so reliability not applied
michalkessel
Posts: 3
Joined: Mon Sep 19, 2011 1:12 pm

Re: Inter-rater reliability

Postby michalkessel » Tue Sep 20, 2011 6:13 am

okay, but if you can please answer me this too: how do I analyze it? I can't do an average and I have to report frequencies and percenteges in my work, so do I report everything twice, once for every rater?

Who is online

Users browsing this forum: No registered users and 2 guests

cron