Please don't get me wrong, I was very much intending to compare the output from the individual variables (my teacher has always emphasized the importance). So I can see the use of the binomial test, and I thank you for pointing it out to me. It's also true that the One Sample t-test does not work very well for me in this case, seeing as it tests differentiation from a specified (zero-decimal) number, and now that I've recoded my variables into 0 and 1, it won't let me specify a test value of 0,5 (which would signify an even distribution). That does leave me wondering if in this case it would be of any use to change the 0 to -1. Both 0 and 1 give me p< .001 for every variable, so that's not very useful.
When looking at the individual variables it is striking that the standard deviations are quite large (from .390 to .506) for data with a minimum value of 0 and a maximum value of 1. I'm guessing this is due to having such a small test group (N= 44).
The actual results for the binomial test show a wide variety in the proportions as well, so, based on that, I think neither the "positive" outcome nor the "negative" outcome is more likely to occur. However, when doing the binomial test on the entire sample (0= 213 (.44), 1= 271 (.56)), it shows that the chances of getting these scores (when assuming a probability parameter of .50) are quite small (p< .05). Given the amount of variation between the individual variables, though, I'm forced to give more credit to their individual analyses. After all, the overall p-value is nice but it does not (apparently) reflect the scores of highly comparable variables and cannot, as such, be taken for granted.
The Paired Samples t-test, then, shows a slightly negative but not significant correlation between the means of the door and naar groups (r= -.062). The standard deviations are, luckily, much smaller than in the case of the individual variables. It seems that the individual respondents are more consistent than the group as a whole, which is probably the least I can ask for.
So, it seems that on average my response group showed a significant preference for the "positive" outcome of the "answer" sentences for those "question" sentences that contain "naar" (M= .61, SE= .03), as compared to those that contain "door" (M= .50, SE= .03), t(43)= 2.63, p< .05, r= .37.
This could explain the difference in overall proportion that I've noted above. In response to this result I also did the binomial test for the door and naar groups separately, which gave me the same results. Having a medium effect size also contributes to this result. Of course, there's still the individual analyses to do, but that's too lengthy to get into here, I think.
Well, this has taken me some time to figure out and I'm sure that I've done at least something wrong, so I would very much appreciate your opinion on these results. For reference, here's a link to the relevant data:
http://snk.to/f-ct9yxya3