Article Content
Abstract
This paper reports the results of a visual world study that explored the processing of sentential negation by Italian adults. To fulfill this aim, we assessed the perceptual prominence of the negated information (that is, the propositional content in the scope of negation). Specifically, we employed an identification task in a visual world set-up in which participants had to listen to affirmative and negative sentences (e.g., Aladdin [is/is not] closing the door…) while looking at visual scenes with the number of pictures matching the negated content varying from one to three. Negation processing was investigated across different propositional and perceptual dimensions by including three types of items (cartoons, black and white, and coloured shapes). We found that i) participants were always slower in target identification with negative sentences vs. their affirmative counterparts; ii) the perceptual prominence of the negated information reduced this processing penalty. These results support the idea that the representation of the negated information plays an active role in negative sentence comprehension, in compliance with two-step-based accounts of negation processing. Nonetheless, the computation of sentential negation displays some degree of flexibility and is in part modulated by the visual and linguistic information provided.
Explore related subjects
Discover the latest articles and news from researchers in related subjects, suggested using machine learning.
- Cognitive Psychology
- Cognition
- Cognitive Science
- Inhibition
- Language Processing
- Natural Language Processing (NLP)
Notes
-
Processing costs are generally evaluated in terms of accuracy (i.e., correctness in performing the task) and reaction times (participant’s response latency).
-
It represents the ‘argument’ of negation (following Tian et al.’s (2010) terminology), intended as the semantic information occurring under its scope, and it is in all respects mentioned, i.e., explicitly expressed in the sentences.
-
This and the subsequent values mentioned throughout the section represent the percentage of target fixations, where 0.06 corresponds to 6%.
-
The main effect of target number was significant in all item type conditions (cartoons: β = 0.15, t = 16.58, p <.001; black and white shapes: β = 0.15, t = 13.74, p <.001; coloured shapes: β = 0.04, t = 2.84, p = < 0.01) and was due to the adopted experimental design (i.e., different base probability of target fixation across the three target conditions).
-
A series of post-hoc power analyses were conducted using G*Power (Faul et al., 2007) to assess the achieved statistical power for the LMMs (R2 deviation from zero) for the three item types (given the total sample size = 62; number of predictors = 3; critical F-value = 2.76). For cartoons (f² = 0.249), the power to detect obtained effects at the alpha level of 0.05 was 0.91. For black and white shapes (f² = 0.212), the power to detect obtained effects at the alpha level of 0.05 was 0.85. For coloured shapes (f² = 0.166), the power to detect obtained effects at the alpha level of 0.05 was 0.74. These analyses indicate sufficient power for detecting medium to large effects for cartoon and black and white shapes, while the analysis for coloured shapes reflects a slightly lower power, reducing sensitivity to smaller effects.
-
For ease of reading, we report the values of the GLMM conducted on the first significant 50ms-bin.
-
It is worth asking whether the explanation we have provided for this effect could be given in different terms, which are unrelated to the role of the negated information itself. For instance, it could be that in negative trials involving only one mentioned argument (and three targets)– which revealed a maximum penalty for negation–, the fact that the negated information only matched a single picture in the visual display could have drawn the listeners’ attention to a greater extent compared to other conditions involving more than one mentioned argument. That is, under this hypothesis, the uniqueness of the mentioned argument, rather than its greater numerosity, was a more decisive factor in determining its visual prominence. While this explanation cannot be ruled out a priori for the conditions with three targets and one mentioned argument, it would fail to explain the gradual reduction of penalty as well as the difference between the negative conditions with two vs. one target(s). This is so because in both these conditions there was never a unique mentioned argument, and it is very unlikely that two quadrants displaying the same character were more salient than three.
References
-
Allopenna, P. D., Magnuson, J. S., & Tanenhaus, M. K. (1998). Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models. Journal of Memory and Language, 38, 419–439.
-
Altmann, G. T., & Kamide, Y. (2009). Discourse-mediation of the mapping between Language and the visual world: Eye-movements and mental representation. Cognition, 111, 55–71.
-
Aparicio, H., Xiang, M., & Kennedy, C. (2015). Processing gradable adjectives in context: A visual world study. Proceedings of SALT 25 (pp. 413–432). LSA and CLC Publications.
-
Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013). Random effects structure for confirmatory hypothesis testing: Keep it maximal. Journal of Memory and Language, 68, 255–278.
-
Barton, S. B., & Sanford, A. J. (1993). A case study of anomaly detection: Shallow semantic processing and cohesion establishment. Memory & Cognition, 21(4), 477–487.
-
Carpenter, P., & Just, M. (1975). Sentence comprehension: A psycholinguistic processing model of verification. Psychological Review, 82(1), 45–73.
-
Clark, H., & Chase, W. (1972). On the process of comparing sentences against pictures. Cognitive Psychology, 3, 472–517.
-
Dahan, D., & Tanenhaus, M. K. (2005). Looking at the rope when looking for the snake: Conceptually mediated eye movements during spoken-word recognition. Psychonomic Bulletin & Review, 12, 453–459.
-
Dale, R., & Duran, N. D. (2011). The cognitive dynamics of negated sentence verification. Cognitive Science, 35(5), 983–996.
-
Damian, M., & Bowers, J. (2003). Locus of semantic interference in picture-word interference tasks. Psychonomic Bulletin & Review, 10, 111–117.
-
Faul, F., Erdfelder, E., Lang, A. G., & Buchner, A. (2007). G* power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175–191.
-
Ferguson, H. J., Sanford, A. J., & Leuthold, H. (2008). Eye-movements and erps reveal the time course of processing negation and remitting counterfactual worlds. Brain Research, 123(6), 113–125.
-
Ferreira, V. S., & Pashler, H. (2002). Central bottleneck influences on the processing stages of word production. Journal of Experimental Psychology: Learning Memory and Cognition, 28(6), 1187.
-
Fischler, I., Bloom, P., & Childers, D. (1983). Brain potentials related to stages of sentence verification. Psychophysiology, 20(4), 400–409.
-
Givón, T. (1978). Negation in language: Pragmatics, function, ontology. In C. P., Syntax and semantics 9: Pragmatics. Academic.
-
Glenberg, A. M., Robertson, D. A., Jennifer, L. J., & Johnson-Glenberg, M. C. (1999). Not propositions. Cognitive Systems Research, 1(1), 19–33.
-
Hasson, U., & Glucksberg, S. (2006). Does Understanding negation entail affirmation? An examination of negated metaphors. Journal of Pragmatics, 38(7), 1015–1032.
-
He, Y., Sommer, J., Hansen-Schirra, S., & Nagels, A. (2022). Negation impacts sentence processing in the N400 and later time windows: Evidence from multivariate pattern analysis of EEG. https://doi.org/10.31234/osf.io/8rbw3
-
Horn, L. R. (1989). A natural history of negation. University of Chicago Press.
-
Huettig, F., & Altmann, G. T. (2004). The online processing of ambiguous and unambiguous words in context: Evidence from head-mounted eye-tracking. In M. Carreiras, & C. Clifton (Eds.), The on-line study of sentence comprehension: Eyetracking, ERP and beyond (pp. 187–207). Psychology.
-
Huettig, F., & Altmann, G. T. (2007). Visual-shape competition during language-mediated attention is based on lexical input and not modulated by contextual appropriateness. Visual Cognition, 15, 985–1018.
-
Huettig, F., Rommers, J., & Meyer, A. S. (2011). Using the visual world paradigm to study Language processing: A review and critical evaluation. Acta Psychologica, 137, 151–171.
-
Ikeda, S. (1996). Inhibition in picture naming and word reading. Perceptual and Motor Skills, 1319–1329.
-
Jaeger, T. F. (2008). Categorical data analysis: Away from ANOVAs (transformation or not) and towards logit mixed models. Journal of Memory and Language, 59, 434–446.
-
Johnson-Laird, P. N. (1983). Mental models: Towards a cognitive science of language, inference, and consciousness (Vol. 6No.). Harvard University Press.
-
Jost, T., Ouerhani, N., Wartburg, R., Müri, R., & Hügli, H. (2005). Assessing the contribution of color in visual attention. Computer Vision and Image Understanding, 100(1), 107–123.
-
Kamp, H., & Partee, B. (1995). Prototype theory and compositionality. Cognition, 57, 129–191.
-
Kaup, B., Lüdtke, J., & Zwaan, R. (2005). Effects of negation, truth value, and delay on picture recognition after reading affirmative and negative sentences. In B. G. Bara, & L. Barsal (Ed.), Proceedings of the 27th Annual Conference of the Cognitive Science Society (pp. 1114–1119). Mahwah, NJ: Lawrence Erlbaum.
-
Kaup, B., Lüdtke, J., & Zwaan, R. (2006). Processing negated sentences with contradictory predicates: Is a door that is not open mentally closed? Journal of Pragmatics, 38, 1033–1050.
-
Kaup, B., Lüdtke, J., & Zwaan, R. A. (2007a). The experiential view of Language comprehension: How is negation represented? In F. Schmalhofer, & C. A. Perfetti (Eds.), Higher level Language processes in the brain. Inference and comprehension processes (pp. 255–288). Lawrence Erlbaum Associates.
-
Kaup, B., Yaxley, R. H., Madden, C. J., Zwaan, R. A., & Lüdtke, J. (2007b). Experiential simulations of negated text information. Quarterly Journal of Experimental Psychology, 60(7), 976–990.
-
Khemlani, S., Orenes, I., & Johnson-Laird, P. N. (2012). Negation: A theory of its meaning, representation, and use. Journal of Cognitive Psychology, 24(5), 541–559.
-
Kim, D. (2010). The Interactive Effects of Colors on Visual Attention and Working Memory: In Case of Images of Tourist Attractions. International CHRIE Conference. Amherst, MA: ScholarWorks@UMass Amherst.
-
Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. (2017). LmerTest: Tests in linear mixed effects models. Journal of Statistical Software, 82(13).
-
Lüdtke, J., Friedrich, C. K., Filippis, M. D., & Kaup, B. (2008). Event-related potential correlates of negation in a sentence–picture verification paradigm. Journal of Cognitive Neuroscience, 8, 1355–1370.
-
Lüdtke, J., & Kaup, B. (2006). Context effects when reading negative and affirmative sentences. In R. Sun (Ed.), Proceedings of the 28th Annual Conference of the Cognitive Science Society. Mahwah, NJ: Lawrence Erlbaum.
-
Meyer, A. S., & Damian, M. F. (2007). Activation of distractor names in the picture-picture interference paradigm. Memory & Cognition, 35, 494–503.
-
Nieuwland, M. S., & Kuperberg, G. R. (2008). When the truth is not too hard to handle. Psychological Science, 19(12), 1213–1218.
-
Orenes, I. (2021). Looking at negation: Faster processing for symbolic rather than iconic representations. Journal of Psycholinguistic Research, 50(6), 1417–1436.
-
Orenes, I., Beltrán, D., & Santamaría, C. (2014). How negation is understood: Evidence from the visual world paradigm. Journal of Memory and Language, 74, 36–45.
-
Orenes, I., Moxey, L., Scheepers, C., & Santamaría, C. (2016). Negation in context: Evidence from the visual world paradigm. The Quarterly Journal of Experimental Psychology, 69(6), 1082–1092.
-
Sedivy, J. C. (2005). Evaluating explanations for referential context effects: Evidence for Gricean meachanisms in online Language interpretation. In J. C. Trueswell, & M. K. Tanenhaus (Eds.), Approaches to studying World-Situated Language use: Bridging the Language-as-Product and Language-as-Action traditions (pp. 345–364). MIT Press.
-
Sedivy, J. C., Tanenhaus, M. K., Chambers, C. G., & Carlson, G. N. (1999). Achieving incremental semantic interpretation through contextual representation. Cognition, 71(2), 109–147.
-
Staab, J., Urbach, T. P., Kutas, M., Alexandre, J., Schleicher, E., & Bates, E. (2008). Negation processing in context is not (always) delayed. CRL Technical Report, 20(3).
-
Starreveld, P., & La Heij, W. (2017). Picture-word interference is a Stroop effect: A theoretical analysis and new empirical findings. Psychonomic Bulletin & Review, 24, 721–733.
-
Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K. M., & Sedivy, J. C. (1995). Integration of visual and linguistic information in spoken Language comprehension. Science, 268, 1632–1634.
-
Team, R. C. (2022). R: A Language and environment for statistical computing. R Foundation for statistical computing.
-
Testoni, A., Greco, C., & Bernardi, R. (2022). Artificial intelligence models do not ground negation, humans do. guesswhat?! Dialogues as a case study. Frontiers in Big Data, 4, 736709.
-
Tian, Y., Breheny, R., & Ferguson, H. (2010). Why we simulate negated information: A dynamic pragmatic account. The Quarterly Journal of Experimental Psychology, 63(12), 2305–2312.
-
Tian, Y., Ferguson, H., & Breheny, R. (2016). Processing negation without context—Why and when we represent the positive argument. Language Cognition and Neuroscience, 31(5), 683–698.
-
Vender, M., & Delfitto, D. (2010). Towards a pragmatic of negation: The interpretation of negative sentences in developmental dyslexia. GG@G– Generative Grammar at Geneva, 5–32.
-
Villiers, J. G., & Flusberg, H. B. (1975). Some facts one simply cannot deny. Journal of Child Language, 2, 279–286.
-
Wason, P. (1961). Response to affirmative and negative binary statements. British Journal of Psychology, 52(2), 133–142.
-
Wason, P. (1965). The contexts of plausible denial. Journal of Verbal Learning and Verbal Behaviour, 4(1), 7–11.
-
Wason, P. C. (1959). The processing of positive and negative information. Quarterly Journal of Experimental Psychology, 11(2), 92–107.
-
Wolfe, J. M., & Horowitz, T. S. (2004). What attributes guide the deployment of visual attention and how do they do it?? Nature Reviews Neuroscience, 5(6), 495–501.
-
Yee, E., Huffstetler, S., & Thompson-Schill, S. L. (2009). Function follows form: Activation of shape & function features during concept retrieval. Poster presented at the 50th Annual Meeting of the Psychonomic Society.
Acknowledgments
We would like to thank Denis Delfitto, Maria Vender, and Hedde Zeijlstra for their valuable feedback and discussions on earlier versions of this work. We are also grateful for the feedback received when the data from this study were presented at the AMLaP 2019 conference. Finally, we thank all the participants who took part in the study.
Funding
No funds, grants, or other support was received.
Ethics declarations
Ethical Approval
Ethical approval was obtained from the ethics committee at University of Verona (Ref No: 2020_04). The study was conducted in accordance with the standards specified in the 2013 Declaration of Helsinki.
Informed Consent
Permission to conduct the experiment for the purposes of this research was obtained by all participants, who were fully informed about the purposes of this research and how their responses would be used and stored. Please see below for the consent form template translated to English.
Conflict of Interest
All authors certify that they have no affiliations with or involvement in any organization or entity with any financial interest or non-financial interest in the subject matter or materials discussed in this manuscript.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
Reprints and permissions
About this article
Cite this article
Tagliani, M., Panizza, D. & Melloni, C. The Role of the Negated Information in Processing Negation: A Visual World Study.. J Psycholinguist Res 54, 43 (2025). https://doi.org/10.1007/s10936-025-10161-5
- Accepted
- Published
- DOI https://doi.org/10.1007/s10936-025-10161-5
Keywords
- Negation
- Sentence processing
- Visual world paradigm