Abstract
People see with feeling. We ‘gaze’, ‘behold’, ‘stare’, ‘gape’ and ‘glare’. In this paper, we develop the hypothesis that the brain's ability to see in the present incorporates a representation of the affective impact of those visual sensations in the past. This representation makes up part of the brain's prediction of what the visual sensations stand for in the present, including how to act on them in the near future. The affective prediction hypothesis implies that responses signalling an object's salience, relevance or value do not occur as a separate step after the object is identified. Instead, affective responses support vision from the very moment that visual stimulation begins.
References
Abramson B.P.& Chalupa L.M. . 1985The laminar distribution of cortical connections with the tecto- and cortico-recipient zones in the cat's lateral posterior nucleus. Neuroscience. 15, 81–95.doi:10.1016/0306-4522(85)90125-3. . Crossref, PubMed, ISI, Google ScholarBar M. . 2003A cortical mechanism for triggering top-down facilitation in visual object recognition. J. Cogn. Neurosci. 15, 600–609.doi:10.1162/089892903321662976. . Crossref, PubMed, ISI, Google ScholarBar M. . 2004Visual objects in context. Nat. Rev. Neurosci. 5, 617–629.doi:10.1038/nrn1476. . Crossref, PubMed, ISI, Google ScholarBar M. . 2007The proactive brain: using analogies and associations to generate predictions. Trends Cogn. Sci. 11, 280–289.doi:10.1016/j.tics.2007.05.005. . Crossref, PubMed, ISI, Google ScholarBar M.& Aminoff E. . 2003Cortical analysis of visual context. Neuron. 38, 347–358.doi:1016/S0896-6273(03)00167-3. . Crossref, PubMed, ISI, Google ScholarBar M., Tootell R.B., Schacter D.L., Greve D.N., Fischl B.& Mendola J.D. . 2001Cortical mechanisms specific to explicit visual object recognition. Neuron. 29, 529–535.doi:10.1016/S0896-6273(01)00224-0. . Crossref, PubMed, ISI, Google ScholarBar M., 2006Top-down facilitation of visual recognition. Proc. Natl Acad. Sci. USA. 103, 449–454.doi:10.1073/pnas.0507062103. . Crossref, PubMed, ISI, Google ScholarBar M. . 2009The proactive brain: memory for predictions. Phil. Trans. R. Soc. B. 364, 1235–1243.doi:10.1098/rstb.2008.0310. . Link, ISI, Google ScholarBarbas H. . 1988Anatomic organization of basoventral and mediodorsal visual recipient prefrontal regions in the rhesus monkey. J. Comp. Neurol. 276, 313–342.doi:10.1002/cne.902760302. . Crossref, PubMed, ISI, Google ScholarBarbas H. . 1993Organization of cortical afferent input to orbitofrontal areas in the rhesus monkey. Neuroscience. 56, 841–864.doi:10.1016/0306-4522(93)90132-Y. . Crossref, PubMed, ISI, Google ScholarBarbas H. . 1995Anatomic basis of cognitive-emotional interactions in the primate prefrontal cortex. Neurosci. Biobehav. Rev. 19, 499–510.doi:10.1016/0149-7634(94)00053-4. . Crossref, PubMed, ISI, Google ScholarBarbas H. . 2000Connections underlying the synthesis of cognition, memory, and emotion in primate prefrontal cortices. Brain Res. Bull. 52, 319–330.doi:10.1016/S0361-9230(99)00245-2. . Crossref, PubMed, ISI, Google ScholarBarbas H.& De Olmos J. . 1990Projections from the amygdala to basoventral and mediodorsal prefrontal regions in the rhesus monkey. J. Comp. Neurol. 300, 549–571.doi:10.1002/cne.903000409. . Crossref, PubMed, ISI, Google ScholarBarbas H.& Pandya D.N. . 1989Architecture and intrinsic connections of the prefrontal cortex in the rhesus monkey. J. Comp. Neurol. 286, 353–375.doi:10.1002/cne.902860306. . Crossref, PubMed, ISI, Google ScholarBarbas H., Saha S., Rempel-Clower N.& Ghashghaei T. . 2003Serial pathways from primate prefrontal cortex to autonomic areas may influence emotional expression. BMC Neurosci. 4, 25–37.doi:10.1186/1471-2202-4-25. . Crossref, PubMed, ISI, Google ScholarBarrett L.F. Solving the emotion paradox: categorization and the experience of emotion. Pers. Soc. Psychol. Rev. 10, 2006a20–46.doi:10.1207/s15327957pspr1001_2. . Crossref, PubMed, ISI, Google ScholarBarrett L.F. Valence as a basic building block of emotional life. J. Res. Pers. 40, 2006b35–55.doi:10.1016/j.jrp.2005.08.006. . Crossref, ISI, Google Scholar- Barrett, L. F. & Bliss-Moreu, E. In press. Affect as a psychological primitive. Adv. Exp. Social Psychol. Google Scholar
Barrett L.F., Quigley K., Bliss-Moreau E.& Aronson K.R. . 2004Arousal focus and interoceptive sensitivity. J. Person. Social Psychol. 87, 684–697. Crossref, PubMed, ISI, Google ScholarBarrett L.F., Mesquita B., Ochsner K.N.& Gross J.J. The experience of emotion. Annu. Rev. Psychol. 58, 2007a373–403.doi:10.1146/annurev.psych.58.110405.085709. . Crossref, PubMed, ISI, Google ScholarBarrett L.F., Lindquist K.& Gendron M. Language as a context for emotion perception. Trends Cogn. Sci. 11, 2007b327–332. Crossref, PubMed, ISI, Google ScholarBauer R.M. . 1982Visual hypoemotionality as a symptom of visual-limbic disconnection in man. Arch. Neurol. 39, 702–708. Crossref, PubMed, Google ScholarBerridge K.C.& Winkielman P. . 2003What is an unconscious emotion? The case for unconscious ‘liking’. Cogn. Emotion. 17, 181–211.doi:10.1080/02699930302289. . Crossref, PubMed, ISI, Google ScholarBliss-Moreau E., Barrett L.F.& Wright C.I. . 2008Individual differences in learning the affective value of others under minimal conditions. Emotion. 8, 479–493.doi:10.1037/1528-3542.8.4.479. . Crossref, PubMed, ISI, Google Scholar- Bliss-Moreau, E., Barrett, L. F. & Owren, M. Submitted. I like the sound of your voice: affective learning about the human voice. Google Scholar
Buchner H., Gobbele R., Wagner M., Fuchs M., Waberski T.D.& Beckmann R. . 1997Fast visual evoked potential input into human area V5. Neuroreport. 8, 2419–2422.doi:10.1097/00001756-199707280-00002. . Crossref, PubMed, ISI, Google ScholarBullier J. . 2001Integrated model of visual processing. Brain Res. Rev. 36, 96–107.doi:10.1016/S0165-0173(01)00085-6. . Crossref, PubMed, Google ScholarCarmichael S.T.& Price J.L. . 1995Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys. J. Comp. Neurol. 363, 615–641.doi:10.1002/cne.903630408. . Crossref, PubMed, ISI, Google ScholarCarmichael S.T.& Price J.L. . 1996Connectional networks within the orbital and medial prefrontal cortex of macaque monkeys. J. Comp. Neurol. 371, 179–207.doi:10.1002/(SICI)1096-9861(19960722)371:2<179::AID-CNE1>3.0.CO;2-#. . Crossref, PubMed, ISI, Google ScholarCasanova C. . 1993Response properties of neurons in area 17 projecting to the striate-recipient zone of the cat's lateralis posterior-pulvinar complex: comparison with cortico-tectal cells. Exp. Brain Res. 96, 247–259.doi:10.1007/BF00227105. . Crossref, PubMed, ISI, Google ScholarCatani M., Jones D.K., Donato R.& Ffytche D.H. . 2003Occipito-temporal connections in the human brain. Brain. 126, 2093–2107.doi:10.1093/brain/awg203. . Crossref, PubMed, ISI, Google ScholarCavada C., Company T., Tejedor J., Cruz-Rizzolo R.J.& Reinsos-Suarez F. . 2000The anatomical connections of the macaque monkey orbitofrontal cortex: a review. Cereb. Cortex. 10, 220–242.doi:10.1093/cercor/10.3.220. . Crossref, PubMed, ISI, Google ScholarChen C.M., Lakatos P., Shah A.S., Mehta A.D., Givre S.J., Javitt D.C.& Schroeder C.E. . 2007Functional anatomy and interaction of fast and slow visual pathways in macaque monkeys. Cereb. Cortex. 17, 1561–1569.doi:10.1093/cercor/bhl067. . Crossref, PubMed, ISI, Google ScholarClore G.L.& Storbeck J. Affect as information about liking, efficacy, and importance. Hearts and minds: affective influences on social cognition and behaviour& Forgas J. . 2006pp. 123–142. Eds. New York, NY:Psychology Press. Google ScholarCraig A.D. . 2002Opinion: how do you feel? Interoception: the sense of the physiological condition of the body. Nat. Rev. Neurosci. 3, 655–666. Crossref, PubMed, ISI, Google ScholarCraig A.D. . 2009How do you feel—now? The anterior insula and human awareness. Nat. Rev. Neurosci. 10, 59–70.doi:10.1038/nrn2555. . Crossref, PubMed, ISI, Google ScholarDamasio A. The feeling of what happens: body and emotion in the making of consciousness. 1999Fort Worth, TX:Harcourt College. Google ScholarDamasio A.R., Damasio H.& Van Hoesen G.W. . 1982Prosopagnosia: antomic basis and behavioral mechanisms. Am. Acad. Neurol. 32, 331–341. Google ScholarDeArmond S.J., Fusco M.M.& Dewey M.M. Structure of the human brain: a photographic atlas3rd edn.1989New York, NY:New York University Press. Google ScholarDuncan S.& Barrett L.F. . 2007Affect as a form of cognition: a neurobiological analysis. Cogn. Emotion. 21, 1184–1211.doi:10.1080/02699930701437931. . Crossref, PubMed, ISI, Google ScholarEdelman G.M. Neural Darwinism: the theory of neuronal group selection. 1987New York, NY:Basic Books Inc. Google ScholarEdelman G.M.& Tononi G. A universe of consciousness: how matter becomes imagination. 2000New York, NY:Basic Books. Google ScholarEimer M.& Holmes A. . 2007Event-related brain potential correlates of emotional face processing. Neuropsychologia. 45, 15–31.doi:10.1016/j.neuropsychologia.2006.04.022. . Crossref, PubMed, ISI, Google ScholarFfytche D.H., Guy C.N.& Zeki S. . 1995The parallel visual motion inputs into areas V1 and V5 of human cerebral cortex. Brain. 118, 1375–1394.doi:10.1093/brain/118.6.1375. . Crossref, PubMed, ISI, Google ScholarFine I., Wade A.R., Brewer A.A., May M.G., Goodman D.F., Boynton G.M., Wndell B.A.& MacLeod D.I.A. . 2003Long-term deprivation affects visual perception and cortex. Nat. Neurosci. 6, 915–916.doi:10.1038/nn1102. . Crossref, PubMed, ISI, Google ScholarFoxe J.J.& Simpson G.V. . 2002Flow of activation from V1 to frontal cortex in humans. A framework for defining “early” visual processing. Exp. Brain Res. 142, 139–150.doi:10.1007/s00221-001-0906-7. . Crossref, PubMed, ISI, Google ScholarFrey S.& Petrides M. . 2000Orbitofrontal cortex: a key prefrontal region for encoding information. Proc. Natl Acad. Sci. USA. 97, 8723–8727.doi:10.1073/pnas.140543497. . Crossref, PubMed, ISI, Google ScholarGhashghaei H.T.& Barbas H. . 2002Pathways for emotion: interactions of prefrontal and anterior temporal pathways in the amygdala of the rhesus monkey. Neuroscience. 115, 1261–1279.doi:10.1016/S0306-4522(02)00446-3. . Crossref, PubMed, ISI, Google ScholarGoodale M.A.& Milner A.D. . 1992Separate visual pathways for perception and action. Trends Neurosci. 15, 20–25.doi:10.1016/0166-2236(92)90344-8. . Crossref, PubMed, ISI, Google ScholarHabib M. . 1986Visual hypo-emotionality and prosopagnosia associated with right temporal lobe isolation. Neuropsychologia. 24, 577–582.doi:10.1016/0028-3932(86)90101-6. . Crossref, PubMed, ISI, Google ScholarHumphrey N. Seeing red: a study in consciousness. 2006Cambridge, MA:Harvard University Press. Google ScholarKlistorner A., Crewther D.P.& Crewther S.G. . 1997Separate magnocellular and parvocellular contributions from temporal analysis of the multifocal VEP. Vision Res. 37, 2161–2169.doi:10.1016/S0042-6989(97)00003-5. . Crossref, PubMed, ISI, Google ScholarKoenigs M.& Tranel D. . 2008Prefrontal cortex damage abolishes brand-cued changes in cola preference. Soc. Cogn. Affect. Neurosci. 3, 1–6.doi:10.1093/scan/nsm032. . Crossref, PubMed, ISI, Google ScholarKondo H., Saleem K.S.& Price J.L. . 2003Differential connections of the temporal pole with the orbital and medial prefrontal networks in macaque monkeys. J. Comp. Neurol. 465, 499–523.doi:10.1002/cne.10842. . Crossref, PubMed, ISI, Google ScholarKringelbach M.L. . 2005Linking reward to hedonic experience. Nat. Rev. Neurosci. 6, 691–702.doi:10.1038/nrn1747. . Crossref, PubMed, ISI, Google ScholarKringelbach M.L.& Rolls E.T. . 2004The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology. Prog. Neurobiol. 72, 341–372.doi:10.1016/j.pneurobio.2004.03.006. . Crossref, PubMed, ISI, Google ScholarKveraga K., Boshyan J.& Bar M. Magnocellular projections as the trigger of top-down facilitation in recognition. J. Neurosci. 27, 2007a13 232–13 240.doi:10.1523/JNEUROSCI.3481-07.2007. . Crossref, ISI, Google ScholarKveraga K., Ghuman A.S.& Bar M. Top-down predictions in the cognitive brain. Brain Cogn. 65, 2007b145–168.doi:10.1016/j.bandc.2007.06.007. . Crossref, PubMed, ISI, Google ScholarLamme V.A.& Roelfsema P.R. . 2000The distinct modes of vision offered by feedforward and recurrent processing. Trends Neurosci. 23, 571–579.doi:10.1016/S0166-2236(00)01657-X. . Crossref, PubMed, ISI, Google ScholarLaylock R., Crewther S.G.& Crewther D.P. . 2007A role for the “magnocellular advantage” in visual impairments in neurodevelopmental and psychiatric disorders. Neurosci. Biobehav. Rev. 31, 363–376.doi:10.1016/j.neubiorev.2006.10.003. . Crossref, PubMed, ISI, Google ScholarLeDoux J.E. . 2000Emotion circuits in the brain. Annu. Rev. Neurosci. 23, 155–184.doi:10.1146/annurev.neuro.23.1.155. . Crossref, PubMed, ISI, Google ScholarLi W., Moallem I., Paller K.A.& Gottfried J.A. . 2007Subliminal smells can guide social preferences. Psychol. Sci. 18, 1044–1049.doi:10.1111/j.1467-9280.2007.02023.x. . Crossref, PubMed, ISI, Google ScholarMcDonald A.J. . 1998Cortical pathways to the mammalian amygdala. Prog. Neurobiol. 55, 257–332.doi:10.1016/S0301-0082(98)00003-3. . Crossref, PubMed, ISI, Google ScholarMerigan W.H.& Maunsell J.H.R. . 1993How parallel are the primate visual pathways?. Annu. Rev. Neurosci. 16, 369–402.doi:10.1146/annurev.ne.16.030193.002101. . Crossref, PubMed, ISI, Google ScholarMesulam M. Behavioral neuroanatomy: large-scale networks, association cortex, frontal syndromes, the limbic system, and hemispheric specializations. Principles of behavioral and cognitive neurology& Mesulam M. 2nd edn2000pp. 1–120. Eds. New York, NY:Oxford University Press. Google ScholarMorris J.S., Ohman A.& Dolan R.J. . 1998A subcortical pathway to the right amygdala mediating “unseen” fear. Proc. Natl Acad. Sci. USA. 96, 1680–1685.doi:10.1073/pnas.96.4.1680. . Crossref, ISI, Google ScholarOliva A.& Torralba A. . 2001Modeling the shape of a scene: a holistic representation of the spatial envelope. Int. J. Comput. Vision. 42, 145–175.doi:10.1023/A:1011139631724. . Crossref, ISI, Google ScholarÖngür D.& Price J.L. . 2000The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cereb. Cortex. 10, 206–219.doi:10.1093/cercor/10.3.206. . Crossref, PubMed, ISI, Google ScholarÖngür D., An X.& Price J.L. . 1998Prefrontal cortical projections to the hypothalamus in macaque monkeys. J. Comp. Neurol. 401, 480–505.doi:10.1002/(SICI)1096-9861(19981130)401:4<480::AID-CNE4>3.0.CO;2-F. . Crossref, PubMed, ISI, Google ScholarÖngür D., Ferry A.T.& Price J.L. . 2003Architectonic subdivision of the human orbital and medial prefrontal cortex. J. Comp. Neurol. 460, 425–449.doi:10.1002/cne.10609. . Crossref, PubMed, ISI, Google ScholarPalermo R.& Rhodes G. . 2007Are you always on my mind? A review of how face perception and attention interact. Neuropsychologia. 45, 75–92.doi:10.1016/j.neuropsychologia.2006.04.025. . Crossref, PubMed, ISI, Google ScholarPaulus W., Korinth S., Wischer S.& Tergau F. . 1999Differential inhibition of chromatic and achromatic perception by transcranial magnetic stimulation of the human visual cortex. Neuroreport. 10, 1245–1248.doi:10.1097/00001756-199904260-00017. . Crossref, PubMed, ISI, Google ScholarPessoa L. . 2008On the relationship between emotion and cognition. Nat. Rev. Neurosci. 2, 148–158.doi:10.1038/nrn2317. . Crossref, ISI, Google ScholarPessoa L.& Ungerleider L.G. . 2004Neuroimaging studies of attention and the processing of emotion-laden stimuli. Prog. Brain Res. 144, 171–182.doi:10.1016/S0079-6123(03)14412-3. . Crossref, PubMed, ISI, Google ScholarPrice J.L. Connections of orbital cortex. The orbitofrontal cortex, Zald D.H.& Rauch S.L. . 2007pp. 38–56. Eds. New York, NY:Oxford University Press. Google ScholarRempel-Clower N.L.& Barbas H. . 1998Topographic organization of connections between the hypothalamus and prefrontal cortex in the rhesus monkey. J. Comp. Neurol. 398, 393–419.doi:10.1002/(SICI)1096-9861(19980831)398:3<393::AID-CNE7>3.0.CO;2-V. . Crossref, PubMed, ISI, Google ScholarRolls E.T. . 2000Précis of “The Brain and Emotion”. Behav. Brain Sci. 23, 177–191.doi:10.1017/S0140525X00002429. . Crossref, PubMed, ISI, Google ScholarRudrauf D., David O., Lachaux J.-P., Kovach C.K., Martinerie J., Renault B.& Damasio A. . 2008Rapid interactions between the ventral visual stream and emotion-related structures rely on a two-pathway architecture. J. Neurosci. 28, 2796–2803.doi:10.1523/JNEUROSCI.3476-07.2008. . Crossref, ISI, Google ScholarRussell J.A.& Barrett L.F. . 1999Core affect, prototypical emotional episodes, and other things called emotion: dissecting the elephant. J. Pers. Soc. Psychol. 76, 805–819.doi:10.1037/0022-3514.76.5.805. . Crossref, PubMed, ISI, Google ScholarSchyns P.G.& Oliva A. . 1994From blobs to boundary edges: evidence for time- and spatial-dependent scene recognition. Psychol. Sci. 5, 195–200.doi:10.1111/j.1467-9280.1994.tb00500.x. . Crossref, ISI, Google ScholarSierra M., Lopera F., Lambert M.V., Phillips M.L.& David A.S. . 2002Separating depersonalisation and derealisation: the relevance of the ‘lesion method’. J. Neurol. Neurosurg. Psychiatry. 72, 530–532. PubMed, ISI, Google ScholarSincich L.C., Park K.F., Wohlgemuth M.J.& Horton J.C. . 2004Bypassing V1: a direct geniculate input to area MT. Nat. Neurosci. 7, 1123–1128.doi:10.1038/nn1318. . Crossref, PubMed, ISI, Google ScholarStefanacci L.& Amaral D.G. . 2002Some observations on cortical inputs to the macaque monkey amygdala: an anterograde tracing study. J. Comp. Neurol. 451, 301–323.doi:10.1002/cne.10339. . Crossref, PubMed, ISI, Google Scholar- Sully, J. 1892. Outlines of psychology, vol. 2. New York, NY: Appleton and Company. Google Scholar
Torralba A.& Oliva A. . 2003Statistics of natural image categories. Network. 14, 391–412. Crossref, PubMed, ISI, Google ScholarThorpe S.J., Rolls E.T.& Maddison S. . 1983The orbitofrontal cortex: neuronal activity in the behaving monkey. Exp. Brain Res. 49, 93–115.doi:10.1007/BF00235545. . Crossref, PubMed, ISI, Google ScholarUngerleider L.G.& Mishkin M. Two cortical visual systems. Analysis of visual behavior, Ingle D.A., Goodale M.A.& Mansfield R.J.W. . 1982pp. 549–586. Eds. Cambridge, MA:MIT Press. Google ScholarVuilleumier P.& Pourtois G. . 2007Distributed and interactive brain mechanisms during emotion face perception: evidence from functional neuroimaging. Neuropsychologia. 45, 174–194.doi:10.1016/j.neuropsychologia.2006.06.003. . Crossref, PubMed, ISI, Google ScholarVuilleumier P., Armony J.L., Driver J.& Dolan R.J. . 2001Effects of attention and emotion on face processing in the human brain: an event-related fMRI study. Neuron. 30, 829–841.doi:10.1016/S0896-6273(01)00328-2. . Crossref, PubMed, ISI, Google Scholar- Wager, T. D., Barrett, L. F., Bliss-Moreau, E., Lindquist, K., Duncan, S., Kober, H., Joseph, J., Davidson, M. & Mize, J. 2008 The neuroimaging of emotion. In The handbook of emotion (eds. M. Lewis, J. M. Haviland-Jones, & L. F. Barrett), pp. 249–271, 3rd edn. New York, NY: Guilford. Google Scholar
Webster M.J., Bachevalier J.& Ungerleider L.G. . 1993Subcortical connections of inferior temporal areas TE and TEO in macaque monkeys. J. Comp. Neurol. 335, 73–91.doi:10.1002/cne.903350106. . Crossref, PubMed, ISI, Google ScholarWebster M.J., Bachevalier J.& Ungerleider L.G. . 1995Transient subcortical connections of inferior temporal areas TE and TEO in infant macaque monkeys. J. Comp. Neurol. 352, 213–226.doi:10.1002/cne.903520205. . Crossref, PubMed, ISI, Google ScholarWeiskrantz L. . 1996Blindsight revisited. Curr. Opin. Neurobiol. 6, 215–220.doi:10.1016/S0959-4388(96)80075-4. . Crossref, PubMed, ISI, Google ScholarWilson C.L., Babb T.L., Halgren E.& Crandall P.H. . 1983Visual receptive fields and response properties of neurons in human temporal lobe and visual pathways. Brain. 106, 473–502.doi:10.1093/brain/106.2.473. . Crossref, PubMed, ISI, Google ScholarWinkielman P., Berridge K.C.& Wilburger J.L. . 2005Unconscious affective reactions to masked happy versus angry faces influence consumption behavior and judgements of value. Pers. Social Psychol. Bull. 1, 121–135.doi:10.1177/0146167204271309. . Crossref, ISI, Google ScholarWundt W. Outlines of psychology. 1998Bristol, UK:Thoemmes Press(Trans L. C. H. Judd) (Original work published 1897). Google ScholarZajonc R.B. . 1980Feeling and thinking: preferences need no inferences. Am. Psychol. 35, 151–175.doi:10.1037/0003-066X.35.2.151. . Crossref, ISI, Google Scholar


