SPRING
2009
Thursday, 3-5:30, Moore 206
Ben Bergen
This
course is an introduction to simulation
semantics. Simulation semantics is a cognitively oriented theory of
meaning, based on the idea that in order to produce or understand meaningful
language, language users run a mental simulation of (that is, mentally imagine)
the content of the utterance. Running this simulation involves activating the
same brain structures that are responsible for perceiving or performing the
events described in the utterance. On this view, linguistic units do not in and
of themselves have meaning. Rather, they evoke meaning - they are cues that
contribute to a blueprint, which the speaker provides to the hearer, so that
the hearer can run an internal simulation with the desired properties.
The
course will introduce evidence for simulation semantics from neuroscience,
cognitive psychology, and psycholinguistics. Students will have the opportunity
to produce novel research in this new paradigm, and will present their work in
the course.
All
students who have taken at least an introduction to cognitive linguistics,
semantics, psycholinguistics, or experimental methods are welcome. Others
require instructor approval.
The
idea of a 700-level seminar is to encourage independent research and thinking
on the part of graduate students. In this research seminar, the main goals are
for you to read about other people's work pertaining to simulation semantics
and start working on your own research projects on simulation semantics
One important component of being an independent researcher
is developing the ability to read critically. To this end, each student will
orally present a synopsis of two readings over the course of the semester in
class. All participants will also be expected to contribute to class
discussion.
Students will write a research paper approximately 10-20
pages in length on their topic, due on May 14th. This will most
likely be a paper either addressing some previously unexplored aspect of
simulation semantics (There are many of these!) and will make use of
first-hand, empirical evidence collected by the student.
Students may work on research projects individually or
together with classmates. Collaborative projects will need to be substantially
bigger than individual ones in terms of depth and breadth - each student should
put in as much time and effort on collaborative projects as they would for
individual projects.
A little more than one month before the research paper is
due (March 19), students will hand in a one-to-three-page research paper
proposal, and will schedule a meeting with the instructor to discuss it.
Office hours will be held at a time TBA in 581 Moore Hall. If you canŐt make these times, make an appointment with me, and IŐll find another time to be available. The course website is: http://www2.hawaii.edu/~bergen/ling750M/
|
Week |
Date |
Topic |
Reading |
|
1 |
Jan
15 |
|
|
|
2 |
Jan
22 |
Basics
of simulation semantics |
R1 |
|
3 |
Jan
29 |
Empirical
methods |
R2 |
|
4 |
Feb 5 |
Mental
simulation |
R3 |
|
5 |
Feb
12 |
Visual
simulation in language processing I |
R4 |
|
6 |
Feb
19 |
R5 |
|
|
7 |
Feb
26 |
Motor
simulation in language processing I |
R6 |
|
8 |
Mar 5 |
R7 |
|
|
9 |
Mar
12 |
Grammar
and simulation I |
R8 |
|
10 |
Mar
19 |
Grammar
and simulation II Term
Project proposal due |
R9 |
|
11 |
Mar
26 |
Spring Break (no class) |
|
|
12 |
Apr 2 |
Abstract
and metaphorical language |
R10 |
|
13 |
Apr 9 |
The function of Simulation |
R11 |
|
14 |
Apr 16 |
Visual
simulation |
R12 |
|
15 |
Apr
23 |
Mirror
neurons |
R13 |
|
16 |
Apr
30 |
Perceptual
symbol systems |
R14 |
|
17 |
May 7 |
Student
reports on papers |
|
|
18 |
May
14 |
Term
Paper Due |
|
All the
readings will be available electronically, at the URLs listed below.
R1:
Basics of simulation semantics
á
Bergen,
Benjamin K. (ms.) Simulation semantics. Ch. 1., p. 1-8. http://www2.hawaii.edu/~bergen/ling750M/book/ch1.pdf
á
Barsalou, L.W. (1999). Language comprehension:
Archival memory or preparation for situated action? Discourse Processes, 28,
61-80. http://psychology.emory.edu/cognition/barsalou/papers/Barsalou_DP_1999_situated_comprehension.pdf
á
Feldman,
J. and S. Narayanan (2003). Embodiment in a Neural Theory of Language. Brain
and Language. http://www.icsi.berkeley.edu/NTL/papers/B+L.doc
á
Zwaan,
R.A. (1999). Embodied cognition, perceptual symbols, and situation models.
Discourse Processes, 28, 81-88. http://www.brain-cognition.eu/publications//zwaan-dp-99.pdf
á
Bergen,
Benjamin K. (ms.) Simulation semantics. Ch. 1., p. 9-15. http://www2.hawaii.edu/~bergen/ling750M/book/ch1.pdf
á
Bergen,
Benjamin. (2008). Experimental methods for simulation semantics. In Monica
Gonzalez-Marquez, Irene Mittelberg, Seana Coulson, and Michael J. Spivey (eds.)
Methods in Cognitive Linguistics: Ithaca. John Benjamins. http://www2.hawaii.edu/~bergen/papers/BergenEMCLchapter.doc
á
Gibbs,
Raymond W. (2008). ÔJust why should cognitive linguists care about empirical
evidence, much less want to go to the trouble of gathering it?Ő. In M. Gonzalez-Marquez (ed.). Empirical Methods in Cognitive
Linguistics. Amsterdam: John
Benjamins. http://www2.hawaii.edu/~bergen/ling750M/papers/gibbs.pdf
á
[If
needed: Hyperstat: Introduction to
ANOVA (sections 1, 2, and 6)
http://davidmlane.com/hyperstat/intro_ANOVA.html]
R3:
Mental simulation
á
Bergen,
Benjamin K. (ms.) Simulation semantics. Ch. 2. http://www2.hawaii.edu/~bergen/ling750M/book/ch2.pdf
á
Penfield, Wilder. 1958. Some mechanisms
of consciousness discovered during electrical stimulation of the brain. Proceedings of the National Academy of Sciences,
44(2).http://www2.hawaii.edu/~bergen/ling750M/papers/penfield1958.pdf
á
Kosslyn, S. M., Ball, T. M. & Reiser, B.
J. (1978). Visual images preserve metric spatial information: Evidence from studies of image scanning. Journal of
Experimental Psychology: Human Perception and Performance, 4(1), 47-60.http://www2.hawaii.edu/~bergen/ling750M/papers/kosslynetal1978.pdf
á
Lotze,
M., Montoya, P., Erb, M., Hlsmann, E., Flor, H., Klose, U., Birbaumer, N.,
& Grodd, W. (1999) Activation of cortical and cerebellar motor areas during
executed and imagined hand movements: An fMRI study, Journal of Cognitive Neuroscience, 11(5): 491-501 http://www2.hawaii.edu/~bergen/ling750M/papers/lotzeetal.pdf
á
Porro
CA, Francescato MP, Cettolo V, Diamond ME, Baraldi P, Zuian C, Bazzocchi M,
& di Prampero PE (1996) Primary motor and sensory cortex activation during
motor performance and motor imagery: a functional magnetic resonance imaging
study. J Neurosci 16:7688–7698.
http://www2.hawaii.edu/~bergen/ling750M/papers/porroetal.pdf
á
Ehrsson,
H.H., Geyer, S., and Naito, E. 2003. Imagery of voluntary movement of fingers,
toes, and tongue activates corresponding body-part specific motor
representations. J. Neurophysiol. 90: 3304-3316. http://mr.imaging-ks.nu/docs/Ehrsson_et_al_2003b.pdf
á
Nyberg, L., Petersson, K.-M., Nilsson, L.-G.,
Sandblom, J., berg, C., & Ingvar, M. (2001). Reactivation of motor brain
areas during explicit memory for actions. NeuroImage, 14, 521-528. http://www2.hawaii.edu/~bergen/ling750M/papers/nybergetal.pdf
R4:
Visual imagery in language processing I
á
Bergen,
Benjamin K. (ms.) Simulation semantics. Ch. 3. http://www2.hawaii.edu/~bergen/ling750M/book/ch3.pdf
á
Stanfield,
R.A. & Zwaan, R.A. (2001). The effect of implied orientation derived from
verbal context on picture recognition. Psych Science, 12, 153-156. http://www.brain-cognition.eu/publications//psysci2001.pdf
á
Zwaan, R.A., Stanfield, R.A., Yaxley,
R.H. (2002). Language comprehenders routinely
represent the shapes of objects? Psychological Science, 13, 168-171. http://www.brain-cognition.eu/publications//shapes.pdf
á
Richardson,
D. C., Spivey, M. J., McRae, K., & Barsalou, L. W. (2003). Spatial
representations activated during real-time comprehension of verbs. Cognitive
Science. http://www.cogstud.cornell.edu/spiveylab/spatrepresverbs.pdf
á
Bergen,
Benjamin, Shane Lindsay, Teenie Matlock, and Srini Narayanan. 2007. Spatial and
linguistic aspects of visual imagery in sentence comprehension. Cognitive
Science. http://www2.hawaii.edu/~bergen/papers/BLMN-final.pdf
á
Borghi, A. M., Glenberg,
A. M., & Kaschak, M. P. (2004). Putting words in perspective. Memory and Cognition, 32, 863-873. http://www.psy.fsu.edu/~kaschaklab/PuttingWordsInPerspective.pdf
á
Kaschak, M. P., Madden, C. J., Therriault, D. J., Yaxley, R. H.,
Aveyard, M. E., Blanchard, A. A., & Zwaan, R. A. (2005).
Perception of motion affects language processing. Cognition, 94, B79-B89. http://www.psy.fsu.edu/~kaschaklab/PerceptionOfMotion.pdf
R6: Motor imagery in language processing I
á
Bergen,
Benjamin K. (ms.) Simulation semantics. Ch. 4. http://www2.hawaii.edu/~bergen/ling750M/book/ch4.pdf
á Glenberg, A. M., & Kaschak, M. P. (2002). Grounding language in action. Psychonomic Bulletin & Review. http://psych.wisc.edu/glenberg/Papers/Grounding%20language.pdf
á
Bergen, Benjamin, Avis Chan, Shweta
Narayan, Diana Stojanovic,
and Kathryn Wheeler (submitted) Body
part representations in verbal semantics http://www2.hawaii.edu/~bergen/papers/ImageVerbPaperRevised.pdf
á
Bergen, Benjamin and Kathryn Wheeler. 2005.
Sentence Understanding Engages Motor Processes. In Proceedings of the
Twenty-Seventh Annual Conference of the Cognitive Science Society. http://www2.hawaii.edu/~bergen/papers/731-bergen.pdf
á
Chatterjee,
A. Language and space: some interactions. Trends
in Cognitive Science, 2001, 5: 55-61. http://ccn.upenn.edu/~chatterjee/anjan_pdfs/langandspace.pdf
R7:
Motor imagery in language processing II
á Buccino G., Riggio L., Melli G., Binkofski, F. , Gallese V., and Rizzolatti G. (2005) Listening to action-related sentences modulates the activity of the motor system: a combined TMS and behavioral study. Cog. Brain Res. 24: 355-363. http://www.unipr.it/arpa/mirror/pubs/pdffiles/Buccino%20et%20al%202005.pdf
á Pulvermller, F., Haerle, M., & Hummel, F. (2001). Walking or Talking?: Behavioral and Neurophysiological Correlates of Action Verb Processing Brain and Language 78, 143–168. http://www2.hawaii.edu/~bergen/ling750M/papers/WalkorTalk.pdf
á
Pulvermller, F., Hauk, O., Nikulin, V. &
Ilmoniemi, R.J. (2005) Functional interaction of
language and action: a TMS study. European Journal of Neuroscience, 21 (3),
793-797. http://www.his.sunderland.ac.uk/mirrorbot/material/mirrorbot_report8.doc
á
Tettamanti,
M., Buccino, G., Saccuman,
M.C., Gallese, V., Danna, M., Scifo,
P., Fazio, F., Rizzolatti, G., Cappa,
S.F. and Perani, D. (2005). Listening to action-related sentences activates fronto-parietal motor circuits. J Cogn.
Neurosci. 17: 273-281. http://www.unipr.it/arpa/mirror/pubs/pdffiles/Tettamanti%20et%20al%202005.pdf
R8: Grammar and Simulation I
á Madden, C.J. & Zwaan, R.A. (2003). How does verb aspect constrain event representations? Memory & Cognition, 31, 663-672. http://poseidon.eur.nl/memorylab/Publications/Madden%20&%20Zwaan%2003%20Mem%20&%20Cog%20aspect.pdf
á Bergen, Benjamin and Kathryn Wheeler (under revision). Grammatical Aspect and Mental Simulation. http://www2.hawaii.edu/~bergen/papers/aspectsim-v3submit_final_wfigs.pdf
a
Taylor, L.J. & Zwaan, R.A. (2008). Motor resonance and linguistic focus. Quarterly Journal
of Experimental Psychology, 61, 896-904. http://www.brain-cognition.eu/publications//TandZQJEP2008[1].pdf
R9: Grammar and Simulation II á
Bergen, Benjamin K. (ms.) Simulation semantics.
Ch. 7. http://www2.hawaii.edu/~bergen/ling750M/book/ch7.pdf á
Brunye,
T. T., Ditman, T., Mahoney, C. R., Augustyn, J. S., & Taylor, H. A. (in
press). When you and I share perspectives: Pronouns and perspective-taking
during narrative comprehension.
Psychological Science. http://ase.tufts.edu/psychology/spacelab/pubs/Brunye_etal_psychsci.pdf á
Wheeler, Kathryn and Benjamin Bergen (submitted)
You versus the man: Perspective in language-driven mental simulation
http://www2.hawaii.edu/~bergen/papers/perspective-draft.pdf R10: Abstract and metaphorical language á
Bergen, Benjamin K. (ms.) Simulation semantics.
Ch. 6. http://www2.hawaii.edu/~bergen/ling750M/book/ch6.pdf á
Matlock, Teenie.
(2003). Fictive motion as cognitive simulation. http://www2.hawaii.edu/~bergen/ling750M/papers/matlock.jml-fictive-final.pdf á
Gibbs,
RW, JM Bogdanovich, JR Sykes, DJ Barr. 1997. Metaphor in idiom comprehension.
Journal of Memory and Language. http://www.cogsci.ucsd.edu/~coulson/203/gibbs.pdf á
Aziz-Zadeh, L., Koski, L., Zaidel, E., Mazziotta, J., Iacoboni, M. (2006)
Lateralization of the human mirror neuron system. Journal of Neuroscience
26(11): 2964-2970. http://www-hsc.usc.edu/~lazizzad/papers/JON2006.pdf R11: The function of simulation á
Bergen, Benjamin K. (ms.) Simulation semantics.
Ch. 5. http://www2.hawaii.edu/~bergen/ling750M/book/ch5.pdf á
Glenberg,
A. M., Robertson, D. A., (2000). Symbol Grounding and Meaning: A
Comparison of High-Dimensional and Embodied Theories of Meaning. JML, 43,
379-401. http://www.uic.edu/classes/psych/psych454/glenberg.pdf á
Mahon , B.Z., & Caramazza, A. (2008). A critical look at the Embodied
Cognition Hypothesis and a new proposal for grounding conceptual content. Journal
of Physiology - Paris, 102, 59-70. http://www.wjh.harvard.edu/%7Ecaram/PDFs/2008_Mahon_Caramazza.pdf R12: Visual and Affective Simulation á
Kosslyn,
S.M., Ganis, G., and Thompson, W. L. (2001). Neural foundations of imagery.
Nature Reviews Neurosci, 2, 635 -642. http://www2.hawaii.edu/~bergen/ling750M/papers/kosslynetal.pdf á
Havas,
D. A., Glenberg, A. M., & Rinck, M. (under review).Using emotion to
understand language. http://psych.wisc.edu/glenberg/Papers/Using%20emotion.pdf á
Wheeler, M. E., Petersen, S. E., & Buckner,
R. L. (2000). MemoryŐs echo: Vivid remembering reactivates sensory specific
cortex. Proc. Natl. Acad. Sci. USA 97:
11125–11129. http://www.pnas.org/cgi/reprint/97/20/11125.pdf R13: Mirror Neurons á
Buccino,
G, Binkofski, F, Fink, G.R., Fadiga, L, Fogassi, L, Gallese, V, Seitz, R.J.,
Zilles, K, Rizzolatti, G, & Freund, H.J. (2001). Action observation
activates premotor and parietal areas in a somatotopic manner: an fMRI study. European Journal of Neuroscience 13(2):
400-404. http://www.unipr.it/arpa/mirror/pubs/pdffiles/Buccino-Binkofski%202001.pdf á
Gallese
, V., Fadiga, L., Fogassi, L., & Rizzolatti, G.. 1996. Action recognition
in the premotor cortex. Brain 119:
593-609. http://brain.oxfordjournals.org/cgi/reprint/119/2/593.pdf á
Rizzolatti,
G., Fadiga, L., Gallese, V., & Fogassi, L.. (1996).
Premotor cortex and the recognition of motor actions. Cognitive Brain Research, 3:131--141. http://www.stefan-koelsch.de/VL_BioPsych/Referate/Mirror_Function/Rizzolatti+_CognitiveBrainResearch13_02.pdf á
Shergill
et al. 2002. Modulation of activity in temporal cortex during generation of
inner speech. Human Brain Mapping 16(4):219 - 227 http://www-bmu.psychiatry.cam.ac.uk/PUBLICATION_STORE/shergill02mod.pdf R14: Perceptual symbol systems á
Bergen,
Benjamin K. (ms.) Simulation semantics. Ch. 8. http://www2.hawaii.edu/~bergen/ling750M/book/ch8.pdf á
Barsalou,
L.W. (1999). Perceptual symbol systems. Behavioral and Brain Sciences, 22,
577-609. http://psych.wisc.edu/ugstudies/Psych733/Barsalou.pdf