Publication Details
Title: Operations on Multimodal Records: Towards a Computational Cognitive Linguistics
Author: A. Buller
Group: ICSI Technical Reports
Date: June 1995
PDF: ftp://ftp.icsi.berkeley.edu/pub/techreports/1995/tr-95-027.pdf
Overview:
The report discusses a cognitive model in which a key concept Multimodal Record (MMR)-an organized aggregate of transcripts of signals representing all information an Agent continuously acquired for a certain period of time. The MMR consists of a video track, sound track, and a number of tracks containing transcripts of the values of temperature, pressure, etc., as well as transcripts of states of the Agent's internal structure.Three basic operations on MMRs, i.e. multimodal difference (m-), multimodal union (m+) and multimodal intersection (m*), to be performed using neural network has been introduced. Based on the operations one can explain and/or implement a number of psycho- linguistic phenomena. MMR may be considered as a computable form of Image Scheme - the basic concept of Lakoff-Langacker Cognitive Grammar. Hence, the proposed model seems to be a bridge over the gap between the non-computational Cognitive Linguistics and an applied neurocomputing. Moreover, it may be considered as a step towards a unified symbolic-connectionist paradigm. Key words: Cognitive Grammar, Neurocomputing, Language acquisition
Bibliographic Information:
ICSI Technical Report TR-95-027
Bibliographic Reference:
A. Buller. Operations on Multimodal Records: Towards a Computational Cognitive Linguistics. ICSI Technical Report TR-95-027, June 1995
Author: A. Buller
Group: ICSI Technical Reports
Date: June 1995
PDF: ftp://ftp.icsi.berkeley.edu/pub/techreports/1995/tr-95-027.pdf
Overview:
The report discusses a cognitive model in which a key concept Multimodal Record (MMR)-an organized aggregate of transcripts of signals representing all information an Agent continuously acquired for a certain period of time. The MMR consists of a video track, sound track, and a number of tracks containing transcripts of the values of temperature, pressure, etc., as well as transcripts of states of the Agent's internal structure.Three basic operations on MMRs, i.e. multimodal difference (m-), multimodal union (m+) and multimodal intersection (m*), to be performed using neural network has been introduced. Based on the operations one can explain and/or implement a number of psycho- linguistic phenomena. MMR may be considered as a computable form of Image Scheme - the basic concept of Lakoff-Langacker Cognitive Grammar. Hence, the proposed model seems to be a bridge over the gap between the non-computational Cognitive Linguistics and an applied neurocomputing. Moreover, it may be considered as a step towards a unified symbolic-connectionist paradigm. Key words: Cognitive Grammar, Neurocomputing, Language acquisition
Bibliographic Information:
ICSI Technical Report TR-95-027
Bibliographic Reference:
A. Buller. Operations on Multimodal Records: Towards a Computational Cognitive Linguistics. ICSI Technical Report TR-95-027, June 1995