Generic placeholder image

Recent Patents on Engineering

Author(s): Rahul Shrivastava, Prabhat Kumar* and Sudhakar Tripathi

DOI: 10.2174/1872212113666190211145444

DownloadDownload PDF Flyer Cite As
A Human Memory Process Modeling

Page: [179 - 193] Pages: 15

  • * (Excluding Mailing and Handling)

Explore Articles
About Journal
For Authors
For Editors
For Reviewers

Abstract

Background: The cognitive models based agents proposed in the existing patents are not able to create knowledge by themselves. They also did not have the inference mechanism to take decisions and perform planning in novel situations.

Objective: This patent proposes a method to mimic the human memory process for decision making.

Methods: The proposed model simulates the functionality of episodic, semantic and procedural memory along with their interaction system. The sensory information activates the activity nodes which is a binding of concept and the sensory values. These activated activity nodes are captured by the episodic memory in the form of an event node. Each activity node has some participation strength in each event depending upon its involvement among other events. Recalling of events and frequent usage of some coactive activity nodes constitute the semantic knowledge in the form of associations between the activity nodes. The model also learns the actions in context to the activity nodes by using reinforcement learning. The proposed model uses an energy-based inference mechanism for planning and decision making.

Results: The proposed model is validated by deploying it in a virtual war game agent and analysing the results. The obtained results show that the proposed model is significantly associated with all the biological findings and theories related to memories.

Conclusion: The implementation of this model allows humanoid and game agents to take decisions and perform planning in novel situations.

Keywords: Episodic memory, semantic memory, procedural memory, encoding, forgetting, consolidation.

Graphical Abstract

[1]
J.R. Anderson, M. Matessa, and C. Lebiere, "Act-r: A theory of higher level cognition and its relation to visual attention", Hum. Comput. Interact., vol. 12, pp. 439-462, 1997.
[http://dx.doi.org/10.1207/s15327051hci1204_5]
[2]
P.S. Rosenbloom, J.E. Laird, A. Newell, and R. McCarl, "A preliminary analysis of the soar architecture as a basis for general intelligence", Artif. Intell., vol. 47, pp. 289-325, 1991.
[http://dx.doi.org/10.1016/0004-3702(91)90057-Q]
[3]
P. Langley, D. Choi, and S. Rogers, Interleaving learning, problem-solving, and execution in the icarus architecture.Stanford University, Center for the Study of Language and Information, .2005. Retrieved on February 13 2007
[4]
M. Beetz, L. Mo¨senlechner, and M. Tenorth, "Crama cognitive robot abstract machine for everyday manipulation in human environments In the 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan, ", 2010, pp. 1012-1017.
[5]
W. Wang, B. Subagdja, A.H. Tan, and J.A. Starzyk, "A self-organizing approach to episodic memory modeling In the 2010 International Joint Conference on Neural Networks (IJCNN), Barcelona,", 2010, pp. 1-8.
[http://dx.doi.org/10.1109/IJCNN.2010.5596734]
[6]
S. Nason, and J.E. Laird, "Soar-RL: Integrating reinforcement learning with Soar", Cogn. Syst. Res., vol. 6, pp. 51-59, 2005.
[http://dx.doi.org/10.1016/j.cogsys.2004.09.006]
[7]
B. Subagdja, and A.H. Tan, "Neural modeling of sequential inferences and learning over episodic memory", Neurocomputing, vol. 161, pp. 229-242, 2015.
[http://dx.doi.org/10.1016/j.neucom.2015.02.038]
[8]
A.A. Wright, H.C. Santiago, S.F. Sands, D.F. Kendrick, and R.G. Cook, "Memory processing of serial lists by pigeons, monkeys, and people", Science, vol. 229, pp. 287-289, 1985.
[http://dx.doi.org/10.1126/science.9304205 ] [PMID: 9304205]
[9]
A. Chella, M. Frixione, and A. Lieto, Representational issues in the debate on the standard model of the mind arXiv preprint arXiv:1804.08299,, 2018.
[10]
D.A. Elizondo, and S.G. Matthews, "Recent patents on computational intelligence", Recent Patents. Comput. Sci., vol. 1, pp. 110-117, 2008.
[http://dx.doi.org/10.2174/2213275910801020110]
[11]
R. Gupta, and K. Hennacy, Reluctant Episodic Memory (REM) to store experiences of everyday interactions with objects. US 7,974,938 B2, 2011.
[12]
M. Chunyan, H. Xiaogang, and S. Zhiqi, Episodic and Semantic Memory based remembrance agent modeling method and system for virtual companions. US 2015/0278688 A1, 2015.
[13]
C.J. Brainerd, and V.F. Reyna, "Fuzzy-trace theory and false memory", Curr. Directions. Psychological. Sci., vol. 11, pp. 164-169, 2002.
[http://dx.doi.org/10.1111/1467-8721.00192]
[14]
S.J. Jones, A.R. Wandzel, and J.E. Laird, Efficient computation of spreading activation using lazy evaluation.Ann Arbor, . vol. 1001, 2016, pp. 48109-2121, 2016.
[15]
E. Tulving, Organization of memory: Quo vadis.The Cognitive Neurosciences. M.S. Gazzaniga, Ed.The MIT Press, . : vol. 839847, pp. 839-853, 1995.
[16]
H.E. Atallah, M.J. Frank, and R.C. O’reilly, "Hippocampus, cortex, and basal ganglia: Insights from computational models of complementary learning systems", Neurobiol. Learn. Mem., vol. 82, pp. 253-267, 2004.
[http://dx.doi.org/10.1016/j.nlm.2004.06.004] [PMID: 15464408]
[17]
L. Shastri, "Episodic memory and cortico–hippocampal interactions", Trends Cognitive. Sci., vol. 6, pp. 162-168, 2002.
[http://dx.doi.org/10.1016/S1364-6613(02)01868-5]
[18]
L. Shastri, "From transient patterns to persistent structure: A model of episodic memory formation via cortico-hippocampal interactions", Behav. Brain Sci., 2001.
[19]
E.T. Rolls, "A computational theory of episodic memory formation in the hippocampus", Behav. Brain Res., vol. 215, pp. 180-196, 2010.
[http://dx.doi.org/10.1016/j.bbr.2010.03.027] [PMID: 20307583]
[20]
M.A. Yassa, and Z.M. Reagh, "Competitive trace theory: a role for the hippocampus in contextual interference during retrieval", Front. Behav. Neurosci., vol. 7, p. 107, 2013.
[http://dx.doi.org/10.3389/fnbeh.2013.00107 ] [PMID: 23964216]
[21]
L. Nadel, and M. Moscovitch, "Memory consolidation, retrograde amnesia and the hippocampal complex", Curr. Opin. Neurobiol., vol. 7, pp. 217-227, 1997.
[http://dx.doi.org/10.1016/s0959-4388(97)80010-4] [PMID: 9142752]
[22]
R. Shrivastava, and S. Tripathi, "Computational Model of Episodic Memory Formation, Recalling, and Forgetting", Proceedings of International Conference on Recent Advancement on Computer and Communication Springer: Singapore, . pp. 395-403, 2018.
[http://dx.doi.org/10.1007/978-981-10-8198-9_41]
[23]
E. Tulving, "Precis of elements of episodic memory", Behav. Brain Sci., vol. 7, pp. 223-238, 1984.
[http://dx.doi.org/10.1017/S0140525X0004440X]
[24]
E. Tulving, "Episodic memory: from mind to brain", Annu. Rev. Psychol., vol. 53, pp. 1-25, 2002.
[http://dx.doi.org/10.1146/annurev.psych.53.100901.135114]
[25]
T.J. Teyler, and J.W. Rudy, "The hippocampal indexing theory and episodic memory: updating the index", Hippocampus, vol. 17, pp. 1158-1169, 2007.
[http://dx.doi.org/10.1002/hipo.20350] [PMID: 17696170]
[26]
D. Johnston, and D.G. Amaral, Hippocampus In the Synaptic Organization of the Brain, G.M. Shepherd, Ed., Oxford University Press: 2004, pp. 455-498.
[http://dx.doi.org/10.1093/acprof:oso/9780195159561.003.0011]
[27]
M.A. Gluck, C. Myers, and M. Meeter, "Cortico-hippocampal interaction and adaptive stimulus representation: A neurocomputational theory of associative learning and memory", Neural Netw., vol. 18, pp. 1265-1279, 2005.
[http://dx.doi.org/10.1016/j.neunet.2005.08.003 ] [PMID: 16275027]
[28]
P.E. Gilbert, R.P. Kesner, and I. Lee, "Dissociating hippocampal subregions: A double dissociation between dentate gyrus and CA1", Hippocampus, vol. 11, pp. 626-636, 2001.
[http://dx.doi.org/10.1002/hipo.1077]
[29]
R.J. Sutherland, M.P. Weisend, D. Mumby, R.S. Astur, F.M. Hanlon, A. Koerner, M.J. Thomas, Y. Wu, S.N. Moses, C. Cole, D.A. Hamilton, and J.M. Hoesing, "Retrograde amnesia after hippocampal damage: recent vs. remote memories in two tasks", Hippocampus, vol. 11, pp. 27-42, 2001.
[http://dx.doi.org/10.1002/1098-1063(2001)11:1<27:AID-HIPO1017>3.0.CO;2-4] [PMID: 11261770]
[30]
M.T. Ullman, The declarative/procedural model: a neurobiological model of language learning, knowledge and use In the Neurobiology of Language, S.L. Small, G. Hickok, Eds., Academic Press: 2016, pp. 953-968.
[http://dx.doi.org/10.1016/B978-0-12-407794-2.00076-6]
[31]
O. Hikosaka, A. Ghazizadeh, W. Griggs, and H. Amita, "Parallel basal ganglia circuits for decision making", J. Neural Transm. (Vienna), vol. 125, pp. 515-529, 2018.
[http://dx.doi.org/10.1007/s00702-017-1691-1 ] [PMID: 28155134]
[32]
H. Mochizuki-Kawai, "Neural basis of procedural memory", Brain Nerve, vol. 60, pp. 825-832, 2008.
[PMID: 18646622]
[33]
M.J. Frank, B. Loughry, and R.C.O. Reilly, "Interactions between frontal cortex and basal ganglia in working memory: a computational model", Cogn. Affect. Behav. Neurosci., vol. 1, pp. 137-160, 2001.
[http://dx.doi.org/10.3758/cabn.1.2.137 ] [PMID: 12467110]
[34]
G.S. Berns, and T.J. Sejnowski, "A computational model of how the basal ganglia produce sequences", J. Cogn. Neurosci., vol. 10, pp. 108-121, 1998.
[http://dx.doi.org/10.1162/089892998563815] [PMID: 9526086]
[35]
M. Paletta, "Self-Organizing Multi-Agent Systems by means of Scout Movement", Recent Patents. Comput. Sci., vol. 5, pp. 197-210, 2012.
[http://dx.doi.org/10.2174/2213275911205030197]
[36]
C.E. Curtis, and M. D’Esposito, "Persistent activity in the prefrontal cortex during working memory", Trends Cogn. Sci., vol. 7, pp. 415-423, 2003.
[http://dx.doi.org/10.1016/S1364-6613(03)00197-9]
[37]
R. Cools, R.A. Barker, B.J. Sahakian, and T.W. Robbins, "Mechanisms of cognitive set flexibility in parkinson’s disease", Brain, vol. 124, pp. 2503-2512, 2001.
[http://dx.doi.org/10.1093/brain/124.12.2503] [PMID: 11701603]
[38]
A.D. Baddeley, and G. Hitch, Working memory. InPsychology of Learning and Motivation.. Academic Press: New York, NY, vol. 8, pp. 47-89, 1974.
[39]
R. Gupta, and K. Hennacy, Reluctant Episodic Memory (REM) to store experiences of everyday interactions with objects. US 7,974,938 B2, 2011.
[40]
B.L. McNaughton, and R.G. Morris, "Hippocampal synaptic enhancement and information storage within a distributed memory system", Trend Neurosci., vol. 10, pp. 408-415, 1987.
[http://dx.doi.org/10.1016/0166-2236(87)90011-7]
[41]
H. Roediger, "Remembering ebbinghaus", Contemp. Psychol., vol. 30, pp. 519-523, 1985.
[http://dx.doi.org/10.1037/023895]