Special Issue on Biologically Inspired Cognitive Architectures (Selected Papers from BICA 2008, BICA 2009 and BICA 2010); Guest Editor: Alexei V. Samsonovich (George Mason Univ., USA)No Access

A PARTIAL IMPLEMENTATION OF THE BICA COGNITIVE DECATHLON USING THE PSYCHOLOGY EXPERIMENT BUILDING LANGUAGE (PEBL)

SHANE T. MUELLER

SHANE T. MUELLER

Klein Associates Division, Applied Research Associates, Inc., 1750 Commerce Center Blvd, Fairborn OH 45324, United States

Search for more papers by this author

https://doi.org/10.1142/S1793843010000497Cited by:16 (Source: Crossref)

Abstract

The Cognitive Decathlon is a proposed set of tasks that can be tested on both human and artificially intelligent agents, and which constitutes a modern specification for the Turing Test. In this paper, a partial implementation of the Cognitive Decathlon is described using the Psychology Experiment Building Language (PEBL). The tasks focus not simply on generic human abilities, but on critical skills that highlight aspects of human performance that are at odds with common artificial intelligence approaches. The differences between human and algorithmic behavior in such tasks can reveal properties of the human cognitive architecture, and production of similar behavior by artificial systems can help constrain and validate biologically-inspired systems.

Keywords:

References

L. Allender , L. Salvi and D. Promisel , Evaluation of human performance under diverse conditions via modeling technology , Proceedings of Workshop on Emerging Technologies in Human Engineering, Testing and Evaluation, NATO Research Study Group 24 ( 1997 ) . Google Scholar
F. Attneave and M. D. Arnoult, Psychological Bulletin 53, 452 (1956). Crossref, Web of Science, Google Scholar
A. Becharaet al., Cognition 50, 7 (1994). Crossref, Web of Science, Google Scholar
B. Best , Route planning and threat avoidance through cognitive robotics , Proceedings of the 2004 Winter Simulation Conference ( 2004 ) . Google Scholar
J. R. Busemeyer and J. G. Johnson, Blackwell Handbook of Judgment and Decision Making (Blackwell Publishing Co., Oxford, UK, 2004) pp. 133–154. Crossref, Google Scholar
W. J. Camara, J. S. Nathan and A. E. Puente, Professional Psychological Research and Practice 31(2), 141 (2000). Crossref, Web of Science, Google Scholar
C. A. Collin and P. A. McMullen, Behavior Research Methods 34(1), 55 (2002). Crossref, Web of Science, Google Scholar
P. M. Fitts, Journal of Experimental Psychology 47, 381 (1954). Crossref, Web of Science, Google Scholar
E. A. Fleishman, American Psychologist 30(12), 1127 (1975). Crossref, Web of Science, Google Scholar
Fleishman, E. A., Kinkade, R. G. and Chambers, A. N. [1968] "Development of a taxonomy of human performance: A review of the first year's progress," DTIC Document AD0684583. . Google Scholar
B. Försteret al., Perception 25, 1301 (1996). Crossref, Web of Science, Google Scholar
R. P. Goebel, Journal of Mathematical Psychology 34(4), 435 (1990). Crossref, Web of Science, Google Scholar
S. Harnad, Physica D 42, 335 (1989). Crossref, Web of Science, Google Scholar
S. Harnad, Minds and Machines 1, 43 (1990). Crossref, Google Scholar
S. Harnad, Journal of Logic, Language and Information 9(4), 425 (2000). Crossref, Web of Science, Google Scholar
S. Harnad , The Turing Test Sourcebook: Philosophical and Methodological Issues in the Quest for the Thinking Computer , eds. R. Epstein and G. Peters ( Kluwer , 2004 ) . Google Scholar
E. Hunt, Educational Psychologist 25(3), 223 (1990). Crossref, Web of Science, Google Scholar
L. Itti and C. Koch, Nature Reviews Neuroscience 2(3), 194 (2001). Crossref, Web of Science, Google Scholar
A. Larsen, Perception & Psychophysics 38(1), 63 (1985). Crossref, Web of Science, Google Scholar
L. J. Latecki, R. Lakaemper and D. Wolter, Image and Vision Computing Journal (IVC) 23, 227 (2005). Crossref, Web of Science, Google Scholar
S. Makeig and M. Jolley , COMPTRACK: A compensatory tracking task for monitoring alertness , Technical Document 96-3C Naval Health Research Center ( 1996 ) . Google Scholar
Mueller, S. T. [2009] "The Psychology Experiment Building Language (PEBL)," Version 0.10, http://pebl.sf.net. . Google Scholar
S. T. Mueller et al. , Adapting the Task-Taxon-Task methodology to model the impacts of chemical protective gear , Proceedings of the 19th Beh. Rep. in Modeling and Sim ( 2010 ) . Google Scholar
S. T. Mueller and B. Minnery , Adapting the Turing test for embodied neurocognitive evaluation of biologically-inspired cognitive agents , AAAI Fall Symposium on Biologically Inspired Cognitive Architectures ( 2008 ) . Google Scholar
S. T. Mueller et al. , Establishing a set of cognitive tests to predict the effect of novel protection suit design concepts , Proceedings of Chem. Bio. Defense (CBD) Science and Technology Conference ( 2006 ) . Google Scholar
S. T. Mueller et al. , A qualitative analysis of MOPP gear and the warfighter , Proceedings of the Chem. Bio. Defense (CBD) Science & Technology Conference ( 2009 ) . Google Scholar
R. D. O'Donnell, S. Moise and R. M. Schmidt, Aviation, Space, and Environmental Medicine 76, 24 (2005). Google Scholar
S. Parks , Inside HELP, Administrative and Reference Manual ( VORT Corp. , Palo Alto , 2006 ) . Google Scholar
Z. Pizloet al., Journal of Problem Solving 1(1), 83 (2006). Google Scholar
R. M. Reitan, Perc. Mot. Skills 8, 271 (1958). Crossref, Web of Science, Google Scholar
R. A. Rescorla and A. R. Wagner, Classical Conditioning II (Appleton-Century-Crofts, 1972) pp. 64–99. Google Scholar
Samsonovich, A. and Mueller, S. T. [2008] "Toward a growing computational replica of the human mind," Preface to the Papers from the AAAI Fall Symposium, Biologically Inspired Cognitive Architectures (Menlo Park, AAAI Press). . Google Scholar
R. Shepard and J. Metzler, Science 171, 701 (1970). Crossref, Web of Science, Google Scholar
R. L. Simpson and C. R. Twardy , Refining the cognitive decathlon , Proceedings of Perf. Metrics for Int. Systems (PERMIS) ( 2008 ) . Google Scholar
R. S. Sutton and A. G. Barto , Reinforcement Learning: An Introduction ( MIT Press , 1998 ) . Google Scholar
A. Treisman and G. Gelade, Cog. Psych. 12, 97 (1980). Crossref, Web of Science, Google Scholar
A. Turing, Mind LIX, 433 (1950). Crossref, Google Scholar
J. M. Wolfe, K. R. Cave and S. L. Franzel, Journal of Experimental Psychology: Human Perception and Performance 15(3), 419 (1989). Crossref, Web of Science, Google Scholar