Faculty Profile

Alex Kirlik

Coordinated Sciences Lab
Alex Kirlik
Alex Kirlik
4220 Siebel Center for Comp Sci
201 N. Goodwin Ave.
Urbana Illinois 61801
(217) 244-8972

Education

  • Ph.D. Industrial & Systems Engineering, The Ohio State University, 1989.

Biography

Alex Kirlik is Professor in the Department of Computer Science with additional appointments in the Department of Industrial & Enterprise Systems Engineering, the Department of Electrical and Computer Engineering, the Beckman Institute for Advanced Science and Technology, and the Information Trust Institute. He previously served as acting head of Illinois's Human Factors program in the Institute of Aviation from 2006-2010. Alex earned his B.S., M.S. and Ph.D. degrees in Industrial & Systems Engineering (Human-Machine Systems) at The Ohio State University. His Ph.D. thesis, "The organization of perception and action in complex control skills" earned the George Briggs Award from APA's Division of Applied Experimental and Engineering Psychologists, as the best dissertation of the year. During his academic career, in addition to positions held with his home institutions at the University of Illinois (2002-date) and Georgia Tech (1989-2001), Alex has held visiting positions at Stanford University and NASA Ames Research Center (ASEE-NASA Stanford Summer Faculty Fellow, 1989, 1990), Yale University, Haskins Laboratory and the University of Connecticut (Visiting Scholar, 2001-02 academic year), Draper Laboratory, Cambridge, MA (Sabbatical Research, 2012-13 academic year), and the Liberty Mutual Institute for Safety (Visiting Scholar, summer 2015).

Alex's research interests include human-computer interaction, human factors visual analytics to support judgment and decision making, human-robot interaction, social computing, human-automation interaction and decision support is sociotechnical systems such as aviation, space, intelligence analysis, severe weather forecasting, disaster and emergency response, healthcare and medicine, autonomous vehicles, education and so forth.

￿ Alex's approach to teaching and mentoring students is naturally dependent of the level of instruction involved. Perhaps one notable aspect of his educational approach is that no crisp line can be drawn between his interests and activities in research and teaching. For example, he has advised 2 PhD dissertations on the development and evaluation of new techniques and technologies for teaching engineering design. His research and educational activities also dovetail in the realm of his graduate seminars, which are intensively group- and project-based, typically involving students in actual research projects to motivate and animate the course material. For example, in 2010 Alex seized on an opportunity afforded by a U.S. ￿Challenge.gov￿ Health and Human Services competition that required competing project teams to design a Facebook app that would be useful to people in the aftermath of natural disasters and emergencies. This project not only involved the students, working as a design team, to create a conceptual design for the app, but to also create a working software prototype and a video demo. The competition was open to any group who wanted to enter ￿ it was not specifically targeted to the educational community or to educational institutions. The students￿ design earned 3rd place nationally: www.hhs.gov/news/press/2012pres/02/20120223b.html His current (Spring, 2017) syllabus for his graduate course "Experimental Methods for HCI and Interactive Technologies in Engineering" can be found at: courses.engr.illinois.edu/cs598ack.html

￿

Teaching Statement

Alex's approach to teaching and mentoring students is naturally dependent of the level of instruction involved. Perhaps one notable aspect of his educational approach is that no crisp line can be drawn between his interests and activities in research and teaching. For example, he has advised 2 PhD dissertations on the development and evaluation of new techniques and technologies for teaching engineering design.

His research and educational activities also dovetail in the realm of his graduate seminars, which are intensively group- and project-based, typically involving students in actual research projects to motivate and animate the course material. For example, in 2010 Alex seized on an opportunity afforded by a U.S. ￿Challenge.gov￿ Health and Human Services competition that required competing project teams to design a Facebook app that would be useful to people in the aftermath of natural disasters and emergencies. This project not only involved the students, working as a design team, to create a conceptual design for the app, but to also create a working software prototype and a video demo. The competition was open to any group who wanted to enter ￿ it was not specifically targeted to the educational community or to educational institutions. The students￿ design earned 3rd place nationally:￿www.hhs.gov/news/press/2012pres/02/20120223b.html

His current (Spring, 2017) syllabus for his graduate course "Experimental Methods for HCI and Interactive Technologies in Engineering" can be found at: courses.engr.illinois.edu/cs598ack.html

Research Statement

Alex Kirlik￿s research program in human-computer interaction, human factors, and cognitive science & engineering has focused on understanding and supporting the cognition (judgment, decision making, prediction, problem solving and system control), of professionals working in technological workplaces, operational contexts and sociotechnical systems. His research contributing to commercial aviation safety in both airborne and ground operations has been supported by NASA for over 25 years.

Recently, aspects of these lines of research have matured into NSF- and NASA-sponsored multidisciplinary projects, joint with collaborators in aerospace, mechanical and software engineering, to create and evaluate formal techniques and general principles for the design of safe and robust cyber-physical-human systems comprised of people and hardware and software automation: Engineering Safety-Critical Cyber-Physical-Human (CPH) Systems. The aim of this research, which is relevant to applications not solely in aviation but in contexts such as healthcare and highways, is to achieve levels of human-automation system performance, robustness and safety exceeding what would be achievable by either a human or automation acting alone. A 5-minute public video demo illustrating this work in an aviation context is available at:￿www.youtube.com/watch.￿

A second major thrust of Alex's research concerns support for judgment and decision making in high-stakes tasks. This line of research developed into an NSF-sponsored project to develop and evaluate quantitative models of judgment in technological systems (e.g., KIrlik, 2006, Adaptive Perspectives on Human-Technology Interaction, NY: Oxford; see: www.oup.com/us/companion.websites/9780195171822/).

Recently, Alex also participated in an IARPA-sponsored project to develop visual analytics to support intelligence analysts in forecasting world events, and most recently, he and his multi-disciplinary team began a 3-year research project involving the design and use of domestic, aerial and ground robotics to support aging-in-place called ASPIRE: Automation Supporting Prolonged Independent Residence for the Elderly, sponsored by the National Robotics Initiative. ￿A brief video showing progress to date, presented at the October, 2016 "Aging 2.0" conference in San Francisco can be viewed at:￿https://www.youtube.com/watch?v=YoUvRaTnA8c#action=share"

Also, Alex has co-edited (with J.D. Lee) the first authoritative handbook of its kind, The Oxford Handbook of Cognitive Engineering (2013), representing the contributions of more than 60 of the discipline￿s most influential and accomplished researchers. He has been editor of the Oxford Series in Human-Technology Interaction￿for Oxford University Press for more than 10 years, a series that includes more than a dozen scholarly books and edited volumes by prominent researchers published to date: https://global.oup.com/academic/content/series/h/human-technology-interaction-series-hti/?cc=us&lang=en&

￿

￿

Undergraduate Research Opportunities

Alex often has paid or for-credit undergraduate research opportunities in both human-computer interaction and human factors.

Books Edited or Co-Edited (Original Editions)

  • Lee, J.D. & Kirlik, A. (Eds.) The Oxford Handbook of Cognitive Engineering. New York: Oxford University Press, 2013.
  • Vicente, K (Au), Kirlik, A. (Ed.). Human-Tech: Ethical and Scientific Foundations. New York, Oxford University Press, 2011.
  • Kramer, A., Weigman, D. & Kirlik, A. (Eds.). Attention: From Theory to Practice. New York, Oxford University Press, 2006.
  • Kirlik, A. (Ed). Adaptive Perspectives on Human-Technology Interaction: Methods and Models for Cognitive Engineering and Human-Computer Interaction. New York, Oxford University Press, 2006.

Chapters in Books

  • Kirlik, A., Ackerman, K., Seefeldt, B., Xargay, E., Riddle, K., Talleur, D., Carbonari, R., Sha, L. & Hovakimyan N. (2016)). Visualizing automation in aviation interfaces. In (J. Flach, P. Tsang, and M. Vidulich, Eds.), Avances in Aviation Psychology, Vol. 2. Ashgate.
  • Lee, J.D. & A. Kirlik (2013). Introduction to the handbook. In J.D. Lee & A. Kirlik, The Oxford Handbook of Cognitive Engineering. NY: Oxford University Press.
  • Kirlik, A. (2013). Judgment analysis. In J.D. Lee & A. Kirlik, The Oxford Handbook of Cognitive Engineering. NY: Oxford University Press.
  • Kirlik, A. (2012). An overview of human factors. In S.W.K Kozlowski (Ed.), The Oxford Handbook of Organizational Psychology. New York: Oxford University Press.
  • Kirlik, A. & Bertel, S. (2011). Decision making under pressure and constraints: Bounded rationality. Wiley Encyclopedia of Operations Research and Management Science. NY: Wiley.
  • Bertel, S. & Kirlik (2011). Fast and frugal heuristics. Wiley Encyclopedia of Operations Research and Management Science: NY: Wiley.
  • Kirlik, A. (2011). Introduction. In K. Vicente & A. Kirlik, Human-Tech, (pp. 3-8). NY: Oxford University Press.
  • Kirlik, A. (2011). The origins of human-tech. In K. Vicente & A. Kirlik, Human-Tech, (pp. 9-20). NY: Oxford University Press.
  • Kirlik, A. (2011). A human-tech research agenda and approach. In K. Vicente & A. Kirlik, Human-Tech, (pp. 21-30). NY: Oxford University Press.
  • Kirlik, A. (2011). Inventing possibilities: Understanding work systems and tasks. In K. Vicente & A. Kirlik, Human-Tech, (pp. 53-59). NY: Oxford University Press.
  • Kirlik, A. (2011). Psychological distance: Manipulating an interface versus controlling a system. In K. Vicente & A. Kirlik, Human-Tech, (pp. 77-83). NY: Oxford University Press.
  • Kirlik, A. (2011). Statistics for human-tech research. In K. Vicente & A. Kirlik, Human-Tech, (pp. 107-111). NY: Oxford University Press.
  • Kirlik, A. (2011). Constructing the subject: Cognitive modeling. In K. Vicente & A. Kirlik, Human-Tech, (pp. 145-156). NY: Oxford University Press.
  • Kirlik, A. (2011). Sociotechnical systems, risk, and error. In K. Vicente & A. Kirlik, Human-Tech, (pp. 191-195). NY: Oxford University Press.
  • Kirlik, A. (2011). Nested systems: Economic, cultural and political dimensions. In K. Vicente & A. Kirlik, Human-Tech, (pp. 221-225). NY: Oxford University Press.
  • Kirlik, A. and Storkerson, P. (2010). Naturalizing Peirce￿s semiotics: Ecological psychology￿s solution to the problem of creative abduction. In L. Magnani (Ed.), Model-Based Reasoning in Science and Technology: Studies in Computational Intelligence, 314, pp. 31-50. Berlin: Springer-Verlag.
  • Kirlik, A. (2007). Ecological resources for modeling interactive behavior and embedded cognition. In W. Gray (Ed.), Integrated Models of Cognitive Systems (pp. 194-210). New York: Oxford University Press.
  • Byrne, M., Kirlik, A. & M. D. Fleetwood (2007) Closing the loop on computational models of interactive human performance models in aviation. In D. Foyle & B. Hooey (Eds.), Human Performance Models in Aviation (pp. 77-104). Boca Raton: CRC Press.
  • Foyle, D.C., Hooey, B.L., Byrne, M.D., Kirlik, A., Lebiere, C., Archer, R., Corker, K., Deutsch, S., Pew, R. W., Wickens, C.D. & McCarley, J. (2007). Human performance modeling: A virtual roundtable discussion. . In D. Foyle & B. Hooey (Eds.), Human Performance Models in Aviation (pp. 285-320). Boca Raton: CRC Press.
  • Sternberg, R. J., Birney, D., Jarvin, L., Kirlik, A., Stemler, S. & E. Grigorenko (2006). From Molehill to mountain: The process of scaling up educational interventions. In R. J. Sternberg & M. Constas (Eds.), Translating Educational Theory and Research into Practice (pp. 205-222). Mahwah, NJ: Erlbaum.
  • Kirlik, A. (2006). Cognitive engineering: Toward a workable concept of mind. In A. Kirlik (Ed.), Adaptive Perspectives on Human-Technology Interaction (pp. 3-9_NY: Oxford University Press.
  • Kirlik, A. (2006). Abstracting situated action: Implications for cognitive modeling and interface design. In A. Kirlik (Ed.), Adaptive Perspectives on Human-Technology Interaction (pp. 212-226). New York: Oxford University Press.
  • Degani, A., Shafto & A. Kirlik (2006). What makes vicarious functioning work? Exploring the geometry of human-automation interaction. In A. Kirlik (Ed.), Adaptive Perspectives on Human-Technology Interaction (pp. 179-196). NY: Oxford University Press.
  • Bisantz, A., Kirlik, A., Gay, P., Walker, N. & Fisk, A.D. (2006). Knowledge versus execution in dynamic judgment tasks. In A. Kirlik (Ed.), Adaptive Perspectives on Human-Technology Interaction (pp. 29-42). NY: Oxford University Press.
  • Byrne, M. & A. Kirlik (2006). Kilograms matter: Computational cognitive modeling of closed loop dynamic decision making in system control. In A. Kirlik (Ed.), Adaptive Perspectives on Human-Technology Interaction (pp. 267-286) NY: Oxford University Press
  • Horrey, W. J., Wickens, C. D., & Stewart, T. & A. Kirlik (2006). Supporting situation assessment through attention guidance and diagnostic aiding: Benefits, costs, and the impact of automation on judgment skill. In A. Kirlik (Ed.), Adaptive Perspectives on Human-Technology Interaction (pp. 55-70). NY: Oxford U. Press.
  • Rothrock, L. & A. Kirlik (2006). A technique for inferring fast and frugal heuristics from behavioral data in dynamic, interactive judgment tasks. In A. Kirlik (Ed.), Adaptive Perspectives on Human-Technology Interaction (pp. 131-148). NY: Oxford University Press.
  • Kirlik, A. (2005). Work in progress: Reinventing intelligence for an invented world. In R. J. Sternberg and D. Preiss (Eds.), Intelligence and Technology: Impact of Tools on the Nature and Development of Human. Skills (pp. 105-134). Mahwah, NJ: Erlbaum.
  • Kirlik, A. and Strauss, R., (2001). Medical information uncertainty and the older patient: Implications for human factors and cognitive aging research. In W. Rogers and A.D. Fisk, (Eds.) Human Factors Interventions for the Health Care of Older Adults. Mahwah: NJ: Lawrence Erlbaum Associates.
  • Kirlik, A. (2001). On Gibson's review of Brunswik. In K. R. Hammond and T. Stewart, (Eds.), The Essential Brunswik: Beginnings, Explications, and Applications. NY: Oxford University Press.
  • Kirlik, A. (2001). Human factors. In K. R. Hammond and T. Stewart, (Eds.) The Essential Brunswik: Beginnings, Explications, and Applications, 238-242. NY: Oxford University Press, 2001.
  • Kirlik, A., (1998). Everyday life environments. In W. Bechtel and G. Graham, (Eds.). A Companion to Cognitive Science, Oxford: Blackwell, 1998.
  • Kirlik, A., Fisk, A.D., Walker, N. and Rothrock, L. (1998). Feedback augmentation and part-task practice in training dynamic decision making skills. In J. Cannon-Bowers and E. Salas, (Eds.), Decision Making Under Stress: Implications for Individual and Team Training Washington, DC: American Psychological Association Press.
  • Kirlik, A., and Bisantz, A., (1998). Cognition in human-machine systems: Experiential and environmental aspects of adaptation. In P. Hancock, (Ed.), Handbook of Perception and Cognition: Human Performance and Ergonomics. San Diego, CA: Academic Press.
  • Fisk, A.D., and Kirlik, A. (1996). Practical relevance and cognitive aging research: Can theory develop without application? In W. Rogers, A.D. Fisk, and N. Walker (Eds.), Aging and Skilled Performance: Advances in Theory and Application. Hillsdale, NJ: Erlbaum.
  • Kirlik, A., (1995) Requirements for psychological models to support design: Toward ecological task analysis. In J. Flach, P. Hancock, J. Caird, and K. J. Vicente, (Eds.), Global Perspectives on the Ecology of Human-Machine Systems, Hillsdale, NJ: Erlbaum.

Selected Articles in Journals

  • Kirlik, A. (2017/in-press). Automation and adaptive behavior. Journal of Cognitive Engineering and Decision Making.
  • Lin, J-H, Kirlik, A, & Xu, X. (2017). New technologies in human factors and ergonomics research and practice. Applied Ergonomics, 66, 179-181. Introduction to an edited (Lin, Kirlik, Xu) special journal issue with 19 peer-reviewed technical articles.
  • Ackerman, K., Talleur, D., Carbonari, R., Xargay, X., Seefeldt, B,, Kirlik, A., Hovakimyan, N, and Trujillo, A, (2017). Aviation situation awareness display for a flight envelope protection system. Journal of Guidance, Control and Dynamics (E-Version printed: DOI: 10.2514/1.G000338).
  • Marinho, T, Widdowson, C,, Oetting, A, Lakshmananm, A., Cui, H., Hovakimyan, N., Wang, F., Kirlik, A., Laviers, A., and Stipanovic (2016). Carebots: Prolonged elderly independence using small mobile robots. Mechanical Engineering, September, 2016.
  • Hettinger, L. J., Kirlik, A., Goh, Y. M. & Buckle, P. (2015). Modelling and simulation of complex sociotechnical systems: Envisioning and analysing work environments. Ergonomics, 58, (4), 600-614.
  • Miller, S., Bailey, B. & A. Kirlik (2014). Exploring the utility of Bayesian truth serum for assessing design knowledge. Human-Computer Interaction, 29(5-6), 487-515. 
  • Fraccone, G.C., Valenzuela-Vega, R., Siddique, S., Volovoi, V. & A. Kirlik (2013). Nested modeling of hazards associated with off-nominal scenarios in the national airspace system. Journal of Aircraft, 50(2), March-April.
  • Kirlik, A. (2012). Relevance versus generalization in cognitive engineering. (Invited) Cognition, Technology and Work, 14(3), 213-220.
  • Kirlik, A. (2010). Editorial: Brunswikian theory and method as a foundation for simulation-based research on clinical judgment. (Invited). Simulation in Healthcare, 5(5). 255-259.
  • Kirlik, A. (2009). Brunswikian resources for event perception research. Perception, Vol. 38, 376-398.
  • Weiss, D.J., Brennan, K., Thomas, R., Kirlik, A., and Miller, S.M. (2009). Criteria for performance evaluation. Judgment and Decision Making, 4(2), 164-174).
  • Araujo, D. & Kirlik, A. (2008). Toward an ecological approach to visual anticipation in sport. International Journal of Sport Psychology, Vol. 39(2), 122-140.
  • Kirlik, A. & Strauss, R. (2006). Situation awareness as judgment I: Theoretical framework, modeling, and quantitative measurement. International Journal of Industrial Ergonomics. Special Issue on New Insights in Human Performance and Decision Making, 36, 463-474.
  • Strauss, R. & Kirlik, A. (2006). Situation awareness as judgment II: Experimental evaluation and demonstration. International Journal of Industrial Ergonomics: Special Issue on New Insights in Human Performance and Decision Making. 36, 475-484.
  • Byrne, M. & Kirlik, A. (2005). Using computational cognitive modeling to diagnose possible sources of aviation error. International Journal of Aviation Psychology, 15(2), 135-155.
  • Kirlik, A. (2004). Stoffregen's analysis of affordances. Ecological Psychology, 16(1), 73-77.
  • Kirlik, A. & Maruyama, S. (2004). Human-technology interaction and music perception and performance: Toward the robust design of sociotechnical systems. Proceedings of the IEEE, Vol. 92, No. 4, 616-632.
  • Kirlik, A. (2003). Human factors distributes its workload. Review of E. Salas (Ed.), "Advances in Human Performance and Cognitive Engineering Research." Contemporary Psychology, Vol. 48, No. 6.
  • Rothrock, L. & A. Kirlik (2003). Inferring rule-based strategies in dynamic judgment tasks. IEEE Transactions on Systems, Man, and Cybernetics: Part A: Systems and Humans, 33(1) 58-72.
  • Kirlik, A. (2003). Charting a midcourse between neuroscience and cognitive science. Review of J.E.R. Staddon's, "Adaptive Dynamics: The Theoretical Analysis of Behavior." Contemporary Psychology, 48(3), 382-384.
  • Cianciolo, A. & Kirlik, A. (2003). A multi-level, differential perspective on human performance. Review of "Human Performance: Cognition, Stress, and Individual Differences" by G. Matthews, R.D. Davies, S.J. Westerman, & R. B. Stammers. Contemporary Psychology, 48(2), 221-223.
  • Kirlik, A. (2001). Life without Bayes: Judgment and decision making in Sweden (review of Juslin and Montgomery: Judgment and Decision Making: Neo-Brunswikian and Process Tracing Approaches). Applied Cognitive Psychology.
  • Bisantz, A., and Kirlik, A., (2000). Adaptivity and rule verification: An empirical investigation. International Journal of Cognitive Ergonomics, 4(1), 1-18.
  • Bisantz, A., Kirlik, A., Gay, P., Phipps, D., Walker, N., and Fisk, A.D., (2000). Modeling and analysis of a dynamic judgment task using a lens model approach. IEEE Transactions on Systems, Man, and Cybernetics, Vol. 30, 6, 605-616.
  • Degani, A., Shafto, M. and Kirlik, A. (1999). Modes in human-machine systems: Review, classification, and application. International Journal of Aviation Psychology, Vol. 9, No. 2.
  • Kirlik, A., Rediscovering Turing's brain. (1997). Commentary on Ballard. Behavioral and Brain Sciences, Vol. 20, No. 4.
  • Kirlik, A., Walker, N. and Fisk, A.D., (1996). Supporting perception in the service of dynamic decision making. Human Factors, Vol. 38, No. 2.
  • Kirlik, A., (1993). Modeling strategic behavior in human-automation interaction: Why an "aid" can (and should) go unused. Human Factors, Vol. 34, No. 2.
  • Kirlik, A., Miller, R.A., and Jagacinski, R.J., (1993). Supervisory control in a dynamic uncertain environment: A process model of skilled human-environment interaction. IEEE Transactions on Systems, Man, and Cybernetics, Vol. 23(4).
  • Kirlik, A., Jagacinski, R.J., Miller, R.A., Plamondon, IT, and Lytton, L., (1993). Supervisory control in a dynamic uncertain environment: Comparisons of one and two-person crews. IEEE Transactions on Systems, Man, and Cybernetics, Vol. 23(4), 1993.
  • Vicente, K. and Kirlik, A., Putting the cart before the horse: Taking perception seriously in unified theories of cognition. Commentary on Newell. Behavioral and Brain Sciences, Vol. 15, No. 3, 1992.

Articles in Conference Proceedings

  • Deloatch, R., Bailey, B., Kirlik, A. and Zilles (2017). I Need Your Encouragement! Requesting Supportive Comments on Social Media Reduces Test Anxiety. ACM CHI'17, May 6-11, 2017, Denver, CO.
  • Eslami, M., Karahalios, K., Sandvig, C., Vaccaro, K., Rickman, A. & Kirlik, A. (2016). First I "like" it, then I hide it: Folk Theories of Social Feeds. ACM CHI￿16, May 07 - 12, 2016, San Jose, CA, USA
  • Kirlik, A., Ackerman, K., Seefeldt, B., Xargay, E., Talleur, D., Carbonari, R., Hovakimyan, N. and Sha, L. (2015). Inverting the human/automation equation to support situation awareness and prevent loss of control. Proceedings of the 2015 International Symposium on Aviation Psychology. Dayton, OH.
  • Ackerman, K. A., S. T. Pelech, R. S. Carbonari, N. Hovakimyan, and A. Kirlik (2014). Pilot-in-the-loop flight simulator for NASA￿s Transport Class Model. In Proceedings of the AIAA Guidance, Navigation and Control Conference, National Harbor, MD.
  • Chongvisal, J., N. Tekles, E. Xargay, D. A. Talleur, A. Kirlik, and N. Hovakimyan (2014). Loss-of-control prediction and prevention for NASA￿s Transport Class Model. In Proceedings of the AIAA Guidance, Navigation and Control Conference, National Harbor, MD.
  • Deloatch, R., Marmarchi, A. & Kirlik A. (2013). Testing conditions for acquiring intuitive expertise in judgment: Evidence from a study of NCAA basketball tournament predictions. To appear in the Proceedings of the 2013 Human Factors and Ergonomics Society Annual Meeting. Santa Monica: CA.
  • Moehlenbrink, C., Manske, P. & A. Kirlik (2012). An analysis of ground traffic control decision support system based on the 3-step principle of heuristic decision making. Proc. Human Factors and Ergonomics Scciety Europe Chapter Conference. Toulouse, France.
  • Tsai, J. and Kirlik, A. (2012). Coherence and correspondence competence: Implications for the elicitation and aggregation of probabilistic forecasts of world events. Proceedings of the 2012 Human Factors and Ergonomics Society Annual Meeting. Santa Monica, CA.
  • Riddle, K., Kirlik, A., Talleur, D. and Carbonari, R. (2012). A comparison of visualization and command-based decision aiding in a simulated aircraft departure sequencing and timing task. Proceedings of the 2012 Human Factors and Ergonomics Society Annual Meeting. Santa Monica, CA.
  • Miller, S., Bailey, B.P., and Kirlik, A. (2012). Toward the development of an objective assessment technique for use in engineering design education. Proceedings of the 119th Annual American Society for Engineering Education (ASEE) Conference. San Antonio, TX.
  • Tsai, J., Miller, S. and Kirlik, A. (2011). Interactive visualizations to improve Bayesian reasoning. Proceedings of the 2011 Human Factors and Ergonomics Society Annual Meeting. Santa Monica, CA.
  • Miller, S., Kirlik, A. & Hendren, N. (2011). Applying knowledge and confidence information to predict achievement in forecasting. Proceedings of the 2011 Human Factors and Ergonomics Society Annual Meeting. Santa Monica, CA.
  • Tsai, J., Kirlik, A., Kosorukoff, A., Miller, S. (2008) Rule and instance based strategies in expert judgment. Proceedings of the 52nd Annual Meeting of the Human Factors and Ergonomics Society. Santa Monica, CA: Human Factors and Ergonomics Society.
  • Miller, S., Kirlik, A., Kosorukoff, A., Tsai, J. (2008) Supporting joint human-computer judgment under uncertainty. Proceedings of the 52nd Annual Meeting of the Human Factors and Ergonomics Society. Santa Monica, CA: Human Factors and Ergonomics Society.
  • Byrne, M. D., Kirlik, A., Allard, T., Foyle, D. C., Hooey, B. L., Gluck, K. A., Wickens, C. D., Pritchett, A. R. (2008) Issues and challenges in human performance modeling in aviation: Goals, advances, and gaps. Proceedings of the 52nd Annual Fleeting of the Human Factors and Ergonomics Society. Santa Monica, CA: Human Factors and Ergonomics Society.
  • Kirlik, A. (2007) Lessons learned from the design of the decision support system used in the hurricane Katrina evacuation decision. Proceedings of the 51st Annual Meeting of the Human Factors and Ergonomics Society. Santa Monica, CA: Human Factors and Ergonomics Society.
  • Kirlik, A., Bisantz, A., Burns, C., Cooke, N. J., Guerlain, S., Lee, J. D., Sarter, N., Serfaty, D. (2007) Design specifications for a cognitive engineering textbook. Proceedings of the 51st Annual Meeting of the Human Factors and Ergonomics Society. Santa Monica, CA: Human Factors and Ergonomics Society.
  • Kirlik, A. (2007) Conceptual and technical issues in extending computational cognitive modeling to aviation. Proceedings of Human-Computer Interaction International 2007, Beijing, China.
  • Carlson, R., Gray, W. D., Kirlik, A., Kirsh, D., Payne, S. J., Neth, H. (2007) Immediate interactive behavior: How embodied and embedded cognition uses and changes the world to achieve its goals. Proceedings of the Cognitive Science Society 2007 Annual Meeting, Nashville, TN.
  • Miller, S. & Kirlik, A. (2006). Rational analysis and the lens model. Proceedings of the Human Factors Society 2006 Meeting, San Francisco, CA.
  • Nunes, A., Kirlik, A. (2005) An empirical study of calibration in air traffic control expert judgment. Proceedings of the 49th Annual Meeting of the Human Factors and Ergonomics Society (pp. 422-426). Santa Monica, CA: Human Factors and Ergonomics Society.
  • Byrne, M. D., Kirlik, A., Fleetwood, M. D., Huss, D. G., Kosorukoff, A., Lin, R. S., Fick, C.S. (2004) A closed-loop, ACT-R approach to modeling approach and landing with and without synthetic vision system (SVS) technology. Proceedings of the 48th Annual Meeting of the Human Factors and Ergonomics Society. Santa Monica, CA: Human Factors and Ergonomics Society.
  • Rothrock, L. & A. Kirlik (2003). Explorations in modeling human decision making in dynamic contexts. Proceedings of HCI International 2003, Crete, Greece.
  • Kirlik, A. "Conducting generalizable research in the age of the field study." IEA/HFES 2000. San Diego, CA, 2000.
  • Strauss, R. and Kirlik, A. "Measuring the judgmental components of situation awareness." IEAIHFES 2000. San Diego, CA, 2000.
  • Kirlik, A. (1999). "Ecological modeling of human-machine interaction." Proceedings of the 1999 IEEE International Conference on Systems, Man, and Cybernetics, Tokyo, Japan.
  • Bisantz, A.M. and Kirlik, A., "Investigating the effect of problem format and task-related experience on evidential reasoning. " Proceedings of the Symposium on Human Interaction with Complex Systems. Dayton, OH, 1988.
  • Degani, A., and Kirlik, A., "Describing the design contributors to mode error. Proceedings of the Symposium on Human Interaction with Complex Systems. Dayton, OH, 1998.
  • Kirlik, A., (1988). The ecological expert: Acting to create information to guide action. Proceedings of the Fourth Symposium on Human Interaction with Complex Systems (HICS-98). Dayton, OH: IEEE Computer Society Press.
  • Turns, J.A and Kirlik, A. "Structural assessment to support engineering education." Proceedings of the 1998 American Society of Engineering Educators Conference, Seattle, WA, 1998.
  • Bisantz, A.M. Gay, P., Phipps, D., Walker, N., Kirlik, A., and Fisk, A.D. "Specifying training needs in a dynamic judgment task using a Lens Model approach." Proceedings of the 1997 IEEE Conference on Systems, Man, and Cybernetics. 1997.
  • Shafto, M., Degani, A. And Kirlik, A., "Canonical correlation analysis of data on human-automation interaction.￿ Proceedings of the Human Factors and Ergonomic Society Annual Meeting. Santa Monica, CA: 1997.
  • Degani, A., and Kirlik, A. "Modeling human interaction with semi-automated control systems to identify interface design problems." Proceedings of the International Symposium on Artificial Intelligence, Robotics, and Human Activity Support for Nuclear Applications. Wako-Shi, Saitama, Japan, 1997.
  • Gay, P., Phipps, D., Bisantz, A.M., Walker, N., Kirlik, A., and Fisk, A.D. "Operator specific modeling of identification judgments in a complex dynamic task." Proceedings of the Human Factors and Ergonomic Society Annual Meeting. Santa Monica, CA: 1997.
  • Kirlik, A., Rothrock, L., Walker, N. And Fisk, A.D., "Simple strategies or simple tasks? Dynamic decision making in "complex" worlds." Proceedings of the Human Factors and Ergonomics Society 40th Annual Meeting. Santa Monica, CA, 1996.
  • Walker, N., Fisk, A.D., .Phipps, D., Kirlik, A., "Training perceptual-rule-based skills." Proceedings of the Human Factors and Ergonomics Society, Santa Monica, 1995.
  • Kirlik, A., "The design of perceptually augmented displays to support interaction with dynamic systems," Proceedings of the 1995 IFAC Conference on Man-Machine Systems, Cambridge, MA, 1995.
  • Degani, A., Shafto, M. and Kirlik, A., "Modes in human-automation interaction," Proceedings of the 1995 IFAC Conference on Man-Machine Systems, Cambridge, MA, 1995.
  • Degani, A., Shafto, M., and Kirlik, A., "A modeling framework for human interaction with modal systems." Proceedings of the 1995 IEEE International Conference on. Systems, Man, and Cybernetics, Vancouver, CA, 1995.
  • Kirlik, A. "Perceptual augmentation to support skilled interaction," Proceedings of the 1993 IEEE International Conference on Systems, Man, and Cybernetics, Le Touquet, France, 1993.
  • Kirlik, A. "Requirements for design-relevant psychological models," Proceedings of the 1992 IEEE International Conference on Systems, Man., and Cybernetics, Chicago, IL, 1992.
  • Kirlik, A. and Rothrock, L., "Constraints on neural net modeling to support display design for skilled decision-making," Proceedings of the Second Workshop on Neural Networks: Academic/Industrial /NASA/Defense, Auburn, Alabama, 1991.
  • Kirlik, A., Markert, W.J., and Shively, R.J. "Perceptual and contextual influences on dynamic decision-making performance," Proceedings of the 1990 IEEE International Conference on Systems, Man, and Cybernetics, Los Angeles, CA, 1990.
  • Kirlik, A., Miller, R.A., and Jagacinski, R.J. "A process model of skilled human performance in a dynamic uncertain environment," Proceedings of the 1989 IEEE Int'l Conference on Systems, Man, and Cybernetics, Cambridge, MA, 1989.
  • Kirlik, A., Miller, R.A. and Jagacinski, R.J. "Route Planning as a Perceptual Task," Proceedings of the Twenty-Third Annual Conference on Manual Control, Cambridge, NIA, 1988.
  • Miller, R.A., Jagacinski, R.J., Plamondon, B.D., Lytton, L.E., and Kirlik, A., "A Comparison of One-and-Two-Person Crew Performance in a Supervisory Control Task," Proceedings of the Fourth Symposium on Aviation Psychology, Columbus, OH, 1987.
  • Kirlik, A., Miller, R.A., and Jagacinski, R.J. "A study of the effects of display aiding in a task with random components," Proceedings of the 1986 IEEE International Conference on Systems, Man, and Cybernetics, Atlanta, GA 1986.
  • Miller, R.A., Plamondon, B.D., Jagacinski, R.J. and Kirlik, A. "Investigation of Crew Performance in a Multi-Vehicle Supervisory Control Task," Proceedings of the Twenty-First Annual Conference on Manual Control, Columbus, OH, 1986.

Invited Lectures

  • Kirlik, A. Using Intelligent Vehicle Automation to Drive Interfaces as Well as Cars. CAR HMI Meeting, Dearborn, MI, April, 2017.
  • Kirlik, A. Two ￿NextGen￿ aviation research and implementation projects: A novel design for human-centered cockput automation, and novel schemes for air-ground coordination in continuous descent approach operations at LAX. TU Dresden Human Factors Group. Dresden, Germany, November, 2014.
  • Kirlik, A. Cognitive engineering: The analysis and design of sociotechnical systems. TU Berlin Human Factors Group. Berlin, Germany, November, 2014.
  • Kirlik, A. Two ￿NextGen￿ aviation research and implementation projects: A novel design for human-centered cockput automation, and novel schemes for air-ground coordination in continuous descent approach operations at LAX. DLR (German Aerospace Center) Human Factors Group. Braunschweig, Germany, November, 2014.
  • Kirlik, A. A multidisciplinary perspective on measuring safety and efficiency in human-automation interaction. NASA and University of Central Florida Workshop on Developing Best Practices for Measuring Safety and Efficiency in Human-Automation Systems. Chicago, IL, October, 2014.
  • Kirlik, A. The key role of perceived performance incentives in shaping strategic cognition and behavior. Georgia Tech Conference on Strategies in Human-Technical Systems. Atlanta, GA, April, 2014.
  • Kirlik, A. Supporting situation awareness in disaster preparation and response. Transportation Research Board, Washington DC, January, 2014.
  • Kirlik, A. Cognitive Engineering: Human factors as human-centered system design and evaluation. Department of Industrial Engineering, Tsinghua University, Beijing, China, December, 2013.
  • Kirlik, A. Cognitive Engineering: Human factors as human-centered system design and evaluation. China Astronaut Research and Training Center, Beijing, China, December, 2013.
  • Kirlik, A. Cognitive Engineering: Human factors as human-centered system design and evaluation. Chinese Academy of Sciences, Beijing, China, December, 2013.
  • Kirlik, A. Predictive visual analytics. Keynote, New England Chapter of the Human Factors and Ergonomics Society Conference, Cambridge, MA, April, 2013.
  • Kirlik, A. A cognitive engineering approach to the design of interactive systems. Draper Laboratory, Cambridge, MA, April, 2013.
  • Kirlik, A. Making better predictions: Especially of the future. Department of Industrial & Systems Engineering, SUNY Buffalo, March, 2013.
  • Kirlik, A. Interactive visualizations to support prediction. Department of Cognitive Science, Renssalaer Polytechnic Institute, Troy, NY, February, 2013.
  • Kirlik, A. Making better predictions. Charles River Analytics, Cambridge, MA, December, 2012.
  • Kirlik, A. The emerging toolbox of cognitive engineering models. Keynote, ￿International Conference on Cognitive Modeling.￿ Berlin, Germany, March, 2012.
  • Kirlik, A. Using interactive visualizations to support human reasoning under uncertainty. Distinguished Speaker, Faculty of Applied Science and Engineering, University of Toronto, November, 2011.
  • Kirlik, A. Human-automation interaction in aerospace systems. P.R. China Astronaut Research and Training Center and National University of Defense Technology Aero-Astro Summer School, Changsha, China, July, 2011.
  • Kirlik, A. Beyond usability: Ethical design. Keynote, "Mensch and Computer" Conference (Human-Computer Interaction), Humboldt University, Berlin, Germany, 2009.
  • Kirlik, A. Acting thoughtfully, thinking reflectively: Model based cognition and expertise. Keynote, 2009 ￿Model-Based Cognition￿ Conference, Campanas, Brazil.
  • Kirlik, A. Nudges and affordances: Can ecological psychology learn from behavioral economics? Invited Symposium on "Affordances: 25 Years Later." 15th International Conference on Perception and Action, Minneapolis, MN, 2009.
  • Kirlik, A. Supporting joint human-computer judgment under uncertainty. Department of Mechanical & Industrial Engineering, University of Iowa, 2008.
  • Kirlik, A. Comments on paper by Kenneth R. Hammond. Brunswik Society Meeting, Chicago, IL, 2008.
  • Kirlik, A. The NASA human performance modeling project. The Human Factors of NextGen conference, Arlington, TX, 2008.
  • Kirlik, A. Brunswik's cues at 50: Ecological psychology reinvents (not rediscovers) probabilistic functionalism. Brunswik Society Meeting, Chicago, IL, 2008.
  • Kirlik, A. Vicarious functioning implies representative design. Original Brunswik Meeting, Landau, Germany, 2008.
  • Kirlik, A. Collisions and other encounters. Conference to celebrate the 20th anniversary of the Center for the Ecological Study of Perception and Action, Department of Psychology, University of Connecticut, Storrs, CT, 2008.
  • Kirlik, A. On MT, for M.T. A Natural-Physical Perspective on Perception-Action-Cognition, Department of Psychology, University of Connecticut, Storrs, CT, 2008.
  • Kirlik, A. Expertise: Insights from Brunswik and Darwin. Department of Psychology, Wright State University, Dayton, OH, 2008.
  • Kirlik, A. The hurricane Katrina evacuation decision: A case study of meta-information portrayal. 2nd Annual Workshop on Meta-Information Portrayal, Washington, DC, 2007.
  • Kirlik, A. Expertise: Insights from Brunswik and Darwin. Department of Psychology, Wright State University, Dayton, OH, 2008.
  • Kirlik, A. The hurricane Katrina evacuation decision: A case study of meta-information portrayal. 2nd Annual Workshop on Meta-Information Portrayal, Washington, DC, 2007.
  • Kirlik, A. A multidimensional measure of expertise when a gold standard is lacking. Psychonomics and Brunswik Societies, 2006.
  • Kirlik, A. Cognitive Engineering. IBM TJ Watson Research Center, 2006.
  • Kirlik, A. Modeling cognition, eye, hand and technology as a Closed-Loop. College of Arts & Sciences, Illinois Wesleyan University, 2006.
  • Kirlik, A. Generalization and representative design. Lecture in honor of the retirement of Prof. Marv Dainoff. Department of Psychology, Miami University, Oxford, OH, 2005.
  • Kirlik, A. Modeling cognition, eye, hand and technology as a Closed-Loop. College of Arts & Sciences, Illinois Wesleyan University, 2006.
  • Kirlik, A. Generalization and representative design. Lecture in honor of the retirement of Prof. Marv Dainoff. Department of Psychology, Miami University, Oxford, OH, 2005.
  • Kirlik, A. Keynote: Closing the loop on cognitive models. Symposium on Integrated Models of Cognitive Systems. (Wayne Gray, Org.). Saratoga Springs, NY, 2005.
  • Kirlik, A. A University-Industry research collaboration on the human factors of Emerson's "DeltaV" digital automation for process plant control. Emerson Exchange Users Group Meeting, Dallas, TX, 2004.
  • Kirlik, A. Timely and accurate decisions. Invited panel presentation on the topic of "Time Design" at the 2004 Meeting of the Human Factors & Ergonomics Society, September, 2004.
  • Kirlik, A. Alphonse Chapanis, Egon Brunswik, and representative design in human factors. Invited panel presentation on the topic of "The Lens Model in Human Factors Research" at the 2004 Meeting of the Human Factors & Ergonomics Society, 2004.
  • Kirlik, A., Cognitive tools and augmented minds: The good, the bad, and the inevitable. Keynote address given at the 2004 Paul D. Scholz Symposium on Technology and Society. College of Engineering, University of Iowa, 2004.
  • Kirlik, A., Functional modeling of human-technology interaction. Lecture in honor of the retirement of Prof. Allen Miller, Department Chair, Industrial & Systems Engineering, the Ohio State University. 2004.
  • Kirlik, A., Success stories in cognitive engineering: Five projects. Cognitive Systems Engineering Consortium (CSEC), Dayton Ohio, 2004.
  • Kirlik, A. Closing the loop on models of cognitively-mediated interaction. Symposium on Psychology, Systems Dynamics Society Annual Conference, NY, 2003.
  • Kirlik, A. & Byrne, M., Closed-loop, dynamic modeling of pilot cognition with and without synthetic vision displays. NASA Workshop on Cognitive Modeling for Aviation Safety, System-Wide Accident Prevention Program, NASA Ames Research Center, Moffett Field, CA, March 2003.
  • Kirlik, A., The "Real world" fallacy in psychological research: Origin and alternative. Illinois State University Department of Psychology, Bloomington, IL: 2003.
  • Kirlik, A., Ecological modeling of judgment under uncertainty. Cognitive Science Program, Illinois State University, Bloomington, IL, 2003.
  • Kirlik, A., Modeling taxi errors in the tangled web of Chicago O'Hare. Brunswik Society Meeting, Kansas City, MO, November, 2002.
  • Kirlik, A., The law of the excluded middle in human-automation interaction. Panel presentation on "Training challenges for automating human cognitive processes," Human Factors & Ergonomics Society 2002 Annual Meeting, 2002.
  • Kirlik, A., Comments on Harry Heft's Ecological Psychology in Context. The 2002 North American Meeting of the International Society for Ecological Psychology, Miami, OH, 2002.
  • Kirlik, A., The multiplicity of the fundamental in psychological science. Haskins Laboratories, Yale University, New Haven, CT, 2002.
  • Kirlik, A., Understanding and supporting cognition in technological work environments. Industrial/Organizational Psychology Program, University of Connecticut, 2002.
  • Kirlik, A., Meta-Adaptivity as a new challenge and opportunity for human factors. Department of Industrial Engineering, University of Buffalo, 2002.
  • Kirlik, A., Deconstructing Fitts Law. Perception-Action Workshop, Center for the Ecological Study of Perception and Action, University of Connecticut, 2002.
  • Kirlik, A., The designed environment: theory and application. Department of Psychology, University of Connecticut, 2002.
  • Kirlik, A., Ecological validity, representative design, and the real world. Department of Psychology, Yale University, February, 2002.
  • Kirlik, A., Control, Coordination, and Improvisation in Engineering and Music. Workshop on Human Supervision and Control in Engineering and Music, Kassel, Germany, September 2001.
  • Kirlik, A., Conducting generalizable research in the age of the field study. Human Factors & Ergonomics Society Annual Meeting. Symposium on the Ecological Approach to Human Factors, San Diego, CA, Sept. 2000.
  • Kirlik, A., Information technology and the new Taylorism. Society for Work Science Annual Meeting, Marietta, GA, October 2000.
  • Kirlik, A., An ecological approach to modeling interactive behavior in dynamic tasks. Beckman Institute, Department of Psychology, and Institute of Aviation, University of Illinois. October, 2000.
  • Kirlik, A., A distributed systems view of cognition: History and future prospects. Japanese Society for the Promotion of Science, Workshop on Symbiosis on Humans, Artifacts, and the Environment. Kyoto, Japan, October 1999.
  • Kirlik, A. Ecological modeling of human-machine interaction. Invited by Organizing Committee, IEEE International Conference on Systems, Man, and Cybernetics, Tokyo, Japan, 1999.
  • Kirlik, A., What distinguishes difficult from easy tasks? Fifteenth Annual Meeting of the Brunswik Society, University of Colorado, Boulder, CO, July, 1999.
  • Kirlik, A. The cognition of normative behavior. Department of Cognitive Science, University of California, San Diego, and U. San Diego Law School. La Jolla, CA, February, 1998.
  • Kirlik, A., Analytical versus intuitive cognition in decision making. National Science Foundation Workshop on Decision Based Design. Atlanta, GA, September, 1998.
  • Kirlik, A., An ecological perspective on situated action. Department of Cognitive Science, University of California, San Diego, La Jolla, CA, April, 1997.
  • Kirlik, A., Describing the environmental contributors to mode error. International Symposium on Artificial Intelligence, Robotics, and Human Activity Support for Nuclear Applications. Wako-Shi, Saitama, Japan. November, 1997.
  • Kirlik, A., Modeling mode-based interactions. Japanese Atomic Energy Research Institute, Mito, Japan, 1997.
  • Kirlik, A., Expert versus novice, ecologically speaking: From expert knowledge to expert activity. The Human-Computer Interaction Consortium. Winter Park, CO, February, 1996.
  • Kirlik, A., Some constraints on an ecological theory of strategic action. The Eighth International Conference on Perception and Action, International Society for Ecological Psychology, Marseille, France, July, 1995.
  • Kirlik, A., Epistemic action: Or, why the world does not look at all simple to this Brunswikian. Eleventh Annual Meeting of the Brunswik Society, Los Angeles, CA, November, 1995.
  • Kirlik, A., Environmental Contributions to Skilled Performance in Dynamic Interaction. Invited Address Presented at the NASA Ames Workshop on Cognitive Modeling in Aviation, February, 1994.
  • Kirlik, A., Ecological Task Analysis: Display Design to Support Skilled Interaction. Presentation to Tri-State and Central Ohio Chapters of the Human Factors and Ergonomics Society, June, 1994.
  • Kirlik, A . & Fisk, A.D. "Training Dynamic Decision-Making Skills. Presented at the 1993 American Psychological Association Annual Meeting, Toronto, Canada, 1993.
  • Kirlik, A., Toward a Brunskwian Theory of Action. Presented at the 1993 Annual Meeting of the Brunswik Society, Washington, DC, 1993.
  • Kirlik, A., Decision-Making in the EMS Helicopter Environment. Helicopter International Meeting, Miami, FL, January, 1993.
  • Kirlik, A., Decision-Making Models. Society for Technology in Anesthesia Annual Meeting, New Orleans, LA, February, 1993.
  • Kirlik, A., Cognitive Demands in Skilled Interaction. Presented at the NASA Ames A3I Offsite Program Review Meeting, Bodega Bay, CA, January, 1993.
  • Kirlik, A., Describing the Environment for Complex Skills: Dynamic Affordance Distributions and their Specifying Information. Presented to the Emory University Department of Psychology, February 1992.
  • Kirlik, A., Introduction to Cognitive Engineering. Presented to the IBM SHARE Users Group, Atlanta, GA, August, 1992.
  • Kirlik, A. Markov Decision Process Modeling of Strategic Behavior. ORSA/TIMS Meeting, Orlando, FL, 1992.
  • Kirlik, A., Ecological Task Analysis: What Every Good Designer Already Knows. Invited presentation to University of Toronto Human Factors Chapter. October, 1992.
  • Kirlik, A. Dynamic Affordance Distributions. Presented to the 1991 Meeting of The International Society for Ecological Psychology, Urbana, IL, June 1991.
  • Kirlik, A., An Interactive Optimization Method for Cockpit Display Layout Analysis. Presented to the NASA Ames Research Center Army Aircraft-Aircrew Integration Program, July, 1989.
  • Kirlik, A., A Process Model of Supervisory/ Manual Control Behavior: Toward a Perceptual View of Skilled Decision-Making. Presented to the NASA Ames Research Center Rotorcraft Human Factors Branch, July, 1989.
  • Kirlik, A., The Acquisition and Production of Skill in Dynamic Decision-Making Tasks. Presented to the NASA-ASEE Stanford Summer Faculty Fellowship Program 1989.