Publication Types:

(Re)creating the posture portraits: Artistic and technological (re)productions of the gendered (re)presentations of bodies at institutions of higher education

Journal paper
Baldwin, N. A., Henderson, H., Lee, S.
Body Studies Journal
Publication year: 2020


This article explores the connection of the posture portraits taken at colleges and universities as a part of modern physical education programs in the United States, in relation to the eugenics movement of the late-nineteenth and early-twentieth centuries, and the underlying assumptions of what it means to be “normal.” We examine how the reification of ideologies around health and discipline using a medicalized gaze and photographic technologies led American scientists and academics of this period to pathologize gendered, racialized people, and people with disabilities as “Other.”

In this research, we engaged in a recreation of this narrative of pathology and shame by using photography and the arts — specifically dance — to refocus the gaze as well as to critique the academic discourse at the time by celebrating the body and the participatory process of creating knowledge. More specifically, in our recreation, we focused on how transparency, agency and choice render bodies as interactive “performers” and how by engaging thoughtfully posed movements, we can make art from data, from history, and from a process of de-literalizing and de-othering.


  • Art, Eugenics, Gender, Healthism, Modernism, Physical Education, Postmodernism, Posture, Science

Acceptability, feasibility, and preliminary efficacy of a theory-based relational embodied conversational agent mobile phone intervention to promote HIV medication adherence in young HIV-positive African American MSM

Journal paper
Dworkin, M. S., Lee, S., Chakraborty, A., Monahan, C., Hightow-Weidman, L., Garofalo, R., Qato, D. M., Liu, L. C., Jimenez, A.
Journal of AIDS Education and Prevention, 31(1)
Publication year: 2019


An embodied conversational agent can serve as a relational agent and provide information, motivation, and behavioral skills. To evaluate the feasibility, acceptability, and preliminary efficacy of My Personal Health Guide, a theory-based mobile-delivered embodied conversational agent intervention to improve adherence to antiretroviral therapy in young African American men who have sex with men, we conducted this prospective pilot study using a 3-month pre–post design. Outcome measures included adherence, acceptability, feasibility, pre versus post health literacy, and pre versus post self-efficacy. There were 43 participants. Pill count adherence > 80% improved from 62% at baseline to 88% at follow-up (p = .05). The acceptability of the app was high. Feasibility issues identified included loss of usage data from unplanned participant app deletion. Health literacy improved whereas self-efficacy was high at baseline and follow-up. This pilot study of My Personal Health Guide demonstrated acceptability and preliminary efficacy in improving adherence in this important population.


  • Adherence
  • mHealth
  • HIV
  • African American MSM
  • Avatar

A realistic talking human embodied agent mobile phone intervention to promote HIV medication adherence and retention in care in young HIV-positive African American men who have sex with men: qualitative study.

Journal paper
Dworkin, M. S., Chakraborty, A., Lee, S., Monahan, C., Hightow-Weidman, L., Garofalo, R., Qato, D. M., Liu, L. C., Jimenez, A.
Journal of Medial Internet Research mHealth and uHealth, 6(7).
Publication year: 2018


BackgroundAvatars and embodied agents are a promising innovation for human health intervention because they may serve as a relational agent that might augment user engagement in a behavioral change intervention and motivate behavioral change such as antiretroviral adherence and retention in care.

ObjectiveThis study aimed to develop a theory-driven talking avatar-like embodied agent mobile phone intervention guided by the information-motivation-behavioral skills model to promote HIV medication adherence and retention in care in young African American men who have sex with men (MSM).

MethodsWe performed 5 iterative focus groups in Chicago with HIV-positive African American MSM aged 18-34 years to inform the ongoing development of a mobile phone app. Participants for the focus groups were recruited from 4 University of Illinois at Chicago Community Outreach Intervention Project sites located in different high HIV incidence areas of the city and the University of Illinois at Chicago HIV clinic using fliers and word of mouth. The focus group data analysis included developing an ongoing list of priorities for app changes and discussion between two of the investigators based on the project timeline, resources, and to what extent they served the app’s objectives.

ResultsIn this study, 16 men participated, including 3 who participated in two groups. The acceptability for an embodied agent app was universal in all 5 focus groups. The app included the embodied agent response to questions and antiretroviral regimen information, adherence tracking, CD4 count and viral load tracking, motivational spoken messages, and customizability. Concerns that were identified and responded to in the development process included privacy, stigma, avoiding the harsh or commanding tone of voice, avoiding negative motivational statements, and making reminder functions for a variety of health care interactions.

ConclusionsAn avatar-like embodied agent mHealth approach was acceptable to young HIV-positive African American MSM. Its relational nature may make it an effective method of informing, motivating, and promoting health behavioral skills. Furthermore, the app’s ease of access, stigma-free environment, and audiovisual format may help overcome some adherence barriers reported in this population.



  • adherence;
  • mHealth;
  • HIV;
  • African American;
  • men who have sex with men;
  • avatar, embodied agent

AI in informal science education: Bringing Turing back to life to perform the Turing Test.

Journal paper
Gonzalez, A. J., Hollister, J. R., DeMara, R. F., Leigh, J., Lanman, B., Lee, S., Parker, S., Walls, C., Parker, J., Wong, J., Barham, C., Wilder, B.
Journal of Artificial Intelligence in Education, 27(2)
Publication year: 2017


This paper describes an interactive museum exhibit featuring an avatar of Alan Turing that informs museum visitors about artificial intelligence and Turing’s seminal Turing Test for machine intelligence. The objective of the exhibit is to engage and motivate visiting children in the hope of sparking an interest in them about computer science and artificial intelligence, and cause them to consider pursuing future studies and/or careers in these fields. The exhibit interacts with the visitors, allowing them to participate in a simplified version of Turing’s test that is brief and informal to suit the limitations of a five-minute exhibit. In this exhibit, the visitor (targeted towards middle school age children) invokes an avatar of his/her own choice, and acts to endow it with human-like qualities (voice, brain, eyesight and hearing). Then, the visitor engages the avatar in a (brief) question-and-answer session to determine whether the visitor thinks that he/she is interacting with a real human on a video conference or with an avatar. We consider this interaction to be an extension of the original Turing Test because, unlike Turing’s original that used text via a teletype, this version features a graphical embodiment of an agent with which one can converse in spoken natural language. This extension serves to make passing the Turing Test more difficult, as now the avatar must not only communicate like a human, but also look, sound and act the part. It also makes the exhibit visual, dynamic and interesting to the visitors. Evaluations were performed with museum visitors, both in backrooms with prototypes as well as on the museum floor with the final version. The formative and summative evaluations performed indicated overall success in engaging the museum visitors and increasing their interest in computer science. More specifically, the formative testing, mostly done in quiet back rooms with selected test subjects, indicated that on the important questions about enjoyment of exhibit and increased interest in computer science by the test subjects, their self-reported Likert scale responses (1 being negative and 5 being positive) increased from 3.16 in the first evaluation to 4.38 in the third one for increased interest in CS. Likewise for the question about exhibit enjoyment (from 3.92 to 4.56). The summative evaluation, done through unobtrusive observation of exhibit use on museum floor, indicated that almost 74% of the parties that initiated the exhibit were either highly or moderately engaged by the exhibit. However, there was one major negative finding, namely the overly long duration of the exhibit, which may have caused premature abandonment of the exhibit in several cases during the summative evaluation. These tests and their results are presented and discussed in detail in this paper. The exhibit has been on permanent display at the Orlando (FL) Science Center since June 2014 and has received a strongly positive response from visitors since that time.


  • Artificial virtual humans
  • Avatars
  • Embodied conversational agents
  • Informal science education
  • Science museum exhibit
  • Turing test

Development and validation of a virtual human vignette to compare nurses’ assessment and intervention choices for pain in critically ill children

Journal paper
LaFond, C. M., Vincent, C. V., Lee, S., Corte, C., Hershberger, P.E., Johnson, A., Park, C. G., & Wilkie, D. J.
Journal of the Society for Simulation in Healthcare, 10(1), 14-20.
Publication year: 2014


As virtual experiences are increasingly used in healthcare training and research, it is important that adequate processes are applied for developing valid scenarios. We describe the development and validation of virtual human (VH) vignettes, computer-generated scenarios with animated patients and clinical information, for a mixed-methods study regarding nurses’ assessment and intervention choices for critically-ill children’s pain.

We followed the Case Development and Review Process for High-Fidelity Simulation Case Scenarios, including use of validated written vignettes and content experts. Forty nurses described their pain assessment and intervention choices for the newly derived VH vignettes and completed a pain questionnaire. Nurses’ reports of VH vignette consistency with their professional experience and recognition of VH facial expressions were evaluated to establish face validity. Their pain ratings for the VH and written (questionnaire) vignettes were evaluated for convergent validity. Qualitative content analysis, descriptive statistics, correlations, and paired t-tests were employed.

Most nurses (68.4%) supported vignette consistency with their professional experience. Facial expression recognition was 98.4%. Smiling children’s pain was rated significantly lower than grimacing children in both VH and written vignettes. Pain was rated significantly lower for grimacing children in the VH vignettes than the written vignettes. VH vignette pain ratings were strongly correlated with their written counterparts.

This process was effective for developing VH vignettes that demonstrated good face validity with participants and convergent validity with written vignettes. VH vignettes may be useful in studying the influence of facial actions on nurses’ choices for children’s pain assessment and treatment.


  • Vignettes
  • Pediatric Intensive Care
  • Pediatric Nurses
  • Children’s Pain
  • Sickle Cell Disease

Passing an enhanced turing test - Interacting with lifelike computer representations of specific individuals

Journal paper
Gonzalez, A., DeMara, R., Hung, V., Leon-Barth, C., Elvir, M., Hollister, J., Kobosko, S., Leigh, J., Johnson, A., Jones, S., Carlson, G., Lee, S., Renambot, L., Brown, M.
Journal of Intelligent Systems, 22(4), 365-415.
Publication year: 2013


This article describes research to build an embodied conversational agent (ECA) as an interface to a question-and-answer (Q/A) system about a National Science Foundation (NSF) program. We call this ECA the LifeLike Avatar, and it can interact with its users in spoken natural language to answer general as well as specific questions about specific topics. In an idealized case, the LifeLike Avatar could conceivably provide a user with a level of interaction such that he or she would not be certain as to whether he or she is talking to the actual person via video teleconference. This could be considered a (vastly) extended version of the seminal Turing test. Although passing such a test is still far off, our work moves the science in that direction. The Uncanny Valley notwithstanding, applications of such lifelike interfaces could include those where specific instructors/caregivers could be represented as stand-ins for the actual person in situations where personal representation is important. Possi- ble areas that come to mind that might benefit from these lifelike ECAs include health-care support for elderly/disabled patients in extended home care, educa- tion/training, and knowledge preservation. Another more personal application would be to posthumously preserve elements of the persona of a loved one by family members. We apply this approach to a Q/A system for knowledge preser- vation and dissemination, where the specific individual who had this knowledge was to retire from the US National Science Foundation. The system is described in detail, and evaluations were performed to determine how well the system was perceived by users.


  • Embodied conversational agents
  • Chatbots
  • Animated pedagogical agents
  • Dialogue management
  • Automated question-and-answer systems.