HAP 786: Workshop in Health Informatics

AI Challenge

Home
 
   
 

AI system recommending wrong medication
Generated by ChatGPT

Overview

Objectives

  1. Examine how interactions between AI and patients can be evaluated through annotations
  2. Understand how patient's medical history can be simulated
  3. Understand how patient's linguistic and behavioral preference can affect interactions with the AI system

Assigned Reading for Project on Management of Depression

  • Overview of annotation task Slides► Video►
  • Annotation guidelines for evaluation of synthetic conversations about medical history Download►

Background Reading

  • Effectiveness of antidepressants PubMed►
  • Proxy measure for remission of depression symptoms PubMed►
  • Planned project on management of depression in African Americans Read►
  • Description of AI system for management of depression Read► (Use instructor's last name for password)
  • Overview of AI Challenge for management of major depressive disorder Read►

Assignment

Instruction for Submission of Assignments: Submission should follow these rules:

  1. Include a brief summary statement about who in project management teams approved your work
  2. Submit you work in Canvas.

Task 1: Complete the abstract (executive summary) for your project, as if you have completed the work.  The abstract should be structured to have the following sections:  Objective, Methods, Results, and Conclusions. The abstract should have one sentence on study objective, It should have two or three sentences on source of data and methods of analysis.  It should have on sentence on study findings.  It should have one sentence on conclusions. The purpose of writing the abstract is to check on your understanding of the task ahead.  Make sure you understand what analysis needs to be done. This assignment shows that you have understood the entire project.

Task 2, ORC New User Tutorial and Hopper Cluster Access Objective: To gain access to the Hopper high-performance computing (HPC) cluster by completing the ORC New User Tutorial, ensuring you are familiar with the cluster environment and basic operations before starting the Challenge AI Project. Step-by-Step Instructions

  1. Request a Hopper Cluster Account Go to the Hopper Quick Start Guide. Scroll to the “Getting an account” section near the top. Fill out the account request form using your GMU email ID. Wait approximately 2 days for your account to be created and activated.
  2. Access the ORC New User Tutorial in Canvas After your account is activated (within 48 hours), you should be added to the ORC New User Tutorial course on Canvas. Log into GMU Canvas and check your dashboard for the course titled “ORC New User Tutorial.”  
  3. Complete All Modules and Quizzes The tutorial consists of 6 modules. For each module: Read/watch the content thoroughly. Complete the quiz at the end of each module. After completing all modules and quizzes, fill out the Sign-Off Form. This notifies ORC that you’ve completed the tutorial.  
  4. Submit the screenshot  of completing the sign-off form

Resources available for Task 2

  • Quick start Hopper guide  Web►

Task 3: The project will provide detailed interactions between a synthetic patient and the AI system and you are asked to annotate the interaction with regard of accurate/inaccurate or unsupported interactions. The necessary files are provide in Doccano software.  Once you are finished please go to Canvas and indicate you are finished, you do not need to attach any file as the software tracks the information.

 Resources available for Task 3: 

    • 16775 relevant medical history for assessing depression treatment  Excel►
    • Overview of annotation Video►
    • Annotation medical history guidelines Slides►

 

 
Copyright © 2025 Farrokh Alemi, Ph.D. Most recent revision 05/30/2025.  This page is part of the course on Workshop in Health Informatics.