Georgetown University's Health Systems Administration
 

Process Improvement

 


Rubric for Evaluating the Benchmarking Assignment

When you are learning a topic, you learn better by teaching it.  To accomplish this goal, from time to time we ask you to comment on another student's work.  To help you do so we provide a rubric that you need to follow closely.  This rubric applies to the project on Benchmarking Clinicians.

Where do I get the student's work?

It is your responsibility to arrange to receive a student's work.  You can find other students currently in class by visiting a password protected page.  You can exchange your work with the same student.  Keep in mind that you are required to make your comments within 48 hours of receiving a copy of the work.  Because voice files are large, mail a compact disk to the student involved; emails will not work well as many service providers have limits on size of attachments to emails.

Where do I send the comments?

Email responses to the following questions to both the student from whom you received the assignment and to the instructor.  Make sure that each section is properly identified.  Maintain a copy for yourself.

What should be included?

Administrative

Make a comment in every section.  Follow the structure provided and do not provide free-form comments. 

What is the title of the work being reviewed?

What are the initials of the student whose work is being reviewed? 

 

What are your initials?

 

What date you received the work (use format MM/DD/YY)?

What is your email (in the format name@server.com)?

What is the email of the student that provided you with the work you have reviewed?

Presentation format

No Adjectives
Do not use adjectives in your comments.
Instead, describe why you liked a piece
by giving details of what you liked.

Full sentences

Always write full sentences, with a subject,
verb and object.  Always end with a period.

What worked well in the presentation?  Discuss at least one aspect of the project that was presented well (provide a complete sentence ending with a period.  Make sure the sentence has a subject, verb and an object.)

 

Was the voice recording easy to hear?

The volume of the recording changed unnecessarily 
The recording was not loud enough to easily understand the content?

Was the visual presentation appealing? 

The font used in Slides was too small and difficult to read
The numbers reported had more digits than the justified by the precision these estimates were obtained (Maximum of 2 digits after a period)
The narration was verbatim from the slides 
The use of color and graphics did not help the narration  

Was the length of the presentation appropriate? 

Too many slides used, typically because the presentation did not focus on the analysis and spent a great deal of time describing the field or making introductory comments. 
There were too many or too few slides.  5-7 slides were expected.
Narration of some slides exceeded 2 minutes

Was privacy of sources maintained?

References to name of organizations was not removed
Slide discussing whether the slide show can be posted was not present
Personal information was not stripped from the presentation
Expert was not identified by initials

Content

What worked well in the way the model was constructed?   Please use complete sentences with appropriate punctuations. 

 

Was the benchmarking project correctly setup?

No severity scores were used nor was there a clear attempt to match patients feature by feature
The appropriate existing literature was not reviewed (e.g. source of what features were included was not clear).
The case by case data from which the estimates were provided was not presented. 

Was the analysis correct? 

The expected outcome for each clinician was not calculated or calculated correctly

The expected outcome for Dr. Smith's patients taken care of by Dr. Jones is:

Expected stay = 0.85*(0.85*4.5+0.15*(0.3*5+0.7*4))+0.15*(0.7*(0.45*3+0.55*4)+0.3*(0.85*2+0.15*4)) = 3.68

These calculations are based on the following figure.  Note how the upper right hand corner outcomes are replaced with the expected value of the outcome for patients with MI and CHF of Dr. Jones:

The expected outcomes of Dr. Jones' patients taken care of by Dr. Smith is:

Expected stay = =0.85*(0.85*4.5+0.15*(0.3*5+0.7*4))+0.15*(0.7*(0.45*3+0.55*4)+0.3*(0.85*2+0.15*4)) = 4.28

These calculations are based on the following figure:

Please note how Dr. Jones' tree was truncated to only MI and CHF patients, removing the segment on BP<90.  This was done because Dr. Smith has not taken care of any patients with MI, CHF and BP<90.

The expected outcome of one clinician seeing the patient of another was not calculated correctly or not reported.

Suggestions for Improvements

Contrast the work done with your own effort.  Describe what you learned from the work you have reviewed that could help you in the future?  Please use complete sentences with appropriate punctuations. 

 

Suggest what the student might want to do to further improve the assignment.   Please use complete sentences with appropriate punctuations. 

 

Before you submit your work, check that all entries are correct sentences, with a subject, verb and object.  Always end with a period.  You can include this page in the email

 


This page is part of the course on Decision Analysis for Healthcare.  It was first created in 2006.  It was last edited on 10/21/2011 by Farrokh Alemi, Ph.D.  © Copyright protected.