538 Home

Objectives

Schedule

Assignments

Grading

BHI Home Page

 

BHI Research Methods

MEBI 538, Fall, '06 (listed as MEBI 598A)

Assignment Calendar:

(see below for expectations, handouts, and other details)

Date Topic Reading assignments Written assignments
Sept 29 (no class) (cancelled due to travel)  
Oct 3 Intro & Motivation Tues: none
Thurs: Three textbook intros: Shadish, pp 1--26, Friedman, pp. 17--26, Cohen, pp. 1--8.
 
Oct 10 Intro & Motivation

Tues: Three very different articles: Larkin 2000, Pettigrew 1999, and Aronsky 2001.
Thurs: Chapter 4 Friedman

Essay #1 due Tues
Oct 17 Systems eval Tues: Chpt 5 of Friedman, & Chpt 6 of Cohen
Thurs: Mooney et al, 2005
Essay #2 due Thurs
Oct 24 System eval Tues: Musen 1996, & Goldstein 2004
Thurs: Giancomini 2000, Poses 1998
Essay #3 due Thurs
Oct 31 Qualitative methods

Tues: Reddy 2006 & Chapter 9 of Friedman
Thurs: Qualy methods handouts

Final project deliverable #1 due on Thurs
Nov 7 Qualitative methods

Tue: LaPelle 2006 (special guest: Nick Anderson)
Thurs: Lock 2005 (guest lecture by Brian Brown)

Final project deliverable #2 due on Thurs
Nov 14 Qual methods (Tues cancelled due to AMIA)
Thurs: Shadish, chpts 2 & 3 (but see skim guide)
 
Nov 21 Quant methods Tue: Mohr 2003
(Thurs is Thanksgiving)
Essay #4 due Tues
Nov 28 Quant methods Tue: SNOW DAY! Class cancelled.
Thurs: Shadish, chpts 8 (entire) and 9 (279-290 only)
Final project deliverable #3 due on Tues
Dec 5 Quant methods Tue: Schriger 2000 and Shadish, chpt 4 (entire).
(special guest: George Demiris)
Thurs: Course recap
Final project deliverable #4 due on Tues
Dec 13 Final project presentations (final exam block on WED) Final project deliverable #5 & #6 due on Dec 13

I will draw material from three textbooks for this course:

Shadish, WR, Cook, TD, & Campbell, DT. (2002). Experimental and
Quasi-Experimental Designs for Generalized Causal Inference
.

Cohen, PR. (1995). Empirical Methods for Artificial Intelligence.

Friedman, CP & Wyatt, JC (1997). Evaluation Methods in Medical Informatics.

Given the cost of these texts, I do not expect students to buy all three of these. (If you want to buy one, I would probably most recommend Friedman & Wyatt.) Since there are few of you this quarter, and since I will only be using selections from these text, I (and Joan San) will prepare copies of any assigned readings from these texts.

All other reading assignments from the primary literature can be retrieved from the course Eres pages.

General expectations:

There are three categories of assignments in this class: (a) reading assignments, (b) written essays, and (c) the final project. See the final project page for information on this assignment.

To help with my goal (b), you can expect that I will grade homeworks promptly (within about a week) and be available should you want to discuss them.

Reading assignments:

In addition to (obviously) reading these prior to class, I also expect you to be able to discuss them in class. In some cases, this may require multiple readings; it certainly means that you must think about what you read, and perhaps taking some notes to help you offer discussion points and ideas during class. (As specified in the grading page, class participation is 15% of your final grade.) Reading assignments are either from textbooks, where an aspect of research methods is presented in a didactic manner, or readings from the primary literature. For the latter sort of reading, the idea is that the papers are cases or examples of different sorts of research methodologies. Thus, you should focus on these methodological aspects of the readings.

Written (essay) assignments:

First, please read my web page on a "reaction essay", as designed for the KR course (MEBI 550) that I taught in Winter '05. Although the essays for BHI Research Methods are not all "reaction essays", this description should give you a view of my perspective on writing skills and the value of a short, well-constructed essay. All of the essays for this course have the same page limit: 2 pages, 12 pt font.

All of the essays are also somewhat open-ended. My approximate grading rubric for these essays is as follows:

Organization: Does the essay have a clear opening paragraph? A good conclusion? Do paragraphs flow logically? ~30%
Content: Does the writer answer the question posed by the assignment? Is their grasp of the concepts reasonable? ~25%
Clarity (sentence level): Are sentences convoluted? Does the author use appropriate tenses? Parallel construction? ~20%
Argumentation: Is the writer logical? Is the argument convincing? ~15%
Grammar, typos, missing words ~10%

In addition to helping you think and learn about research methods, an important secondary goal of these assignments is to be able to write clearly and convincingly. So that you can learn about my expectations and improve over the course of the quarter, you can expect that I will grade homeworks promptly (within a week) and be available should you want to discuss them.

Essay #1:

Using the three assigned papers, either defend or reject the idea that all three describe research that is appropriately part of the single scientific field of "biomedical & health informatics". Given your 2-page limit, you should not summarize each of the articles, but instead focus on particular aspects of the papers that support your argument.

Essay #2:

The article by Bunescu et al (AI in Medicine, 2005; Mooney is the "corresponding" and senior author) is a good example of a systems evaluation paper. It is a formal, careful comparative study, yet has no driving hypothesis to be proven (no causal connection to be established), nor does it evaluate system use in the "real world" (it is a laboratory-only evaluation).

Use this work as a springboard for some imaginative work: Write a piece of fiction that describes more about an installation and application of some of the technologies that Bunescu et al. describe. You may either describe an observational study of the use of a fictional installation of this technology, or describe a hypothesis-testing study that investigates some effect of the technology. You should describe your experimental methods and results.

A required component of this assignment is that your fictional work must make appropriate reference to the Bunescu paper. I'd like you to make your reference as detailed as possible -- you must choose which of the AI methodologies your installation uses, and refer to the characteristics of that method that Bunescu et al describe. Of course, as fiction, you can also cite other fictional "background work", if the Bunescu results are not quite sufficient for the implementation you have in mind.

Thus, I am asking you to demostrate how exporatory, systems evaluation research can be built upon and used in more mature, hypothesis driven or real-world evaluation research.

Essay #3:

How to we decide if qualitative work is good or useful? In 1998, Poses & Isis published a rather inflammatory "perspective paper" about the use of qualitative research and its relevance & significance to practitioners of health care. [The '98 issue of J Gen Int Med also includes an explicit rebuttal by various authors. Although fun to read, I didn't find it as useful. It's also on the eres pages; consider it an optional reading assignment] Imho, one of the best rebuttals can be found in JAMA, in a pair of articles by Giacomini & Cook (2000). I've assigned the first of these articles that focuses on the quality of qualitative work.

Given these two articles, take a stand on the issue. My strong preference is that you not simply say "BHI needs to have both qualitative and quantitative research", but instead argue in favor of one approach or the other. One teaching goal for this assignment is to help you realize that although one can do good research in either tradition, in some ways the two world views are indeed in conflict with one another. You certainly need not be as dogmatic as Poses & Isis, but I want you to emphasize and argue for the strengths of one of these approaches over the other.

Essay #4:

For this essay, I'll simply ask for a regular, open-ended "reaction essay", with the explicit request that you focus on the methodology used, and (of course) the relationship between that methodology, the research question, and the reported results. By now, you should have read enough and thought about methods enough to have other results and methods to compare and contrast this reading to.

 

 

 

Assignment for Nov 16: Chapters 2 and 3 from Shadish add up to a lot of reading, some of which I consider "details". (But others may have different opinions.) From my perspective, the chapters can be "skimmed" by reading only about 40 pages:
pp. 33-47; 53-55; 63-74; 83-87; 93-102
.

 

Handouts (All are MS Word documents) :

 

Last Updated:
Nov, '06

Contact the instructor at: gennari@u.washington.edu