Comprehensive Healthcare
Work Group
Qualitative Evaluation Report
A report of activities funded by the
Health Resources and Services Administration
HIV/AIDS Bureau
Special Projects of National Significance
A collaboration of the
Comprehensive Healthcare Work Group of HRSA/HAB's SPNS Cooperative Agreement
Steering Committee
University of Nevada School of Medicine
University of Vermont & State Agricultural
College
Washington University School of Medicine
The Measurement GroupPROTOTYPES
Evaluation and Dissemination Center
Report produced by The Measurement Group
5811A Uplander Way, Culver City, California 90230 Acknowledgments
The efforts of the Comprehensive Healthcare Work Group were
led by Trudy Larson, M.D., of the University of Nevada; Karen Richardson Soons, Ph.D., of
the University of Vermont; and Karen Meredith, M.P.H., of Washington University in St.
Louis. This short version of the full report was prepared at The Measurement Group with
contributions by Lisa A. Melchior, Ph.D., George J. Huba, Ph.D., Natasha De Veauuse
Brown,
M.P.H., and Jacqueline Gelfand, M.A.
This publication is supported by Grant Numbers BRU
900113-03-0 (The Measurement GroupPROTOTYPES Evaluation and Dissemination Center),
BRU 900121-03-0 (University of Nevada School of Medicine), BRU 900109-03-0 (University of
Vermont & State Agricultural College), and BRU 900125-03-0 (Washington University
School of Medicine) from the Health Resources and Services Administration (HRSA) Special
Projects of National Significance (SPNS) Program. The publications contents are
solely the responsibility of the authors and do not necessarily represent the official
views of HRSA or HRSA/HAB's Special Projects of National Significance. Printing run of 07-23-97.
Introduction
As part of their involvement in the overall Cooperative Agreement Steering
Committee, three projects which constitute the Comprehensive Healthcare Work
Groupthe University of Nevada, the University of Vermont, and Washington
Universityhave developed an evaluation report to educate people about the
comprehensive HIV care projects, their experiences, and the valuable lessons that they
have learned. Issues discussed include program start-up and the initiation of an
evaluation system, diverse activities, common barriers, and recommendations. This report
examines these issues from the perspective of a mid-course look at the first two years of
funding for these projects.
Background and Funding
On October 1, 1994, the Special Projects of National Significance (SPNS)
Program of the Health Resources and Services Administration (HRSA) funded an HIV
Innovative Model of Care Initiative consisting of 27 cooperative agreements, HRSA, and an
Evaluation and Dissemination Center (EDC). The cooperative agreement funding mechanism was
selected to encourage projects to identify shared goals and objectives; to enable projects
to share technical expertise; and to establish a cross-cutting evaluation. At its first
meeting, the Steering Committee created five project Work Groups. This report is the first
joint report from the Work Groups and details the progress and start-up issues faced by
three projects providing comprehensive HIV/AIDS services within the context of
university-based medical institutions.
Comprehensive Healthcare Work Group
The three Comprehensive Healthcare projectsthe University of Nevada
School of Medicines Early Nutrition Intervention in HIV and AIDS project, the
University of Vermont & State Agricultural Colleges Rural HIV Service
Delivery project, and Washington University School of Medicines Helena Hatch
Special Care Center for Womenhave developed specialized medical care models
within the context of a continuum of services in a medical clinic.
The University of Vermont has developed community clinics throughout
Vermont and is determining whether patients receive appropriate and consistent care at the
satellite clinics, rather than not receiving care, or traveling great distances to a
single central site located at the state medical center. The University of Nevada has
added a nutrition component to its comprehensive AIDS care clinic and is studying the
effects of adding nutrition assessment, objective measurements, counseling, and
supplements to the treatment of wasting in AIDS patients. Both the University of Vermont
and the University of Nevada projects are providing services to largely rural patient
populations.
The Washington University project in St. Louis, Missouri, is providing a
continuum of care to women with HIV and their children within a traditional medical clinic
model, combined with aggressive community outreach and case management. The Washington
University project serves a group of inner city women, most of whom are African American.
Project Start-up and Initiation issues
The three Comprehensive Healthcare projects have identified a number of issues that
they have encountered in the initial period of program implementation. Many start-up
issues are common to some or all of the projects in this Work Group, although others are
unique to specific programs. These issues include:
- Pressure to start services immediately
- Identifying specific service model concepts
- Client recruitment/outreach
- Logistics in implementing new clinics
- Ensuring consumer participation
- Technology and information systems
Start-up issues common to these three programs include staff recruitment
and training, client recruitment and outreach, ensuring consumer participation,
integrating local and national evaluations, and other issues associated with starting up a
program that offers comprehensive medical and psychosocial services. The Vermont and
Nevada programs overcame the problems of maintaining unique consumer advisory boards by
seeking input from consumers who serve on other existing advisory groups, such as the
State Title II consumer advisory boards. Linkages with HIV test sites proved successful
for recruitment of clients at Washington University.
Another Comprehensive Healthcare project discovered significant training
issues for staff who were extremely experienced in clinical service delivery, but had
difficulty learning how to use the computers needed for clinic management and information.
Bridging the gap between clinical and technical knowledge is one that has been addressed
by training in all three projects in this Work Group.
Many of the issues faced by these programs were often due to the context
in which services are provided (e.g., rural vs. urban, working with existing staff vs.
newly hired staff). Other programs attempting to initiate comprehensive healthcare
services within university settings may face many similar issues.
Evaluation
Each of the Comprehensive Healthcare projects, as is true of other HRSA
SPNS Cooperative Agreement Projects, has a significant evaluation component. The SPNS projects
each have local evaluations that focus on the unique aspects of their service models
- The University of Nevada uses the CIPP model (Context, Input, Process, and Product),
with the goal of full, continuing and cost effective integration of nutrition into the
Early Intervention Clinic
- The University of Vermont uses initial and follow-up questionnaires, surveys, and pre-
and post- mini-residency tests to evaluate their goals involving the development of a
healthcare delivery model and HIV/AIDS education of medical providers
- Washington University incorporates the process and outcome aspects of the CIPP model and
involves qualitative assessment of areas such as enrollment rates, continuity of care,
client satisfaction with services and care received
The cross-cutting data collected by the Evaluation and Dissemination Center (EDC)
includes demographic information, medical intervention services, psychosocial intervention
services, medications, client satisfaction, health related quality of life, program
discharge/departure, and medical health indicators. These outcomes are measured comparably
so that the data may be pooled.
Selected Accomplishments
The Comprehensive Healthcare Work Group projects have undertaken a large number of
activities to increase their capacity to provide services to individuals with HIV/AIDS
living in their target populations.
University of Nevada School of Medicines Early Nutrition Intervention in
HIV and AIDS (Reno, Nevada)
- A nutritionist has been made available more frequently to provide various patient
services
- Project staff have instituted frequent nutrition screenings, routine counseling, and
intervention with HIV-infected persons before their disease process worsened
University of Vermonts Rural HIV Service Delivery Project (Burlington,
Vermont)
- Three state-of-the-art rural HIV specialty clinics became operational
- Client referrals increased by 30-35 percent
- Program staff created HIV "mini-residency" trainings for primary care
providers and medical students/residents
- Quarterly HIV/AIDS educational sessions designed for community service organizations,
mental health counselors, clergy, and associate health professionals have been held
Washington Universitys Helena Hatch Special Care Center (St. Louis,
Missouri)
- A clinic was established at Washington University Medical School
- Enrollment increased from 25 to 215 in the first two years
- Personalized care was provided, including home visits prior to the first clinic visit
- Adult and pediatric primary care clinics were combined
Barriers Encountered and Project Resolutions
In the course of their activities throughout the first two years of program funding,
the projects have identified a number of barriers to developing and implementing their
models. Barriers discussed include: (1) lack of funding/resources; (2) cooperative
agreements with agencies in the projects service network; (3) staff-related
problems; (4) enrollment and maintenance of high retention rates; (5) competing agendas
within and among institutions and communities; and (6) other barriers.
Suggested solutions to these barriers are:
- Working with Medicaid representatives and the Ryan White system to negotiate rates and
to cover non-medical and supportive services
- Unifying existing outreach activities by forming collaborative initiatives
- Clarifying roles and identifying shared missions
- Building trust through joint projects
- Communicating with and listening to all members of associated networks
- Developing clear job descriptions with objective criteria for evaluation of staff
- Providing ongoing professional development/support for project staff
- Developing retention strategies based on client feedback
- Adjusting programs based on ongoing information to provide the full array of services
- Inform patients of mechanisms in place to protect confidentiality
- Provide technical assistance to staff in evaluation issues
- Matching tasks to peoples skills and interests
- Giving feedback to stakeholders on data quality and interim findings on an ongoing basis
Summary
The three Comprehensive Healthcare projects are diverse in the locations
of their projects, the types of services they provide, the target populations they serve,
and the types of issues they face within their programs. Although each program is unique,
the Comprehensive Healthcare Work Group projects have been united by the primary goal of
developing specialized medical care models within the context of a comprehensive service
continuum in a medical clinic.
Each of the projects experienced program and evaluation start-up issues,
including staff recruitment and training, client recruitment and outreach, local and
national evaluation systems, and other issues associated with beginning a program that
offers a wide range of medical and psychosocial services. The projects also achieved
specific goals during the first two years, resulting in significant accomplishments,
project outcomes, and improvements in their service networks and in the delivery of HIV
care services to their target populations.
In an effort to supply other comprehensive HIV care programs with
information about the valuable lessons they learned during the first two years of funding,
a number of recommendations have been made by the Comprehensive Healthcare Work Group.
These recommendations include:
- Conduct initial and ongoing assessments with target populations, the base institution,
and the community regarding needs, barriers, and common goals and resources
- Develop a collaborative atmosphereboth internally and externallyin program
development and implementation
- Develop service models that are responsive to client concerns and barriers
- Establish dynamic referral/recruitment mechanisms
- Define jobs, recruit the right person, and provide incentives and ongoing training
- Establish goal-defined qualitative and quantitative evaluation plans, sharing
incremental results with clients, staff and other interested parties
- Communicate, communicate, and communicate!
All of the programs have found that flexibility and perseverance are key attributes in
building the referral networks needed to achieve their goals. It is expected that these
suggestions will prove extremely useful to other programs offering comprehensive care
services to people living with HIV/AIDS.
For Additional Information
The complete report on the Comprehensive Healthcare Work Group Qualitative Evaluation
Report is available by contacting:
The Measurement GroupPROTOTYPES
Evaluation and Dissemination Center
5811A Uplander Way, Culver City, CA 90230
-or-
The Health Resources and Services Administration,
Special Projects of National Significance Program
5600 Fishers Lane, Parklawn Building, Room 7A-08
Rockville, MD 20857.
This report is also available on the Internet at The Measurement Group web
site (www.TheMeasurementGroup.com). Additional reports and
presentations are also available.
HRSA/HAB's SPNS Steering
Committee Representatives
1996 1997
AIDS Healthcare Foundation (Peter Reis)
Center for Community Health, Education, and
Research/Haitian Community AIDS Outreach Project (Eustache Jean-Louis, M.D.)
Center for Women Policy Studies (Leslie R. Wolfe,
Ph.D.)
East Boston Neighborhood Health Center (Judith
Steinberg, M.D.)
Emory University (Jacqueline Zalumas, Ph.D.)
The Fortune Society (Tracey Gallagher)
Health Initiatives for Youth
(Ron Henderson)
Health Resources and Services Administration
(Barney
Singer, J.D.)
Hektoen Institute for Medical Research/Cook County HIV
Primary Care Center
(Mary Driscoll, R.N., M.P.H.)
Interamerican College of Physicians and Surgeons
(James
P. Tierney, M.A., M.B.A.)
Johns Hopkins University School of Medicine
(John
G. Bartlett, M.D.)
Larkin Street Services (Anne B. Stanton, M.S.W.,
C.S.W.)
Missouri Department of Health
(James M. Dempsey,
M.S.W., L.C.S.W.)
New York State Department of Health/Health Research
(Humberto
Cruz)
Outreach, Inc. (Sandra S. McDonald)
PROTOTYPES (Vivian Brown, Ph.D.)
SUNYHealth Science Center at Brooklyn
(Jill
Rips, M.A., M.Phil.)
The Measurement Group-PROTOTYPES Evaluation &
Dissemination Center
(George Huba, Ph.D.)
University of Colorado Health Sciences Center
(Donna
Anderson, Ph.D., M.P.H.)
University of Mississippi Medical Center
(Harold
M. Henderson, M.D.)
University of Nevada School of Medicine
(Trudy A.
Larson, M.D.)
University of Texas Health Science Center at San
Antonio (Victor F. German, M.D., Ph.D.)
University of Vermont & State Agricultural College
(Karen R. Soons, Ph.D.)
University of Washington (Karina K. Uldall, M.D.,
M.P.H.)
Visiting Nurse Association of Los Angeles
(David
A. Cherin, M.S.W.)
Washington University (Karen Meredith, M.P.H.,
R.N.)
Well-Being Institute (Geoffrey Smereck, J.D.)
© Copyright 1997-2005 by The Measurement Group LLC. All rights
reserved. |