Individual portal training was followed by more use of viewing functions in a 55-person Chicago HIV-care pilot. The study offers a useful distinction for digital-care teams: having an activated account, opening information and using it to improve care are separate outcomes. Its uncontrolled design cannot establish that training caused the change. Original pilot study
Almost all participants—98.2%—already had an active MyChart account. The intervention therefore mainly tested help with using an existing service, rather than bringing a previously disconnected population online.
Help with a specific task
A community health worker provided a 30-minute, individual session covering basic portal use, privacy and logging in, with additional functions tailored to each participant. The worker followed up after one month. Researchers compared recorded activity over six months before training with six months afterwards.
That approach connects support to tasks a patient might actually want to complete, such as finding information or communicating with a team. It also makes the choice of outcome important: opening a portal once during a six-month window is a different measure from using it frequently or understanding a result.
Viewing and updating did not show the same result
The proportion using any read/view function rose from 61.8% to 81.8%, an increase of 20 percentage points. The reported p-value was 0.048. Use of any write/update function rose from 56.4% to 72.7%, but that difference was not statistically significant, with a reported p-value of 0.216. Results and analysis methods
A larger number after training is therefore insufficient grounds to say every kind of use improved. The study also did not evaluate whether participants’ HIV-care outcomes improved.
“Engagement” can describe several different achievements
A separate October umbrella review illustrates the wider measurement problem. It brought together 42 reviews of digital interventions, covering concepts such as adherence, self-management and patient activation. Forty reviews were rated low or critically low in methodological quality. The authors treated favourable pooled findings as exploratory and identified important gaps in the evidence. Umbrella review and its limitations
That review does not replicate the Chicago study. It helps explain why a claim that an intervention “increases engagement” needs a named behaviour, a defined measure and a clear distinction from a health outcome.
What another service would still need to learn
The pilot involved one worker at one clinic and English-speaking adults who volunteered. People whose impairments prevented device use were excluded. With no comparison group, other changes over time could have contributed to the observed activity. These limits are especially relevant when considering people who have not enrolled or face greater access barriers. Study limitations and eligibility
The practical contribution is a more precise evaluation question: which portal task changed after support, and for whom? Our account of devices, connectivity and digital-care support covers the separate work of making participation possible in the first place.
