News Release

Improving health outcomes with a little help from our friends -- and artificial intelligence

Medical University of South Carolina researchers identified socially isolated prostate cancer patients with 90 percent accuracy by parsing physicians' notes using natural language processing, a type of artificial intelligence

Peer-Reviewed Publication

Medical University of South Carolina

Dr. Chanita Hughes-Halbert, Medical University of South Carolina

image: Dr. Chanita Hughes-Halbert of the Medical University of South Carolina and Hollings Cancer Center studies social determinants of health and health disparities. view more 

Credit: Sarah Pack, Medical University of South Carolina

We fare better during health challenges when we have a little help from our friends, family and community. And perhaps an assist from artificial intelligence.

Researchers at the Medical University of South Carolina (MUSC) trained natural language processing (NLP) software to look for mentions of social isolation in clinical notes in the electronic health record (EHR). NLP is a type of artificial intelligence that tries to make human language "readable" to computers. Once trained by the MUSC team, NLP identified socially isolated patients with 90 percent accuracy. The findings are reported in BioMed Central Medical Informatics and Decision Making.

Social isolation is one of the "social determinants of health," aspects of a person's life that affect well-being and health. Other examples of social determinants are income, education, race, and marital status. These social determinants have been shown in clinical trials to affect health outcomes as much as usual suspects such as blood pressure and diabetes.

"We know from careful evidence that social determinants are important to health care and health outcomes," says Chanita Hughes-Halbert, Ph.D., senior author on the article.

"Social isolation is a really important social determinant because it reflects the extent to which people perceive they have a high level of connectedness and support."

Hughes-Halbert is professor of Psychiatry & Behavioral Sciences at MUSC. She also directs a center funded by the National Institutes of Health (NIH) focused on precision medicine and minority men's health at MUSC Hollings Cancer Center.

"The mission of our center is to identify the ways in which social, clinical, psychological and behavioral data and genomic information interact with each other to lead to disease risk and affect how men respond to treatment options," explains Hughes-Halbert.

"As part of that, we're really interested in the role that social determinants play."

Like many teams using artificial intelligence to unlock the insights embedded in the EHR, the MUSC team paired a subject matter expert, Hughes-Halbert, and a bioinformatics team.

The bioinformatics team was led by Leslie Lenert, M.D., MS, Chief Research Information Officer for MUSC and director of MUSC's Biomedical Informatics Center (BMIC). Other team members included Vivienne Zhu, M.D., M.S., first author of the article, and Jihad Obeid, M.D, both of BMIC, and Brian Bunnell, Ph.D., of the Department of Psychiatry & Behavioral Sciences.

The team came together to find a way to help physicians provide care informed by an awareness of their patients' social determinants of health, including social isolation.

The National Academy of Medicine has called for physicians to document social determinants in the EHR. However, busy physicians do not always have the time to do so. Even when they do, the current EHR has no place to enter information on a number of the social determinants as coded data. At best, physicians can mention a discussion with a patient about social isolation in their clinical notes.

"When people go to the doctor, they do talk about social isolation and other determinants of health. But you won't find that in the coded data," explains Zhu.

"You have to look at the clinical notes - that's where the information is embedded."

It would take a human many months to sort through the notes looking for mentions of social isolation. In contrast, the NLP software combed through the 55, 516 clinical notes comprising 150,990 documents from 3138 prostate cancer patients in the training data set in just eight seconds.

"There were I don't know how many hundreds of thousands of documents in this prostate cancer data set," explains Lenert.

"It's too many for a human being to read through to do the abstractions, but it's relatively easy for a computer."

Once trained, NLP was able to analyze a new set of documents from 1057 patients and identify patients who were socially isolated with 90 percent accuracy.

"It's pretty darned accurate," says Lenert. "It performed well, but the problem remains that some physicians do not comment on these issues and so don't leave a trail for NLP to follow."

Artificial intelligence could help here too. Lenert and the bioinformatics team hope that they can use another type of artificial intelligence known as machine learning to identify which clinical and other traits characterize socially isolated patients. Machine learning could then search for patients with that constellation of traits in the EHR. It would be able to identify socially isolated patients even when the physician made no explicit mention of social isolation in the clinical notes.

Future studies will be needed to develop and test Interventions for socially isolated patients. For now, these patients can be referred for hospital- and community-based support services.

The NLP strategy developed by the MUSC team can be applied to other social determinants of health, particularly those that cannot be entered as coded data, and to other diseases. The team is already using NLP to identify patients with financial insecurity and alcohol abuse.

MUSC owes its expertise in NLP in part to the NIH-funded South Carolina Clinical & Translational (SCTR) Institute. SCTR is a Clinical and Translational Science Award hub housed at MUSC.

"The general expertise in NLP, the infrastructure for the access to the notes, and some of the support for the software comes through SCTR," says Lenert.

In a sense, NLP can help physicians "listen" to their patients better, understand their health challenges in the broader context of their lives, and provide more informed and nuanced care.

"Sometimes physicians focus excessively on the 'medical' problems and don't pay enough attention to the context that people live in and the social aspects that influence their health," says Lenert.

"Our study once again highlights the importance of knowing this information in order to provide patients our very best care."


This study was funded by the National Institute on Minority Health and Health Disparities, the National Center for Advancing Translational Sciences, and the National Institute on Drug Abuse. The content of the article summarized in this release is solely the responsibility of the authors of the article and does not necessarily represent the official views of the National Institutes of Health

About MUSC

Founded in 1824 in Charleston, MUSC is the oldest medical school in the South, as well as the state's only integrated, academic health sciences center with a unique charge to serve the state through education, research and patient care. Each year, MUSC educates and trains more than 3,000 students and 700 residents in six colleges: Dental Medicine, Graduate Studies, Health Professions, Medicine, Nursing and Pharmacy. The state's leader in obtaining biomedical research funds, in fiscal year 2018, MUSC set a new high, bringing in more than $276.5 million. For information on academic programs, visit

As the clinical health system of the Medical University of South Carolina, MUSC Health is dedicated to delivering the highest quality patient care available, while training generations of competent, compassionate health care providers to serve the people of South Carolina and beyond. Comprising some 1,600 beds, more than 100 outreach sites, the MUSC College of Medicine, the physicians' practice plan, and nearly 275 telehealth locations, MUSC Health owns and operates eight hospitals situated in Charleston, Chester, Florence, Lancaster and Marion counties. In 2018, for the fourth consecutive year, U.S. News & World Report named MUSC Health the number one hospital in South Carolina. To learn more about clinical patient services, visit

MUSC and its affiliates have collective annual budgets of $3 billion. The more than 17,000 MUSC team members include world-class faculty, physicians, specialty providers and scientists who deliver groundbreaking education, research, technology and patient care.

About Hollings Cancer Center

The Hollings Cancer Center at the Medical University of South Carolina is a National Cancer Institute-designated cancer center and the largest academic-based cancer research program in South Carolina. The cancer center comprises more than 100 faculty cancer scientists and 20 academic departments. It has an annual research funding portfolio of more than $40 million and a dedication to reducing the cancer burden in South Carolina. Hollings offers state-of-the-art diagnostic capabilities, therapies and surgical techniques within multidisciplinary clinics that include surgeons, medical oncologists, radiation therapists, radiologists, pathologists, psychologists and other specialists equipped for the full range of cancer care, including more than 200 clinical trials. For more information, visit

About the SCTR Institute

The South Carolina Clinical and Translational Research (SCTR) Institute, a National Institutes of Health Clinical and Translational Science Awards hub, is the catalyst for changing the culture of biomedical research, facilitating sharing of resources and expertise, and streamlining research-related processes to bring about large-scale, change in the clinical and translational research efforts in South Carolina. Our vision is to improve health outcomes and quality of life for the population through discoveries translated into evidence-based practice. For more information, visit

Disclaimer: AAAS and EurekAlert! are not responsible for the accuracy of news releases posted to EurekAlert! by contributing institutions or for the use of any information through the EurekAlert system.