Workshop-Big Data

Big Data and Big Crowds: Getting Useful Data from Text Fields Using Large Data Sets

Wednesday, October 15, 2014, 1:00 - 2:30 p.m. EDT

Overview: Abstracting information from imaging reports is traditionally done by trained researchers who review the report text and record the presence or absence of key words or findings. The standard abstraction method is laborious, time-consuming, and expensive, and the alternative method, natural language processing (NLP), requires special expertise to implement and tailor the algorithm.  A third, more recent, option is crowd-sourcing through Amazon mTurk, a marketplace where people can sign-up to work on human intelligence tasks (HITs).
This webinar will review three approaches for abstracting data from imaging reports based on the experiences of the Back pain Outcomes using Longitudinal Data (BOLD) Project. The webinar will also discuss strategies for working with and evaluating the effectiveness of abstraction conducted by trained researchers and individuals in the Amazon mTurk marketplace.
The BOLD Project established a cohort of 5,239 senior patients with back pain recruited from primary care settings in health systems that are part of the HMO Research Network. The BOLD-Extension of Research (BOLDER) Project provided for 18 month extension of the project. Several projects that are part of BOLDER require collecting not only quantitative variables, such as counts of particular CPT codes, but also information buried in text fields such as radiology reports. BOLDER will yield approximately 6,400 text-based spine imaging reports.
Faculty: Janna Friedly, M.D., University of Washington (moderator); Bryan Comstock, M.S., University of Washington; and Jeffrey (Jerry) Jarvik, M.D., M.P.H., University of Washington  
Learning Objectives: At the conclusion of the session, participants will be able to: 

• Review the BOLD/BOLDER registry
• Review the approaches for abstracting data from imaging reports
• Describe the accuracy, cost, and time of Amazon mTurk and NLP compared with the trained researcher abstract.

Registration Price: Free 
Course Level: 101 (Introductory)


Acknowledgement: This webinar is brought to you by AcademyHealth's EDM Forum, a cooperative agreement from the Agency for Healthcare Research and Quality, Grant #U18 HS022789-01. To learn more about the EDM Forum, please visit www.edm-forum.org.