In addition to the references cited throughout the toolkit, we have provided an additional Supplementary Bibliography of resources that informed this work and may be useful to readers.

Work Cited
Agency for Healthcare Research and Quality. Engaging stakeholders in the effective health care program. October 31, 2011. Accessed March 9, 2020. Link
Austin E, LeRouge C, Hartzler AL, Chung AE, Segal C, Lavallee DC. Opportunities and challenges to advance the use of electronic patient-reported outcomes in clinical care: a report from AMIA workshop proceedings. JAMIA Open. 2019; 2(4):407-410. Link
Austin E, LeRouge C, Hartzler AL, Segal C, Lavallee DC. Capturing the patient voice: implementing patient-reported outcomes across the health system. Qual Life Res. 2020; 29:347-355. Link
Basch E. Patient-reported outcomes — harnessing patients’ voices to improve clinical care. N Engl J Med 2017; 376(2):105-108. Link
Biber J, Ose D, Reese J, et al. Patient reported outcomes – experiences with implementation in a University Health Care setting. J Patient Rep Outcomes. 2018; 2:34. Link
Burns LR, Pauly MV. Transformation of the health care industry: curb your enthusiasm? Milbank Q 2018; 96:57–109.
Canada Health Infoway. Pan-Canadian Change Management Network. A Framework and Toolkit for Managing eHealth Change: People and Processes. March 2013. Accessed March 10, 2020. Link
Centers for Medicare & Medicaid Services. Person and Family Engagement Strategy. Accessed March 9, 2020. Link
Centers for Medicare & Medicaid Services. Promoting Interoperability Programs. Accessed March 9, 2020. Link
Cohen, Dan S. The Heart of Change Field Guide: Tools and Tactics for Leading Change in Your Organization. Boston, MA: Harvard Business School Press, 2005.
Damschroder LJ, Aron DC, Keith RE, et al. Fostering implementation of health services research findings into practice: a considered framework for advancing implantation science. Implement Sci. 2009; 4:50.
EASIPRO. Seamless integration of patient-reported outcome measures in electronic health records. Accessed March 9, 2020. Link
Freel J, Bellon J, Hamner J. Better physician ratings from discussing PROs with patients. NEJM Catalyst. June 20, 2018. Accessed March 9, 2020. Link
Gerhardt WE, Mara CA, Kudel I, et al. Systemwide implementation of patient-reported outcomes in routine clinical care at a children’s hospital. Jt Comm J Qual Patient Saf. 2018; 44(8):441-453. Link
Greenhalgh T, Wherton J, Papousti C, et al. Beyond adoption: a new framework for theorizing and evaluating non- adoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. J Med Internet Res. 2017; 19(11):e367.
Hartzler AL, Izard JP, Dalkin BL, Mikles SP, Gore JL. Design and feasibility of integrating personalized PRO dashboards into prostate cancer care. J Am Med Inform Assoc. 2016; 23(1):38-47.
HL7 FHIR. FHIR Overview. Accessed March 9, 2020. Link
Hsiao CJ, Dymek C, Kim B, Russell B. Advancing the use of patient-reported outcomes in practice: challenges, opportunities, and the potential of health information technology. Qual Life Res. 2019; 28(6): 1575-1583.
IEEE Computer Society. IEEE Standard for Functional Modeling Language–Syntax and Semantics for IDEF0, IEEE Std 1320.1–1998 (R2004). 1998. Accessed March 11, 2020. Link
Institute for Healthcare Improvement. Improving Health and Healthcare Worldwide. Accessed March 10, 2020. Link
International Society for Quality of Life Research (prepared by Aaronson N, Elliott T, Greenhalgh J, Halyard M, Hess R, Miller D, Reeve B, Santana M, Snyder C). User’s Guide to Implementing Patient-Reported Outcomes Assessment in Clinical Practice, Version: January 2015. Accessed March 9, 2020. Link
Kotter John P, Cohen Dan S. The Heart of Change. Boston, MA: Harvard Business School Press, 2002.
Lavallee DC, Chenok KE, Love RM, Petersen C, Holve E, Segal CD, Franklin PD. Incorporating patient-reported outcomes into health care to engage patients and enhance care. Health Aff (Millwood). 2016; 35(4):575-582.
Lean Enterprise Institute. What is LEAN?. Accessed March 10, 2020. Link
Marca DA, McGowan CL. SADT: Structured Analysis and Design Technique, New York, NY: McGraw-Hill Book Co., 1988.
McGraw DC, Leiter AB. eGEMS: pathways to success for multisite clinical data research. eGEMs (Wash DC). 2013; 1(1):1041
Mutic S, Brame RS, Oddiraju S, Michalski JM, Wu B. System mapping of complex healthcare processes using IDEF0: a radiotherapy example. Int J Collab Enterp. 2010; 1(3–4):316–331.
National Institutes of Health. Patient-Reported Outcomes Measurement Information System (PROMIS). Accessed March 9, 2020. Link
National Quality Forum. Patient-Reported Outcomes. Accessed March 9, 2020. Link
Papuga MO, Dasilva C, McIntyre A, et al. Large-scale clinical implementation of PROMIS computer adaptive testing with direct incorporation into the electronic medical record. Health Syst (Basingstoke). 2017; 7(1):1-12. Link
Proctor EK, Lansdverk J, Aarons G, et al. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health 2009; 36:24–34. Link
Proctor E, Silmere H, Raghavan R et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011; 38(2):65-76. Link
Segal C, Holve E, Sabharwal R. Collecting and using patient-reported outcomes (PRO) for comparative effectiveness research and patient-centered outcomes research: challenges and opportunities. EDM Forum. July 2013. Accessed March 9, 2020. Link
Snyder C, Wu AW, eds. Users’ Guide to Integrating Patient-Reported Outcomes in Electronic Health Records. Baltimore, MD: Johns Hopkins University. 2017. Funded by Patient-Centered Outcomes Research Institute (PCORI); JHU Contract No. 10.01.14 TO2 08.01.15. Accessed March 9, 2020. Link
United States Access Board. About the Section 508 Standards. Accessed March 11, 2020. Link
Van der Wees PJ, Verkerk EW, Verbiest MEA, et al. Development of a framework with tools to support the selection and implementation of patient-reported outcome measures. J Patient Rep Outcomes. 2019; 3:77. Link
Web Accessibility Initiative. Web Content Accessibility Guidelines (WCAG): Overview. Accessed March 11, 2020. Link
Wu AW, Kharrazi H, Boulware LE, Synder CF. Measure once, cut twice – adding patient-reported outcome measures to the electronic health record for comparative effectiveness research. J Clin Epidemiol 2013; 66(8):S12-20. Link
Supplementary Bibliography
Ahmed S., Berzon R.A., Revicki D.A., Lenderking W.R., Moinpour C.M., Basch E., et al (2012). The use of patient-reported outcomes (PRO) within comparative effectiveness research: implications for clinical practice and healthcare policy. Medical Care, 50(12), 1060-70.
Arcia, A., Woollen, J., & Bakken, S. (2018). A systematic method for exploring data attributes in preparation for designing tailored infographics of patient reported outcomes. eGEMs (Generating Evidence & Methods to improve patient outcomes), 6(1), 2. Link
Ayers D.C., Zheng H., Franklin P.D. (2013). Integrating patient-reported outcomes into orthopaedic clinical practice: proof of concept from FORCE-TJR. Clinical Orthopedics Related Research, 471(11), 3419-25.
Basch EM, Reeve BB, Mitchell SA, Clauser SB, Minasian L, Sit L, et al. Electronic toxicity monitoring and patient-reported outcomes. Cancer J. 2011;17(4):231-4.
Bennett, A. V., Jensen, R. E., & Basch, E. (2012). Electronic patient-reported outcome systems in oncology clinical practice. CA: A Cancer Journal for Clinicians,62(5), 336-347. Link
Chenok K., Teleki S., SooHoo N.F., Huddleston J., 3rd, Bozic K.J. (2015). Collecting patient-reported outcomes: Lessons from the California joint replacement registry. EGEMS (Wash DC), 3(1), 1196.
Damman, O. C., Verbiest, M. E., Vonk, S. I., Berendse, H. W., Bloem, B. R., de Bruijne, M. C., & Faber, M. J. (2019). Using PROMs during routine medical consultations: The perspectives of people with Parkinson’s disease and their health professionals. Health Expectations, 22(5), 939-951.
Griffiths-Jones W., Norton M.R., Fern E.D., Williams D.H. (2014). The Equivalence of remote electronic and paper patient reported outcome (PRO) collection. Journal of Arthroplasty, 29(11), 2136-9.
Grossman, L. V., Feiner, S. K., Mitchell, E. G., & Creber, R. M. M. (2018). Leveraging patient-reported outcomes using data visualization. Applied clinical informatics, 9(03), 565-575.
Harle C.A., Listhaus A., Covarrubias C.M., Schmidt S.O., Mackey S., Carek P.J., et al. (2016). Overcoming barriers to implementing patient-reported outcomes in an electronic health record: a case report. Journal of the American Medical Informatics Association, 23(1), 74-9.
Hartzler A.L., Chaudhuri S., Fey B.C., Flum D.R., Lavallee D. (2015). Integrating patient-reported outcomes into spine surgical care through visual dashboards: Lessons learned from human-centered design. EGEMS (Wash DC), 3(2), 1133.
Haverman L, Engelen V, van Rossum MA, Heymans HS, Grootenhuis MA. Monitoring health-related quality of life in paediatric practice: development of an innovative web-based application. BMC Pediatr. 2011;11:3.
Jensen R.E., Snyder C.F., Abernethy A.P., Basch E., Potosky A.L., Roberts A.C., et al (2014). Review of electronic patient-reported outcomes systems used in cancer clinical care. Journal of Oncology Practice, 10(4), e215-22.
Jensen R.E., Rothrock N.E., DeWitt E.M., Spiegel B., Tucker C.A., Crane H.M., et al. (2015) The role of technical advances in the adoption and integration of patient-reported outcomes in clinical care. Medical Care, 53(2),153-9.
Katzan I.L., Fan Y., Speck M., Morton J., Fromwiller L., Urchek J., et al. n (2015). Electronic stroke CarePath: Integrated approach to stroke care. Circulation: Cardiovascular Quality and Outcomes, 8(6 Suppl 3), S179-89.
LeRouge C., Hasselquist M.B., Kellogg L., Austin E., Fey B.C., Hartzler A.L., Flum D.R., and Lavallee D. (2017). Using heuristic evaluation to enhance the visual display of a provider dashboard for patient-reported outcomes. AcademyHealth eGEMs (Generating Evidence & Methods to improve patient outcomes): 5(2), article 6. Link
Lor M., Koleck, T.A. Bakken S., Information visualizations of symptom information for patients and providers: a systematic review, Journal of the American Medical Informatics Association, Volume 26, Issue 2, February 2019, Pages 162–171. Link
Newman E.D., Lerch V., Billet J., Berger A., Kirchner H.L. (2015). Improving the quality of care of patients with rheumatic disease using patient-centric electronic redesign software. Arthritis Care Research (Hoboken), 67(4), 546-53.
Rodrigue J.R., Vishnevsky T., Fleishman A., Brann T., Evenson A.R., Pavlakis M., et al (2015). Patient-reported outcomes following living kidney donation: A single center experience. Journal of Clinical Psychology in Medical Settings, 22(2-3), 160-8.Schick-Makaroff K, Molzahn A. Strategies to use tablet computers for collection of electronic patient-reported outcomes. Health Qual Life Outcomes. 2015;13:2.
Schick-Makaroff K, Molzahn A. Strategies to use tablet computers for collection of electronic patient-reported outcomes. Health Qual Life Outcomes. 2015;13:2.
Slover J.D., Karia R.J., Hauer C., Gelber Z., Band P.A., Graham J. (2015). Feasibility of integrating standardized patient-reported outcomes in orthopedic care. American Journal of Managed Care, 21(8), e494-500.
Sokka T., Rannio T., Khan N.A. (2012). Disease activity assessment and patient-reported outcomes in patients with early rheumatoid arthritis. Rheumatic Disease Clinics of North America, 38(2), 299-310.
Steele Gray C., Khan A.I., Kuluski K., McKillop I., Sharpe S., Bierman A.S., et al. (2016). Improving Patient Experience and Primary Care Quality for Patients With Complex Chronic Disease Using the Electronic Patient-Reported Outcomes Tool: Adopting Qualitative Methods Into a User-Centered Design Approach. JMIR Research Protocols, 5(1), e28.
Theodosopoulos P.V., Ringer A.J. (2015). Measuring outcomes for neurosurgical procedures. Neurosurgery Clinics of North America, 26(2), 265-9, x.
Torda P., & Tinoco A. (2013) Achieving the promise of electronic health record-enabled quality measurement: a measure developer’s perspective, eGEMs (Generating Evidence & Methods to improve patient outcomes): Vol. 1: Iss. 2, Article 3. Link
Trautmann F., Hentschel L., Hornemann B., Rentsch A., Baumann M., Ehninger G., et al. (2016) Electronic real-time assessment of patient-reported outcomes in routine care-first findings and experiences from the implementation in a comprehensive cancer center. Support Care Cancer.
Trick W.E., Deamant C., Smith J., Garcia D., Angulo F. (2015). Implementation of an audio computer-assisted self-interview (ACASI) system in a general medicine clinic: patient response burden. Applied Clinical Informatics, 6(1), 148-62.
Wilson J., Arshad F., Nnamoko N., Whiteman A., Ring J., Roy B. (2014). Patient-reported outcome measures: an on-line system empowering patient choice. Journal of the American Medical Informatics Association, 21(4), 725-9.
Wu A.W., White S.M., Blackford A.L., Wolff A.C., Carducci M.A., Herman J.M., et al (2015). Improving an electronic system for measuring PROs in routine oncology practice. Journal of Cancer Survivorship.