Back to Journals » Patient Preference and Adherence » Volume 10

Communicating laboratory test results for rheumatoid factor: what do patients and physicians want?

Authors Kelman A, Robinson CO, Cochin E, Ahluwalia NJ, Braverman J, Chiauzzi E, Simacek K 

Received 16 January 2016

Accepted for publication 6 May 2016

Published 13 December 2016 Volume 2016:10 Pages 2501—2517

DOI https://doi.org/10.2147/PPA.S104396

Checked for plagiarism Yes

Review by Single anonymous peer review

Peer reviewer comments 4

Editor who approved publication: Dr Johnny Chen



Ariella Kelman,1,2 Caroline O Robinson,1 Elisenda Cochin,3 Nina J Ahluwalia,1 Julia Braverman,3 Emil Chiauzzi,3 Kristina Simacek3

1Genentech, South San Francisco, CA, USA; 2Division of Immunology and Rheumatology, Stanford University Medical School, Stanford, CA, USA; 3PatientsLikeMe, Cambridge, MA, USA

Objective: This study aimed to explore patient and physician perspectives on current laboratory test reporting practices and to elicit ideas for improvement.
Methods: Two independent studies were conducted. The first solicited members of an online physician community for opinions on current laboratory test reporting practices and possible improvements. The second addressed the same topic, but solicited patient feedback, and included an evaluation of a mock laboratory test report for the rheumatoid factor blood test.
Results: Both physicians and patients expressed a desire for patient-friendly information on laboratory reports. Physicians expressed a need for education for patients around false-positive and false-negative results within laboratory reports, while patients sought context around the meaning of results, relevance to other tests, and follow-up steps.
Conclusion: Physicians and patients see value in enhancing laboratory test reports to improve communication. While reports should include the context that patients value, they should also contain cautionary interpretation emphasized by physicians. Patient consultation on improving laboratory reports may help improve such patient-focused communication and promote greater patient understanding of health information, thereby increasing patient participation in their own health care and improving outcomes.
Practice implications: Laboratory reports are typically designed by experts. Including patients in laboratory report design may facilitate communication and improve outcomes through better patient engagement.

Keywords: laboratory test reports, doctor–patient communication, patient-centered, medical records, health records

Introduction

In recent years, direct patient access to laboratory test reports has increased significantly. An amendment passed in 2014 to the Patient Protection and Affordable Care Act of 2010 requires that patients must be allowed to access their laboratory test reports directly,1 bypassing the ordering and treating physician. As a consequence, patients in the United States are now able to access much of the same information as their health care providers. Similar efforts are being made in Europe, such as are described under the Digital Agenda for Europe.2 In a recent EU-commissioned study of the country-level policies on interoperability and sharing of electronic health records among health care providers and patients, it was found that each EU member state has policy or policies to provide patients with access to their electronic health records, with around half of EU countries granting patients full access to their health data, without exemptions and/or restrictions.3

There is inconsistency in whether and how communications about laboratory test results take place. In the United States, between 6.8% and 62% of laboratory test reports are not followed up by physicians in ambulatory care settings, with potentially negative consequences for patients, including missed diagnoses.4 While most physicians are comfortable with direct reporting (ie, patients’ receipt of laboratory reports without initial physician screening) of normal results to patients, many physicians are less comfortable with direct reporting of abnormal results and are concerned that providing patients with direct access to laboratory test reports introduces the risk of misinterpretation and may cause some patients undue worry and confusion, or cause them to seek unreliable health information.57

Patients want immediate access to their medical reports, whether results are normal or not, and find information written in lay language to be helpful.812 Direct access to medical records enhances patient empowerment and involvement in medical care, which is associated with better outcomes,13,14 better adherence to treatment recommendations, and greater satisfaction with the health care system.15,16 Unfortunately, patients find laboratory test reports to be among the most difficult parts of their health record to understand, as these reports use professional medical terminology and may lack explanation of complex concepts such as reference ranges.17

In the United States, as in Europe, there is no regulatory requirement to provide reports in a patient-friendly format, nor are there standards for how to construct reports to enhance patient comprehension.18 Many efforts have been targeted at bringing health materials to a level that more closely matches patients’ health literacy and numeracy based on observations of patient barriers to comprehension,1925 while others have focused on the design and display of medical records.26 Patients value the content of reports (ie, interpretation of results, clinician advice, and purpose of testing) more than pictorial displays of results.27 However, few studies have gathered direct patient insight on ways to make laboratory test reports clearer and more understandable.

The need for patient-centered laboratory reports may be most acute with tests that require clinical interpretation and patient education, eg, rheumatoid factor (RF). The RF blood test uses a diagnostic blood biomarker found to be elevated in patients with certain autoimmune and other diseases, especially rheumatoid arthritis.28 Interpretation of this test necessitates consideration of multiple clinical factors in addition to requiring a high degree of physician–patient communication. An examination of patient and physician attitudes of the challenges of RF test reporting may illuminate key considerations in communicating other laboratory test results.

To explore ways in which laboratory test results can be communicated in a patient-friendly manner, we conducted two independent surveys to explore physician and patient perspectives regarding: 1) the current content of RF blood test reports; 2) the adequacy of physician–patient communication about laboratory reports in general; 3) the adequacy of physician–patient communication about RF laboratory reports; and 4) potential areas for improvement in the presentation of laboratory test results to patients. We included perspectives from the United States and from physicians in three European countries (the United Kingdom, Germany, and Switzerland). The research sample was drawn from these four countries due to the similarity of each of the countries in health care policy and practice regarding patient access to health records and to the ease of availability of data from a sample of physicians within each country and a sample of patients within the United States.

Methods

Two independent studies are described in this paper: the physician study was conducted as a survey among physicians within the United States, United Kingdom, Germany, and Switzerland; the patient study was conducted as a survey among US patients.

Physician study

Participants

Eligible physicians were 1) members of the Sermo physician social networking platform; 2) practicing in one of the following specialties: rheumatology, immunology, general medicine, or family medicine; 3) previously opted into receiving surveys through Sermo; and 4) located in the United States, Germany, Switzerland, or the United Kingdom. Sermo is a large medical social network for exclusive use by physicians in the United States (in which over 300,000 US physicians are registered as users) and in other countries, including those in Europe; physicians primarily use Sermo to connect anonymously with each other to discuss medical cases and professional issues, but can also participate in research through the platform.29 Physicians received a nominal fee for completing the survey. IRB/EC approval was not required for this survey, which contained exclusively a physician sample.

Procedure

A convenience sample of physicians who met eligibility criteria was recruited through Sermo. The data were collected through a cross-sectional online survey, which was posted on the Sermo website, and for which a link was sent to Sermo member physicians who had opted into receiving surveys.

Measures and materials

Laboratory test report survey

The survey instrument applied within this research was developed by 1) identifying a set of research domains that were appropriate based on the primary research questions; 2) developing a draft survey instrument to assess the domains; 3) evaluating the draft instrument for content and construct validity through review with four practicing clinicians and survey instrument experts; 4) revising the draft instrument based on the pilot testing; and 5) preparing the instrument with complete user instructions and formatting appropriate for online implementation. The survey instrument consisted of nine questions. These included two questions about the current state of information contained in laboratory test reports (eg, How much general information about the laboratory tests is currently provided on the laboratory test reports your patients receive?); three Likert scale items on physicians’ perspectives on doctor–patient communication for general laboratory test reports and three Likert scale items for RF reports (eg, I sometimes find it challenging to communicate with my patients about lab results); and an open-ended item that asked about areas of potential improvement for laboratory test reports. The complete survey is provided in Supplementary material A.

Analysis

Quantitative analysis

Data collected from the physician survey were analyzed through descriptive methods with mean values and standard deviation presented for numerical data and frequencies for categorical data. χ2, t-test, or analysis of variance analyses were conducted as applicable to compare between groups.

Qualitative analysis

A conventional approach to content analysis was used to analyze the qualitative responses that were provided by survey respondents to the open-text question.30 This approach involved the following steps: all comments were collected within a Microsoft Word document; two researchers (AK and NA) independently reviewed the qualitative data as a set and identified a small set of primary themes into which the data could be organized; the researchers then met to discuss the thematic groupings of the data and resolved discrepancies through collaborative discussion, resulting in a final list of codes; two researchers (NA and AK) coded the qualitative data set within Microsoft Excel and developed a summary of the findings identified among the final set of themes and associated qualitative comments; a final summary description of findings associated with the qualitative data was developed through collaborative review by all researchers.

Patient study

Participants

For the patient study, eligible participants were 1,954 patients who met the criteria of 1) having registered on the PatientsLikeMe (PLM) website; 2) having reported a diagnosis of systemic lupus erythematosus (SLE) or rheumatoid arthritis as a health condition on the PLM profile (patients with these two conditions were targeted for the survey because they are likely to have received a blood test for RF in the past); 3) being located in the United States; 4) having had at least one login into the PLM website in the last 90 days; and 5) being aged ≥18 years. PLM is an online platform comprised of many disease communities, which allows patients with life-changing, typically chronic, medical conditions to find other patients like themselves, to share information about their outcomes, and to learn more about their condition. At the present time, there are over 7,600 and 8,300 patients with diagnoses of rheumatoid arthritis and SLE, respectively, registered on PLM.

Procedure

A convenience sample of patient members of PLM who met eligibility criteria were invited to complete an online survey, hosted on the PLM website. Participation in the survey was voluntary; the nature and potential risks of the study were explained. Informed consent was obtained electronically from participants before they were able to access and complete the survey. Of the eligible population, 270 (13%) opened the survey, and, of those, 211 completed the survey (78%). According to CHERRIES guidelines for online survey report, this represents a satisfactory recruitment rate and completion rate.31 Participants were not remunerated for their participation. The research study was approved by the New England Institutional Review Board on November 18, 2014.

Measures and materials

Patients laboratory report survey

The patient survey (presented in Supplementary material B) consisted of open-ended and Likert-type questions on overall clarity of the laboratory reports, patients’ preferences, and satisfaction and was divided into the following parts: 1) eight demographic/clinical questions on age, sex, race, ethnicity, education, health insurance, last time the laboratory test report was received, and if they ever had a blood test for RF; 2) 19 items about past laboratory test report experiences in general; 3) 3 items regarding experience of receiving results on the RF blood test and presented only to those who reported they had the test in the past; 4) ten questions on doctor–patient communication with regard to laboratory test reports; and 5) 13 questions related to a mock laboratory test report for RF.

Mock laboratory test report

To elicit feedback on a laboratory report containing additional information written for patients, a mock report was developed and included within the patient survey as the final section encountered by patients when completing the survey online. The mock laboratory test report used in the patient survey was based on a typical US commercial laboratory report that physicians and patients receive. However, this typical report was revised based on the findings from the physician study within this research and based on recommendations for patient-facing health care information, as discussed in patient engagement literature.14,24 The resulting mock laboratory report included explanatory information about the laboratory test and patient resources based on information from quality patient educational websites written by health care professionals.27,32 In addition to information about the patient, provider, laboratory, test results, and reference range, the mock report also included sections defining RF, the units used and reference range, an explanation for what an elevated score means, and links to trusted websites where patients could find more information. Language was simplified to reflect a Flesch–Kincaid grade level of 9.9 in Microsoft Word; however, this level may be elevated due to the inclusion of medical terminology.

Analysis

The analysis for quantitative and qualitative data followed a similar approach as that of Study 1. The themes identified for the coding of the qualitative survey responses, using a conventional analysis approach, were discussed among several researchers until consensus was reached (EC, KS, AK, and CR).

Results

Physician study

Physician sample

A total of 348 physicians practicing in four countries (the United States, United Kingdom, Germany, and Switzerland) across four specializations completed the physician survey in the Sermo platform. Table 1 lists the distribution of physician responses across the four countries and specializations. A summary of responses from US physicians and (separately) all other physicians is available upon request.

Table 1 Physician demographic characteristics (N=348)
Note: aN=216 for this characteristic due to nonresponses on the optional survey item.

Current state of laboratory test reporting

When asked about the current availability of laboratory test reports for their patients, only one in five (19%) physicians reported that their patients always receive a copy of their laboratory results. Half (50%) of physicians reported their patients “sometimes” receive laboratory results, depending on the kinds of tests ordered or other factors; about a third (31%) reported their patients do not receive a report of laboratory results at all. Comparing US to non-US countries, a greater proportion of those outside the United States reported that patients do not receive laboratory test reports at all (16% in the United States vs 37% outside the United States, χ2 =107.38, P<0.01). This is mostly driven by responses by physicians in the United Kingdom; the majority of UK physicians in our sample (68%) reported that patients never receive their laboratory reports, whereas in Germany and the United States under 20% of physicians report the same; Switzerland falls in-between at 27%.

Of the 69% (240 physicians) who reported that their patients receive laboratory test reports all or some of the time, over half (58%) said the laboratory test reports their patients receive contain a small amount of general information about the laboratory tests. The aggregate responses from the physician survey are listed in Table 2.

Table 2 Physician survey responses (N=348)
Notes: aData were missing for this question, resulting in total number of responses provided <348; percentages presented reflect the relative percentage of responses for this item.
Abbreviation: RF, rheumatoid factor.

Doctor–patient communication

All physician participants were asked whether they find it challenging to communicate with their patients about laboratory results. On average, physicians tend to agree that they find communication with patients about laboratory test reports challenging (M=2.89 [1.21]) on a scale from 1: completely disagree to 5: completely agree). No difference between country or specialty was found. The same statement was posed to the physicians regarding RF tests. In this case, physicians disagreed, on average, with the statement that communication was sometimes challenging (M=1.92 [0.64]).

Areas for improvement

Physicians were asked their opinion about the helpfulness of providing more general information about laboratory test results on their patients’ laboratory reports. On average, most physicians felt that more information on laboratory test reports would be helpful for patients (M=3.21 [1.14]). Furthermore, physicians also tend to agree with the statement that adding general information could improve their relationship with their patients (M=3.05 [1.16]). Physicians were then asked about these same statements in relation to RF tests. Unlike laboratory test reports in general, on average, physicians disagreed that providing this information about RF tests could help their patients (M=2.66 [0.66]) and disagreed that adding this information could improve their relationship with their patients (M=2.49 [0.64]).

Qualitative results

Table 3 lists the key areas of improvement as suggested by physicians. Most respondents did not believe anything should be changed about the current reporting of laboratory results. Suggestions for improvement focused on interpretation of the numeric result. For example, physicians would like patients to be cautioned that a test result alone is not a diagnosis, but needs to be assessed together with other clinical considerations, that there is a possibility of false-negative and -positive results, and the importance of a follow-up discussion with their physician. Most opinions did not vary significantly between the four countries surveyed. Some physicians, mostly in Germany, stated that no additional information is needed on laboratory test reports, citing that providing this information is the responsibility of the physician. However, caution should be used in drawing conclusions about regional differences as the sample sizes in individual countries were limited, and the survey was provided in English, which could have skewed the results in countries where other languages are prevalent.

Table 3 Physician suggestions for additional information to be included in laboratory test reports

Patient study

Patient sample

Eligible participants who completed the survey (n=211) were included in the final analyses sample. About half (49%) reported they had rheumatoid arthritis, 46% reported they had SLE, and 5% reported they had both SLE and rheumatoid arthritis. Demographic characteristics are listed in Table 4.

Table 4 Patient demographic characteristics (N=211)
Abbreviations: SLE, systemic lupus erythematosis; VA, Veteran’s Administration.

Current state of laboratory test reports

Most (73%) of the 211 survey respondents reported they received a laboratory test report the last 3 months, and 99% received one within the last year. Patients’ overall evaluation for the clarity of typical laboratory test reports was 3.16 (SD 1.12, Cronbach’s α=0.87), on a scale from 1 to 5. More than 30% strongly disagreed that their most recent report had easy-to-understand explanations of the results or about future steps. No results showed any correlation with age or sex.

Patients were also asked the extent to which they felt they understood their RF test report. A total of 19% reported they did not understand what the results of their RF test meant (ie, they selected somewhat disagree or strongly disagree with the statement “after receiving the results, I understood what the results of my RF test meant”). Self-reported understandability of the results was not correlated with age or sex.

Almost half of the 172 patients who have had an RF test (47%) said that their most current reports did not provide general information about the laboratory results; about half (47%) did not find it easy to understand RF reports they had received.

Doctor–patient communication: general laboratory test reports

Most (76%) of 210 patients have reported that doctors always or most of the time tell them the reasons why the tests are being done. According to patients, their doctors also frequently explain to them how and when they may expect the results, what the abnormal results are, and what the results measure. However, patients have reported that doctors are less likely to tell how and where a patient can get more information about the test, explain how to read the laboratory test report, or arrange an office call to ask if a patient has any questions. Figure 1 provides more details.

Figure 1 Doctor–patient communication regarding general laboratory test reports.
Notes: aMissing one case, bmissing two cases, cmissing three cases.

Doctor–patient communication: RF laboratory test report

Most of the 170 patients within the sample who have had an RF test and chose to answer the questions feel comfortable talking to their doctors about their results (79% strongly or somewhat agree) and most agree that they could understand the doctor’s explanations (69% strongly or somewhat agree). Most patients would find the opportunity to talk to their doctor or doctor’s office about their laboratory results helpful (52% strongly or somewhat agree) (Figure 2).

Figure 2 Doctor–patient communication regarding the RF laboratory test report.
Notes: aMissing six cases, bMissing one case.
Abbreviation: RF, rheumatoid factor.

Areas for improvement

We asked patients about what they find helpful to have included in the RF report on 1–5 Likert scale, where 1 was strongly disagree and 5 was strongly agree. Figure 3 shows the extent to which patients would like to have specific information in their laboratory test reports.

Figure 3 What kinds of information would you like to be added to the laboratory reports you receive to help you better understand the test results and what the results mean to you and your health? (N=209).
Note: N=209; Missing data for two patients.

There was high agreement with all statements, with the highest agreement for what is the “normal” range of results (93% either strongly agree or somewhat agree) to the least agreement for how often the test might be done (62% strongly or somewhat agree).

In addition, more than half (57%) of 168 respondents believed they would benefit from including more general information about the RF test in RF laboratory test reports; 50% of 167 respondents strongly or somewhat agreed it would be helpful to have specific instructions on what to do next in the RF report (Figure 4).

Figure 4 Patients’ attitudes regarding desired information in the RF report (N=168).
Notes: aMissing four cases, bMissing five cases.
Abbreviation: RF, rheumatoid factor.

Additional information seeking

Almost half of 211 patients (47%) usually do not look for more information when they receive their laboratory results. Among those who do look for more information, most prefer to go to the Internet (78%), while a sizable minority talk to their physician (36%) or to other patients (25%).

Mock RF laboratory test report

Overall, participants had highly positive responses to the mock laboratory test report. The highest agreement was with the statement “I would want to see this much information in all of my laboratory test reports” (95% somewhat or strongly agree). The lowest agreement was for “I would be likely to go to the suggested websites to learn more” (86% somewhat or strongly agree).

Four most frequent themes were revealed in analysis of open text responses to questions about shortcomings of the mock laboratory test report (Table 5). The most common area of improvement was inclusion of more explanations and recommendations about the next steps. The less common suggestions (<3%) were design recommendations, request to list comorbidities, and to include more online resources.

Table 5 Most frequent themes in suggestions for improvement to information contained in mock laboratory test report
Note: aOut of 211 patients, 126 chose to skip this open-response question.

Discussion

We assessed patient and physician perspectives about current laboratory test reporting practices and tested a prototype RF test report with patients. In a context where patients receive laboratory reports written for use by physicians, the primary goal of this research was to understand what would aid communication of such test results to patients. While both physicians and patients agreed that providing additional, patient-oriented information about the test results in the report would be of help to patients and would enhance communication, patients wanted a more extensive explanation of the meaning of the results, while physicians would like to see cautionary text to mitigate errors in interpretation of the results by patients.

Patients find laboratory test reports to be lacking in the kinds of information they find most helpful, that is, what the results mean for them. Patients want more than an in-depth explanation of the purpose of laboratory tests, the result, and reference range. Rather, our findings suggest that what matters to patients is what the results mean, in simple language, including how they fit in the patient’s overall medical history and the next steps to take with their care.1,12,13,19,20 Additionally, patients reported that physicians skip high-touch follow-up of laboratory reports. To address this unmet informational need, patients report they supplement the laboratory test report information with online resources, a reflection of broader trends in Internet use for health-related purposes.3337 By asking patients for their input, laboratory test reports can be redesigned to include information they find helpful or guide them to resources where they can find such information.

Physicians, however, had a more cautionary approach to laboratory test reports. While they felt that providing more information to patients would enhance communication and aid patient understanding, they emphasized that this information must be provided with explanations about potential false-positives and false-negatives, reassurance that positive results do not by themselves confirm diagnosis, and a prompt for patients to contact their physician if they have further questions. This is consistent with previous findings that physicians are concerned that patient access to medical records might increase worry and confusion.6,38 Yet overall, both groups agree that providing more information on laboratory test reports has the potential to improve care.

On the basis of these results, we identified four elements that could improve laboratory test reports for RF. First, include an explanation of the blood test and meaning of the results to the extent possible and practical. Second, flag results that need careful interpretation and physician follow-up discussions due to the potential for false-positives and false-negatives to mitigate the risk of undue worry or misinterpretation. Third, provide information on what actions to take next so that patients understand their options and as a safeguard against missed follow-ups.4 Finally, RF test reports could contain trusted resources for more information, including physician contact and balanced and accurate education or information resources. Based on this research, it appears that patients tend to want to receive sufficient information to understand not just what their laboratory test results are, but what the result means and what their next steps should or could be; physicians appear to generally agree that patients need enough helpful information to guide them to understand the meaning of their test results within the context of practical, patient-centered, and evidence-based medical care.

Limitations

There are several limitations to this study. First, participants in both studies consisted of a convenience sample of patients and providers who are members of online communities and may be somewhat different from the general patient and physician populations. For example, patient demographics in this study generally reflect the sex distribution seen in patients with lupus and rheumatoid arthritis, but an increased proportion of Hispanic and African-American patients might be expected based on the epidemiology of lupus in the United States.39 Patients who are active in a health-tracking website may be particularly interested in health information and may have different perceptions about laboratory test reports from the general public. Likewise, physicians who are members of an online physician community may have perceptions about laboratory test reports and communication with patients that differ from those who are not members.

Second, the surveys used to collect physician and patient data were constructed with similar, but not identical, questions and response options, thereby limiting comparisons between the two groups. Third, the results of the feedback on the mock laboratory test report may not be generalizable to other types of laboratory tests or diagnostic tests, for example, biopsy, imaging results, or genetic tests. Furthermore, there were some inconsistencies in variability across items with some evidence of acquiescence bias. Patients may be seeking as much information on laboratory test reports as possible, and may have a tendency to report high levels of agreement across a broad range of items.

Conclusion

Overall, these results suggest that laboratory test reports present an opportunity for improving communication between physicians and patients. Involving both patients and physicians in the design of reports is an important step to ensure patients can understand and act upon the information contained in their laboratory test reports.

This paper also highlights the limits of patient-centered approaches for specificity. There are a range of laboratory reports requiring different levels of comprehension and need for professional guidance. Simply providing patients with access to their reports without understanding these differences may be premature. There is a need to develop laboratory report standards that are patient centered and patient friendly. Future research is needed to determine the types of information patients do not understand, the types of reports that are particularly challenging, and communications needed for different types of reports. A study of regional and international differences, which may be sensitive to cultural and policy variations, and with different types of laboratory test reports, would provide more generalizable results in terms of the impact of health conditions and demographic factors on preferences for laboratory test reports. Finally, the effect of using such patient-centered laboratory reports on patient outcomes warrants further investigation.

Practice implications

The widespread availability of direct patient access to laboratory test reports underscores the need for reporting of results in a way that patients understand and that enhance doctor–patient communication. Our study suggests that patients and physicians have unique perspectives on laboratory reporting. Including both patients and physicians when designing laboratory test reports may lead to better patient engagement, doctor–patient communication, and potentially improved outcomes.

Acknowledgments

We acknowledge the contribution of patients and physicians who participated in the study questionnaires. Chris Curran supported the preparation and submission of the manuscript.

Disclosure

EC, JB, EC, and KS are employees of PatientsLikeMe and hold stock options in the company; the PatientsLikeMe Research department has received funding from Genentech. AK, CR, and NA are employees of Genentech. The authors declare no other conflicts of interest in this work.


References

1.

Boyd JL, Hazy JM, Sanders SA. Communicating and understanding laboratory test results: what matters? Lab Med. 2007;38(11):680–684.

2.

European Commission. Digital agenda for Europe: action 75: give Europeans secure online access to their medical health data and achieve widespread telemedicine deployment 2010. Available from: http://ec.europa.eu/digital-agenda/en/pillar-vii-ict-enabled-benefits-eu-society/action-75-give-europeans-secure-online-access-their. Accessed July 29, 2015.

3.

European Commission. Overview of the national laws on electronic health records in the EU Member States and their interaction with the provision of cross-border eHealth services: Final report and recommendations. 2011. Available from: http://ec.europa.eu/health/ehealth/projects/nationallaws_electronichealthrecords_en.htm. Accessed March 15, 2016.

4.

Callen JL, Westbrook JI, Georgiou A, Li J. Failure to follow-up test results for ambulatory patients: a systematic review. J Gen Intern Med. 2012;27(10):1334–1348.

5.

Giardina TD, Callen J, Georgiou A, et al. Releasing test results directly to patients: a multisite survey of physician perspectives. Patient Educ Couns. 2015;98(6):788–796.

6.

Earnest MA, Ross SE, Wittevrongel L, Moore LA, Lin CT. Use of a patient-accessible electronic medical record in a practice for congestive heart failure: patient and physician experiences. J Am Med Inform Assoc. 2004;11(5):410–417.

7.

Sung S, Forman-Hoffman V, Wilson MC, Cram P. Direct reporting of laboratory test results to patients by mail to enhance patient safety. J Gen Intern Med. 2006;21(10):1075–1078.

8.

Johnson AJ, Easterling D, Nelson R, Chen MY, Frankel RM. Access to radiologic reports via a patient portal: clinical simulations to investigate patient preferences. J Am Coll Radiol. 2012;9(4):256–263.

9.

Choudhry A, Hong J, Chong K, et al. Patients’ preferences for biopsy result notification in an era of electronic messaging methods. JAMA Dermatol. 2015;151(5):513–521.

10.

Baldwin DM, Quintela J, Duclos C, Staton EW, Pace WD. Patient preferences for notification of normal laboratory test results: a report from the ASIPS Collaborative. BMC Fam Pract. 2005;6(1):11.

11.

Meza JP, Webster DS. Patient preferences for laboratory test results notification. Am J Manag Care. 2000;6(12):1297–3000.

12.

Giardina T, Modi V, Parrish D, Singh H. The patient portal and abnormal test results: an exploratory study of patient experiences. Patient Exp J. 2015;2(1):148–154.

13.

Laurance J, Henderson S, Howitt PJ, et al. Patient engagement: four case studies that highlight the potential for improved health outcomes and reduced costs. Health Aff. 2014;33(9):1627–1634.

14.

Keselman A, Slaughter L, Smith CA, et al. Towards consumer-friendly PHRs: patients’ experience with reviewing their health records. AMIA Annu Symp Proc. 2007:399–403.

15.

Heisler M, Piette JD, Spencer M, Kieffer E, Vijan S. The relationship between knowledge of recent HbA 1c values and diabetes care understanding and self-management. Diabetes Care. 2005;28(4):816–822.

16.

Van der Vaart R, Drossaert CH, Taal E, Drossaers-Bakker KW, Vonkeman HE, van de Laar MA. Impact of patient-accessible electronic medical records in rheumatology: use, satisfaction and effects on empowerment among patients. BMC Musculoskelet Disord. 2014;15(1):102.

17.

Peters E, Hibbard J, Slovic P, Dieckmann N. Numeracy skill and the communication, comprehension, and use of risk-benefit information. Health Aff. 2007;26(3):741–748.

18.

Centers for Medicare & Medicaid Services. CLIA program and HIPAA privacy rule; patients’ access to test reports; Final rule. Fed Regist. 2014;79:7290–7316.

19.

Donelle L, Arocha JF, Hoffman-Goetz L. Health literacy and numeracy: key factors in cancer risk comprehension. Chronic Dis Can. 2008;29(1):1–8.

20.

Nelson W, Reyna VF, Fagerlin A, Lipkus I, Peters E. Clinical implications of numeracy: theory and practice. Ann Behav Med. 2008;35(3):261–274.

21.

Reyna VF, Nelson WL, Han PK, Dieckmann NF. How numeracy influences risk comprehension and medical decision making. Psychol Bull. 2009;135(6):943–973.

22.

Gardner PH, McMillan B, Raynor DK, Woolf E, Knapp P. The effect of numeracy on the comprehension of information about medicines in users of a patient information website. Patient Educ Couns. 2011;83(3):398–403.

23.

Elder NC, Barney K. But what does it mean for me? Primary care patients’ communication preferences for test results notification. Jt Comm J Qual Patient Saf. 2012;38(4):168–176.

24.

Bossen JKJ, Hageman MGJS, King JD, Ring DC. Does rewording MRI reports improve patient understanding and emotional response to a clinical report? Clin Orthop Relat Res. 2013;471(11):3637–3644.

25.

Haga SB, Mills R, Pollak KI, et al. Developing patient-friendly genetic and genomic test reports: formats to promote patient engagement and understanding. Genome Med. 2014;6(7):58.

26.

Flaherty J. How restyling the mundane medical record could improve health care. Wired. 2013. Available at: http://www.wired.com/2013/01/medical-record-redesign/. Accessed March 3, 2015.

27.

MayoClinic.org. Tests and procedures: rheumatoid factor (updated July 9, 2013). Rochester, MN: Mayo Foundation for Medical Education and Research. Available from: http://www.mayoclinic.org/tests-procedures/rheumatoid-factor/basics/definition/prc-20013484. Accessed March 3, 2015.

28.

VERBI Software – Consult – Sozialforschung GmbH. MAXQDA software for qualitative data analysis. 2014.

29.

SERMO. The voice for doctors. Physician social network. SERMO. Available from: http://blog.sermo.com/. Accessed July 29, 2016.

30.

Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–1288.

31.

Eysenbach G. Improving the quality of Web surveys: the Checklist for Reporting Results of Internet E-Surveys (CHERRIES). J Med Internet Res. 2004;6(3):e34.

32.

LabTestsOnline.org. Rheumatoid factor (updated June 1, 2014). Washington, DC: American Association for Clinical Chemistry. Available from: https://labtestsonline.org/understanding/analytes/rheumatoid/. Accessed March 3, 2015.

33.

Ybarra M, Suman M. Reasons, assessments and actions taken: sex and age differences in uses of Internet health information. Health Educ Res. 2008;23(3):512–521.

34.

Andreassen, HK, Bujnowska-Fedak, MM, Chronaki, CE, et al. European citizens’ use of E-health services: a study of seven countries. BMC Public Health. 2007;7(1):53.

35.

Ahmad F, Hudak PL, Bercovitz K, Hollenberg E, Levinson W. (2006). Are physicians ready for patients with Internet-based health information? J Med Internet Res. 2006;8(3):e22.

36.

Fiksdal AS, Kumbamu A, Jadhav AS, et al. Evaluating the process of online health information searching: a qualitative approach to exploring consumer perspectives. J Med Internet Res. 2014;16(10):e224.

37.

Hesse BW, Nelson DE, Kreps GL, et al. Trust and sources of health information: the impact of the internet and its implications for health care providers: findings from the first health information national trends survey. Arch Intern Med. 2005;165(22):2618–2624.

38.

Masys D, Baker D, Butros A, Cowles KE. Giving patients access to their medical records via the internet: the PCASSO experience. J Am Med Inform Assoc. 2002;9:181–191.

39.

Pons-Estel GJ, Alarcón GS, Scofield L, Reinlib L, Cooper GS. Understanding the epidemiology and progression of systemic lupus erythematosus. Semin Arthritis Rheum. 2010;39(4):257–268.

Supplementary materials


Creative Commons License © 2016 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.