Mendeley and Reference Management Software: Why They Fall Short for EU MDR Clinical Evaluation
Introduction
The use of reference management software and citation managers has become increasingly common in academic and clinical research workflows. Citation management tools such as Mendeley and EndNote support the organisation of literature, streamline citation management, and improve efficiency in handling large volumes of scientific data.
However, as expectations for literature review continue to evolve under EU MDR, the role of these tools must be understood within the context of regulatory requirements. Clinical evaluation now requires not only the collection of relevant literature, but also the ability to demonstrate how that evidence has been systematically identified, evaluated, and integrated within the broader evidence lifecycle.
While reference management software and citation managers are useful in supporting these activities, their functionality is limited to specific aspects of the workflow. Understanding where these tools add value, and where additional structured processes are required, is essential to ensure that clinical evaluation remains transparent, traceable, and aligned with regulatory expectations.
Role of Reference Management Tools
Reference management tools play a valuable role in supporting literature-based work, particularly in environments where large volumes of scientific data need to be handled efficiently. Tools such as Mendeley allow users to organise references, store and annotate PDFs, and generate citations within writing software, helping to streamline the process of drafting academic and technical documents.
In practice, citation managers can significantly reduce administrative burden by centralising literature and simplifying reference formatting. They also support collaboration and accessibility, particularly where multiple documents or versions are involved.
Despite these benefits, their primary function is to manage and organise information, rather than to support the structured processes required for regulatory-grade clinical evaluation. As such, while they are a useful component of the overall workflow, their role is inherently limited in scope.
Nevertheless, in many settings, these tools form a central component of literature workflows, particularly in managing large and complex reference libraries.
EU MDR Expectations for Literature Review
Within the EU MDR framework, the role of literature review extends beyond the identification of relevant publications to the structured evaluation of clinical evidence. Article 61 establishes the requirement for sufficient clinical evidence to demonstrate the safety and performance of a medical device, while Annex XIV outlines the need for a systematic and documented approach to clinical evaluation.
Within this context, literature review is expected to follow a clearly defined methodology. This includes the development of structured search strategies, with predefined databases, search terms, and inclusion and exclusion criteria, allowing the process to be transparent and reproducible.
In addition, the selection of literature must be supported by documented screening processes, demonstrating how studies have been identified, assessed, and either included or excluded. This ensures that the evidence base is not only comprehensive, but also traceable.
Critical appraisal forms a further essential component of the process. Clinical data must be evaluated for quality, relevance, and potential risk of bias using a structured approach, supporting a balanced and well-justified interpretation of findings.
As such, literature review under EU MDR represents a continuous and methodologically driven process, rather than a simple collection of references. The emphasis is placed not only on the evidence itself, but on how that evidence has been identified, evaluated, and integrated within the broader clinical evaluation.
Key Limitations of Reference Management Tools in EU MDR Context
Reference management tools such as Mendeley are widely used to organise literature and support citation workflows. However, their functionality is primarily designed for reference storage and document management, rather than the structured requirements of clinical evaluation under EU MDR.
One commonly encountered limitation is the reliance on automatically generated metadata. When importing PDFs, inaccuracies in author names, publication details, or journal information may occur, requiring manual correction. While this may be manageable in smaller projects, it introduces the potential for inconsistencies across larger evidence bases and may affect the reliability of referenced data within a Clinical Evaluation Report.
Reference management tools do not provide structured support for documenting literature search strategies. EU MDR requires that search methodologies be transparent and reproducible, including clearly defined databases, search terms, and inclusion and exclusion criteria. These elements must be explicitly documented, whereas reference management tools typically store outputs rather than capturing the underlying search process.
Limitations also arise in the screening and selection of literature. Tools such as Mendeley do not provide built-in functionality for systematic screening workflows, such as PRISMA-based tracking or structured inclusion and exclusion logging. As a result, these steps are often managed externally, increasing fragmentation and reducing traceability.
Another key consideration is the lack of integrated critical appraisal functionality. While reference managers allow storage and annotation of documents, they do not support structured evaluation of study quality, relevance, or risk of bias. This requires additional processes outside the tool, further separating evidence management from evaluation.
Technical limitations, such as syncing inconsistencies, plugin instability, and storage constraints, may also affect usability. While these issues are operational in nature, they can contribute to inefficiencies and increase the risk of incomplete or inconsistent evidence management across the evaluation process.
Collectively, these limitations highlight a broader challenge: reference management tools support the organisation of literature, but do not provide the structured, traceable workflows required for regulatory-grade clinical evaluation under EU MDR.
Summary of Key Limitations of Reference Management Tools in EU MDR Literature Review
| Limitation Area | Key Issue | Regulatory Impact |
|---|---|---|
| Search documentation | No structured recording of search strategies | Reduced reproducibility |
| Screening workflows | No structured inclusion/exclusion tracking | Limited traceability |
| Critical appraisal | No systematic evaluation of study quality | Weak evidence justification |
| Traceability | Difficult to demonstrate decision-making | Increased regulatory scrutiny |
| Workflow integration | Processes managed across multiple tools | Fragmentation and inefficiency |
Implications for Regulatory Submissions
Limitations in literature review processes often become most apparent during regulatory assessment, where both the clinical evidence and the methods used to generate it are subject to detailed scrutiny.
Where literature review activities are not supported by transparent and reproducible methodologies, it may be difficult to demonstrate how evidence has been identified, selected, and evaluated. This can lead to questions regarding the completeness and reliability of the clinical evidence presented. These issues are frequently raised by Notified Bodies in the form of review comments or requests for clarification, particularly where documentation of search strategies, screening decisions, or critical appraisal is limited or inconsistent.
Addressing such observations may require additional analysis, re-documentation of processes, or expansion of the evidence base, which can increase workload and extend review timelines.
More broadly, gaps in methodology and traceability can affect the overall defensibility of the Clinical Evaluation Report, particularly where conclusions are not clearly supported by a structured and well-documented evidence base. As such, the strength of a literature review is not only reflected in the evidence collected, but in the clarity and consistency of the processes used to generate it.
Moving Beyond Basic Tools
Literature Review Process Under EU MDR
Integrated literature review workflow required for EU MDR-aligned clinical evaluation
Addressing the limitations of reference management tools requires a shift from isolated functions toward more structured and integrated workflows. Under EU MDR, literature review is expected to operate as part of a broader clinical evaluation process, where each step is clearly defined, documented, and aligned.
In this context, effective literature review involves the integration of multiple components, including systematic search strategy development, structured screening and selection processes, critical appraisal of clinical data, and comprehensive documentation of methodology and outcomes. These elements must function cohesively to support transparency, reproducibility, and traceability.
Rather than relying on a single tool, clinical evaluation processes are typically supported by a combination of systems and structured procedures, ensuring that each stage of the workflow is appropriately captured and documented.
As such, the focus shifts from managing individual references to managing the process by which evidence is generated, evaluated, and incorporated into the Clinical Evaluation Report.
Conclusion
Under EU MDR, literature review extends beyond the management of references to the structured evaluation of clinical evidence. While reference management tools play a useful role in organising and supporting literature workflows, they do not address the full scope of requirements needed for regulatory-grade clinical evaluation.
The strength of a Clinical Evaluation Report lies not only in the evidence it contains, but in the methodology used to generate, assess, and integrate that evidence. Consistency, transparency, and traceability across the evaluation process remain central to demonstrating that clinical conclusions are well-founded and defensible.
As such, emphasis is placed on how evidence is handled throughout the process, rather than how it is stored or managed.
If you are currently managing your EU MDR literature review workflow through reference management software and want to understand what a more structured, regulatory-grade approach looks like, Citemed can help. Get in touch to discuss your requirements.
FAQs
Is Mendeley sufficient for EU MDR literature review?
Mendeley is a useful reference management tool for organising literature, storing PDFs, and managing citations, but it is not sufficient for EU MDR literature review on its own. EU MDR requires a structured, reproducible methodology including documented search strategies, systematic screening workflows, and critical appraisal of clinical evidence — none of which are supported by reference management software. For regulatory-grade clinical evaluation, manufacturers need integrated workflows that go beyond reference storage and citation management.
What is the difference between reference management software and a systematic review tool?
Reference management software such as Mendeley or EndNote is designed to organise, store, and cite literature. It handles the administrative aspects of managing references but does not support the structured processes required for systematic literature review — including search strategy documentation, PRISMA-based screening workflows, or critical appraisal of study quality. Systematic review tools are specifically designed to manage these processes, providing the traceability and reproducibility that EU MDR requires.
What do citation managers lack for EU MDR compliance?
Citation managers lack several capabilities essential for EU MDR compliance. They do not provide structured support for documenting search strategies, systematic screening and inclusion and exclusion logging, critical appraisal of study quality, or integration of literature review with broader clinical evaluation activities. These limitations mean that manufacturers relying solely on citation managers face significant gaps in traceability and reproducibility — two of the most scrutinised aspects of clinical evidence methodology during Notified Body assessment.
What does EU MDR require from a literature review workflow?
EU MDR requires that literature review follows a clearly defined, transparent, and reproducible methodology. This includes structured search strategies with predefined databases, search terms, and inclusion and exclusion criteria; systematic screening processes with documented decisions; critical appraisal of clinical data for quality, relevance, and risk of bias; and comprehensive documentation of all methodology and outcomes. These requirements go significantly beyond what reference management software is designed to support.
What is the best approach to literature review for EU MDR clinical evaluation?
The most effective approach to literature review for EU MDR clinical evaluation integrates systematic search strategy development, structured screening and selection, critical appraisal, and comprehensive documentation within a single, cohesive workflow. Rather than relying on standalone reference management software or citation managers, manufacturers benefit from platforms specifically designed for regulatory evidence generation — where each stage of the process is captured, documented, and traceable across the full clinical evaluation lifecycle. CiteMed’s Evidence Cloud is designed specifically for this purpose, integrating literature review with clinical evaluation, post-market surveillance, and PMCF within a single regulatory evidence ecosystem.
Why is traceability important in EU MDR literature review?
Traceability is essential in EU MDR literature review because Notified Bodies assess not only the evidence presented in a Clinical Evaluation Report but also the processes used to generate it. Manufacturers must be able to demonstrate how evidence was identified, how screening decisions were made, how studies were appraised, and how conclusions were reached. Where traceability is limited — as is typically the case when relying solely on reference management software — it may be difficult to justify decisions during regulatory review, leading to requests for clarification, additional documentation, or rework that extends submission timelines significantly.
