24 KiB
Reporting Guidelines for Scientific Studies
Overview
Reporting guidelines are evidence-based recommendations for what information should be included when reporting specific types of research studies. They provide checklists and flow diagrams to ensure complete, accurate, and transparent reporting, which is essential for readers to assess study validity and for other researchers to replicate the work.
The EQUATOR Network (Enhancing the QUAlity and Transparency Of health Research) maintains a comprehensive library of reporting guidelines. Using appropriate reporting guidelines improves manuscript quality and increases the likelihood of publication acceptance.
Why Use Reporting Guidelines?
Benefits
For authors:
- Ensures nothing important is forgotten
- Increases acceptance rates
- Improves manuscript organization
- Reduces reviewer requests for additional information
For readers and reviewers:
- Enables critical appraisal of study validity
- Facilitates systematic reviews and meta-analyses
- Improves understanding of what was actually done
For science:
- Enhances reproducibility
- Reduces research waste
- Improves transparency
- Enables better evidence synthesis
When to Use
- During study design: Many guidelines include protocol versions (e.g., SPIRIT for trial protocols)
- During manuscript drafting: Use checklist to ensure all items are covered
- Before submission: Verify adherence and often submit checklist with manuscript
- Many journals require: Reporting guideline checklists as part of submission
Major Reporting Guidelines by Study Type
CONSORT - Randomized Controlled Trials
Full name: Consolidated Standards of Reporting Trials
When to use: Any randomized controlled trial (RCT), including pilot and feasibility trials
Latest version: CONSORT 2010 (updated statement)
Key components:
- Checklist: 25 items covering title, abstract, introduction, methods, results, discussion
- Flow diagram: Participant flow through enrollment, allocation, follow-up, and analysis
Main checklist items:
- Title identifies study as randomized trial
- Structured abstract
- Scientific background and rationale
- Specific objectives and hypotheses
- Trial design description (parallel, crossover, factorial, etc.)
- Eligibility criteria for participants
- Settings and locations of data collection
- Interventions described in sufficient detail for replication
- Primary and secondary outcomes defined
- Sample size determination and power calculation
- Randomization sequence generation
- Allocation concealment mechanism
- Blinding implementation
- Statistical methods
- Participant flow with reasons for dropouts
- Recruitment dates and follow-up dates
- Baseline characteristics table
- Analysis results for each outcome
- Harms and adverse events
- Trial limitations
- Generalizability
- Interpretation consistent with results
- Trial registration number
- Full protocol access
- Funding sources
Extensions for specific designs:
- CONSORT for cluster randomized trials
- CONSORT for non-inferiority and equivalence trials
- CONSORT for pragmatic trials
- CONSORT for crossover trials
- CONSORT for N-of-1 trials
- CONSORT for stepped wedge designs
Where to access: http://www.consort-statement.org/
STROBE - Observational Studies
Full name: Strengthening the Reporting of Observational Studies in Epidemiology
When to use: Cohort studies, case-control studies, and cross-sectional studies
Latest version: STROBE 2007 (widely adopted standard)
Key study designs covered:
- Cohort: Follow exposed and unexposed groups forward in time
- Case-control: Compare exposure history between cases and controls
- Cross-sectional: Measure exposure and outcome simultaneously
Main checklist items (22 items):
- Title and abstract indicate study design
- Background and rationale
- Objectives
- Study design with rationale
- Setting, locations, and dates
- Eligibility criteria and selection methods
- Variables clearly defined (outcomes, exposures, confounders)
- Data sources and measurement methods
- Bias management strategies
- Study size justification
- Handling of quantitative variables
- Statistical methods including confounding and interactions
- Sensitivity analyses
- Participant flow with reasons for non-participation
- Descriptive data including follow-up time
- Outcome data
- Main results with unadjusted and adjusted estimates
- Other analyses (subgroups, sensitivity analyses)
- Key results summary
- Limitations with potential bias discussion
- Interpretation and generalizability
- Funding sources and role
Extensions:
- STROBE-ME (Molecular Epidemiology)
- RECORD (Routinely collected health data)
- STROBE-RDS (Respondent-driven sampling)
Where to access: https://www.strobe-statement.org/
PRISMA - Systematic Reviews and Meta-Analyses
Full name: Preferred Reporting Items for Systematic Reviews and Meta-Analyses
When to use: Systematic reviews with or without meta-analysis
Latest version: PRISMA 2020 (significant update)
Key components:
- Checklist: 27 items covering all sections
- Flow diagram: Study selection process
Main sections:
- Title: Identify as systematic review/meta-analysis
- Abstract: Structured summary
- Introduction: Rationale and objectives
- Methods:
- Eligibility criteria
- Information sources (databases, dates)
- Search strategy (full strategy for at least one database)
- Selection process
- Data collection process
- Data items extracted
- Risk of bias assessment
- Effect measures
- Synthesis methods
- Reporting bias assessment
- Certainty assessment (e.g., GRADE)
- Results:
- Study selection flow diagram
- Study characteristics
- Risk of bias assessment results
- Synthesis results (meta-analysis if applicable)
- Reporting biases
- Certainty of evidence
- Discussion:
- Limitations
- Interpretation
- Implications
Extensions:
- PRISMA for Abstracts
- PRISMA for Protocols (PRISMA-P)
- PRISMA for Network Meta-Analyses
- PRISMA for Scoping Reviews (PRISMA-ScR)
- PRISMA for Individual Patient Data
- PRISMA for Diagnostic Test Accuracy
- PRISMA for Equity-focused reviews
Where to access: http://www.prisma-statement.org/
SPIRIT - Study Protocols for Clinical Trials
Full name: Standard Protocol Items: Recommendations for Interventional Trials
When to use: Protocols for randomized trials and other planned intervention studies
Latest version: SPIRIT 2013
Purpose: Ensure trial protocols contain complete descriptions before trial begins
Main checklist items (33 items):
- Administrative information (title, trial registration, funding)
- Introduction (background, rationale, objectives)
- Methods: Trial design
- Study setting
- Eligibility criteria
- Interventions in detail
- Outcomes (primary and secondary)
- Participant timeline
- Sample size calculation
- Recruitment strategy
- Allocation and randomization
- Blinding
- Data collection methods
- Data management
- Statistical methods
- Monitoring (data monitoring committee)
- Harms reporting
- Auditing
- Ethics and dissemination
- Ethics approval
- Consent procedures
- Confidentiality
- Dissemination plans
Where to access: https://www.spirit-statement.org/
STARD - Diagnostic Accuracy Studies
Full name: Standards for Reporting of Diagnostic Accuracy Studies
When to use: Studies evaluating diagnostic test accuracy
Latest version: STARD 2015
Main checklist items (30 items):
- Study design identification
- Background information and objectives
- Study design description
- Participant selection criteria and recruitment
- Data collection methods
- Index test description and execution
- Reference standard description
- Rationale for choosing reference standard
- Test result definition and cutoffs
- Flow of participants with timing
- Baseline demographic and clinical characteristics
- Cross-tabulation of index test results by reference standard
- Estimates of diagnostic accuracy with confidence intervals
- Handling of indeterminate results
- Adverse events from testing
Flow diagram: Shows participant flow and test results
Where to access: https://www.equator-network.org/reporting-guidelines/stard/
TRIPOD - Prediction Model Studies
Full name: Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis
When to use: Studies developing, validating, or updating prediction models
Latest version: TRIPOD 2015
Types of studies:
- Model development only
- Model development with validation
- External validation of existing model
- Model update
Main checklist items (22 items):
- Title identifies study as prediction model study
- Abstract summarizes key elements
- Background and objectives
- Data source and participants
- Outcome definition
- Predictors (candidate and selected)
- Sample size justification
- Missing data handling
- Model building procedure
- Model specification (equation or algorithm)
- Model performance measures
- Risk groups if used
- Participant flow diagram
- Model development results
- Model performance
- Model updating if applicable
Where to access: https://www.tripod-statement.org/
ARRIVE - Animal Research
Full name: Animal Research: Reporting of In Vivo Experiments
When to use: All in vivo animal studies
Latest version: ARRIVE 2.0 (2020 update)
Two sets of items:
ARRIVE Essential 10 (minimum requirements):
- Study design
- Sample size calculation
- Inclusion and exclusion criteria
- Randomization
- Blinding
- Outcome measures
- Statistical methods
- Experimental animals (species, strain, sex, age)
- Experimental procedures
- Results and interpretation
ARRIVE Recommended Set (additional items for full reporting):
- Abstract, background, objectives
- Ethics statement
- Housing and husbandry
- Animal care and monitoring
- Interpretation and generalizability
- Protocol registration
- Data access
Where to access: https://arriveguidelines.org/
CARE - Case Reports
Full name: CAse REport Guidelines
When to use: Case reports and case series
Latest version: CARE 2013
Main checklist items (13 items):
- Title with "case report"
- Abstract summarizing case
- Introduction with case background
- Patient information (demographics, primary concern)
- Clinical findings
- Timeline of events
- Diagnostic assessment
- Therapeutic intervention
- Follow-up and outcomes
- Discussion with strengths and limitations
- Patient perspective
- Informed consent
Where to access: https://www.care-statement.org/
SQUIRE - Quality Improvement Studies
Full name: Standards for QUality Improvement Reporting Excellence
When to use: Healthcare quality improvement reports
Latest version: SQUIRE 2.0 (2015)
Main sections (18 items):
- Title and abstract
- Introduction (problem description, available knowledge, rationale, objectives)
- Methods (context, intervention, study design, measures, analysis, ethical review)
- Results (intervention, outcomes)
- Discussion (summary, interpretation, limitations, conclusions)
- Other information (funding)
Where to access: http://www.squire-statement.org/
CHEERS - Economic Evaluations
Full name: Consolidated Health Economic Evaluation Reporting Standards
When to use: Health economic evaluations
Latest version: CHEERS 2022 (major update from 2013)
Main checklist items (28 items):
- Title identification as economic evaluation
- Abstract
- Background and objectives
- Target population and subgroups
- Setting and location
- Study perspective
- Comparators
- Time horizon
- Discount rate
- Selection of outcomes
- Measurement of effectiveness
- Measurement and valuation of costs
- Currency and price adjustments
- Choice of model
- Assumptions
- Analytical methods
Where to access: https://www.equator-network.org/reporting-guidelines/cheers/
SRQR - Qualitative Research
Full name: Standards for Reporting Qualitative Research
When to use: Qualitative and mixed methods research
Latest version: SRQR 2014
Main sections:
- Title and abstract
- Introduction (problem formulation, purpose)
- Methods (qualitative approach, researcher characteristics, context, sampling strategy, ethical issues, data collection, data analysis, trustworthiness)
- Results (synthesis and interpretation, links to empirical data)
- Discussion (limitations, implications)
Alternative: COREQ (Consolidated criteria for reporting qualitative research) for interviews and focus groups
Where to access: https://www.equator-network.org/reporting-guidelines/srqr/
How to Use Reporting Guidelines
During Study Planning
- Identify relevant guideline based on study design
- Review checklist items that require planning (e.g., randomization, blinding)
- Design study to ensure all required elements will be captured
- Consider protocol guidelines (e.g., SPIRIT for trials)
During Manuscript Drafting
- Download checklist from guideline website
- Work through each item systematically
- Note where each item is addressed in manuscript (page/line numbers)
- Revise manuscript to include missing items
- Use flow diagrams as appropriate
Before Submission
- Complete formal checklist with page numbers
- Review all items are adequately addressed
- Include checklist with submission if journal requires
- Note guideline adherence in cover letter or methods
Example Checklist Entry
Item 7: Eligibility criteria for participants, and the settings and locations where the data were collected
Page 6, lines 112-125: "Participants were community-dwelling adults aged 60-85 years with mild cognitive impairment (MCI) as defined by Petersen criteria. Exclusion criteria included dementia diagnosis, major psychiatric disorders, or unstable medical conditions. Recruitment occurred from three memory clinics in Boston, MA, between January 2022 and December 2023."
Finding the Right Guideline
EQUATOR Network Search
Website: https://www.equator-network.org/
How to use:
- Select your study design from the wizard
- Browse by health research category
- Search for specific keywords
- Filter by guideline status (development stage)
By Study Design
| If your study is a... | Use this guideline |
|---|---|
| Randomized controlled trial | CONSORT |
| Cohort, case-control, or cross-sectional study | STROBE |
| Systematic review or meta-analysis | PRISMA |
| Protocol for a trial | SPIRIT |
| Diagnostic accuracy study | STARD |
| Prediction model study | TRIPOD |
| Animal study | ARRIVE |
| Case report | CARE |
| Quality improvement study | SQUIRE |
| Economic evaluation | CHEERS |
| Qualitative research | SRQR or COREQ |
Multiple Guidelines
Some studies may require multiple guidelines:
Example 1: Pilot RCT with qualitative component
- CONSORT for quantitative arm
- SRQR for qualitative component
Example 2: Systematic review of diagnostic tests
- PRISMA for review methods
- STARD considerations for included studies
Extensions and Adaptations
Many reporting guidelines have extensions for specific contexts:
CONSORT Extensions (examples)
- CONSORT for Abstracts: Structured abstracts for RCT reports
- CONSORT for Harms: Reporting adverse events
- CONSORT-EHEALTH: eHealth interventions
- CONSORT-SPI: Social and psychological interventions
PRISMA Extensions (examples)
- PRISMA-P: Protocols for systematic reviews
- PRISMA for Abstracts: Conference abstracts
- PRISMA-NMA: Network meta-analyses
- PRISMA-IPD: Individual patient data reviews
- PRISMA-S: Search strategies
- PRISMA-DTA: Diagnostic test accuracy reviews
STROBE Extensions (examples)
- STROBE-ME: Molecular epidemiology
- RECORD: Routinely collected health data
Creating Flow Diagrams
CONSORT Flow Diagram
Four stages:
- Enrollment: Assessed for eligibility
- Allocation: Randomly assigned to groups
- Follow-up: Received intervention, lost to follow-up
- Analysis: Included in analysis
Example:
Assessed for eligibility (n=250)
↓
Excluded (n=50)
• Did not meet criteria (n=30)
• Declined to participate (n=15)
• Other reasons (n=5)
↓
Randomized (n=200)
├─────────────────┬─────────────────┐
↓ ↓ ↓
Allocated to Allocated to Allocated to
Intervention A Intervention B Control
(n=67) (n=66) (n=67)
↓ ↓ ↓
Lost to follow-up Lost to follow-up Lost to follow-up
(n=3) (n=5) (n=2)
↓ ↓ ↓
Analyzed Analyzed Analyzed
(n=64) (n=61) (n=65)
PRISMA Flow Diagram
Stages:
- Identification: Records from databases and registers
- Screening: Records screened, excluded
- Included: Studies included in review and synthesis
New features in PRISMA 2020:
- Separate tracking for database and register searches
- Tracking of duplicate removal
- Clear distinction between reports and studies
Common Mistakes and How to Avoid Them
Mistake 1: Not Using Guidelines at All
Impact: Missing critical information, lower chance of acceptance
Solution: Identify and use appropriate guideline from study planning stage
Mistake 2: Using Guidelines Only After Manuscript is Complete
Impact: May realize key data were not collected or documented
Solution: Review guidelines during study design and data collection
Mistake 3: Incomplete Checklist Completion
Impact: Missed items remain unreported
Solution: Systematically address every single checklist item
Mistake 4: Using Outdated Guidelines
Impact: Missing recent improvements in reporting standards
Solution: Always check for latest version on official guideline website
Mistake 5: Using Wrong Guideline for Study Design
Impact: Important design-specific elements not reported
Solution: Carefully match study design to appropriate guideline
Mistake 6: Not Submitting Checklist When Required
Impact: Editorial desk rejection or delays
Solution: Check journal submission guidelines and include checklist
Mistake 7: Generic Reporting Without Specificity
Impact: Insufficient detail for replication or appraisal
Solution: Provide specific, detailed information for each item
Journal Requirements
Many Journals Now Require:
- Statement of adherence to reporting guidelines in Methods
- Completed checklist uploaded as supplementary file
- Page/line numbers on checklist indicating where items are addressed
- Flow diagrams as figures in manuscript
Example Methods Statement:
"This study is reported in accordance with the Strengthening the Reporting of
Observational Studies in Epidemiology (STROBE) statement. A completed STROBE
checklist is provided as Supplementary File 1."
Journals with Strong Requirements:
- PLOS journals (require checklists for specific designs)
- BMJ (requires CONSORT, PRISMA, and others)
- The Lancet (requires adherence statements)
- JAMA and JAMA Network journals (require checklists)
- Nature portfolio journals (encourage guidelines)
Resources
Official Guideline Websites
- EQUATOR Network: https://www.equator-network.org/
- CONSORT: http://www.consort-statement.org/
- STROBE: https://www.strobe-statement.org/
- PRISMA: http://www.prisma-statement.org/
- SPIRIT: https://www.spirit-statement.org/
- ARRIVE: https://arriveguidelines.org/
- CARE: https://www.care-statement.org/
Training Materials
- EQUATOR Network provides webinars and training resources
- Many guidelines have explanatory papers published in medical journals
- Universities often provide workshops on reporting guidelines
Software Tools
- Some reference managers can insert reporting guideline citations
- Covidence, RevMan for systematic review reporting
- PRISMA flow diagram generator: http://prisma.thetacollaborative.ca/
Checklist: Using Reporting Guidelines
Before starting your study:
- Identified appropriate reporting guideline(s)
- Reviewed checklist items requiring prospective planning
- Designed study to capture all required elements
- Registered protocol if applicable
During manuscript drafting:
- Downloaded latest version of guideline checklist
- Systematically addressed each checklist item
- Created required flow diagram
- Noted where each item is addressed (page/line)
Before submission:
- Completed formal checklist with page numbers
- Verified all items adequately addressed
- Included adherence statement in Methods
- Prepared checklist as supplementary file if required
- Checked journal-specific requirements
- Mentioned guideline adherence in cover letter
Venue-Specific Reporting Requirements
Reporting Standards by Venue Type
| Venue Type | Guideline Use | Transparency Requirements |
|---|---|---|
| Medical journals | Mandatory (CONSORT, STROBE, etc.) | Checklist required at submission |
| PLOS/BMC | Mandatory for study types | Checklist uploaded as supplement |
| Nature/Science | Recommended | Methods completeness emphasized |
| ML conferences | No formal guidelines | Reproducibility details required |
ML Conference Reporting Standards
NeurIPS/ICML/ICLR reproducibility requirements:
- Datasets: Names, versions, access methods, preprocessing
- Code: Availability statement; GitHub common
- Hyperparameters: All settings reported (learning rate, batch size, etc.)
- Seeds: Random seeds for reproducibility
- Computational resources: GPUs used, training time
- Statistical significance: Error bars, confidence intervals, multiple runs
- Broader Impact statement (NeurIPS): Societal implications
What to include (typically in appendix):
- Complete hyperparameter settings
- Training details and convergence criteria
- Hardware specifications
- Software versions (PyTorch 2.0, etc.)
- Dataset splits and any preprocessing
- Evaluation metrics and protocols
Enforcement and Evaluation
What gets checked:
- Medical journals: Checklist uploaded; adherence statement in Methods; systematic completeness
- PLOS/BMC: Mandatory checklists for certain designs; reproducibility emphasized
- High-impact: Methods sufficiency for replication (checklist often not required)
- ML conferences: Reproducibility checklist (NeurIPS); code availability increasingly expected
Common issues leading to rejection:
- Missing required checklists (medical journals)
- Insufficient methods detail for reproduction
- Missing key information (randomization, blinding, power calculation)
- No data/code availability statement when required
Methods statement examples:
Journal (STROBE):
This study followed STROBE reporting guidelines. Checklist provided in Supplement 1.
ML conference (reproducibility):
Code available at github.com/user/project. All hyperparameters in Appendix A.
Training used 4×A100 GPUs (~20 hours). Seeds: {42, 123, 456}.
Pre-Submission Reporting Checklist
For clinical trials (medical journals):
- CONSORT checklist complete with page numbers
- Trial registration number in abstract and methods
- CONSORT flow diagram included
- Statistical analysis plan described
- Adherence statement in Methods
For observational studies (medical/epidemiology):
- STROBE checklist complete
- Study design clearly stated
- Statistical methods detailed
- Confounders addressed
- Adherence statement in Methods
For systematic reviews:
- PRISMA checklist complete
- PRISMA flow diagram included
- Protocol registered (PROSPERO)
- Search strategy documented
- Risk of bias assessment included
For ML conference papers:
- All datasets named with versions
- Code availability stated (GitHub link if available)
- Hyperparameters listed (appendix acceptable)
- Random seeds reported
- Computational resources specified
- Error bars/confidence intervals shown
- Broader Impact statement (if required)