Reviewing the reviewers: the quality of reporting in three secondary journals

Citation
Pj. Devereaux et al., Reviewing the reviewers: the quality of reporting in three secondary journals, CAN MED A J, 164(11), 2001, pp. 1573-1576
Citations number
17
Categorie Soggetti
General & Internal Medicine","Medical Research General Topics
Journal title
CANADIAN MEDICAL ASSOCIATION JOURNAL
ISSN journal
08203946 → ACNP
Volume
164
Issue
11
Year of publication
2001
Pages
1573 - 1576
Database
ISI
SICI code
0820-3946(20010529)164:11<1573:RTRTQO>2.0.ZU;2-V
Abstract
Background: Secondary journals such as ACP journal Club (ACP), Journal Watc h (JW) and Internal Medicine Alert (IMA) have enormous potential to help cl inicians remain up to date with medical knowledge. However, for clinicians to evaluate the validity and applicability of new findings, they need infor mation on the study design, methodology and results. Methods: Beginning with the first issue in March 1997, we selected 50 conse cutive summaries of studies addressing therapy or prevention and internal m edicine content from each of the ACP, JW and IMA. We evaluated the summarie s for completeness of reporting key aspects of study design, methodology an d results. Results: All of the summaries in ACP reported study design, as compared wit h 72% of the summaries in JW and IMA (p < 0.001). In summaries of randomize d controlled trials the 3 secondary journals were similar in reporting conc ealment of patient allocation (none reported this), blinding status of part icipants (ACP 62%, JW 70% and IMA 70% [p = 0.7]), blinding status of health care providers (ACP 12%, JW 4% and IMA 4% [p = 0.4]) and blinding status o f judicial assessors of outcomes (ACP 4%, JW 4% and IMA 0% [p = 0.4]). ACP was the only one to report whether investigators conducted an intention-to- treat analysis (in 38% of summaries [p < 0.001]), and it was more likely th an the other 2 journals to report the precision of the treatment effect (as a p value or 95% confidence interval) (ACP 100%, JW 0% and IMA 55% [p < 0. 001]). Interpretation: Although ACP provided more information on study design, met hodology and results, all 3 secondary journals often omitted important info rmation. More complete reporting is necessary for secondary journals to ful fill their potential to help clinicians evaluate the medical literature.