Balneotherapy and Quality Assessment: Interobserver Reliability of the Maastricht Criteria List and the Need for Blinded Quality Assessment
Journal of Clinical EpidemiologyPublished 1 April 1998
Arianne P. Verhagen, Henrica C. W. de Vet, Robert A. de Bie, Alphons G.H. Kessels, Maarten Boers, Paul Knipschild
Citations101
SJR quartileQ1
SJR score3.15
SNIP2.66
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
It is concluded that the Maastricht criteria list is a reliable instrument in quality assessment of clinical trials and no evidence that blinding is necessary to prevent review bias is found.
Abstract
This study investigates aspects of the reliability of the Maastricht criteria list for quality assessment in systematic reviews, and whether blinded reviewing is necessary to prevent review bias. We used the data set of 12 articles from a systematic review concerning the efficacy of balneotherapy in patients with arthritis. Twenty reviewers participated of which two reviewers, who have been involved in developing the Maastricht criteria list, acted as reference standard. Half of all assessments were performed blindly. A high level of agreement was found between the reviewers and a high level of correlation with the reference standard. The quality scores between the blinded and unblinded assessment did not differ much. Based on the results we conclude that the Maastricht criteria list is a reliable instrument in quality assessment of clinical trials. Within the limits of this study we found no evidence that blinding is necessary to prevent review bias.
Keywords
Decision SciencesMedicineEconomics, Econometrics and Finance
Psychological BulletinIntraclass correlations: Uses in assessing rater reliability.
23,020 Citations1979Patrick E. Shrout, Joseph L. Fleiss
Controlled Clinical TrialsAssessing the quality of reports of randomized clinical trials: Is blinding necessary?
17,565 Citations1996Alejandro R. Jadad, R Andrew Moore +5 more
An instrument to assess the quality of reports of randomized clinical trials (RCTs) in pain research is described and its use to determine the effect of rater blinding on the assessments of quality is described.
Controlled Clinical TrialsA method for assessing the quality of a randomized control trial
1,370 Citations1981Thomas C. Chalmers, Harry Smith +5 more
A reasonable standard design and conduct of trials will facilitate the interpretation of those with conflicting results and help in making valid combinations of undersized trials.
New England Journal of MedicineMeta-Analyses of Randomized Controlled Trials
1,268 Citations1987Henry S. Sacks, Jayne Berrier +3 more
Statistics in MedicineA critical discussion of intraclass correlation coefficients
719 Citations1994Reinhold Müller, Petra Büttner
Journal of Clinical EpidemiologyAcupuncture and chronic pain: A criteria-based meta-analysis
314 Citations1990Gerben ter Riet, J. Kleunen +1 more
The efficacy of acupuncture in the treatment of chronic pain remains doubtful because of the quality of even the better studies, which proved to be mediocre.
BMJSpinal manipulation and mobilisation for back and neck pain: a blinded review.
274 Citations1991Bart W. Koes, Willem JJ Assendelft +3 more
Although some results are promising, the efficacy of manipulation has not been convincingly shown and much more attention should be paid to the methods of study.
Controlled Clinical TrialsAn empirical study of the possible relation of treatment differences to quality scores in controlled randomized clinical trials
246 Citations1990John D. Emerson, Elisabeth Burdick +3 more
In an empirical study of the relation of quality scores to treatment differences in published meta-analyses of 7 groups of controlled randomized clinical trials comprising 107 primary studies, it is found no relation between treatment difference and overall quality score.
Physical TherapyThe Efficacy of Laser Therapy for Musculoskeletal and Skin Disorders: A Criteria-Based Meta-analysis of Randomized Clinical Trials
227 Citations1992Heleen Beckerman, Rob A. de Bie +3 more
The efficacy of laser therapy for musculoskeletal disorders seems, on average, to be larger than the efficacy of a placebo treatment, and for rheumatoid arthritis, posttraumatic joint disorders, and myofascial pain, laser therapy seems to have a substantial specific therapeutic effect.
Physical TherapyThe Efficacy of Traction for Back and Neck Pain: A Systematic, Blinded Review of Randomized Clinical Trial Methods
224 Citations1995Geert J. van der Heijden, Anna JHM Beurskens +4 more
There are no clear indications, however, that traction is an ineffective therapy for back and neck pain, and much more attention should be paid to proper design and conduct, as well as to clear descriptions of crucial methodological features and results.
PhysiotherapySystematic Reviews on the Basis of Methodological Criteria
142 Citations1997Henrica C. W. de Vet, Robert A. de Bie +4 more
This method puts much emphasis on the methodological quality of the randomised clinical trials involved and various items concerning the internal validity, precision and relevance of the studies are scored in such a way that the amount of uncertainty about it also becomes visible.
Annals of the Rheumatic DiseasesSulphur bath and mud pack treatment for rheumatoid arthritis at the Dead Sea area.
131 Citations1990S Sukenik, Dan Buskila +4 more
Patients with classical or definite rheumatoid arthritis in a stage of active disease were treated for two weeks at a spa hotel and statistically significant improvement for up to three months was observed in the three treatment groups in most of the clinical indices.
JAMAMultiple Blinded Reviews of the Same Two Manuscripts
131 Citations1994Magne Nylenna
Experienced and young referees gave a stricter assessment of the manuscripts than their less experienced and older colleagues, and an English version seemed to be accepted more easily than a national-language version of the same manuscript.
PubMedSteroid injections for shoulder disorders: a systematic review of randomized clinical trials.
127 Citations1996Geert J. M. G. van der Heijden, Daniëlle van der Windt +3 more
The evidence in favour of the efficacy of steroid injections for shoulder disorders is scarce and the methods of most studies appear to be of poor quality, with only three out of the 16 studies scored more than 50 points, indicating a generally poor quality of methods.
JAMAThe Relationship Between Methodological Quality and Conclusions in Reviews of Spinal Manipulation
122 Citations1995Willem JJ Assendelft
The majority of the reviews concluded that spinal manipulation is an effective treatment for low back pain, and although the reviews with a relatively high methodological quality had a positive conclusion, strong conclusions were precluded by the overall low quality of the Reviews.
Journal of Clinical EpidemiologyThe efficacy of non-steroidal anti-inflammatory drugs (NSAIDS) for shoulder complaints. A systematic review
115 Citations1995D. van der Windt
Future studies should compare the benefit-risk ratios of NSAIDs and analgesics for shoulder complaints in order to establish whether the use ofNSAIDs is more favourable than analgesics, despite the higher risk of adverse reactions from NSAIDs.
Lara D. VeekenHOME EXERCISES ARE AS EFFECTIVE AS OUTPATIENT HYDROTHERAPY FOR OSTEOARTHRITIS OF THE HIP
103 Citations1993J. Green, Frank McKenna +2 more
It is concluded that for most patients, a carefully graded and supervised regimen of home exercises is beneficial and there is little benefit in adding hydrotherapy to this regimen.
PubMedEffect of spa therapy in Tiberias on patients with rheumatoid arthritis and osteoarthritis.
92 Citations1991Ori Elkayam, Irena Wigler +6 more
Journal of Clinical EpidemiologyResolving conflicting clinical trials: Guidelines for meta-analysis
91 Citations1988Zachary B. Gerbarg, Ralph I. Horwitz
An approach to meta-analysis is proposed that requires methodologic criteria to identify scientifically valid studies, and pooling criteria to combine data from each of the studies, which will have enhanced scientific validity and clinical applicability.
Journal of the Royal Society of HealthDouble-Blind Trial on the Effectiveness of the Puspokladany Thermal Water on Arthrosis of the Knee-Joints
65 Citations1989László Szücs, István Ratkó +4 more
It is shown, that the thermal water of Puspokladany is suitable for treating patients suffering from degenerative arthopathies, as shown by the significant increase of the leucocyte number.
PubMedTreatment of psoriatic arthritis at the Dead Sea.
60 Citations1994S Sukenik, Hani Giryes +4 more
Treatment of psoriasis and PsA at the Dead Sea area is very efficacious and the addition of balneotherapy can have additional beneficial effects on patients with PsA.
BMJSystematic Reviews: Some examples
59 Citations1994P. Knipschild
This article gives examples of systematic reviews on vitamin C and the common cold, pyridoxine against the premenstrual syndrome, homeopathy, and physiotherapy.
Statistics in MedicineLessons from overviews of cardiovascular trials
52 Citations1987Curt D. Furberg, Timothy M. Morgan
Overviews of clinical trials in the cardiovascular field have been critically reviewed and recommendations given based on lessons learned include the avoidance of three types of biases--publication bias, overviewer bias and investigator bias.
JAMAMultiple blinded reviews of the same two manuscripts. Effects of referee characteristics and publication language
48 Citations1994M. Nylenna
Clinical RehabilitationInvestigation of the effect of hydrotherapy in the treatment of osteoarthritic hips
45 Citations1990Karen Sylvester
This pilot study compares the treatment of osteoarthritic hips by hydrotherapy with that of short wave diathermy and exercises and found that functional ability had improved in the group treated by hydroTherapy, who also reported a higher score on the life satisfaction scale.
PubMedBalneotherapy for rheumatoid arthritis at the Dead Sea.
44 Citations1995S Sukenik, Lily Neumann +3 more
Patients with active rheumatoid arthritis were treated for 12 days at the Ein Gedi Spa with a combination of daily Dead Sea bathing and sulphur baths, and Statistically significant improvement lasting up to 3 months was observed only in the three treatment groups.
Journal of Clinical Epidemiology“Meta-analysis: Statistical alchemy for the 21st century”: Discussion. A plea for a more balanced view of meta-analysis and systematic overviews of the effect of health care interventions
30 Citations1995Alessandro Liberati
The paper challenges Feinsteins' arguments indicating that meta-analysis is inherently faulted on four grounds, providing examples drawn from the published literature to indicate that--despite their current limitations--systematic reviews are a necessary step to synthesize information, orient clinical research and help produce practice guidelines.
JAMAThe relationship between methodological quality and conclusions in reviews of spinal manipulation
30 Citations1995Willem JJ Assendelft
Physikalische Medizin Rehabilitationsmedizin KurortmedizinBeeinflussung der Schmerzsymptomatik im Fußbereich bei Patienten mit Rheumatoid-Arthritis durch unterschiedliche Physiotherapiemittel
3 Citations1990J. Švarcová, T. Hofta +3 more
Data Archiving and Networked Services (DANS)Meta-analysis for physiotherapists: on the importance of standardization and blinding in the study of literature
2 Citations1990L.M. Bouter, Gerben ter Riet
The main topic of this article will be the methodology of criterium-based meta-analyses, which have become rather popular recently in the field of physiotherapy.