Best Evidence Topics

Diagnosis

Bokhari F, Backenridge S, Ngy K, Roberts R, Smith R, Joseph K, An G, Wiley D, Barrett J.
Prospective evaluation of the sensitivity of physical examination in chest trauma
Journal of Trauma, Injury, Infection and Critical Care
2002;53:1135-1138.
  • Submitted by:Simon Carley - Consultant in Emergency Medicine
  • Institution:Manchester Royal Infirmary
  • Date submitted:13th November 2003
Before CA, i rated this paper: 6/10
1 Objectives and hypotheses
1.1 Are the objectives of the study clearly stated?
  Yes it was to determine which signs and symptoms are sensitive for haemopneumothorax. The underlying aim (not stated apriori by the investigators) is that if clinical exam is sensitive it may be used as a SnOut to prevent the need for chest Xray.
2 Design
2.1 Is the study design suitable for the objectives
  Yes. They have taken a cohort of patients with chest trauma, all had clinical exam, all had CXR. They then compared the results.
This is a diagnostic cohort study.
2.2 Who / what was studied?
  676 patients presenting to a level 1 trauma centre in the US. 523 patients had blunt trauma. 153 had penetrating trauma. Ages ranged from 12-98 years.
Patients who were cardiovascularly unstable were excluded from the study.
Recreuitment was non sequential. It is not stated why. We cannot infer whether this was random non recruitment (unlikely to cause significant bias) or systematic (where it might - eg no recruitment when only junior staff on).
All patients had their clinical exam documented by the admitting team. The CXR was read by the trauma team. Blunt trauma patients had one Xray. Penetrating patients had 2 (another at 6 hours).
2.3 Was this the right sample to answer the objectives?
  Yes it appears to represent a group of patients typical of those presenting to an ED. There is arguably a paucity of baseline information on the patients that may have helped in the interpretation of the findings.
2.4 Is the study large enough to achieve its objectives? Have sample size estimates been performed?
  No sample size calculation has been performed. No confidence intervals are given for the final estimates of sensitivity etc. This suggests a lack of understanding of research design / statistical inference.
2.5 Were all subjects accounted for?
  It would appear so.
2.6 Were all appropriate outcomes considered?
  I think so. They are only looking for CXR abnormality and they have done that.
2.7 Has ethical approval been obtained if appropriate?
  No stated
2.8 Was an independent blinded gold standard test applied to all subjects?
  All patients had a CXR. It is debatable if this is a gold standard for PNX as some are only seen on CT. However, it is probably acceptable as it reflects clinical practice and occult PNXs are unlikely to be that clinicall relevant.
3 Measurement and observation
3.1 Is it clear what was measured, how it was measured and what the outcomes were?
  No. There is little explanation of how the authors determined auscultation to be abnormal beyond the presence of bilateral breath sounds. I find this difficult to believe that this represents the abscence of breath sounds on one side and probably reflects a Difference in breath sounds. However, this is not explicitly stated and is a little confusing.
3.2 Are the measurements valid?
  Yes apart from that mentioned above
3.3 Are the measurements reliable?
  Yes
3.4 Are the measurements reproducible?
  Yes
4 Presentation of results
4.1 Are the basic data adequately described?
  No. Further baseline data and more explicit examination data would be useful
4.2 Are the results presented clearly, objectively and in sufficient detail to enable readers to make their own judgement?
  No there is insufficuent detail regarding exam findings.
4.3 Are the results internally consistent, i.e. do the numbers add up properly?
  Yes
5 Analysis
5.1 Are the data suitable for analysis?
  Yes
5.2 Are the methods appropriate to the data?
  Yes but not enough!
5.3 Are any statistics correctly performed and interpreted?
  Sensitivity Specificity PPV and NPV are appropriately performed
The abscence of confidence intervals is a concern. In fact you can work the confidence intervals out using an online statistical calculator e.g.http://members.aol.com/johnp71/ctab2x2.html
If you do this forn the blunt trauma patients I estimate the sensitivity is 100% BUT the confidence intervals go from 57-100%!!!!!!!!!!!
Hardly something that gives us a definitive answer/.
6 Discussion
6.1 Are the results discussed in relation to existing knowledge on the subject and study objectives?
  Yes.
6.2 Is the discussion biased?
  No
7 Interpretation
7.1 Are the authors' conclusions justified by the data?
  The authors conclusions are as follows.
1. Clinical exam can rule out CXR abnormailty in blunt trauma patients (CVS stable).
- No CIs given in fact they are so wide that this paper is not definitive. However, the prevalence in this group is very low so it is unlikely that a sufficiently large trial will be performed. The study does suggest that CXR abnormality is very unlikely in these patients
2. Clinical exam cannot rule out CXR abnormality in penetrating patients (CVS stable)
- This appears to be true and we should keep doing them
7.2 What level of evidence has this paper presented? (using CEBM levels )
  3
7.3 Does this paper help me answer my problem?
  Yes
After CA, i rated this paper: 2/10
8 Implementation
8.1 Can the test be implemented in practice?
  Hmmm Not sure. The interesting thing for me is that the prevalence is low and they have found a high sensitivity (though wide CIs). Do we believe the findings. Well the outcome (normal exam + pretty normal patient + CVS stable = no CXR) probably represents current practice in many UK emergency departments anyway for blunt trauma.
Penetrating trauma is clearly a different kettle of onions.
8.2 What aids to implementation exist?
  The decision to CXR could be incorporated into a protocol for ED use.
8.3 What barriers to implementation exist?
  Yet another protocol!!
8.4 Are my patients the same as the patients tested?
  Not absolutely clear but probably
8.5 Will the test improve diagnosis in my patients?
  No this is a cost/radiation/time saving decision