Author, date and country | Patient group | Study type (level of evidence) | Outcomes | Key results | Study Weaknesses |
---|---|---|---|---|---|
Harrison,D et al 2011 issue 10 Canada | 330 Children aged One to Sixteen years from four RCTs undergoing needle related procedures. Including venepuncture, heel lance, finger lance, subcutaneous or intra-muscular injection, lumbar puncture or supra-pubic bladder aspiration. Given orally administered sweet tasting substance. Excluded studied with ages less than inclusion criteria and two studies not needle related interventions. | Level 1 Systematic review of RCTs or Quasi-RCTs Four planned prospective blinded RCTs with control group and one or more treatment intervention reviewed. Meta-analysis performed for both age groups. Risk of bias assessed for each study using Risk of Bias Scale(Higgins 2011) | In young children there is no definitive outcome to support or reject the use of sucrose in this age group. For school aged children the available evidence suggests that the use of sweet tasting solution is not of sufficient benefit to advocate its use. | The two studies for toddlers and young children have conflicting results. Therefore unable to recommend the use of 12% sucrose as a pain management strategy beyond the age of twelve months. Significant heterogeneity (I2 – 93%) reported. Two studies for older children comparing analgesic effect of sweetened gum had no effect either when sweet gum chewing stopped prior to or continued during the needle related procedure. Reported zero heterogeneity for the four meta-analyses for this age group. | Low number of studies included in the review therefore is there enough data to reduce both bias and random error. The review acknowledges sensitivity analysis was not carried out due to the small number of studies. The methodological quality was tabulated using the risk of bias scale which shown that the four studies had an unclear risk of selection bias as they had not described the sequence generation. Additionally the four studies had unclear risks of reporting bias as they had not registered their original protocols therefore they were not assessed. Furthermore there was incomplete outcome data from one study even after collecting original data from the author n59 but the published report included n67. It is acknowledged that extracting small numbers of age appropriate participants from the original data could be a source of bias. This also affects the external validity of the review; due to the small samples from each study are the results generalizable to the age group. |
Harrison,D et al 2015 issue 5 Canada | 808 Children aged One to Sixteen years from one unpublished and seven published RCTs who undergo needle related procedures. Including venepuncture heel lance, finger lance, subcutaneous or intra-muscular injection, lumbar puncture or supra-pubic bladder aspiration. Given orally administered sweet tasting substance. Excluded studied with ages less than inclusion criteria. | Level 1 Systematic review of 8 blinded RCTs. One unpublished (including two pilot RCTs) and seven published. This review was an update of the original Cochrane review (Harrison 2011) to ascertain if any subsequent research or publication would transpose the conclusions of the original review. All studies included were prospective blinded RCTs with a control and one or more treatment intervention. Meta-analyses of the data were carried out Heterogeneity of studies including the I2 statistic and sub-group analysis determined by age was carried out. Only one of the RCTs had numbers of participants greater than fifty. | For children aged one to four there is at present insufficient evidence to recommend sucrose use as a strategy for pain management. For school aged children the author’s findings state that sucrose as a strategy should not be considered as there is no evidence to support its effectiveness in this population. And recommend that it is not a research priority for the future. | For children aged one to four years the review found conflicting results. In two studies (Yilmaz2014) (Dilli2009) the use of sucrose significantly reduced pain scores and duration of crying. The study by Yilmaz (2014) also concluded that sucrose at a higher concentration was significantly more effective compared to a lower concentration, although also concluded that the lower concentration solution was more effective than the placebo (water). However the other studies of children in this age group had no significant reduction in crying time with sucrose use. The two studies of older children that considered the analgesic effects of sucrose use by using sweet tasting chewing gum compared to unsweetened chewing gum use prior to or during the procedure had no significant effect on reported pain. | Low number of studies included in the review. Of the eight studies four were reviewed in the previous Cochrane review (2011). All studies or sub-sets reviewed had sample sizes less than fifty with only one study having a sample size greater than this. However the data analysis only included the data from 25% sucrose group with control water to compare to 12% sucrose with no treatment in another study (Dilli 2009) the justification given for this was to improve heterogeneity but acknowledges that this still remained very high. And did not include the comparison as a whole group so that judgement could be made by the reader if there was difference in the effects on outcome. The methodological quality was again tabulated using the risk of bias scale. Only two of the studies sufficiently described random sequence allocations which were therefore classified as unclear risk of bias. And four of the eight studies, including the study with the largest number of participants were deemed at high risk of selection bias as the allocation concealment was unclear. The review also reports a high risk of performance bias for example in the Harrison (2014b) study the use lollipops as the oral sucrose agent would not be able to be blinded to the personnel of the participant, furthermore the older children who were able to verbalise which type of solution they were given may have prevented efforts in blinding the person carrying out the observation. Despite efforts made to blind in these studies particularly when introducing an intervention to older children who may disclose which intervention is used there is no mention in the review if indeed any of these efforts to reduce bias were made or if the person performing the outcome measurements were blinded to the original treatment allocation. Additionally how does classifying bias as unclear risk assist the reader without obtaining the original study themselves? The study by Yilmaz (2014), although the largest sample set included in the review the original planned or actual numbers of participants enrolled for the study were not given therefore unable to determine if all the data collected was included. For the older children is the sample set for the two studies 111 and 103 school aged children respectively for each RCT, even when reviewed together is the sample big enough to ensure that an inaccurate conclusion that the intervention has no effect be made, because the updated review has not included any further studies to this age group from the original review for comparison. The author of the three pilot studies included in the review was part of the review group and her participation included the evaluation of methodological quality, the meta-analysis of the data this could lead to bias whether intentional or not, all collaborating could be influenced by this fact and could be bias to the authors research as the reviewers were not blinded to author or study reviewed. Furthermore the author herself could be unduly critical or provide a more favourable appraisal of her own work |
Curtis,S et al 2012 Canada | Older infants, children and adolescents. Ranging from 0 months to 19 years, an overview of 4 Cochrane reviews, and 11 additional RCTs included by the author which were not included in the original Cochrane reviews. | Level 3 An overview to summarise the systematic reviews of the management of paediatric pain using different interventions. | The overview found no further evidence of the interventions reviewed having any further beneficial outcome. Furthermore that non-pharmacological and sucrose use in older children require further procedure specific study. | This review reports finding the use of sweet gum for toddlers or the use of 12% sucrose use for pain relief during needle related pain that there is no current evidence of benefit to support its use. The overview also considered other non-pharmacological methods and report finding potential effectiveness in other interventions such as distraction, combined cognitive-behavioural interventions, hypnosis, non-nutritive sucking and video distraction. It also finds that Amethocaine provides superior pain relief compared to EMLA for IVC procedures. | The purpose of the overview was to review Cochrane reviews to provide a broad scope of interventions that could be used during painful procedures in children outside the neonatal period but then concludes that the use of sucrose and other non-pharmacological interventions require further procedure specific research, therefore for what reasons were the results collated if only to report the findings of the studies and recommend that further research should keep the interventions separate. Furthermore it only presents parts of the original reviews and offers no explanation to how the included parts were selected or excluded thus introducing bias from the outset. The editors’ note describes the purpose to compile evidence from multiple Cochrane reviews into one accessible and usable document that it aims to focus on the treatment question of which treatment to use for a condition however the piece provided unclear answers to that question, it provides descriptive explanations of the interventions and rationale for their use and no appraisal of the reviews just descriptive representations of the findings and tables reproduced from the original review of methodological qualities of the studies reviewed. Additionally, only presents parts of the original reviews results from which the reader could draw its conclusions, by only including sections or sub-groups is this misleading to the reader. Furthermore the number of different interventions included did not make the review accessible, and although the types of outcome measures were described it was difficult to see where the comparisons lie. The search strategy was not transparent the search for systematic reviews was carried out on the Cochrane data base found 6 reviews which met the criteria of analgesia effect of an intervention on children under 19 years, 2 of which were excluded as procedure specific only two search terms were provided . Furthermore the author then reports completing an updated literature search on the Medline database for the four original reviews using their search strategies outlined and states they are given in an appendix however only provided the strategies for two of the four. Then only completed a literature review in the Embase database using the search strategy for one of the reviews demonstrating inconsistences in the search. From this search 13 additional RCTs were added to the overview additionally it was selective what data was extracted from each original review for example 3 trials were excluded from one review as they were single trials and meta-analysis had not been carried out but then uses a single trial from another review to demonstrate no significant difference in a comparison of the effectiveness of water prior to venepuncture and no treatment group. Further demonstrating selective bias. Additionally only 11 of 51 trials were included from one review as only the 11 fulfilled the criteria for older infant’s toddlers and older children. Although 3 trials from another review which included data from neonates were not excluded, this is acknowledged by the author and reports only a minimal data set however does not provide numbers or explain if this could bias results, on the contrary states that it contributes valuable information to the group of interest. The data synthesis was also debatable each of the Cochrane reviews had used different methods of reviewing results for example for dichotomous data risk ratio was given, for continuous data two reported standard mean difference and one mean difference the overview used Review Manager 5.0 to pool the data however when trials did not report means or standard deviation means were imputed with available medians and standard deviations were imputed with IQRs. Did this have significant effect upon the statistical relevance, also it was not reported which of the trials this was carried out for thus not allowing the reader to interpret the results themselves. In one summary of findings reports the removal of data of seven patients due to significant heterogeneity between the two studies however the heterogeneity remained high at I2 93% and I2 90% respectively did this adjustment have any significance? In another review an outlier trial was removed from analysis has this modified the effect on the results overall. The inclusion and exclusion of particular data without adequate explanation or justification raises concerns of the validity of the overall findings. |