Executive Summary of HTA journal title
Health Technol Assess 2007;11(32):1–188
Current practice, accuracy, effectiveness and cost-effectiveness of the school entry hearing screen
View/Download full text in Adobe Acrobat format (1.0 Mb)
View/Download this summary in Adobe Acrobat format (suitable for printing)
J Bamford,1* H Fortnum,2 K Bristow,1 J Smith,3 G Vamvakas,4 L Davies,4 R Taylor,3† P Watkin,5 S Fonseca,6 A Davis7 and S Hind8
1 Human Communication and Deafness, University of Manchester, UK
2 Trent Research and Development Support Unit, University of Nottingham, UK
3 Department of Public Health and Epidemiology, University of Birmingham, UK
4 Health Economics Research, University of Manchester, UK
5 Paediatric Audiological Medicine, Whipps Cross Hospital, London, UK
6 Developmental Paediatrics, St George's Hospital, London, UK
7 MRC Hearing and Communication Group, University of Manchester, UK
8 MRC Institute of Hearing Research, University of Nottingham, UK
* Corresponding author
† Present address: Peninsula Technology Assessment Group, Universities of Exeter and Plymouth, UK
BackgroundThe ability to hear is important, particularly during children's formal education. Hearing impairment is amenable to intervention and hence a screening programme when children begin their school careers has potential value. School entry hearing screening (SES) has been implemented throughout the UK since the 1950s. There is evidence of mixed practice and uncertainty about the value of the screen. In addition, recent changes in childhood hearing screening policy (abandonment of a screen at 8 months and introduction of universal newborn screening) have implications for identification of children with hearing impairment at school entry.
ObjectivesThis report aimed to determine answers to the following three questions:
- What is current practice for the SES in the UK?
- What is known about the accuracy of alternative screening tests and the effectiveness of interventions?
- What is known about costs, and what is the likely cost-effectiveness of the SES?
MethodsA national postal questionnaire survey was addressed to all leads for the SES in the UK, considering current practice in terms of implementation, protocols, target population and performance data. Primary data from cohort studies in one area of London were examined. A systematic review of alternative SES tests, test performance and impact on outcomes was carried out. Finally, a review of published studies on costs, plus economic modelling of current and alternative programmes was prepared.
The evidence from the national survey of current practice is that:
- the SES is in place in most areas of England, Wales and Scotland; just over 10% of respondents have abandoned the screen; others are awaiting guidance in the light of the national implementation of newborn hearing screening
- coverage of the SES is variable, but is often over 90% for children in state schools
- referral rates are variable, with a median of about 8%
- the test used for the screen is the pure tone sweep test but with wide variation in implementation, with differing frequencies, pass criteria and retest protocols; written examples of protocols were often poor and ambiguous
- there is no national approach to data collection, audit and quality assurance, and there are variable approaches at local level
- the screen is performed in less than ideal test conditions
- resources are often limited and this has an impact on the quality of the screen.
The evidence from the primary cohort studies is that:
- the prevalence of permanent childhood hearing impairment continues to increase through infancy
- of the 3.47 in 1000 children with a permanent hearing impairment at school screen age, 1.89 in 1000 required identification after the newborn screen
- the introduction of newborn hearing screening is likely to reduce significantly the yield of SES for permanent bilateral and unilateral hearing impairments; yield had fallen from about 1.11 in 1000 before newborn screening to about 0.34 in 1000 for cohorts that had had newborn screening, of which only 0.07 in 1000 were unilateral impairments
- just under 20% of permanent moderate or greater bilateral, mild bilateral and unilateral impairments, known to services as 6-year-olds or older, remained to be identified around the time of school entry.
The evidence from the systematic review of the alternative tests and of the effectiveness of interventions is that:
- no good-quality published comparative trials of alternative screens or tests for school entry hearing screening were identified
- studies concerned with the relative accuracy of alternative tests are difficult to compare and often flawed by differing referral criteria and case definitions; with full pure tone audiometry as the reference test, the pure tone sweep test appears to have high sensitivity and high specificity for minimal, mild and greater hearing impairments, better than alternative tests for which evidence was identified
- there is insufficient evidence to draw any conclusions about possible harm of the screen
- there were no published studies identified that examined the possible effects of SES on longer term outcomes.
The evidence from the cost-effectiveness study is that:
- no good-quality published economic evaluations of SES were identified
- a universal SES based on pure tone sweep tests was associated with higher costs and slightly higher quality-adjusted life-years (QALYs) compared with no screen and other screen alternatives; the incremental cost-effectiveness ratio for such a screen is around £2500 per QALY gained; the range of expected costs, QALYs and net benefits was broad, indicating a considerable degree of uncertainty
- targeted screening could be more cost-effective than universal SES
- lack of primary data and the wide limits for variables in the modelling mean that any conclusions must be considered indicative and exploratory only.
A national screening programme for permanent hearing impairment at school entry meets all but three of the criteria for a screening programme, but at least six criteria are not met for screening for temporary hearing impairment.
The lack of good-quality evidence in this area remains a serious problem. Services should improve quality and audit screen performance for identification of previously unknown permanent hearing impairment, pending evidence-based policy decisions based on the research recommendations.
Recommendations for research
Further research is highlighted in the following areas:
- evaluation of an agreed national protocol for services delivering the SES to make future studies and audits of screen performance more directly comparable
- development and evaluation of systems for data monitoring so that robust data on screen performance are available
- determination with greater certainty of the prevalence of congenital unilateral hearing impairment, and permanent mild and minimal hearing impairment at school entry, that could be identified by a suitable quality-assured screen protocol
- a comparison of the effectiveness, efficacy and efficiency of alternative approaches (reactive services, formal surveillance, targeted screening and universal screening at school entry age) to the identification of permanent hearing impairment postnewborn screen
- controlled studies of the effectiveness of hearing screening and subsequent interventions for later outcomes in children with permanent mild, minimal and unilateral hearing impairment identified at school entry
- determination of the distribution of detection thresholds for pure tones in the population at school entry.
Bamford J, Fortnum H, Bristow K, Smith J, Vamvakas G, Davies L, et al. Current practice, accuracy, effectiveness and cost-effectiveness of the school entry hearing screen. Health Technol Assess 2007;11(32).
NIHR Health Technology Assessment Programme
The Health Technology Assessment (HTA) programme, now part of the National Institute for Health Research (NIHR), was set up in 1993. It produces high-quality research information on the costs, effectiveness and broader impact of health technologies for those who use, manage and provide care in the NHS. 'Health technologies' are broadly defined to include all interventions used to promote health, prevent and treat disease, and improve rehabilitation and long-term care, rather than settings of care.
The research findings from the HTA Programme directly influence decision-making bodies such as the National Institute for Health and Clinical Excellence (NICE) and the National Screening Committee (NSC). HTA findings also help to improve the quality of clinical practice in the NHS indirectly in that they form a key component of the 'National Knowledge Service'.
The HTA Programme is needs-led in that it fills gaps in the evidence needed by the NHS. There are three routes to the start of projects.
First is the commissioned route. Suggestions for research are actively sought from people working in the NHS, the public and consumer groups and professional bodies such as royal colleges and NHS trusts. These suggestions are carefully prioritised by panels of independent experts (including NHS service users). The HTA Programme then commissions the research by competitive tender.
Secondly, the HTA Programme provides grants for clinical trials for researchers who identify research questions. These are assessed for importance to patients and the NHS, and scientific rigour.
Thirdly, through its Technology Assessment Report (TAR) call-off contract, the HTA Programme commissions bespoke reports, principally for NICE, but also for other policy-makers. TARs bring together evidence on the value of specific technologies.
Some HTA research projects, including TARs, may take only months, others need several years. They can cost from as little as £40,000 to over £1 million, and may involve synthesising existing evidence, undertaking a trial, or other research collecting new data to answer a research problem.
The final reports from HTA projects are peer-reviewed by a number of independent expert referees before publication in the widely read monograph series Health Technology Assessment.
Criteria for inclusion in the HTA monograph series
Reports are published in the HTA monograph series if (1) they have resulted from work for the HTA Programme, and (2) they are of a sufficiently high scientific quality as assessed by the referees and editors.
Reviews in Health Technology Assessment are termed 'systematic' when the account of the search, appraisal and synthesis methods (to minimise biases and random errors) would, in theory, permit the replication of the review by others.
The research reported in this monograph was commissioned by the HTA Programme as project number 03/05/01. The contractual start date was in October 2004. The draft report began editorial review in August 2006 and was accepted for publication in February 2007. As the funder, by devising a commissioning brief, the HTA Programme specified the research question and study design. The authors have been wholly responsible for all data collection, analysis and interpretation, and for writing up their work. The HTA editors and publisher have tried to ensure the accuracy of the authors' report and would like to thank the referees for their constructive comments on the draft document. However, they do not accept liability for damages or losses arising from material published in this report.
The views expressed in this publication are those of the authors and not necessarily those of the HTA Programme or the Department of Health.
Editor-in-Chief: Professor Tom Walley
Series Editors: Dr Aileen Clarke, Dr Peter Davidson, Dr Chris Hyde, Dr John Powell, Dr Rob Riemsma and Dr Ken Stein
Programme Managers: Sarah Llewellyn Lloyd, Stephen Lemon, Stephanie Russell and Pauline Swinburne
© 2007 Crown Copyright Top ^Details page for this publication