Home > Frequently Asked Questions
Frequently Asked Questions
How do I log-in?
Only deanery staff and the Surveys Working Group (SWG) members have a log-in. Click on the 'log-in' link at the top of the page and enter your email address and password.
What are the implications of the merger of PMETB with the GMC?
The GMC became responsible for all functions of PMETB on 1 April 2010. All surveys conducted in 2009 and before were carried out by PMETB (in partnership with CoPMED where stated). The 2010 surveys began in February 2010 and finished after the merger – as such they were carried out jointly between PMETB, the GMC and CoPMED.
How do I find out when the site is updated?
To be kept informed of changes to the site, please register using the form provided, accessed via the link at the top of the page. Deanery staff who have log-ins are already registered.
How were the surveys’ questions developed?
Each year the surveys are reviewed with researchers, trainees, trainers and other stakeholders to ensure they stay relevant and fresh while still allowing us to make comparisons over time. In 2008/09, for example, new questions were introduced on the trainee survey which asked about the redistribution of tasks from junior doctors to other health professionals, such as nurses and also on the use of simulators in medical training.
This year (2010) there have been new questions added to the trainee survey on child protection and on both the trainee and trainer surveys questions on the European Working Time Regulation (EWTR) were included to reflect changes to the working time regulations for doctors:
http://www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsLegislation/DH_104300
The Surveys’ (2006. 2007, 2008/09) were developed by PMETB with the support of the SWG prior to the merge with GMC (1 April 2010).
The Surveys Working Group advised PMETB on the surveys’ items, survey administration and the reporting of the surveys’ results.
All deaneries are required to publish an action plan as part of their Annual Deanery Report (ADR). The action plans are the key, forward looking part of the ADR, identifying actions to be taken to resolve areas of concern. These action plans routinely build in feedback from the trainee and trainer surveys. Please
click here to view the Annual deanery reports.
The Trainee Survey
In 2008/09, for the first time, the survey form was pre-populated with deaneries providing data about the post the trainee was evaluating in the survey form: deanery, provider, programme specialty, post specialty, GP programme if applicable and grade. It was also the first time that trainees were emailed a receipt as proof of completion to provide at their ARCP/RITA if required. Please see the 2008-2009 National Training Surveys analysis report.
The 2010 online survey reports will be published between July and September. For more information please see Briefing Note Four
The Trainer Survey
The National Survey of Trainers collects evidence on whether trainers consider that they are able to undertake their duties as trainers effectively, whether these duties are formally recognised in their job plans and training and how supported trainers feel in their role. This information helps to inform future policy and enables trainees and trainers to get more recognition of the resources required to support postgraduate training. Please see the 2008-2009 National Training Surveys analysis report.
The 2010 online survey reports will be published between July and September. For more information please see Briefing Note Four
When were previous surveys conducted?
The Trainee Survey
The first trainee survey was delivered in 2006. The results were published on CD Rom and were distributed to all Royal Colleges and Faculties.
The survey was repeated in 2007 and 2008/09. The online reporting tool was added in 2007. The results of the National Survey of Trainees, 2007 can be seen in full (for example, for a particular hospital or deanery) here.
The 2008/09 survey took place between 7 January and 9 April 2009 and included all trainees in a PMETB approved post (except posts approved as Out of Programme Experience) on 2 January 2009, whose data were supplied to PMETB by the deaneries in response to a data request on the 8 October 2008.
The Trainer Survey
The first trainee survey took place in 2007 and the results of the National Survey of Trainers, 2007 can be seen in full (for example, for a particular hospital or deanery) via our reporting tool website.
The 2008/09 survey took place between 26 March and 23 June 2009 and targeted all consultants regardless of whether they were identified as trainers as well as all GP trainers (and GPs with foundation trainees) on the basis that they all have the potential for having responsibility for supervising trainees.
When did the 2010 surveys commence?
The pilot trainee and trainer surveys were launched during the last week in February 2010 and are taking place in Northern Ireland this year. The Pilot is due to end on 31 May 2010.
The National Training Surveys 2010 (England, Scotland and Wales) started on 01 April 2010 and are due to end on 30 June 2010.
Did the surveys have the required approvals?
Following the National Research Ethics Guidance Differentiating Audit, Service Evaluation and Research ethics approval is not required as the surveys are classified as service evaluation. This classification of the work as service evaluation has been confirmed by the Nottingham Research Ethics Committee. The National Training Surveys 2010 have been approved by the Review of Central Returns Steering Committee – ROCR. The ROCR reference number is: ROCR-Lite/OR/0275/000VOLU.
How are the surveys administered?
The Trainee Survey
In 2008/09 trainees were sent an email with a unique survey access code asking them to complete a web-based form. Those that didn’t complete were sent reminder emails. The database sent a total of 201,038 emails. Trainees who were not on the deanery lists were able to request a Survey Access Code directly from the surveys team.
The 2010 survey adopted a similar approach. Participants are sent email invitations which include a link to the survey and a unique survey access code. Non-responders are sent reminders to encourage them to take part in the survey.
The Trainer Survey
In 2008/09 for deaneries that were unable to list out all consultants, a cascade methodology was employed to try and capture the remainder: deaneries nominated a contact at each provider, who was asked to forward an email from PMETB to their consultant colleagues.
For the 2010 trainer survey the deaneries have provided PMETB (became GMC following the merge on 1 April 2010) with trainer data. GMC has distributed email invitations to all trainers and trainees with valid email addresses. Each email invitation contains a link to the relevant survey and a unique access code, which is required to complete the survey.
Survey Registration Form 2010: Trainees and Trainers
In 2008/09 we had a registration form where trainees and trainers could add themselves to the survey.
Similarly, in 2010 trainees and trainers that have not received an email invitation can complete a survey registration form. We verify their details with the deanery and send them their email invitation with their unique survey access code.
What was the overall response rate?
The Trainee Survey
For the 2008/09 National Survey of Trainee Doctors 42,714 doctors in training out of 50,145 for whom PMETB had a valid record in the surveys database, took time to answer the survey giving a response rate of 85 per cent. The survey is currently mandatory for specialty trainees.
The Trainer Survey
For the 2008/09 National Survey of Trainers response rates were calculated by consultant trainer response rate (25.6%) and GP response rate (49.2%). The survey is not mandatory for trainers.
Note: If you would like to check the trainee and trainer response rates to date for 2010 please click here and download the appropriate table.
How can I report errors on the site?
If you notice any errors on the site please click on the 'feedback' link at the left- hand side of the screen in which the error is located and describe the problem. The feedback form automatically captures the page you clicked from and so will help us identify the problem.
How are the grade groups defined?
Trainees in St2 and below are defined as lower, whereas trainees in St3 or SpR posts or above are defined as higher. Exceptions include those specialties where all trainees are defined as higher: chemical pathology, clinical genetics, clinical neurophysiology, histopathology, immunology, medical microbiology and virology, medical ophthalmology, nuclear medicine, occupational medicine, pharmaceutical medicine and public health medicine. Further exceptions include those specialties in which trainees in St3 and below are defined as lower and St4 and above are higher: child and adolescent psychiatry, clinical oncology, clinical radiology, forensic psychiatry, general psychiatry, old age psychiatry, paediatrics, psychiatry of learning disability, psychotherapy, community child health, core psychiatry training and all paediatric and psychiatry sub-specialties. For all specialties trainees in St grades who indicated they were in FTSTA posts were classified as FTSTA; trainees who indicated they were in FTSTA posts who indicated they were SpRs were classified as SpRs.
How are the specialty groups defined?
Specialties are group by college. Please see the Specialties table in the table downloads section of the site.
How were the confidence intervals for proportions (%) calculated?
The confidence intervals of the proportion items (those indicated as percentages) were calculated using the recommended method from Altman, D.G., Machin, D. et al. Statistics with confidence 2nd edition; BMJ Books. 2000. The recommended method has better statistical properties than the traditional method, generates asymmetric values and can be used for any data.
How are the data used to improve the quality of training?
Indicator outliers are shown as triangles on the left hand side of the indicator charts. An outlier is defined as being below the national mean and in the lower quartile, shown as a red triangle or above the mean and in the upper quartile range, shown as green. This is reversed for the two bullying indicators. These outliers are areas that deaneries may target for further investigation locally; in which case the work will be documented in the deanery's annual report, which deaneries are required to submit to the GMC (and were required to submit to PMETB up to 31 March 2010). Please see page 62 of the GMC's Quality Framework.
Which report type should I be looking at when I'm prompted to select a group?
Reports available:
- Trainee Survey: specialty-groups within local education providers (GP by programme). This is most applicable to directors of medical education to view the results for their organisation. The report compares the results for each specialty group within the provider against the results for the given specialty group UK-wide. For instance Surgical Trainees at Health Hospital compared to surgical trainees UK-wide.
- Trainee Survey: specialty and sub-specialty grade groups within deaneries. This is most applicable to Training Programme Directors. An example of the data shown is cardiology trainees Higher (SpR and St3+, excluding FTSTA) within London deanery compared to medical trainees UK-wide.
- Trainee Survey: specialty and sub-specialty grade groups across the UK. This is most applicable to College and Faculty staff, as it shows a given specialty on a UK-wide basis compared to the experience of all trainees UK-wide. For instance Trauma and Orthopaedic trainees lower (St1 –St2, excluding FTSTA posts) compared to trainees UK-wide.
- Trainer Survey: All trainers (TPD excluded). This is most applicable to deanery staff. As it shows the results for all consultants across the selected deanery; please note that Training Programme Directors are reported separately. An example of the data shown is consultants in London deanery compared to Consultants UK-wide.
- Trainer Survey: All GP trainers and foundation tutors. This is most applicable to directors of GP training within deaneries. It shows the results for all active GP trainers and foundation tutors who responded, for instance GP trainers in London deanery compared to GP trainers UK-wide.
Where are Ns reported?
Ns are reported on the bottom level charts accessible by clicking through.
Can I access the National Survey of Trainers data by local education provider?
Unfortunately, data are not reported at this level. Please note that due to response rate we are unable to report these data below the level of deanery.