Abstract
Background: Since its inception by the health professions council of South Africa (HPCSA) as a mandatory requirement in 2011, conducting research has presented multiple challenges for clinical specialist trainees.
Objective: We aim to evaluate the literature looking at challenges encountered by both the specialist trainees and research supervisors.
Data source: PubMed, SciELo SA, Google scholar and ERIC were searched. References of included articles were also evaluated for relevant articles.
Data extraction: Data extraction was performed by all 3 authors. The databases were searched from inception to the present day, for only English language articles and those that reported on challenges.
Conclusion: Many challenges still exist for both student and supervisor. Co-supervision should be normalised and a significant part of the solution is reinforcing already existing protocols.
Recommendations: There is no one size fit all for all the academic institutions but standardized protocols for each centre are encouraged. Co-supervision is strongly encouraged.
Downloads
Introduction
Since its inception by the health professions council of South Africa (HPCSA) as a mandatory requirement in 2011, conducting research has presented multiple challenges for clinical specialist trainees and all parties involved. It forms a fundamental part of clinical practice, especially in a world moving largely towards evidence-based health care (EBHC). The rise in the number of postgraduate candidates is unfortunately not matched by research training and supervision (1). As many specialist trainees do not possess the intrinsic interest in research (2), they are unlikely to pursue research supervision after completion of their own projects. Limitation in number of supervisors is a challenge faced by many institutions in South Africa (SA) (3). Apart from the issue of supervision, some clinical trainees do not see the relevance of the research component in their training (4). We aim to evaluate some of the literature looking at these challenges. This is a multifaceted topic with challenges and solutions not restricted to one or two factors. However, for the purposes of this review we focus on the challenges faced by the specialist trainee and the supervisor. Databases PubMed, scientific electronic library online (SciELo SA), google scholar and education resources information centre (ERIC) were searched. These databases were searched from inception to present day, for English language literature and articles that reported on challenges. We offer potential solutions as well. The student-supervisor relationship has to be one that advances both parties (5). If it is viewed in this manner and objectives are formulated to meet this, then the challenges that follow are not perceived as harshly. Of the 28 candidates that sat and passed the past 4 orthopaedic surgery colleges of medicine of South Africa (CMSA) final examination in 2020 and 2021 from the University of the Witwatersrand, only 32% had completed their Master of medicine (MMED) component. This is a clear indication that challenges remain unsolved; 10 years after the HPCSA mandated this as compulsory for specialist registration (6). SA does dominate the research publication landscape in the continent (7) however; the potential to do significantly better exists. The continent still lacks capacity to develop structures to enhance EBHC (8). These requirements are not set only for South African trainees. Trainees in Malaysia are required to conduct research as part of their master’s standards criteria (9). In a study from that country looking at this, poor accessibility to research supervision proved to be a significant barrier (4). All instrumental aspects that play a role in running a successful research project must be addressed before the perception that research is “daunting” can be changed. By no means is one saying that research is easy but areas where improvement can be made must be made.
Challenges for the student
The challenges faced by MMED students are complex and multiple. Medical doctors are not equipped with the necessary research skills (10). This affects their attitude towards research as supported by the finding that students who had prior research involvement in their undergraduate training tended to involve themselves more in research as post-graduates (11). At the risk of over-simplifying a complex issue, we identified 3 pertinent challenges experienced by MMED candidates. These include inadequate time provided to complete research, challenges with supervision and lastly inadequate research training.
In a study by Kisansa and Lubinga, 61% of the participants felt that not enough time was given to research (12). Time must be divided between clinical work, academia, and service delivery. Registrars make up a significant bulk of the staff complement in each department and a large part of their role is service delivery as public servants. In big academic centres this involves the running of busy outpatient departments and looking after numerous patients admitted in the wards. In Chris Hani Baragwanath academic hospital (CHBAH), the clinical audit for 2021 showed that the orthopaedic outpatient department services 4264 patients every month on average. This in turn is an average of 111 admissions per month. In the emergency department of the same year, the orthopaedic department treated an average of 1078 patients and admitted 417 every month. Having to incorporate time for research with such high demands for service delivery proves to be very difficult.
Candidates also find that time spent waiting for ethical approval is too long. Thirty five percent of students reported that the wait can take more than 6 months before one is granted approval (12).
The idea of “protected MMED time” is an attractive one. This essentially affords the student prescribed time to focus on their research and requires that they produce feedback on the progress made during this time. The amount of time given is different from institution to institution and from department to department within the same institution. It is our experience that while this idea is an attractive one on paper, the practical experience does not match that. The number of registrars per subspecialty unit often makes it difficult to incorporate this amid both academic and clinical work plus negotiating fellow colleagues on annual leave.
The second point is that of supervision. A supervisoris “the person who is principally responsible for the supervision of the student and is responsible for 50% or more of the supervision” (13). Our local academic institutions are still struggling to produce knowledgeable and qualified supervisors (1). Kong Lee et al. in Malaysia reported that accessibility to supervision was cited as a significant barrier by their participants (4). The regulations by the Committee of Higher Education (CHE) stipulate that a supervisor must have a qualification in the relevant field higher than, or at least at the same level as the one he is supervising (14). The challenge with this call in the field of medicine is; when the HPCSA decided to add research as mandatory for specialist registration, the influx of candidates requiring supervision outnumbered the capacity of qualified supervisors. The scholar-clinician route is not one chosen by many and so this mismatch is likely to continue for a long time. Only 37% of general surgeons are involved in research after they qualify (15). The need for professional development programs to upskill specialists in research supervision is apparent (3). Fifty four percent of students feel that supervision is inadequate (12).
A balance must be reached between the mere number of supervisors and that of “good” supervisors. One can evaluate the student’s progress throughout the research period. For the department of orthopaedics at the University of the Witwatersrand (Wits), this is done through multiple mandatory MMED update meetings. The MMED itself is an evaluation of the student as it goes through a rigorous process before it is passed. Evaluation tools for supervisors however are unpopular. This is seen as something that might deter the very small number of supervisors that we do have. However, students become frustrated when they do not receive support or guidance as expected from supervisors (4). “It would be nice when a novice is co-supervised by a willing hard-working mentor with a good track record. Now who is going to make a list of good and bad mentors? What criteria are best to be used? Publications, complaints or comments from others?” (1). As understood in the quote, supervision extends beyond students but also to mentoring novice supervisors. For these reasons we find it crucial that a tool evaluating supervisors be introduced and we present one below (see Figure 1).
The 3rd challenge is that of research training for students. Kisansa and Lubinga found that only 14% of students had any research experience i.e. dissertation writing workshop (12). Only 1 percent of health-care professionals (HCP) have doctoral qualifications (15). This training is lacking in undergraduate programs. Ultimately as post-graduate students, HCPs see research as the necessary evil to attaining a specialist qualification (16). While it would take a natural scientist 9 years to acquire a doctorate from undergraduate, the same would take someone in medicine 16 years (2). Perhaps one can understand why HCPs might be deterred.
Challenges for the supervisor
The challenges experienced by supervisors are closely related to those of the student. Some of them are inherited from their time as registrars. These include but not limited to time constraints and lack of research training or inadequate experience.
Time constraints are very limiting for the supervisor. Multiple commitments are unfortunately unavoidable. Many of the supervisors are specialists who offer their services both in state-owned and private-owned health-care centres. Navigating between the 2 establishments is time consuming. Added to this is the teaching obligation they are entrusted with for registrars and medical students by their respective academic institutions. This could lead to inadequate preparation for meetings and couple that with social factors and their research performance is affected negatively (17). The student-supervisor relationship suffers because of this and ultimately the entire research project (18). It’s not uncommon that the supervisors have ongoing research projects of their own which further puts a strain on the time available to oversee their supervisory duties.
Lack of research training and inadequate experience are tightly linked. One feeds the other. Albertyn et al. advocate that research training and supervision should be incorporated in every activity of a teaching institution (19). As discussed above, it is a small number of specialists who want to involve themselves in research after qualifying (15). Part of this is as a result of their own “daunting” experience as students. To tackle this challenge, the idea of co-supervision comes into the fore. Amongst other things, this is meant to enhance transfer of skills and experience. In this situation the experienced supervisor is paired with one who is starting out. While some authors describe this as a “double mentoring load” (20-22), I much prefer the “train-the-trainer” perspective of it (4). A well-articulated co-supervisory plan is important for the transfer of skills and helps avoid conflicting advice and workload imbalance (23). The orthopaedic surgery department at Wits holds a supervisors’ course in the effort to bridge the lack of research training. Such efforts must be intensified.
Recommendations
As depicted above, both parties face remarkable challenges. The objective should be to alleviate these stressors while enhancing a positive attitude towards research. There is no one size fit all for all the academic institutions but standardized protocols for each centre must be encouraged. Recommendations that speak to the points as discussed above are listed below:
- A coordinated protected MMED time must be reinforced on a quarterly basis and all subspecialty unit heads made to acknowledge this arrangement.
- The same protected MMED time must be afforded to supervisors.
- Co-supervision should be strongly encouraged.
- A clear co-supervision protocol must be established and made available to all parties. This must detail the terms and responsibilities of each party. Diffusion of skills must be prioritised. This must be a transparent relationship with regular reviews of progress made
- The research methodology course must continue to be compulsory for registrars as should be the supervisors’ course for supervisors.
- The use of the proposed supervisors score above should be used as a guide for registrars in choosing a supervisor. The score must be made available to each respective department.
- The regulations as set out by the CHE must be enforced.
Figure 1: Wits Orthopaedics Supervisors Score (WOSS)
Supervisor’s name:
Score | 2 | 1 | 0 | ||
Research Knowledge | Good | Fair | Poor | ||
Protocol development contribution | Good | Fair | Poor | ||
Meeting attendance (i.e. protocol assessment) | Good 100% | Fair>50% | Poor<50% | ||
Feedback time(time spent waiting for feedback) | Good<2 weeks | Fair2 – 6 weeks | Poor>6 weeks | ||
Administration efficiency (signing of forms) | Good | Fair | Poor | ||
Interpersonal Relationships | Good | Fair | Poor | ||
Total |
Additional comments by registrar :_ _____________________________________________________________________________________________________________________________________________
Score | 2 | 1 | 0 |
Last supervisors course attended | <6 months ago | <12 months ago | >12 months ago |
Last ethics/research methodology course attended | 6-12 months ago | 12-24 months ago | >24 months ago |
Last MMED supervised to completion | < 12 months ago | 12-24 months ago | >24 months ago |
Number of MMEDs currently supervised | 1-3 | >3 | 0 |
*Ever been removed as supervisor | Never | >12 months ago | <12 months ago |
Total |
* provide the reason for the removal in the comment section below.
Additional- comments - by supervisor :_ ____________________________________________________________________________________________________________________________________________
16 - 22 | 10 - 15 | <10 |
Allowed to pick supervisors of their choice.
- The sum of the totals from “section A” and “section B” gives the complete score.
- Based on the total score, supervisors are colour-coded as depicted above i.e. green, yellow or red.
- The scoring is to be repeated every 6 months.
- This is to be used as a guide for registrars however, registrars are
- The identity of the registrar is to remain undisclosed unless otherwise
Specified by the concern registrar .
Conclusion
The journey to attaining a MMED is a long and very involved one. Who you choose to walk it with is very instrumental for your future outlook on research as a whole. Many challenges still exist for both student and supervisor. We believe that with a more deliberate and transparent approach from the outset, many of these challenges can be successfully alleviated. Co-supervision should be normalised and research teaching incorporated in every clinical interaction. A significant part of the solution is reinforcing already existing protocols.
References
- Grossman Elly S., Crowther Nigel J.. Co-supervision in postgraduate training: Ensuring the right hand knows what the left hand is doing. S. Afr. j. sci. [Internet]. 2015 Dec [cited 2022 July 07] ; 111( 11-12 ): 1-8. Available from: http://www.scielo.org.za/scielo.php?script=sci_arttext&pid=S0038-23532015000600023&lng=en. http://dx.doi.org/10.17159/sajs.2015/20140305.
- Aldous CM, Adhikari M, Rout CC. The research component of specialist registration--a question of alligators and swamps? A personal view. S Afr Med J. 2015 Jan;105(1):21-2. doi: 10.7196/samj.8732. PMID: 26046156.
- MOXLEY, K. The development of research competence among specialist registrars in South Africa: Challenges and opportunities for research education and capacity development. African Journal of Health Professions Education, [S.l.], v. 14, apr. 2022. ISSN 2078-5127.
- Lee YK, Ng CJ, Sim JH, Firdaus A, Foong CC, Hong WH, Sanusi J, Lim AJH, Boey CCM. Barriers to effective research supervision in clinical specialist training: Experience from a medical school in Malaysia. Malays Fam Physician. 2021 Sep 24;16(3):77-86. doi: 10.51866/oa1222. PMID: 34938395; PMCID: PMC8680945.
- Abdelhafez, A. M. 2007. Postgraduate research students’ knowledge and attitudes towards good supervisory practice at the University of Exeter. Online submission.
- Health Professions Council of South Africa Subcommittee for Postgraduate Education and Training (Medical). New Requirements for the Registration of Specialists in South Africa. http://www.hpcsa.org.za/downloads/medical_dental/new_reqifirements_for_registration_of_specialists_in_sa.pdf(accessed 24 February 2011)
- Uthman OA, Wiysonge CS, Ota MO, et al. increasing the value of health research in the WHO African Region beyond 2015 - reflecting on the past, celebrating the present and building the future: A bibliometric analysis. BMJ Open 2015;5(3):1-8. https://doi.org/10.1136/bmjopen-2014-006340
- Forland F, Rohwer AC, Klatser P, Boer K, Mayanja-Kizza H. Strengthening evidence-based healthcare in Africa. Evid Based Med 2013;18(6):204-206. https://doi.org/10.1136/eb-2012-101143
- Malaysian Qualification Agency. Standards: Master's and Doctoral Degree. Petaling Jaya: Malaysian Qualification Agency; 2015.
- Lemon, T. I. 2013. Lack of research skills teaching not just an African education issue. African Journal of Health Professions Education 5(2): 100.
- Segal, S., T. Lloyd, P. S. Houts, P. L. Stillman and R. L. Jungas. 1990. The association between students' research involvement in medical school and their postgraduate medical activities. Academic Medicine: Journal of the Association of American Medical Colleges 65(8): 530-533.
- Kisansa, M. E., & Lubinga, M. H.. (2020). Strategic and focused solutions to challenges faced by medical postgraduate students in performing research at a South African university. South African Journal of Higher Education, 34(2), 59-73. https://dx.doi.org/10.20853/34-2-3666
- University of the Witwatersrand. Senate standing orders on higher degrees [document on the Internet]. c2013 [updated 2013 Jan 26; cited 2013 Jul 07]. Available from: https://www.wits.ac.za/files/6tbeh_380959001365373856.pdf
- CHE Criteria for programme accreditation, November 2004. 3.1.8 Postgraduate policies, procedures and regulations: Criterion 9 (ii). http://nr-online.che.ac.za/html_documents/CHE_accreditation_ criteria_Nov2004.pdf (accessed 28 July 2014).
- Bateman, C. 2011. SA clinical research output in crisis. South African Medical Journal 101(9): 614-16
- Rout C, Sommerville T, Aldous C. MMed cohort supervision: a path out of the swamp?. SAMJ, S. Afr. med. j. [Internet]. 2015 Apr [cited 2022 July 07] ; 105( 4 ): 275-276. Available from: http://www.scielo.org.za/scielo.php?script=sci_arttext&pid=S0256-95742015000300018&lng=en. http://dx.doi.org/10.7196/SAMJ.9338.
- Albertyn, R. M., C. A. Kapp and E. M. Bitzer. 2009. Profiling exiting postgraduate students performance and experiences. South African Journal of Higher Education 22(4): 749-72.
- Abiddin, N. Z. and A. Ismail. 2011. Effective supervisory approach in enhancing postgraduate research studies. International Journal of Humanities and Social Science 1(2): 206-217.
- Albertyn, R., S. Von Coller-Peter and J. Morrison. 2016. Aligning student and supervisor perspectives of research challenges. In Postgraduate supervision: Future foci for the knowledge society, ed. M. Fourie-Malherbe, R. Albertyn, C. Aitchison and E. Bitzer, 171-187. Stellenbosch: SUN PRESS. doi:10.18820/9781928357223/10.
- Seggie J. On getting published in the SAMJ. S Afr Med J 2015;105(2):77-78. [http://dx.doi.org/10.7196/SAMJ.9348]
- Council for Higher Education criteria for programme accreditation, November 2004. 3.1.8 Postgraduate policies, procedures and regulations: Criterion 9. (ii). http:/nr-online.che. ac.za/html_documents/CHE_accreditation_criteria_Nov2004. pdf (accessed 28 July 2014).
- Burnett P. The supervision of doctoral dissertations using a collaborative cohort model. Counsellor Education and Supervision 1999;39(1):46-52. [http://dx.doi.org/10.1002/j.1556-6978.1999. tb01789.x]
- Spooner-Lane RS, Henderson DJ, Price RA, Hill G. Practice to theory: Co- supervision stories. Int J Res Sup. 2007;1:39–51.