Dental and Medical Problems

Dent Med Probl
Impact Factor (IF 2024) – 3.9
Journal Citation Indicator (JCI 2024) - 1.36
Scopus CiteScore (2024) – 5.0
Index Copernicus Value (ICV 2023) – 181.00
MNiSW – 70 pts
ISSN 1644-387X (print)
ISSN 2300-9020 (online)
Periodicity – bimonthly


 

Download original text (EN)

Dental and Medical Problems

2023, vol. 60, nr 3, July-September, p. 513–525

doi: 10.17219/dmp/156804

Publication type: review

Language: English

License: Creative Commons Attribution 3.0 Unported (CC BY 3.0)

Download citation:

  • BIBTEX (JabRef, Mendeley)
  • RIS (Papers, Reference Manager, RefWorks, Zotero)

Cite as:


Erdilek D, Gümüştaş B, Güray Efes B. Digitalization era of dental education: A systematic review. Dent Med Probl. 2023;60(3):513–525. doi:10.17219/dmp/156804

Digitalization era of dental education: A systematic review

Dina Erdilek1,A,B,C,D,E,F, Burak Gümüştaş2,A,B,C,D,E,F, Begüm Güray Efes1,A,B,C,D,E,F

1 Department of Restorative Dentistry, Faculty of Dentistry, Istanbul University, Turkey

2 Department of Restorative Dentistry, Faculty of Dentistry, Istanbul University-Cerrahpaşa, Turkey

Abstract

Background. Dental education is taking its share of the digitalization of the world. Therefore, it is of value to assess the use of the digital dental education system, especially in the undergraduate period.

Objectives. This systematic review concisely evaluated the use of augmented and virtual reality in preclinical dental education.

Material and methods. The PICOS (Population, Intervention, Comparison, Outcome, and Study design) search strategy was used with the keywords ‘e-learning’, ‘virtual reality’ and ‘preclinic simulation’ to search the PubMed, PubMed Central, Web of Science, and Scopus databases.

Results. A total of 1,774 articles were found, and 45 articles were reviewed. The level of bias in the stu­dies was also calculated. The studies were divided into 3 main groups: computer-assisted learning (C-AL); augmented reality-assisted learning (AR-AL); and virtual reality-assisted learning (VR-AL). Augmented and virtual reality are steadily evolving, and are increasingly being used in education and healthcare.

Conclusions. The evaluated technological applications enable the visualization of medical information and provide clear feedback during the learning process with increased security and reliability; thus, digital simulation systems can be used to enhance students’ abilities in dentistry.

Keywords: augmented reality, virtual reality, computer-assisted learning, dental simulator, digital dentistry

Introduction

Dentistry involves many skills, among which manu­al dexterity is the most difficult to maintain.1, 2, 3 Den­tal students typically take a manual dexterity course during their first 2 years of education. As part of their preclinical practice, students often start with tasks involving simple geometric shapes rather than complex cavity or tooth preparations, and digital systems are rarely deployed. However, technological development is essential in modern dental practice. In addition, digit­al dental instruction shows high potential in facilitat­ing both direct and distance learning in undergraduate and preclinical education. Indeed, applications based on three-dimensional (3D) imaging and printing, computer-aided design and computer-aided manufactur­ing (CAD/CAM),4, 5 augmented reality (AR), and virtual reality (VR) have been used in many fields, including dental research and practice, for over a decade.

Translational applications that use cameras in smartphones and popular face-swap applications are among the best-known AR applications encountered in every­day life. A well-known example of a VR application are the glasses used via game consoles. Applications of AR/VR are employed in various fields, such as entertainment, industry, medicine, and dentistry.6, 7, 8

Learning with digital technologies can be catego­rized as computer-assisted learning (C-AL), AR-assisted learning (AR-AL) or VR-assisted learning (VR-AL). Computer-assisted learning uses computer programs specially designed for education on specific topics. The AR-AL technology uses the existing reality or environments, and enriches them with a computer-generated scenario and the means of interaction. Meanwhile, the VR-AL technology uses only an artificial reality or environments, with which the user can interact.9 By deploying these technologies, users have the opportunity to see preparations from different angles and at different magnifications. Moreover, the real-time feedback provided to the user permits consistent and standardized evaluation.10

The AR/VR components must be well-integrated to achieve the desired effect on users. These components include real and virtual data sources, tracking and regi­stration techniques, visualization processes, perception locations, and feedback mechanisms.

In addition to the growing trend of deploying new information technology applications in education, the quarantine which came with the coronavirus disease 2019 (COVID-19) pandemic also had a marked impact on the education sector, where the traditional systems were forced to be replaced by digitized education. In many countries, students had to be quarantined at home for their safety and online education became the most popular solution for continuing their education, with accessibility and flexibility being among the most important criteria. The advantages of digital education have overcome the problems associated with the traditional education systems almost everywhere.11 Online education has turned every place with access to the Internet into a classroom through personal terminals, such as computers, laptops and smartphones. Furthermore, the sudden closure of universities during the COVID-19 pandemic caused significant changes to the dentistry education system. Consequently, students began to think that they might either not succeed in graduating or graduate without having sufficient practical skills.12 Due to such worries over their preclinical and clinical training adequacy in the context of distant learning, dental students struggled with elevated stress levels.13, 14, 15, 16

If the education system is supported by the AR or VR technologies, students should receive distance education of a higher quality.17, 18 Even though it is well documented that dentistry education deploys the AR and VR technologies, education with AR or VR has never been evaluated along with C-AL systems. However, the C-AL technology should also be evaluated in the same scope as AR and VR.

The primary aim of this systematic review was to present the application areas for the C-AL, AR-AL and VR-AL technologies, and highlight their distinguishing features for dental education. Secondarily, it aimed to determine the application differences between these technologies within dental specialties. Thus, the pre­sent study was meant to establish a pathway for further research.

Methods

Ethics statement

This was not a human-subject study; therefore, neither approval by the institutional review board nor the obtainment of informed consent was required.

Protocol and registration

This systematic review followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) 2020 guidelines. The research protocol was registered in the Open Science Framework (OSF) (https://doi.org/10.17605/OSF.IO/VTQAC).

Eligibility criteria

Table 1 outlines the inclusion and exclusion selection criteria details, which were based on the PICOS (Population, Intervention, Comparison, Outcome, and Study design) framework.

Information sources
and the search strategy

A systematic electronic search of the PubMed, PubMed Central, Web of Science, and Scopus databases was performed. The search was limited to English-language articles published between January 1, 2000, and December 30, 2021.

The search syntax contained Medical Subject Headings (MeSH) terms, and the terms were as follows: (education, dental) AND (virtual reality OR virtual simulation) AND (e-learning OR electronic learning) AND (preclinical simulator OR phantom simulator). All abstracts were read, and duplicates and review articles were excluded. For the final stage, the full texts of all articles were read and relevant information was identified. Abstracts, short communications, letters to the editor, book chapters, and review articles were also excluded at this stage.

Selection process

Two authors (D.E. and B.G.) eliminated duplicated articles manually. They independently checked titles and abstracts to identify potentially eligible studies. If there was persistent disagreement between the 2 authors, a third reviewer (B.G.E.) made the final decision.

Data items and the data collection process

With regard to the general characteristics of the selected studies, the following data was extracted: authors; intervention design; type of digitalized learning technique; specialty; system used; participants; study design; and outcome measures. One author (D.E.) collected the data from the selected studies with the use of an extraction form prepared jointly by the authors. Another author (B.G.) verified the collected information. In instances of disagreement, a third author (B.G.E.) was consulted for the final decision.

Assessment of the risk of bias

The assessment of the risk of bias in the included stu­dies was conducted independently by 2 authors (D.E. and B.G.), using the Medical Education Research Study Quality Instrument (MERSQI). The MERSQI is a tool for assessing the methodological quality of quantitative research articles. The scale consists of 10 items organized into 6 domains: study design; sampling; type of data; validity of the evaluation instrument; data analysis; and outcomes. The total score ranges from 5 to 18. The agreement between the 2 examiners’ results was analyzed using the kappa (κ) statistical coefficient.

Synthesis methods

The data was classified and analyzed to achieve the objectives of this review. The study properties were extracted and key items, such as the acquisition of skills, the quality of preparations and feedback, were tabulated. Data synthesis was initially conducted by 2 authors (D.E. and B.G.), and then discussed with a third author (B.G.E.). The included studies were analyzed through a narrative synthesis. The types of learning methods and the specialization types are presented as percentages.

Assessment of the reporting bias

The reporting bias in this systematic review was independently assessed by 2 authors (D.E. and B.G.) for selective outcome reporting by comparing the study results with the previously published study protocols and registrations. Any disagreement was resolved by consulting a third author (B.G.E.).

Certainty assessment

Not done.

Results

Study selection

A total of 1,774 articles were retrieved via the electro­nic keyword search. Among these, 228 were evaluated further after eliminating duplicates. Finally, the review included 43 articles identified electronically, and an additional 2 articles were manually chosen from the reference lists of the other articles, resulting in a total of 45 articles (Figure 1, Table 2).

Study characteristics

The studies were divided into 3 main groups: C-AL (n = 5; 11%); AR-AL (n = 16; 36%); and VR-AL (n = 24; 53%). Most articles could be categorized into more than one group, so classification was based on the primary objective of the study (Table 1).

Risk of bias in the studies

The MERSQI scale assessed the methodological quality of half of the included studies as relatively moderate, with a mean score of 10.72 ±1.52 (median (interquartile range) (Me (IQR)): 11.5 (6.0–12.5)) (Table 3). The kappa coefficient of concordance was 0.74.

Results of individual studies

Relevant data from the included studies are grouped and summarized separately in Table 4.

Synthesis results

All the programs used in the C-AL studies were produced for experimental purposes. Except for one study,49 all studies reported that C-AL improved students’ education and satisfaction (9%).38, 44, 46, 50

Many studies stated that VR-AL-based education is as effective as the traditional methods (33%).29, 31, 33, 34, 40, 43, 47, 51, 52, 53, 54, 55, 58, 62, 63 However, a few studies reported that VR education was not sufficient and needed improvement (9%).23, 36, 42, 48 One study reported that educating with the use of VR alone was not suitable for undergraduate education.19

Although few studies examined AR-AL systems, many reported that they were effective for pregraduate education (24%).22, 25, 26, 28, 32, 35, 37, 39, 41, 57, 61 Meanwhile, only one study reported no difference in success between the traditional and AR-AL-based education.24

AR-AL systems were mainly used for restorative dentistry training (29%),21, 22, 24, 25, 26, 27, 28, 30, 32, 35, 37, 39, 57 more so than VR-AL systems (27%),19, 20, 40, 43, 45, 47, 48, 55, 56, 59, 60, 63 and no study relat­ed to restorative dentistry teaching used a C-AL system. One study (2%) used C-AL for endodontics training,44 while 2 (4%) used VR-AL systems for this purpose.34, 47 All orthodontics training studies (4%) employed a C-AL system.49, 50 Only one study on pediatric dentistry training (2%) used a VR-AL system62 and 1 (2%) studied periodon­tology training with a C-AL system.38 Two AR-AL system studies (4%),41, 61 2 VR-AL system studies (4%)31, 36 and 1 C-AL system study (2%)46 were found for prosthodon­tics. All 3 surgery studies (6%) used VR-AL systems.23, 29, 33

All 6 studies with a geometric shape subject area that could not be attributed to any dental specialty (13%) employed VR-AL systems.42, 51, 52, 53, 54, 58

Reporting bias

The search showed that none of the protocols or records of the included studies were previously registered. As such, the risk of reporting bias was unclear, as it was not possible to determine if all results were included in the published reports.

Discussion

Modern digital technologies have been used in medical specialties, such as surgery and echocardiography, for decades.64 The VR and AR systems used in neurosurgery and cranial surgery are highly advanced, although they are not as common in dentistry.65 Surgeons can access information on the patient’s medical status throughout the operation by using smart glasses.66 Such features may play a vital role in reducing surgical risks, even during routine procedures.

New technologies have recently become available for medical and dental education. While some of these technologies let the lecturer communicate with students, other digital technologies, such as cloud-based systems, allow data storage and its timely access. Therefore, using digital technologies for education enables low-cost, easy-to-use, reproducible, and equitable assessment and evaluation of students.67 Among the types of digitalized learning, Internet-based and electronic educational applications fall within the scope of e-learning.

C-AL applications are programs that proceed within the framework of specific algorithms and contain codes specially written for education, though they do not include any real or virtual practical application steps. AR-AL uses a computer to process the data collected during the dental operation, and provides instructions and feedback to the user. VR-AL allows the operator to use haptic devices for dental procedures in a completely virtual environment, with instructions and feedback received from the computer.

Computer-assisted learning, augmented reality-assisted learning and virtual reality-assisted learning

Learning has been defined functionally as changes in behavior that result from experience, or mechanistically as changes in the organism that result from experience.68 In a typical classroom setting, information generally flows in only one direction, which can be considered passive learning. However, current education requires the deve­lopment of more active learning through interactive sys­tems. This transformation in learning has already started and has become a critical factor in health education. For example, anatomy is one of the specialties that has bene­fited most from AR; consequently, it is now possible to learn live anatomy by visualizing internal structures.69

Many studies have assessed C-AL in dentistry, especially during undergraduate education. With the use of C-AL, the educational satisfaction level of students increases.44 Including interactive tasks in the curriculum may also prevent demotivation in students.38 Therefore, using C-AL may be an efficient way to enhance learning, especially during repetitive tasks.50 Another benefit of using C-AL is that it requires less hardware than AR-AL and VR-AL systems.

During preclinical dental education, students receive directions from instructors, who evaluate their work before they proceed. Students generally receive feedback directly from instructors at the end of the procedure. However, such delayed feedback may potentially lead to overlooking errors. With VR-AL, students learn faster and perform a higher number of exercises as compared to the traditional systems, and also receive regular internal evaluation, which reduces the time needed for the assessments made by instructors.70

Some authors have reported that VR-assisted training is not a sufficient replacement for the traditional training.62 Indeed, only 27% of the participating students found the textural or tactile sensation to be adequately close to reality.62 Generally, the traditional educational methods are used alongside supportive digital educational methods. Therefore, including standardized digital learning materials with real-time feedback would increase student performance and reduce the learning time. Such an approach would allow students to practice more repetitive procedures for the development of motor skills.

Skill acquisition using augmented
and virtual reality systems

Manual dexterity is used to execute motor skills, and is a permanently acquired ability resulting from practice and experience. The skills associated with AR and VR are continually evolving, and are becoming increasingly used in education and healthcare. These technological applications are useful, as they allow the precise visualization of medical information. Moreover, these systems provide more accurate information during the process, resulting in increased security and reliability.71 By applying the same principles to restorative dentistry, AR and VR simulations can help students improve manual dexterity during Class I and Class II cavity preparations.57

Although this systematic review included only 45 stu­dies, many articles describe the future of digitalized dentist­ry applications. Both AR and VR systems play a substan­tial role in dental education. Moreover, AR systems could be used as an educational standardization medium. One of the studies investigated and compared the removal of carious lesions by novice students and experienced dental residents, and found that novice students removed less material, including sound and carious tooth structure, than residents; the results also demonstrated that caries removal skills could be taught by using computer simulators.45

Immediate feedback is one of the major advantages of digital systems, with many using application time data, target-based data, clinical step data, and motion and force exertion tracking data to provide feedback to the user. Digital simulators can provide information on the preparation size and the amount of removed matter, and observe the stroke magnitude and the movement speed, thereby monitoring the user’s professionalism.72 It has been suggested that just an additional 8 h of computer simulation can improve learning performance.32 A similar study also reported that increasing computer simulation instruction from 6 to 8 h improved practical exam grades among second-year dentistry students.22 With the help of this technology in dental education practical training, it is possible to simulate different scenarios and provide feedback on student performance. In particular, the haptic devices used in VR provide results comparable to a real environment.73 Therefore, learning can be enhanced more easily with VR-AL systems than AR-AL systems.

Another application of AR is a mapping scheme called ‘seeing through reality’, which can be used by operators during surgery.74 Such systems not only assist with operations, but also supply navigation and guidance in real time during surgery, specifically in implant dentistry.75 The AR technology also has diagnostic and treatment planning applications. Navident is the latest AR-assisted implant surgery system. Furthermore, AR-assisted guided surgery is more precise. Even in risky anatomic zones, the average error of the system is approx. 0.96 ±0.7 mm.76

Using digital interfaces in dental education has some limitations. Continuous feedback may cause practitioners to become overly reliant on the system and the cessation of feedback may subsequently lower their performance.77 Although feedback is essential for improvement, reducing feedback frequency facilitates the development of motor and cognitive skills.78 The cognitive load theory predicts that learning varies with feedback during practice. Reduced feedback necessitates more planning to execute the task, whereas increased feedback can cause an information overload.77, 79

Distance learning with augmented
and virtual reality systems

Although it is challenging to execute practical exercises remotely, distance learning has become a requirement in education, especially due to the concerns regarding face-to-face learning during the COVID-19 pandemic. Never­theless, there are some disadvantages associated with distance (or online) learning, such as isolation from the community, which can cause participants’ discomfort and reduce motivation for learning.80 In particular, using webcams and microphones can reduce course participation, and cause distractions or difficulties in focusing.

AR glasses, or smart glasses (e.g., HoloLens 2, Meta Quest 2 and Google Glass), show promising effects in education and medicine, and can be an alternative tool in distance learning. AR glasses involve 3 forms of inter­action: gaze; gesture; and voice. Additionally, AR glasses can use the position-tracking technology to locate and track the user in their 3D environment, and is equipped with the orientation-tracking technology to recognize what the user is looking at.

Some programs work with AR glasses in an educational context, including HoloHuman and HoloPatient.81 It has been reported that 68% of students agree that the dentistry curriculum statement must include HoloHuman as a supplementary teaching tool during anatomy lectures.82 Another program, HoloDentist, connects 2 distant dentists or students to enable communication and the exchange of information. The newly developed portable learning platform DenTeach consists of smart sensors, advanced robotics, big data handling, 3D printing, AR, and cloud-based computing. This platform is applicable to distance learning in preclinical education.83

AR and VR systems contain processors, software, sensors, and input parts that work together. One limitation of the AR and VR technologies is that development can occur only within the framework of the infrastructure, i.e., software updates can only be performed if the system hardware configuration has the necessary permit. Thus, AR systems, which use a real environment, can be more advantageous in terms of visualization quality than VR systems.

The digital technologies used in dentistry education have both advantages and disadvantages. While C-AL does not contribute adequately to the development of motor skills, it provides an advantage in distance education and reduces educational costs.38, 44, 46, 49, 50 AR systems are advantageous for developing motor skills, since the physical environment used is very close to a real environment, although they do have disadvantages as well, such as the need for consumables, which increase training costs.21, 22, 25, 26, 27, 28, 32, 37, 39, 41, 57, 61 While VR systems enhance motor skills without requiring consumables, they need to be developed to imitate a real environment.19, 20, 23, 29, 33, 34, 36, 40, 43, 47, 52, 53, 56, 58, 59, 60, 62 With a reduction in the cost of haptic parts, AR systems are a promising technology for distance education in the future. Since all digital systems provide objective criteria for evaluating the user, they should be included in dental training.

It should be emphasized that our research was limited to articles related to software developed for educational purposes only. Programs related to dentistry that may also be used for educational purposes in the future were not included. Despite the attempt to include as many accessible studies as possible, only a limited number of them were found to be relevant to this study. Furthermore, considering how rapidly technology is evolving and blended learning is becoming a modular and adaptable teaching and learning approach, it is probable that there exist publications which would either support or contradict the findings of this review. Another limitation of the study is the exclusion of non-English articles.

Future research is needed to explore the feasibility of digital technologies in these areas. Furthermore, evidence for the long-term effect of C/AR/VR-assisted training on student clinical performance and competence, as well as data regarding the cost-effectiveness of these devices, are currently lacking.

Conclusions

In the current era, with digital technologies being frequently used in all areas, it has become necessary to use them to improve students’ skills. Among these digital technologies, C-AL, AR-AL and VR-AL were the focus of this study. One of the main advantages of AR-AL and VR-AL systems is that they facilitate manual skill acquisition and provide instant feedback. When considering C-AL sys­tems, even though they are proficient in knowledge trans­fer, they are inferior as compared to AR-AL and VR-AL systems in terms of manual skill acquisition. The biggest feature distinguishing AR-AL systems from VR-AL sys­tems in education is that in the former case there is no disconnection from reality. AR-AL gives students the feel­ing of being close to a real environment, provides infor­mation on the current situation and guides them during dental treatment. Nevertheless, C-AL, AR-AL and VR-AL applications cannot be considered adequate replacements for the traditional preclinical instruction. While distance education is possible, we believe that the instructor and the student must be physically present in the same set­ting for learning to be most effective. Even though C-AL, AR-AL and VR-AL applications can be easily implemented into dental education, further studies are needed to elucidate the benefits of these emerging digital techno­logies to the learning processes.

Ethics approval and consent to participate

Not applicable.

Data availability

All data generated and/or analyzed during this study is included in this published article.

Consent for publication

Not applicable.

Tables


Table 1. Eligibility criteria according to the PICOS (Population, Intervention, Comparison, Outcome, and Study design) framework

PICOS items

Inclusion and exclusion criteria

Population

undergraduate dental students, students of dental specialties

Intervention

studies that explored the effect of the C-AL, AR-AL or VR-AL approaches, either alone or blended; e-learning intervention – web-based educational software, or special AR or VR devices

studies not exploring the effects of the C-AL, AR-AL or VR-AL intervention were excluded

Comparison

studies with or without a comparison group

Outcome

studies that involved the investigation of learning outcomes related to knowledge content and clinical skills (cavity preparation, abutment preparation), as well as the assessment of students’ knowledge; studies that explored learning outcomes related to students’ attitudes, preferences and satisfaction from the learning activity

Study design

cross-sectional studies, case–control studies, cohort studies, observational trials, descriptive studies, and randomized controlled trials were included

short communications, qualitative studies, commentary articles, letters to the editor, editorials, conference abstracts, book chapters, and reviews were excluded

C-AL – computer-assisted learning; AR – augmented reality; VR – virtual reality; AR-AL – AR-assisted learning; VR-AL – VR-assisted learning.
Table 2. Studies excluded after full-text consideration with the corresponding main reason for exclusion

Study

Main reason
for exclusion

Razavi M, Talebi HA, Zareinejad M, Dehghan MR. A GPU-implemented physics-based haptic simulator of tooth drilling.
Int J Med Robot. 2015;11(4):476–485. doi:10.1002/rcs.1635

model making

Höhne C, Schmitter M. 3D printed teeth for the preclinical education of dental students.
J Dent Educ. 2019:83(9):1100–1106. doi:10.21815/JDE.019.103

model making

Hanisch M, Kroeger E, Dekiff M, Timme M, Kleinheinz J, Dirksen D. 3D-printed surgical training model based on real patient situations
for dental education. Int J Environ Res Public Health. 2020;17(8):2901. doi:10.3390/ijerph17082901

model making

Marras I, Nikolaidis N, Mikrogeorgis G, Lyroudia K, Pitas I. A virtual system for cavity preparation in endodontics.
J Dent Educ. 2008;72(4):494–502. PMID:18381855.

off-topic

Saxena P, Gupta SK, Mehrotra D, et al. Assessment of digital literacy and use of smart phones among Central Indian dental students.
J Oral Biol Craniofac Res. 2018;8(1):40–43. doi:10.1016/j.jobcr.2017.10.001

off-topic

Botelho MG, Gao X, Jagannathan N. A qualitative analysis of students’ perceptions of videos to support learning in a psychomotor skills course. Eur J Dent Educ. 2019;23(1):20–27. doi:10.1111/eje.12373

off-topic

Padilla M, Nocera L, Abe Y, Clark GT. A modern web-based virtual learning environment for use in dental education.
J Dent Educ. 2020. doi:10.1002/jdd.12427

short
communication

Table 3. Assessment of the methodological quality of the included studies using the Medical Education Research Study Quality Instrument (MERSQI)

Study

Study design

Sampling

Type of data

Validity of the evaluation instrument

Data analysis

Outcomes

Total score

institution
studied

response
rate score

internal
structure

content

relationships with other variables

appropriateness of analysis

complexity
of analysis

attitudes, perceptions, satisfaction

knowledge,
skills

behaviors

pateient/healthcare outcome

Quinn et al.19

3

0.5

1.5

1

0

1

0

1

2

1

1.5

0

0

12.5

Quinn et al.20

3

0.5

1.5

1

0

1

0

1

2

1

1.5

0

0

12.5

Imber et al.21

3

0.5

1.5

1

0

1

0

1

2

0

1.5

0

0

11.5

LeBlanc et al.22

3

0.5

1.5

1

0

1

0

1

2

0

1.5

0

0

11.5

Heiland et al.23

1

0.5

1.5

1

0

1

0

1

0

0

0

0

0

6

Jasinevicius et al.24

3

0.5

1.5

1

0

1

0

1

2

0

1.5

0

0

11.5

Wierinck et al.25

1.5

0.5

1.5

1

0

1

0

1

2

0

1.5

0

0

10

Wierinck et al.26

3

0.5

1.5

1

0

1

0

1

2

0

1.5

0

0

11.5

Wierinck et al.27

3

0.5

1.5

1

0

1

0

1

2

0

1.5

0

0

11.5

Rees et al.28

1

0.5

1.5

1

0

1

0

1

1

0

1.5

0

0

8.5

Von Sternberg et al.29

2

0.5

1.5

1

0

1

0

1

2

0

1.5

0

0

10.5

Wierinck et al.30

3

0.5

1.5

1

0

1

1

1

2

0

1.5

0

0

12.5

Suebnukarn et al.31

2

0.5

1.5

1

0

1

1

1

2

0

1.5

0

0

11.5

Urbankova32

3

0.5

1.5

1

0

1

0

1

2

0

1.5

0

0

11.5

Pohlenz et al.33

1

0.5

1.5

1

0

1

0

1

1

1

0

0

0

8

Suebnukarn et al.34

3

0.5

1.5

1

0

1

0

1

2

0

1.5

0

0

11.5

Urbankova
and Engebretson35

1

0.5

1.5

1

0

1

0

1

1

0

1.5

0

0

8.5

Gal et al.36

2

0.5

1.5

1

0

1

1

1

1

1

0

0

0

10

Urbankova
and Engebretson37

1

0.5

1.5

1

0

1

0

1

2

0

1.5

0

0

9.5

Woelber et al.38

1

0.5

1.5

1

0

1

0

1

2

1

1.5

0

0

10.5

Tanzawa et al.39

1

0.5

1.5

1

0

1

0

1

1

1

0

0

0

8

Urbankova et al.40

1

0.5

1.5

1

0

1

0

1

2

0

1.5

0

0

9.5

Kikuchi et al.41

3

0.5

1.5

1

0

1

0

1

2

0

1.5

0

0

11.5

Ben-Gal et al.42

2

0.5

1.5

1

0

1

1

1

2

0

1.5

0

0

11.5

Yamaguchi et al.43

1

0.5

1.5

1

0

1

0

1

2

0

1.5

0

0

9.5

Moazami et al.44

1

0.5

1.5

1

0

1

0

1

1

0

1.5

0

0

8.5

Eve et al.45

3

0.5

1.5

1

0

1

1

1

2

1

1.5

0

0

13.5

Reissmann et al.46

1

0.5

1.5

1

0

1

1

1

2

1

0

0

0

10

Wang et al.47

1

0.5

1.5

1

0

1

0

1

2

0

1.5

0

0

9.5

Koo et al.48

3

0.5

1.5

1

0

1

0

1

2

1

1.5

0

0

12.5

Mehta et al.49

3

0.5

1.5

1

0

1

0

1

2

1

0

0

0

11

Ludwig et al.50

3

0.5

1.5

1

0

1

0

1

2

0

1.5

0

0

11.5

De Boer et al.51

3

0.5

1.5

1

0

1

0

1

2

1

0

0

0

11

Al-Saud et al.52

3

0.5

1.5

1

0

1

0

1

2

0

1.5

0

0

11.5

De Boer et al.53

1

0.5

1.5

1

0

1

0

1

2

1

1.5

0

0

10.5

Mirghani et al.54

2

0.5

1.5

1

0

1

0

1

2

0

1.5

0

0

10.5

Dwisaptarini et al.55

3

0.5

1.5

1

0

1

0

1

2

0

1.5

0

0

11.5

Ria et al.56

2

0.5

1.5

1

0

1

0

1

2

0

1.5

0

0

10.5

Llena et al.57

3

0.5

1.5

1

0

1

0

1

2

1

1.5

0

0

12.5

De Boer et al.58

3

0.5

1.5

1

0

1

0

1

2

1

1.5

0

0

12.5

Murbay et al.59

3

0.5

1.5

1

0

1

0

1

2

0

1.5

0

0

11.5

Vincent et al.60

3

0.5

1.5

1

0

1

0

1

2

0

1.5

0

0

11.5

Tang et al.61

3

0.5

1.5

1

0

1

0

1

2

1

1.5

0

0

12.5

Zafar et al.62

1

0.5

1.5

1

0

1

0

1

2

1

0

0

0

9

Aliaga et al.63

1.5

0.5

1.5

1

0

1

0

1

2

0

1.5

0

0

10

Table 4. Studies investigating the use of digitalized learning techniques for acquiring new skills in education

Authors

Intervention design

Type

Specialty

System
used

Participants

Study design

Outcome measures

Quinn
et al.19

split cohort

VR-AL

restorative

experimental

20 students

instructor feedback (conventional) vs. real-time feedback (conventional) vs. real-time feedback (VR)

VR-based skill acquisition is unsuitable for use as the sole method of feedback and evaluation for novice students

Quinn
et al.20

split cohort

VR-AL

restorative

experimental

32 students

instructor feedback (conventional) vs. real-time feedback (VR)

the VR group performed better for outline, depth and smoothness

Imber
et al.21

cohort

AR-AL

restorative

DentSim

26 students

the scores achieved by each student in the last 6 simulator cavities were compared to their final comprehensive grades

simulation exercises are an efficient way to allow the early identification of those who are likely to perform poorly

LeBlanc
et al.22

split cohort

AR-AL

restorative

DentSim

68 students

the comparison of practical skills in the traditional preclinical laboratory or in combination with a VR simulator

training for 6–10 h improved students’ grades

Heiland
et al.23

cohort

VR-AL

surgery

VOXEL-MAN

40 students

the evaluation of the new teaching modality was performed with the help of a questionnaire using ranking scales

further development to extend the range of simulated surgical procedures

Jasinevicius
et al.24

split cohort

AR-AL

restorative

DentSim

28 students

3 categories covering both CS and VR

no statistical differences were observed in the quality of preparations; the instruction time was reduced in the VR group

Wierinck
et al.25

split cohort

AR-AL

restorative

DentSim

42 students

skill acquisition with CS or VR

the feedback group showed higher grades

Wierinck
et al.26

split cohort

AR-AL

restorative

DentSim

36 students

CS with instructions, VR with feedback, and VR with instructions and feedback

simulation with instructions and feedback showed better performance after 4 months

Wierinck
et al.27

split cohort

AR-AL

restorative

DentSim

36 students

CS vs. VR with semi- or full feedback

no difference was observed between semi- or full feedback in simulation

Rees
et al.28

split cohort

AR-AL

restorative

DentSim

16 students

the critical appraisal of the software by students, and the correlation of the preparation time with the final score and the number of evaluations

the positive evaluation of the software Class II cavities was associated with a longer preparation time, and a longer preparation time was associated with higher scores

Von Sternberg
et al.29

split cohort

VR-AL

surgery

VOXEL-MAN

41 students

tested whether the skills acquired on a virtual apicectomy simulator are transferable from virtual to physical reality

training with a virtual apicectomy simulator appears to be effective and the acquired skills are transferable to physical reality

Wierinck
et al.30

cohort

AR-AL

restorative

DentSim

6 students,
12 specialists

a restorative dentist, a periodontist and a novice student prepared cavities

it was possible to distinguish experts in operative dentistry from experts in periodontology

Suebnukarn
et al.31

split cohort

VR-AL

prosthodontics

experimental

10 students
10 residents

a crown preparation task with a haptic VR system that provided FFB to the operating tool was performed while interacting with the virtual tissue/organ

novice and expert performance can be demonstrated in crown preparation by using a haptic VR system

Urbankova32

split cohort

AR-AL

restorative

DentSim

79 students

students were randomized to CDS training or the traditional preclinical dental training alone

8 h of CDS training administered early in the preclinical operative dentistry course may improve student performance

Pohlenz
et al.33

cohort

VR-AL

surgery

VOXEL-MAN

53 students

assessed the realism of a VR system for dental applications

the haptic simulator was considered suitable for training purposes in surgical endodontics by 51 students

Suebnukarn
et al.34

split cohort

VR-AL

endodontics

experimental

32 students

students were randomly assigned to train on either micro-CT tooth models with a haptic VR simulator or extracted teeth in a phantom head training environment for 3 days, after which the assessment was repeated

training on the haptic VR simulator and the conventional phantom head had equivalent effects on minimizing procedural errors in endodontic access cavity preparation

Urbankova
and Engebretson
35

cohort

AR-AL

restorative

DentSim

38 students

cavity preparations during a single 4-hour CDS pre-test prior to the operative dentistry course and during the subsequent practical examinations

a pre-course CDS test may help to identify students in need of early instructional intervention

Gal
et al.36

split cohort

VR-AL

prosthodontics

IDEA

21 educators, 12 students

participants performed drilling tasks using a simulator, and filled out a questionnaire regarding the simulator and the potential ways of using it in dental education

the development of the simulator’s tactile sensation is needed to attune it to genuine sensation

Urbankova
and Engebretson
37

split cohort

AR-AL

restorative

IDEA

39 students

tested whether an AR pre-test can predict preclinical operative dentistry examination scores

a pre-course CDS test may help to identify students in need of early instructional intervention

Woelber
et al.38

split cohort

C-AL

periodontology

experimental

85 students

one group studied with a laborious, high-interaction e-learning program, while the other group studied with a low-interaction learning environment

e-learning programs for case-based learning do not have to be overly laborious to be useful

Tanzawa
et al.39

cohort

AR-AL

restorative

robot patient

88 students

the efficiency of a robot patient in education

the importance of using such a robot in education was stressed

Urbankova
et al.40

cohort

VR-AL

restorative

IDEA

39 students

the association of haptic VR simulator exercise with preclinical dentistry practical exam scores

complex haptic exercise was strongly associated with early student preclinical performance

Kikuchi
et al.41

split cohort

AR-AL

prosthodontics

DentSim

43 students

group 1 received device-only feedback, group 2 received instructor feedback and group 3 received no feedback

the AR system improved student training for PFM crown preparation.

Ben-Gal
et al.42

split cohort

VR-AL

geometric shapes

IDEA

63 students,
28 dentists,
14 non-dentists

performed virtual drilling tasks in different geometric shapes

improved construct validity, a shorter working time and more difficult tasks should be introduced

Yamaguchi
et al.43

cohort

VR-AL

restorative

VR simulation

7 students

the evaluation of haptic VR simulation with repetitive training as a tool in teaching caries removal and periodontal pocket probing skills

VR simulation was effective in the acquisition of hand skills for caries removal

Moazami
et al.44

split cohort

C-AL

endodontics

experimental

40 students

experimental (virtual) and comparative (traditional) learning were evaluated

the comparison of the mean knowledge scores for both groups showed that virtual learning was more effective than the traditional learning

Eve
et al.45

split cohort

VR-AL

restorative

Virteasy

12 students,
14 residents

compared the performance of students vs. residents

residents removed greater amounts of carious and sound tissue

Reissmann
et al.46

split cohort

C-AL

prosthodontics

OLAT

71 students

students participated in a course with blended learning content; for comparisons, data was obtained from 2 courses in the previous years and 3 courses in the subsequent years

the e-learning tool was appreciated by students, suggesting that learning objective tests can be successfully implemented in blended learning

Wang
et al.47

split cohort

VR-AL

restorative and endodontics

iDental

10 residents,
10 dentists

the evaluation included 2 dental drilling tasks – a caries removal operation and a pulp chamber opening operation

no significant differences could be found between the 2 groups, and the volume of removed caries and the depth of pulp chamber insertion showed small standard deviations

Koo
et al.48

split cohort

VR-AL

restorative

IDEA

34 students

assessed the perception of haptic-based manual dexterity training

the manual dexterity module software was not superior in improving dexterity

Mehta
et al.49

split cohort

C-AL

orthodontics

experimental

63 students

32 students received electronic access to e-learning material covering various undergraduate orthodontic topics over a 6-week period, while 31 control students were not given the access during the study period

the use of the novel orthodontic e-resource by fourth-year undergraduate students over a 6-week period did not result in significant improvement in subject knowledge

Ludwig
et al.50

split cohort

C-AL

orthodontics

experimental

30 students

10 students underwent a specifically designed program based on a PPT, other students underwent a commercially available program and 10 students served as controls

blended learning produced better learning outcomes as compared to the use of the traditional teaching method alone; the easy-to-use PPT-based custom software produced better results than the commercially available software

De Boer
et al.51

split cohort

VR-AL

geometric shapes

Simodont

124 students

2D vs. 3D preparations

3D vision has a positive effect on student performance

Al-Saud
et al.52

split cohort

VR-AL

geometric shapes

Simodont

63 non-dentists

group 1 received device-only feedback, group 2 received verbal feedback from a qualified dental instructor, and group 3 received a combination of instructor and device feedback

the acquisition and retention of basic dental motor skills in novice trainees is best optimized through a combination of instructor and visual display (VR)-driven feedback

De Boer
et al.53

split cohort

VR-AL

geometric shapes

Simodont

101 students

practiced with or without FFB

FFB is important for performance in a VR environment

Mirghani
et al.54

split cohort

VR-AL

geometric shapes

Simodont

289 students

examined the sensitivity of a haptic VR dental simulator to differences in dental training experience

statistically significant differences were found between novice and experienced students

Dwisaptarini
et al.55

split cohort

VR-AL

restorative

experimental

32 students

students were randomly assigned to train on either a simulator or conventional extracted teeth for 3 days, after which the assessment was repeated

the VR simulator and the conventional tooth practice had equivalent effects on improving performance in minimally invasive caries removal

Ria
et al.56

cohort

VR-AL

restorative

hapTEL

101 students

to assess the learning progression of novice dental
students using haptic virtual workstations

the system improved student performance in simulated cavity preparation

Llena
et al.57

split cohort

AR-AL

restorative

AR

41 students

the traditional teaching methods vs. AR

the AR techniques favored the acquisition of knowledge and skills, and were regarded as a useful tool by students

De Boer
et al.58

split cohort

VR-AL

geometric shapes

Simodont

126 students

a manual dexterity test in a VR environment with automatic assessment after a 3-month period of practicing with standard FFB

after practice for a sufficient amount of time at one level of FFB, the skill was transferable from one level of FFB to another

Murbay
et al.59

split cohort

VR-AL

restorative

Simodont

32 students

exposure to VR vs. no exposure to VR

the use of VR significantly improved the satisfactory performance of students

Vincent
et al.60

split cohort

VR-AL

restorative

Virteasy

88 students

cavity preparations with VR or conventional simulators

VR allowed assessment based on objective criteria and reduced subjectivity

Tang
et al.61

split Cohort

AR-AL

prosthodontics

DCARER

60 students

traditional vs. digitalized tooth preparation

the tooth preparations of the traditional group scored significantly lower than those of the digital group

Zafar
et al.62

cohort

VR-AL

pediatric dentistry

Simodont

100 students

the perception of the dentistry training gained in VR and a conventional simulation environment

VR could be used as an adjunct in training dental students for pre-clinical pediatric dentistry restorative exercises

Aliaga
et al.63

cohort

VR-AL

restorative

Simodont

82 students

the methacrylate block practice criteria and the evaluation scale were assessed in the 1st and 3rd years

both methodologies can detect manual skill improvement in dental students; additionally, the Simodont practice can be reliably evaluated

IDEA – Individual Dental Education Assistant; CS – contemporary non-computer-assisted simulation system; FFB – force feedback; CDS – computerized dental simulator; CT – computed tomography; PPT – PowerPoint presentation; 2D – two-dimensional; PFM – porcelain-fused-to-metal.

Figures


Fig. 1. Study selection process according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) 2020 guidelines

References (83)

  1. Ranney RR, Wilson MB, Bennett RB. Evaluation of applicants to predoctoral dental education programs: Review of the literature. J Dent Educ. 2005;69(10):1095–1106. PMID:16204675.
  2. García de Andres A, Sánchez E, Hidalgo JJ, Díaz MJ. Appraisal of psychomotor skills of dental students at University Complutense of Madrid. Eur J Dent Educ. 2004;8(1):24–30. doi:10.1111/j.1600-0579.2004.00296.x
  3. Lundergan WP, Lyon L. Research on hand dexterity and the practice of dentistry: Reality and myth. J Am Coll Dent. 2007;74(3):15–16. PMID:18303711.
  4. Miyazaki T, Hotta Y, Kunii J, Kuriyama S, Tamaki Y. A review of dental CAD/CAM: Current status and future perspectives from 20 years of experience. Dent Mater J. 2009;28(1):44–56. doi:10.4012/dmj.28.44
  5. Shah P, Chong BS. 3D imaging, 3D printing and 3D virtual planning in endodontics. Clin Oral Investig. 2018;22(2):641–654. doi:10.1007/s00784-018-2338-9
  6. Perry S, Bridges SM, Burrow MF. A review of the use of simulation in dental education. Simul Healthc. 2015;10(1):31–37. doi:10.1097/SIH.0000000000000059
  7. Dutã M, Amariei CI, Bogdan CM, Popovici DM, Ionescu N, Nuca CI. An overview of virtual and augmented reality in dental education. Oral Health Dent Manag. 2011;10(1):42–49. https://oralhealth.ro/volumes/2011/volume-1/Paper234.pdf. Accessed August 1, 2022.
  8. Kapoor S, Arora P, Kapoor V, Jayachandran M, Tiwari M. Haptics – touchfeedback technology widening the horizon of medicine. J Clin Diagn Res. 2014;8(3):294–299. doi:10.7860/JCDR/2014/7814.4191
  9. Feiner SK. Augmented reality: A new way of seeing. Sci Am. 2002;286(4):48–55. doi:10.1038/scientificamerican0402-48
  10. Nassar HM, Tekian A. Computer simulation and virtual reality in undergraduate operative and restorative dental education: A critical review. J Dent Educ. 2020;84(7):812–829. doi:10.1002/jdd.12138
  11. Park H, Shim S, Lee YM. A scoping review on adaptations of clinical education for medical students during COVID-19. Prim Care Diabetes. 2021;15(6):958–976. doi:10.1016/j.pcd.2021.09.004
  12. Farrokhi F, Mohebbi SZ, Farrokhi F, Khami MR. Impact of COVID-19 on dental education – a scoping review. BMC Med Educ. 2021;21(1):587. doi:10.1186/s12909-021-03017-8
  13. Ertürk Avunduk AT, Delikan E. Satisfaction and stress levels of dentistry students relating to distance education. Dent Med Probl. 2021;58(3):291–298. doi:10.17219/dmp/135318
  14. Flores-Quispe BM, Ruiz-Reyes RA, León-Manco RA, Agudelo-Suárez A. Preventive measures for COVID-19 among dental students and dentists during the mandatory social isolation in Latin America and the Caribbean in 2020. Dent Med Probl. 2022;59(1):5–11. doi:10.17219/dmp/142033
  15. Smolana A, Loster Z, Loster J. Assessment of stress burden among dental students: A systematic literature review and meta-analysis of data. Dent Med Probl. 2022;59(2):301–307. doi:10.17219/dmp/133955
  16. Wieckiewicz M, Danel D, Pondel M, et al. Identification of risk groups for mental disorders, headache and oral behaviors in adults during the COVID-19 pandemic. Sci Rep. 2021;11(1):10964. doi:10.1038/s41598-021-90566-z
  17. Naciri A, Radid M, Kharbach A, Chemsi G. E-learning in health professions education during the COVID-19 pandemic: A systematic review. J Educ Eval Health Prof. 2021;18:27. doi:10.3352/jeehp.2021.18.27
  18. Cheng HC, Lu SL, Yen YC, Siewchaisakul P, Yen AMF, Chen SLS. Dental education changed by COVID-19: Student’s perceptions and attitudes. BMC Med Educ. 2021;21(1):364. doi:10.1186/s12909-021-02806-5
  19. Quinn F, Keogh P, McDonald A, Hussey D. A study comparing the effectiveness of conventional training and virtual reality simulation in the skills acquisition of junior dental students. Eur J Dent Educ. 2003;7(4):164–169. doi:10.1034/j.1600-0579.2003.00309.x
  20. Quinn F, Keogh P, McDonald A, Hussey D. A pilot study comparing the effectiveness of conventional training and virtual reality simulation in the skills acquisition of junior dental students. Eur J Dent Educ. 2003;7(1):13–19. doi:10.1034/j.1600-0579.2003.00264.x
  21. Imber S, Shapira G, Gordon M, Judes H, Metzger Z. A virtual reality dental simulator predicts performance in an operative dentistry manikin course. Eur J Dent Educ. 2003;7(4):160–163. doi:10.1034/j.1600-0579.2003.00299.x
  22. LeBlanc VR, Urbankova A, Hadavi F, Lichtenthal RM. A preliminary study in using virtual reality to train dental students. J Dent Educ. 2004;68(3):378–383. PMID:15038639.
  23. Heiland M, Petersik A, Pflesser B, et al. Realistic haptic interaction for computer simulation of dental surgery. Int Congr Ser. 2004;1268:1226–1229. doi:10.1016/j.ics.2004.03.132
  24. Jasinevicius TR, Landers M, Nelson S, Urbankova A. An evaluation of two dental simulation systems: Virtual reality versus contemporary non-computer-assisted. J Dent Educ. 2004;68(11):1151–1162. PMID:15520234.
  25. Wierinck E, Puttemans V, Swinnen S, Van Steenberghe D. Effect of augmented visual feedback from a virtual reality simulation system on manual dexterity training. Eur J Dent Educ. 2005;9(1):10–16. doi:10.1111/j.1600-0579.2004.00351.x
  26. Wierinck E, Puttemans V, Van Steenberghe D. Effect of tutorial input in addition to augmented feedback on manual dexterity training and its retention. Eur J Dent Educ. 2006;10(1):24–31. doi:10.1111/j.1600-0579.2006.00392.x
  27. Wierinck E, Puttemans V, Van Steenberghe D. Effect of reducing frequency of augmented feedback on manual dexterity training and its retention. J Dent. 2006;34(9):641–647. doi:10.1016/j.jdent.2005.12.005
  28. Rees JS, Jenkins SM, James T, et al. An initial evaluation of virtual reality simulation in teaching pre-clinical operative dentistry in a UK setting. Eur J Prosthodont Restor Dent. 2007;15(2):89–92. PMID:17645072.
  29. Von Sternberg N, Bartsch MS, Petersik A, et al. Learning by doing virtually. Int J Oral Maxillofac Surg. 2007;36(5):386–390. doi:10.1016/j.ijom.2006.12.016
  30. Wierinck ER, Puttemans V, Swinnen SP, Van Steenberghe D. Expert performance on a virtual reality simulation system. J Dent Educ. 2007;71(6):759–766. PMID:17554093.
  31. Suebnukarn S, Phatthanasathiankul N, Sombatweroje S, Rhienmora P, Haddawy P. Process and outcome measures of expert/novice performance on a haptic virtual reality system. J Dent. 2009;37(9):658–665. doi:10.1016/j.jdent.2009.04.008
  32. Urbankova A. Impact of computerized dental simulation training on preclinical operative dentistry examination scores. J Dent Educ. 2010;74(4):402–409. PMID:20388813.
  33. Pohlenz P, Gröbe A, Petersik A, et al. Virtual dental surgery as a new educational tool in dental school. J Craniomaxillofac Surg. 2010;38(8):560–564. doi:10.1016/j.jcms.2010.02.011
  34. Suebnukarn S, Hataidechadusadee R, Suwannasri N, Suprasert N, Rhienmora P, Haddawy P. Access cavity preparation training using haptic virtual reality and microcomputed tomography tooth models. Int Endod J. 2011;44(11):983–989. doi:10.1111/j.1365-2591.2011.01899.x
  35. Urbankova A, Engebretson SP. Computer-assisted dental simulation as a predictor of preclinical operative dentistry performance. J Dent Educ. 2011;75(9):1249–1255. PMID:21890855.
  36. Gal GB, Weiss EI, Gafni N, Ziv A. Preliminary assessment of faculty and student perception of a haptic virtual reality simulator for training dental manual dexterity. J Dent Educ. 2011;75(4):496–504. PMID:21460270.
  37. Urbankova A, Engebretson SP. The use of haptics to predict preclinic operative dentistry performance and perceptual ability. J Dent Educ. 2011;75(12):1548–1557. PMID:22184593.
  38. Woelber JP, Hilbert TS, Ratka-Krüger P. Can easy-to-use software deliver effective e-learning in dental education? A randomised controlled study. Eur J Dent Educ. 2012;16(3):187–192. doi:10.1111/j.1600-0579.2012.00741.x
  39. Tanzawa T, Futaki K, Tani C, et al. Introduction of a robot patient into dental education. Eur J Dent Educ. 2012;16(1):e195–e199. doi:10.1111/j.1600-0579.2011.00697.x
  40. Urbankova A, Eber M, Engebretson SP. A complex haptic exercise to predict preclinical operative dentistry performance: A retrospective study. J Dent Educ. 2013;77(11):1443–1450. PMID:24192409.
  41. Kikuchi H, Ikeda M, Araki K. Evaluation of a virtual reality simulation system for porcelain fused to metal crown preparation at Tokyo Medical and Dental University. J Dent Educ. 2013;77(6):782–792. PMID:23740915.
  42. Ben-Gal G, Weiss EI, Gafni N, Ziv A. Testing manual dexterity using a virtual reality simulator: Reliability and validity. Eur J Dent Educ. 2013;17(3):138–142. doi:10.1111/eje.12023
  43. Yamaguchi S, Yoshida Y, Noborio H, Murakami S, Imazato S. The usefulness of a haptic virtual reality simulator with repetitive training to teach caries removal and periodontal pocket probing skills. Dent Mater J. 2013;32(5):847–852. doi:10.4012/dmj.2013-174
  44. Moazami F, Bahrampour E, Azar MR, Jahedi F, Moattari M. Comparing two methods of education (virtual versus traditional) on learning of Iranian dental students: A post-test only design study. BMC Med Educ. 2014;14:45. doi:10.1186/1472-6920-14-45
  45. Eve EJ, Koo S, Alshihri AA, et al. Performance of dental students versus prosthodontics residents on a 3D immersive haptic simulator. J Dent Educ. 2014;78(4):630–637. PMID:24706694.
  46. Reissmann DR, Sierwald I, Berger F, Heydecke G. A model of blended learning in a preclinical course in prosthetic dentistry. J Dent Educ. 2015;79(2):157–165. PMID:25640620.
  47. Wang D, Zhao S, Li T, Zhang Y, Wang X. Preliminary evaluation of a virtual reality dental simulation system on drilling operation. Biomed Mater Eng. 2015;26(Suppl 1):S747–S756. doi:10.3233/BME-151366
  48. Koo S, Kim A, Donoff RB, Karimbux NY. An initial assessment of haptics in preclinical operative dentistry training. J Investig Clin Dent. 2015;6(1):69–76. doi:10.1111/jicd.12065
  49. Mehta S, Clarke F, Fleming PS. An assessment of student experiences and learning based on a novel undergraduate e-learning resource. Br Dent J. 2016;221(3):131–136. doi:10.1038/sj.bdj.2016.563
  50. Ludwig B, Bister D, Schott TC, Lisson JA, Hourfar J. Assessment of two e-learning methods teaching undergraduate students cephalometry in orthodontics. Eur J Dent Educ. 2016;20(1):20–25. doi:10.1111/eje.12135
  51. De Boer IR, Wesselink PR, Vervoorn JM. Student performance and appreciation using 3D vs. 2D vision in a virtual learning environment. Eur J Dent Educ. 2016;20(3):142–147. doi:10.1111/eje.12152
  52. Al-Saud LM, Mushtaq F, Allsop MJ, et al. Feedback and motor skill acquisition using a haptic dental simulator. Eur J Dent Educ. 2017;21(4):240–247. doi:10.1111/eje.12214
  53. De Boer IR, Lagerweij MD, De Vries MW, Wesselink PR, Vervoorn JM. The effect of force feedback in a virtual learning environment on the performance and satisfaction of dental students. Simul Healthc. 2017;12(2):83–90. doi:10.1097/SIH.0000000000000208
  54. Mirghani I, Mushtaq F, Allsop MJ, et al. Capturing differences in dental training using a virtual reality simulator. Eur J Dent Educ. 2018;22(1):67–71. doi:10.1111/eje.12245
  55. Dwisaptarini AP, Suebnukarn S, Rhienmora P, Haddawy P, Koontongkaew S. Effectiveness of the multilayered caries model and visuo-tactile virtual reality simulator for minimally invasive caries removal: A randomized controlled trial. Oper Dent. 2018;43(3):E110–E118. doi:10.2341/17-083-C
  56. Ria S, Cox MJ, Quinn BF, San Diego JP, Bakir A, Woolford MJ. A scoring system for assessing learning progression of dental students’ clinical skills using haptic virtual workstations. J Dent Educ. 2018;82(3):277–285. doi:10.21815/JDE.018.028
  57. Llena C, Folguera S, Forner L, Rodríguez‐Lozano FJ. Implementation of augmented reality in operative dentistry learning. Eur J Dent Educ. 2018;22(1):e122–e130. doi:10.1111/eje.12269
  58. De Boer IR, Lagerweij MD, Wesselink PR, Vervoorn JM. The effect of variations in force feedback in a virtual reality environment on the performance and satisfaction of dental students. Simul Healthc. 2019;14(3):169–174. doi:10.1097/SIH.0000000000000370
  59. Murbay S, Neelakantan P, Chang JWW, Yeung S. Evaluation of the introduction of a dental virtual simulator on the performance of undergraduate dental students in the pre-clinical operative dentistry course. Eur J Dent Educ. 2020;24(1):5–16. doi:10.1111/eje.12453
  60. Vincent M, Joseph D, Amory C, et al. Contribution of haptic simulation to analogic training environment in restorative dentistry. J Dent Educ. 2020;84(3):367–376. doi:10.21815/JDE.019.187
  61. Tang L, Cao Y, Liu Z, et al. Improving the quality of preclinical simulation training for dental students using a new digital real-time evaluation system. Eur J Dent Educ. 2021;25(1):100–107. doi:10.1111/eje.12580
  62. Zafar S, Lai Y, Sexton C, Siddiqi A. Virtual reality as a novel educational tool in pre-clinical paediatric dentistry training: Students’ percep­tions. Int J Paediatr Dent. 2020;30(6):791–797. doi:10.1111/ipd.12648
  63. Aliaga I, Pedrera-Canal M, Vera V, et al. Preclinical assessment methodology using a dental simulator during dental students’ first and third years. J Oral Sci. 2020;62(1):119–121. doi:10.2334/josnusd.18-0424
  64. Barsom EZ, Graafland M, Schijven MP. Systematic review on the effectiveness of augmented reality applications in medical training. Surg Endosc. 2016;30(10):4174–4183. doi:10.1007/s00464-016-4800-6
  65. Guha D, Alotaibi NM, Nguyen N, Gupta S, McFaul C, Yang VXD. Augmented reality in neurosurgery: A review of current concepts and emerging applications. Can J Neurol Sci. 2017;44(3):235–245. doi:10.1017/cjn.2016.443
  66. Casap N, Wexler A, Tarazi E. Application of a surgical navigation system for implant surgery in a deficient alveolar ridge postexcision of an odontogenic myxoma. J Oral Maxillofac Surg. 2005;63(7):982–988. doi:10.1016/j.joms.2005.03.015
  67. Plessas A. Computerized virtual reality simulation in preclinical dentistry: Can a computerized simulator replace the conventional phantom heads and human instruction? Simul Healthc. 2017;12(5):332–338. doi:10.1097/SIH.0000000000000250
  68. De Houwer J, Barnes-Holmes D, Moors A. What is learning? On the nature and merits of a functional definition of learning. Psychon Bull Rev. 2013;20(4):631–642. doi:10.3758/s13423-013-0386-3
  69. Ma M, Fallavollita P, Seelbach I, et al. Personalized augmented reality for anatomy education. Clin Anat. 2016;29(4):446–453. doi:10.1002/ca.22675
  70. Buchanan JA. Experience with virtual reality-based technology in teaching restorative dental procedures. J Dent Educ. 2004;68:1258–1265. PMID:15576814.
  71. Vávra P, Roman J, Zonča P, et al. Recent development of augmented reality in surgery: A review. J Healthc Eng. 2017;2017:4574172. doi:10.1155/2017/4574172
  72. Towers A, Field J, Stokes C, Maddock S, Martin N. A scoping review of the use and application of virtual reality in pre-clinical dental education. Br Dent J. 2019;226(5):358–366. doi:10.1038/s41415-019-0041-0
  73. Soares PV, De Almeida Milito G, Pereira FA, et al. Rapid prototyping and 3D‐virtual models for operative dentistry education in Brazil. J Dent Educ. 2013;77(3):358–363. PMID:23486902.
  74. Sutherland J, Belec J, Sheikh A, et al. Applying modern virtual and augmented reality technologies to medical images and models. J Digit Imaging. 2019;32(1):38–53. doi:10.1007/s10278-018-0122-7
  75. Stefanelli LV, Mandelaris GA, DeGroot BS, Gambarini G, De Angelis F, Di Carlo S. Accuracy of a novel trace-registration method for dynamic navigation surgery. Int J Periodontics Restorative Dent. 2020;40(3):427–435. doi:10.11607/prd.4420
  76. Cecchetti F, Di Girolamo M, Ippolito DG, Baggi L. Computer-guided implant surgery: Analysis of dynamic navigation systems and digital accuracy. J Biol Regul Homeost Agents. 2020;34(3 Suppl 1):9–17. PMID:32618156.
  77. Hatala R, Cook DA, Zendejas B, Hamstra SJ, Brydges R. Feedback for simulation-based procedural skills training: A meta-analysis and critical narrative synthesis. Adv Health Sci Educ Theory Pract. 2014;19(2):251–272. doi:10.1007/s10459-013-9462-8
  78. Sigrist R, Rauter G, Riener R, Wolf P. Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review. Psychon Bull Rev. 2013;20(1):21–53. doi:10.3758/s13423-012-0333-8
  79. Van Merriënboer JJ, Sweller J. Cognitive load theory and complex learning: Recent developments and future directions. Educ Psychol Rev. 2005;17(2):147–177. doi:10.1007/s10648-005-3951-0
  80. Richardson JC, Swan K. Examining social presence in online courses in relation to students’ perceived learning and satisfaction. JALN. 2003;7(1):68–88. doi:10.24059/olj.v7i1.1864
  81. Collins E, Ditzel L. Holograms enhance student learning. Nurs N Z. 2018;24(10):26.
  82. Zafar S, Zachar JJ. Evaluation of HoloHuman augmented reality application as a novel educational tool in dentistry. Eur J Dent Educ. 2020;24(2):259–265. doi:10.1111/eje.12492
  83. Cheng L, Kalvandi M, McKinstry S, et al. Application of DenTeach in remote dentistry teaching and learning during the COVID-19 pandemic: A case study. Front Robot AI. 2021;7:611424. doi:10.3389/frobt.2020.611424