info@biomedres.us   +1 (720) 414-3554
  One Westbrook Corporate Center, Suite 300, Westchester, IL 60154, USA

Biomedical Journal of Scientific & Technical Research

September, 2021; Volume 38, 5; pp 30736-30739

Mini Review

Mini Review

Designing an Adjustable Head Frame for Surgery Using Mixed Reality Technology Hololens 2

Ivanov VM1*, Krivtsov AM1, Strelkov SV1, Kalakutskiy NV2 and Yaremenko AI2

Author Affiliations

1Peter the Great St. Petersburg Polytechnic University (SPbPU), Russia

2Pavlov First Saint Petersburg State Medical University, Russia

Received: September 08, 2021 | Published: September 17, 2021

Corresponding author: Vladimir Ivanov, Peter the Great St. Petersburg Polytechnic University (SPbPU), Russia

DOI: 10.26717/BJSTR.2021.38.006212

ABSTRACT

Positioning holograms during surgery is a major challenge when using mixed reality as the primary navigation tool. This article provides an overview of the developed adjustable frame that acts as a marker holder for mixed reality. This frame allows the technology to be applied in large quantities without the need to manufacture individual systems for each patient.

Keywords: Mixed Reality; Augmented Reality; Surgery; Hololens

Introduction

To position three-dimensional holograms to a strictly defined point in space, it is necessary to use special markers, which can be represented in the form of images [1], QR codes [2] or geometric objects [3]. In the case of using mixed reality technology in surgery, these markers must be rigidly linked to the patient’s anatomy in order to accurately position the 3D model of the anatomical structures. This can be achieved through the use of special frameholders of the marker [4], which are based on the individual anatomy of the patient and are made using the 3D printing method. The main disadvantage of such marker-holders is that for each patient it is necessary to design and manufacture a new marker-holder, which is time-consuming and expensive. To solve this problem, we have developed an adjustable frame (Figure 1), which is intended for performing operations on the head using mixed reality glasses [5]. This frame fits over the patient’s head and adjusts to his individual parameters. This device is entirely made of polyamide, which allows it to be sterilized before each procedure and used repeatedly in various operations related to neurosurgery and maxillofacial surgery [6].

Figure 1: Adjustable frame design.

Design and Basic Principle of Use

The design of the frame is designed in such a way that it rests on the fixed parts of the patient’s anatomy, namely the bridge of the nose and ear canals. All adjusting elements are near the ears. As a result of their adjustment, the frame is firmly adhered to the patient’s head due to the tension created between the support on the bridge of the nose and the ears. The original fitting position of the frame is designed neurosurgery, however it can be placed upside down in order to open access to the face for maxillofacial surgery (Figure 2). The frame also contains radiopaque markers, which can be used to compare the position of the frame relative to the CT scan and thus calculate the exact position and orientation of the hologram relative to the marker when using mixed reality glasses. The marker itself is inserted into a special slot in the frame, which allows you to set markers of various configurations depending on the surgical access and the position of the patient during surgery.

Figure 2: Two different fitting positions of the frame. For neurosurgery (left) and maxillofacial surgery(right).

Iterative Design Approach

At the moment, the design of the frame has undergone 2 major development iterations. On each of them, various design changes were made to improve the ergonomics and quality of positioning of the holograms (Figure 3). The first version used plastic adjusting clips with metal rods. Despite the small length and size of the threads, they gave very strong interference in CT scans; as a result, the retainers were replaced with polyamide screws with nuts from the same material. In the second version, in addition to screws, polyamide plugs were made, which were put on over the screws and increased convenience in the process of adjusting the position of this frame. Also, the frame was reinforced with stiffening ribs to reduce possible deformation as a result of tightening the screws in the ears. In addition, the design of the installation of radiopaque markers has been revised. Now they are represented by small 2x2 mm set screws. This made it possible to significantly improve the quality of calibration and the positioning accuracy of the holograms. The result of using the frame during surgery with mixed reality glasses can be seen on the Figure 4.

Figure 3: Two versions of the frame. Old design (left) and new design (right).

Figure 4: Doctor wearing Hololens 2 glasses during the procedure (left) and picture from first point of view through glasses (right).

Conclusion

The adjustable frame allows surgeons to perform multiple surgeries using the same rig without creating custom system for each procedure. The latest version of the design is not final and requires some improvements. In particular, it is planned to revise the regulation mechanism to increase compactness in order to fit portable dental CT scans. We are also considering an option in which has an additional emphasis on the forehead to increase the rigidity of fixation.

References

Mini Review

Designing an Adjustable Head Frame for Surgery Using Mixed Reality Technology Hololens 2

Ivanov VM1*, Krivtsov AM1, Strelkov SV1, Kalakutskiy NV2 and Yaremenko AI2

Author Affiliations

1Peter the Great St. Petersburg Polytechnic University (SPbPU), Russia

2Pavlov First Saint Petersburg State Medical University, Russia

Received: September 08, 2021 | Published: September 17, 2021

Corresponding author: Vladimir Ivanov, Peter the Great St. Petersburg Polytechnic University (SPbPU), Russia

DOI: 10.26717/BJSTR.2021.38.006212

ABSTRACT

Positioning holograms during surgery is a major challenge when using mixed reality as the primary navigation tool. This article provides an overview of the developed adjustable frame that acts as a marker holder for mixed reality. This frame allows the technology to be applied in large quantities without the need to manufacture individual systems for each patient.

Keywords: Mixed Reality; Augmented Reality; Surgery; Hololens