Abstract
This work assesses the accuracy of mono and stereo vision-based marker tracking on the Microsoft HoloLens as a representative of current generation AR devices. This is motivated by the need to employ object tracking in industrial AR applications. We integrate mono and stereo vision-based marker tracking with the HoloLens. A calibration procedure is developed that allows users to assess the accuracy of the calibration alignments by walking around the virtual calibration target. This can be generally applied when calibrating additional tracking systems with ready-made AR systems. Finally, the accuracy that can be achieved with the developed system is evaluated (comparing the influence of different parameters).
Chapter PDF
Similar content being viewed by others
References
1. Vassallo R, Rankin A, Chen ECS et al. (2017) Hologram stability evaluation for Microsoft HoloLens. In: Kupinski MA, Nishikawa RM (eds) Medical Imaging 2017: Image Perception, Observer Performance, and Technology Assessment. SPIE, p 1013614
2. Zhou F, Duh HB-L, Billinghurst M (2008) Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR. In: Livingston MA (ed) 7th IEEEACM International Symposium on Mixed and Augmented Reality, 2008: ISMAR 2008 ; Sept. 15 - 18, 2008, Cambridge, UK. IEEE Service Center, Piscataway, NJ, pp 193–202
3. Mitsuno D, Ueda K, Hirota Y et al. (2019) Effective Application of Mixed Reality Device HoloLens: Simple Manual Alignment of Surgical Field and Holograms. Plast Reconstr Surg 143(2): 647–651. https://doi.org/10.1097/prs.0000000000005215
4. Eschen H, Kötter T, Rodeck R et al. (2018) Augmented and Virtual Reality for Inspection and Maintenance Processes in the Aviation Industry. Procedia Manufacturing 19: 156–163. https://doi.org/10.1016/j.promfg.2018.01.022
5. Hoover M (2018) An evaluation of the Microsoft HoloLens for a manufacturing-guided assembly task. Master Thesis, Iowa State University
6. Evans G, Miller J, Iglesias Pena M et al. (2017) Evaluating the Microsoft HoloLens through an augmented reality assembly application. In: Sanders-Reed JN, Arthur JJ (eds) Degraded Environments: Sensing, Processing, and Display 2017. SPIE, 101970V
7. Garrido-Jurado S, Muñoz-Salinas R, Madrid-Cuevas FJ et al. (2014) Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recognition 47(6): 2280–2292. https://doi.org/10.1016/j.patcog.2014.01.005
8. Marchand E, Uchiyama H, Spindler F (2016) Pose Estimation for Augmented Reality: A Hands-On Survey. IEEE Trans Vis Comput Graph 22(12): 2633–2651. https://doi.org/10.1109/tvcg.2015.2513408
9. Schweighofer G, Pinz A (2006) Robust pose estimation from a planar target. IEEE Trans Pattern Anal Mach Intell 28(12): 2024–2030. https://doi.org/10.1109/tpami.2006.252
10. Bergamasco F, Albarelli A, Torsello A (2011) Image-Space Marker Detection and Recognition Using Projective Invariants. In: International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), 2011: 16 - 19 May 2011, Hangzhou, China ; proceedings. IEEE, Piscataway, NJ, pp 381–388
11. Abawi DF, Bienwald J, Dorner R (2004) Accuracy in Optical Tracking with Fiducial Markers: An Accuracy Function for ARToolKit. In: Third IEEE and ACM International Symposium on Mixed and Augmented Reality, 2004: ISMAR 2004 ; 02 - 05 Nov. 2004, [Arlington, VA, USA ; proceedings …]. IEEE Computer Society, Los Alamitos, Calif., pp 260–261
12. Malbezin P, Piekarski W, Thomas BH (2002) Measuring ARTootKit accuracy in long distance tracking experiments. In: Katō H, Billinghurst M (eds) IEEE ART02: The First IEEE International Augmented Reality Toolkit Workshop : 29 September 2002, Darmstadt, Germany. [IEEE], Piscataway, N.J., p 2
13. Grubert J, Itoh Y, Moser K et al. (2018) A Survey of Calibration Methods for Optical See-Through Head-Mounted Displays. IEEE Trans Vis Comput Graph 24(9): 2649–2662. https://doi.org/10.1109/tvcg.2017.2754257
14. Tuceryan M, Navab N (2000) Single point active alignment method (SPAAM) for optical see-through HMD calibration for AR. In: Proceedings, IEEE and ACM International Symposium on Augmented Reality (ISAR 2000): October 5-6, 2000, Munich, Germany. IEEE Computer Society, Los Alamitos, Calif, pp 149–158
15. Genc Y, Sauer F, Wenzel F et al. (2000) Optical see-through HMD calibration: a stereo method validated with a video see-through system. In: Proceedings, IEEE and ACM International Symposium on Augmented Reality (ISAR 2000): October 5-6, 2000, Munich, Germany. IEEE Computer Society, Los Alamitos, Calif, pp 165–174
16. Genc Y, Tuceryan M, Navab N (2002) Practical solutions for calibration of optical seethrough devices. In: International Symposium on Mixed and Augmented Reality: ISMAR 2002, September 30-October 1, 2002, Darmstadt, Germany : proceedings. IEEE Computer Society, Los Almitos, Calif, pp 169–175
17. Qian L, Azimi E, Kazanzides P et al. (2017) Comprehensive tracker based display calibration for holographic optical see-through head-mounted display. arXiv preprint arXiv:1703.05834
18. Qian L, Deguet A, Kazanzides P (2018) ARssist: augmented reality on a head-mounted display for the first assistant in robotic surgery. Healthcare technology letters 5(5): 194–200. https://doi.org/10.1049/htl.2018.5065
Acknowledgement
This work was created as part of the research project “MiReP” and is supported by the Federal Ministry for Economic Affairs and Energy as part of the Federal Aeronautical Research Programme “LuFo V-3”.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Open Access This chapter is licensed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.
The images or other third party material in this chapter are included in the chapter's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the chapter's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.
Copyright information
© 2020 The Author(s)
About this paper
Cite this paper
Brand, M., Wulff, L.A., Hamdani, Y., Schüppstuhl, T. (2020). Accuracy of Marker Tracking on an Optical See-Through Head Mounted Display. In: Schüppstuhl, T., Tracht, K., Henrich, D. (eds) Annals of Scientific Society for Assembly, Handling and Industrial Robotics. Springer Vieweg, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-61755-7_3
Download citation
DOI: https://doi.org/10.1007/978-3-662-61755-7_3
Published:
Publisher Name: Springer Vieweg, Berlin, Heidelberg
Print ISBN: 978-3-662-61754-0
Online ISBN: 978-3-662-61755-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)