Telepointer technology in telemedicine : a review

BioMedical Engineering OnLine

Rohana Abdul Karim³  Nor Farizan Zakaria³  Mohd Asyraf Zulkifley¹  Mohd Marzuki Mustafa¹  Ismail Sagap²  Nani Harlina Md Latar² 

[1] Department of Electrical, Electronic & Systems Engineering, Faculty of Engineering & Built Environment, Universiti Kebangsaan Malaysia (UKM), Bangi, Malaysia

[2] Department of Surgery, Universiti Kebangsaan Malaysia (UKM) Medical Centre, Kuala Lumpur, Malaysia

[3] Faculty of Electrical & Electronics Engineering, Universiti Malaysia Pahang, Pekan, Malaysia

关键词: Sketching pointer;    Laser pointer;    Hand pointer;    Cursor pointer;    Telemedicine;    Telepointer;   

Others  :  797924
DOI  :  10.1186/1475-925X-12-21

 received in 2012-12-04, accepted in 2013-03-04,  发布年份 2013

【 摘 要 】

Telepointer is a powerful tool in the telemedicine system that enhances the effectiveness of long-distance communication. Telepointer has been tested in telemedicine, and has potential to a big influence in improving quality of health care, especially in the rural area. A telepointer system works by sending additional information in the form of gesture that can convey more accurate instruction or information. It leads to more effective communication, precise diagnosis, and better decision by means of discussion and consultation between the expert and the junior clinicians. However, there is no review paper yet on the state of the art of the telepointer in telemedicine. This paper is intended to give the readers an overview of recent advancement of telepointer technology as a support tool in telemedicine. There are four most popular modes of telepointer system, namely cursor, hand, laser and sketching pointer. The result shows that telepointer technology has a huge potential for wider acceptance in real life applications, there are needs for more improvement in the real time positioning accuracy. More results from actual test (real patient) need to be reported. We believe that by addressing these two issues, telepointer technology will be embraced widely by researchers and practitioners.

【 授权许可】

   
2013 Abdul Karim et al.; licensee BioMed Central Ltd.

【 图 表 】

Figure 1.

Figure 2.

Figure 3.

Figure 4.

【 参考文献 】

• [1]Latifi R: Telepresence and telemedicine in trauma and emergency. In Studies in health technology and informatics. Amsterdam: Oxford: Ios Press; 2008:viii, 287.
• [2]Murthy VK, Krishnamurthy EV: Multimedia Computing Environment for Telemedical Applications. In Encyclopedia of Information Science and Technology. IGI Global; 2005:2045-2050.
• [3]Greenberg S, Gutwin C, Roseman M: Semantic telepointers for groupware. Computer-human interaction, 1996 proceedings, sixth australian conference on; 24–27 Nov 1996 1996, 54-61.
• [4]Fussell SR, Setlock LD, Yang J, Ou J, Mauer E, Kramer ADI: Gestures over video streams to support remote collaboration on physical tasks. Hum Comput Interact 2004, 19:273-309.
• [5]Kuzuoka H, Kosaka J, Yamazaki K, Suga Y, Yamazaki A, Luff P, Heath C: Mediating dual ecologies. In Proceedings of the 2004 ACM conference on Computer supported cooperative work (CSCW '04). New York, NY, USA: ACM; 2004:477-486.
• [6]Ou J, Fussell SR, Chen X, Setlock LD, Yang J: Gestural communication over video stream: supporting multimodal interaction for remote collaborative physical tasks. In Proceedings of the 5th international conference on Multimodal interfaces(ICMI '03). New York, NY, USA: ACM; 2003:242-249.
• [7]Kirk D, Fraser DS: Comparing remote gesture technologies for supporting collaborative physical tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06). Edited by Rebecca G, Thomas R, Paul A, Ed C, Robin J, Gary O. New York, NY, USA: ACM; 2006:1191-1200.
• [8]Tajimi K, Sakata N, Uemura K, Nishida S: Remote collaboration using real-world projection interface. In Systems Man and cybernetics (SMC), 2010 IEEE international conference on; 10–13 Oct. 2010. IEEE; 2010:3008-3013.
• [9]Ereso AQ, Garcia P, Tseng E, Gauger G, Kim H, Dua MM, Victorino GP, Guy TS: Live transference of surgical subspecialty skills using telerobotic proctoring to remote general surgeons. J Am Coll Surg 2010, 211:400-411.
• [10]Pichiliani MC, Hirata CM, Soares FS, Forster CHQ: TeleEye: an awareness widget for providing the focus of attention in collaborative editing systems collaborative computing: networking, applications and worksharing. Volume 10. Edited by Bertino E, Joshi JBD. Heidelberg: Springer Berlin; 2009::258-270. [Akan O, Bellavista P, Cao J, Dressler F, Ferrari D, Gerla M, Kobayashi H, Palazzo S, Sahni S, Shen X, et al. (Series Editor): Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering]
• [11]Ikeda S, Asghar Z, Hyry J, Pulli P, Pitkanen A, Kato H: Remote assistance using visual prompts for demented elderly in cooking. In Proceedings of the 4th International Symposium on Applied Sciences in Biomedical and Communication Technologies (ISABEL '11). New York, NY, USA: ACM; 2011:1-5.
• [12]Kurata T, Sakata N, Kourogi M, Kuzuoka H, Billinghurst M: Remote collaboration using a shoulder-worn active camera/laser. In Wearable computers, 2004 ISWC 2004 eighth international symposium on; 31 Oct.-3 Nov. IEEE; 2004:62-69.
• [13]Alem L, Tecchia F, Huang W: Remote tele-assistance system for maintenance operators in mines. In Proceedings of 11th Underground Coal Operators Conference (COAL2011). Wollongong University; 2011.
• [14]Lai AM, Kaufman DR, Starren J, Shea S: Evaluation of a remote training approach for teaching seniors to use a telehealth system. Int J Med Inform 2009, 78:732-744.
• [15]Christophe B, amp, vart Antoine B, Hassan Abdourahman A, Paul M, Renaud D: Severe Vertex Epidural Hematoma in a Child: A Case Report of a Management without Expert Neurosurgical Care. Case Reports in Surgery 2011.
• [16]McLauchlan CA, Jones K, Guly HR: Interpretation of trauma radiographs by junior doctors in accident and emergency departments: a cause for concern? J Accid Emerg Med 1997, 14:295-298.
• [17]Wootton R: Telemedicine support for the developing world. J Telemed Telecare 2008, 14:109.
• [18]Azzolini C: A pilot teleconsultation network for retinal diseases in ophthalmology. J Telemed Telecare 2011, 17:20-24.
• [19]Beula Devamalar PM, Thulasi Bai V, Srivatsa SK: Design and architecture of real time web-centric tele health diabetes diagnosis expert system. Int J Med Eng and Informatics 2009, 1:307-317.
• [20]Alem L, Li J: A study of gestures in a video-mediated collaborative assembly task. Adv in Hum-Comp Int 2011, 2011:1-7.
• [21]Huang W, Alem L, Albasri J: HandsInAir: a wearable system for remote collaboration. CoRR 2011. abs/1112.1742
• [22]Sachpazidis I, Kiefer S, Selby P, Ohl R, Sakas G: A medical network for teleconsultations in Brazil and Colombia. 2006, 16-21.
• [23]Pavlovych A, Stuerzlinger W: Target following performance in the presence of latency, jitter, and signal dropouts. Canadian human-computer communications society 2011, 33-40.
• [24]Dyck J, Gutwin C, Subramanian S, Fedak C: High-performance telepointers. In Proceedings of the 2004 ACM conference on Computer supported cooperative work (CSCW '04). New York, NY, USA: ACM; 2004:172-181.
• [25]Gutwin C, Benford S, Dyck J, Fraser M, Vaghi I, Greenhalgh C: Revealing delay in collaborative environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). New York, NY, USA: ACM; 2004:503-510.
• [26]Rizou D, Sesma L, Salvatore L: Doctors mobility covered by TraumaStation. In information technology and applications in biomedicine (ITAB). 2010 10th IEEE International Conference on; 3–5 Nov 2010, 2010:1-4.
• [27]Telemedicine. http://www.ustudy.in/node/5162 webcite
• [28]Bonnardot L, Rainis R: Store-and-forward telemedicine for doctors working in remote areas. J Telemed Telecare 2009, 15:1-6.
• [29]Dala-Ali BM, Lloyd MA, Al-Abed Y: The uses of the iPhone for surgeons. Surgeon 2011, 9:44-48.
• [30]Farber N, Haik J, Liran A, Weissman O, Winkler E: Third generation cellular multimedia teleconsultations in plastic surgery. J Telemed Telecare 2011, 17:199-202.
• [31]Hailey D, Ohinmaa A, Roine R: Study quality and evidence of benefit in recent assessments of telemedicine. J Telemed Telecare 2004, 10:318-324.
• [32]Augestad K, Lindsetmo R: Overcoming distance: video-conferencing as a clinical and educational tool among surgeons. World J Surg 2009, 33:1356-1365.
• [33]Lundvoll Nilsen L: Collaboration and learning in medical teams by using video conference. Behav & Inf Technol 2011, 30:507-515.
• [34]Nagata H, Mizushima H: A remote collaboration system for telemedicine using the Internet. J Telemed Telecare 1998, 4:89-94.
• [35]Young-Hughes S, Simbartl L: Spinal cord injury/disorder teleconsultation outcome study. Rehabil Nurs 2011, 36:153.
• [36]Butner SE, Ghodoussi M: Transforming a surgical robot for human telesurgery. Robotics and Automation, IEEE Transactions on 2003, 19:818-824.
• [37]Clifford G, Blaya J, Hall-Clifford R, Fraser H: Medical information systems: a foundation for healthcare technologies in developing countries. Biomed Eng Online 2008, 7:18. BioMed Central Full Text
• [38]Ramalanjaona G: The development of telemedicine in Madagascar. J Telemed Telecare 2011, 17:161-162.
• [39]Xia S, Sun D, Chengzheng S, Chen D: Object-associated telepointer for real-time collaborative document editing systems. Collaborative computing: networking, applications and worksharing, 2005 international conference on; 0–0 0 2005, 10.
• [40]Sun A, Sun C: Televiewpointer: an integrated workspace awareness widget for real-time collaborative 3d design systems. In Proceedings of the 16th ACM international conference on Supporting group work (GROUP '10). New York, NY, USA: ACM; 2010:21-30.
• [41]Julsrud PR, Breen JF, Jedeikin R, Peoples W, Wondrow MA, Bailey KR: Telemedicine consultations in congenital heart disease: assessment of advanced technical capabilities. Mayo Clin Proc 1999, 74:758-763.
• [42]Kaidu M, Toyabe S, Oda J, Okamoto K, Ozaki T, Shiina M, Sasai K, Akazawa K: Development and evaluation of a teleradiology and videoconferencing system. J Telemed Telecare 2004, 10:214-218.
• [43]Lee JS, Tsai CT, Pen CH, Lu HC: A real time collaboration system for teleradiology consultation. Int J Med Inform 2003, 72:73-79.
• [44]Gambadauro P, Magos A: NEST (network enhanced surgical training): A PC-based system for telementoring in gynaecological surgery. Eur J Obstet Gynecol Reprod Biol 2008, 139:222-225.
• [45]Ohta S, Kuzuoka H, Noda M, Sasaki H, Mishima S, Fujikawa T, Yukioka T: Remote support for emergency medicine using a remote-control laser pointer. J Telemed Telecare 2006, 12:44-48.
• [46]Bruschi M, Micali S, Porpiglia F, Celia A, De Stefani S, Grande M, Scarpa RM, Bianchi G: Laparoscopic telementored adrenalectomy: the italian experience. Surg Endosc 2005, 19:836-840.
• [47]Yuan-Pin Y: Object oriented teleconsultations in global PACS using multi-thread Java. In System Sciences, 1997, Proceedings of the Thirtieth Hawaii International Conference on; 7-10 Jan 1997. IEEE; 1997:166-175. vol.164
• [48]Bardram JE: Activity-based computing for medical work in hospitals. ACM Trans Comput-Hum Interact 2009, 16:1-36.
• [49]Graschew G, Roelofs TA, Rakowsky S, Schlag PM: WinVicos - wavelet-based interactive video communication system for medical and non-medical applications. In Industrial Technology, 2002 IEEE ICIT '02 2002 IEEE International Conference on; 11-14 Dec. 2002. IEEE; 2002:864-868. vol.862
• [50]Gackowski A, Czekierda Ł, Chrustowicz A, Cała J, Nowak M, Sadowski J, Podolec P, Pasowicz M, Zieliński K: Development, implementation, and multicenter clinical validation of the TeleDICOM—advanced, interactive teleconsultation system. J Digit Imaging 2011, 24:541-551.
• [51]Lai AM, Starren JB, Kaufman DR, Mendonça EA, Palmas W, Nieh J, Shea S: The REmote patient education in a telemedicine environment architecture (REPETE). Telemed E-Health 2008, 14:355-361.
• [52]MARSHALL J: The safety of laser pointers: myths and realities. Br J Ophthalmol 1998, 82:1335-1338.
• [53]Silva A, Frere A: Virtual environment to quantify the influence of colour stimuli on the performance of tasks requiring attention. Biomed Eng Online 2011, 10:74. BioMed Central Full Text
• [54]Schneider A, Wilhelm D, Bohn U, Wichert A, Feussner H: An evaluation of a surgical telepresence system for an intrahospital local area network. J Telemed Telecare 2005, 11:408-413.
• [55]Kirstein C, Muller H: Interaction with a projection screen using a camera-tracked laser pointer. In Multimedia Modeling, 1998 MMM '98 Proceedings 1998; 12-15 Oct 1998. IEEE; 1998:191-192.
• [56]Dan R, Olsen J, Nielsen T: Laser pointer interaction. In Proceedings of the SIGCHI conference on Human factors in computing systems; Seattle, Washington, United States. New York, NY, USA: ACM; 2001:17-22.
• [57]Ahlborn BA, Thompson D, Kreylos O, Hamann B, Staadt OG: A practical system for laser pointer interaction on large displays. In Proceedings of the ACM symposium on Virtual reality software and technology; Monterey, CA, USA. New York, NY, USA: ; 2005:106-109.
• [58]Ursic CM, Coates NE, Fischer RP: The pocket laser pointer as a teaching tool in laparoscopic surgery. Surg Laparosc Endosc Percutan Tech 1997, 7:47-48.
• [59]Racz GB, Kao JY: Laser pointer as a teaching tool in operating rooms. Anesthesiology 1998, 88:549.
• [60]Moustris GP, Hiridis SC, Deliparaschos KM, Konstantinidis KM: Evolution of autonomous and semi-autonomous robotic surgical systems: a review of the literature. Int J Med Robot 2011, 7:375-392.
• [61]Clarke JV, Deakin AH, Nicol AC, Picard F: Measuring the positional accuracy of computer assisted surgical tracking systems. Comput Aided Surg 2010, 15:13-18.
• [62]Yamazaki K, Yamazaki A, Kuzuoka H, Oyama S, Kato H, Suzuki H, Miki H: GestureLaser and GestureLaser Car ECSCW ’99. Edited by Bødker S, Kyng M, Schmidt K. Netherlands: Springer; 2002:239-258.
• [63]Ko R, Razvi H: C-Arm laser positioning device to facilitate percutaneous renal access. Urology 2007, 70:360-361.
• [64]Yamashita N, Kaji K, Kuzuoka H, Hirata K: Improving visibility of remote gestures in distributed tabletop collaboration. In Proceedings of the ACM 2011 conference on Computer supported cooperative work. Hangzhou, China: ACM; 2011:95-104.
• [65]Alem L, Tecchia F, Huang W: HandsOnVideo: towards a gesture based mobile AR system for remote collaboration recent trends of mobile collaborative augmented reality systems. Edited by Alem L, Huang W. New York: Springer; 2011:135-148.
• [66]Tang JC, Minneman SL: Videodraw: a video interface for collaborative drawing. ACM Trans Inf Syst 1991, 9:170-184.
• [67]Anvari M: Telesurgery: remote knowledge translation in clinical surgery. World J Surg 2007, 31:1545-1550.
• [68]Tsuda S: Teleproctoring in surgery the SAGES manual of quality, outcomes and patient safety. Edited by Tichansky MDFDS, Morton MDMPHJ, Jones DB. US: Springer; 2012:513-517.
• [69]Ali MR, Loggins JP, Fuller WD, Miller BE, Hasser CJ, Yellowlees P, Vidovszky TJ, Rasmussen JJ, Pierce J: 3-D telestration: a teaching tool for robotic surgery. J Laparoendosc Adv Surg Tech 2008, 18:107-112.
• [70]Qiru Z, Dong L: Interactive visual content sharing and telestration: a novel network multimedia service. Intelligence in next generation networks (ICIN), 2010 14th international conference on; 11–14 Oct. 2010 2010, 1-6.
• [71]Kim H, Cho Y, Do E: Using Pen-based computing in technology for health human-computer interaction. Users and applications. In Lecture notes in computer science. Edited by Jacko J. Berlin / Heidelberg: Springer; 2011:192-201. 6764
• [72]Dante A-T: The design and evaluation of a Pen-based computer interface for novice older users. Computer science, 2006 ENC ’06 seventh mexican international conference on; sept. 2006 2006, 142-150.
• [73]Westin J, Ghiamati S, Memedi M, Nyholm D, Johansson A, Dougherty M, Groth T: A new computer method for assessing drawing impairment in Parkinson’s disease. J Neurosci Methods 2010, 190:143-148.
• [74]Kim H: Exploring technological opportunities for cognitive impairment screening. In Book exploring technological opportunities for cognitive impairment screening (editor ed.^eds.). pp. 887–892. ACM; 2011:887-892.
• [75]Tu H, Ren X, Zhai S: A comparative evaluation of finger and pen stroke gestures. In Book a comparative evaluation of finger and pen stroke gestures (editor ed.^eds.). pp. 1287–1296. ACM; 2012:1287-1296.
• [76]Yun F, Huang TS: HMouse: head tracking driven virtual computer mouse. Applications of computer vision, 2007 WACV ’07 IEEE workshop on; Feb. 2007 2007, 30-30.
• [77]Olsen A, Schmidt A, Marshall P, Sundstedt V: Using eye tracking for interaction. In Book using eye tracking for interaction (editor ed.^eds.). pp. 741–744. ACM; 2011:741-744.
• [78]Wickey A, Alem L: Analysis of hand gestures in remote collaboration: some design recommendations. In Proceedings of the 19th Australasian conference on Computer-Human Interaction: Entertaining User Interfaces; Adelaide, Australia. New York, NY, USA: ACM; 2007:87-93.
• [79]Argyros A, Lourakis MA, Huang T, Sebe N, Lew M, Pavlović V, Kölsch M, Galata A, Kisačanin B: Vision-Based Interpretation of Hand Gestures for Remote Control of a Computer Mouse. In Computer Vision in Human-Computer Interaction. Volume 3979. Springer Berlin Heidelberg; 2006:40-51. [Huang T, Sebe N, Lew M, Pavlović V, Kölsch M, Galata A, Kisačanin B] Lecture Notes in Computer Science
• [80]Gallo L, Ciampi M: Wii remote-enhanced hand-computer interaction for 3D medical image analysis. Current trends in information technology (CTIT), 2009 international conference on the; 15–16 Dec. 2009 2009, 1-6.
• [81]Grätzel C, Fong T, Grange S, Baur C: A non-contact mouse for surgeon-computer interaction. Technol Health Care 2004, 12:245-257.
• [82]Grange S, Fong T, Baur C: M/ORIS: a medical/operating room interaction system. In Proceedings of the 6th international conference on Multimodal interfaces. Edited by ACM, New York, NY, USA. New York N, USA: State College, PA, USA; 2004:159-166.
• [83]Wachs JP, Stern HI, Edan Y, Gillam M, Handler J, Feied C, Smith M: A gesture-based tool for sterile browsing of radiology images. J Am Med Inform Assoc 2008, 15:321-323.
• [84]Wachs J, Stern H, Edan Y, Gillam M, Feied C, Smith M, Handler J: Gestix: A Doctor-Computer Sterile Gesture Interface for Dynamic Environments. In Soft Computing in Industrial Applications. Volume 39. Edited by Saad A, Dahal K, Sarfraz M, Roy R, Saad A, Dahal K, Sarfraz M, Roy R. Springer Berlin Heidelberg; 2007:30-39. Advances in Soft Computing
• [85]MacLean J, Herpers R, Pantofaru C, Wood L, Derpanis K, Topalovic D, Tsotsos J: Fast hand gesture recognition for real-time teleconferencing applications. In Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, 2001 Proceedings IEEE ICCV Workshop on. IEEE; 2001:133-140.
• [86]Jayaraman S, Apriasz I, Trejos AL, Bassan H, Patel RV, Schlachta CM: Novel hands-free pointer improves instruction efficiency in laparoscopic surgery. Surg Innov 2009, 16:73-77.
• [87]Eng-Jon O, Bowden R: Robust facial feature tracking using shape-constrained multiresolution-selected linear predictors. Pattern Analysis and Machine Intelligence, IEEE Transactions on 2011, 33:1844-1859.
• [88]Jie C, Ming-Chao C, Xiaolin W, Jie L: GPU-aided directional image/video interpolation for real time resolution upconversion. In Multimedia Signal Processing, 2009 MMSP '09 IEEE International Workshop on. IEEE; 2009:1-6.
• [89]Zulkifley M, Moran B: Statistical patch-based observation for single object tracking image analysis and processing – ICIAP 2011. In Lecture notes in computer science. Edited by Maino G, Foresti G. Heidelberg: Springer Berlin; 2011:119-129. 6979
• [90]Zulkifley MA, Moran B, Rawlinson D: Robust foreground detection: a fusion of masked GreyWorld, probabilistic gradient information and extended conditional random field approach. Sensors-Basel 2012, 12:5623-5649.
• [91]Vidhya M: Statistical analysis identifies genes in prostate cancer. Int J Medical Eng and Inf 2009, 1:407-417.
• [92]Xue Z, Shen D: A new statistically-constrained deformable registration framework for MR brain images. Int J Medical Eng and Inf 2009, 1:357-367.