Wearable fatigue monitoring glasses based on N-Range

Kang YAO; Kai-jie GUAN; Xi ZHANG

doi:10.3788/OPE.20192707.1661

您当前的位置：

首页 >

文章列表页 >

Wearable fatigue monitoring glasses based on N-Range

Information Sciences | 更新时间：2020-08-13

- Wearable fatigue monitoring glasses based on N-Range
- Optics and Precision Engineering Vol. 27, Issue 7, Pages: 1661-1672(2019)
- 作者机构：
  
  1.中国科学技术大学，安徽合肥 230000
  2.中国科学院苏州生物医学工程技术研究所，江苏苏州 215000
  3.中国人民解放军总医院第二医学中心神经内科，北京 100000
- 作者简介：
- 基金信息：
- DOI：10.3788/OPE.20192707.1661
  CLC： TP391.4
- Received：19 March 2019，
  
  Accepted：29 April 2019，
  
  Published：15 July 2019
- 稿件说明：
移动端阅览
Kang YAO, Kai-jie GUAN, Xi ZHANG. Wearable fatigue monitoring glasses based on N-Range[J]. Optics and precision engineering, 2019, 27(7): 1661-1672.
DOI：

Kang YAO, Kai-jie GUAN, Xi ZHANG. Wearable fatigue monitoring glasses based on N-Range[J]. Optics and precision engineering, 2019, 27(7): 1661-1672. DOI： 10.3788/OPE.20192707.1661.

摘要

现行的疲劳监测设备造价昂贵，便携性差且有效性不高，正面疲劳监测方案极大地影响了使用者的工作效率，因此进行实用且准确的疲劳监测方案研究十分有意义。提出了新型的侧眼眼动疲劳监测眼镜并结合N-Range图像处理算法提高眼部定位的鲁棒性与疲劳监测的准确率。在侧眼图像处理过程中，用N*N的卷积核及Sigmoid函数计算激活图，采用OTSU阈值分割法对激活图进行阈值分割，将小于阈值的像素点激活值置于0。据此计算水平方向与垂直方向的标准差投影，从投影图中通过平均阈值法定位出人眼区域，随后通过计算人眼高宽比表征眼部闭合度，采用基于PERCLOS的P80疲劳评测方法为设备的使用者进行实时的疲劳分析。实验结果表明现行设备所存在的问题，通过我们的方案得到了很好的解决，即使在复杂的环境中，本文的方法仍然表现出色，疲劳判决准确度达到了94%。疲劳监测眼镜与N-Range算法可以实现在不影响使用者作业效率的前提下，仍然保持着较高的疲劳监测精度，具有较高的实用价值。

Abstract

Current fatigue monitoring equipment is expensive

non-portable

and its algorithm has a low robustness in eye movement image processing. Existing front-end camera fatigue monitoring schemes have many limitations and greatly affect their users efficiency; as such

the development of portable and accurate fatigue monitoring systems is very challenging. In this paper

a new type of fatigue monitoring glasses and N-Range image processing algorithm is proposed to improve the robustness of eye location analysis and accuracy of fatigue detection. Real-time fatigue analysis is performed for users of the proposed mechanism according to the theory of percentage eye closure (PERCLOS) P80 fatigue assessment; it is considered that the P80 criterion is the most suitable for this study. In the process of side-eye image processing

an N-Range eye region extraction algorithm is proposed. The activation map is computed by an N*N convolution kernel

and it is segmented by the OTSU threshold segmentation method. The activation value of pixels smaller than the threshold is set at zero. Based on this

the standard deviation projection in the horizontal and vertical directions is calculated; the human eye region is located by the average threshold method from the projection map. The eye closure degree is measured by calculating the ratio of eye height to eye width and then counting the closure time. Experiments show that the aforementioned problems can be adequately solved by our method. Even in complex environments

the method in this paper still performs well

with fatigue judgment accuracy reaching 94%. The fatigue-monitoring scheme proposed in this paper

can be positively adapted under many uncertainties. As such

our fatigue monitoring glasses and N-Range algorithm can achieve high accuracy without affecting the efficiency of workers.

关键词

Keywords

references

TANAKA M, TAJIMA S, MIZUNO K, et al .. Frontier studies on fatigue, autonomic nerve dysfunction, and sleep-rhythm disorder[J]. The Journal of Physiological Sciences , 2015, 65(6): 483-498.

DOGHRAMJI K. The Pharmacological Management of Fatigue and Sleepiness in Affective Disorders [M]//Sleep and Sleep Disorders. Boston, MA: Springer US, 2006: 183-187.

REINGOLD E M. Eye tracking research and technology: Towards objective measurement of data quality[J]. Visual Cognition , 2014, 22(3/4): 635-652.

屈肖蕾.基于转向操作和车辆状态的疲劳驾驶检测方法研究[D].北京: 清华大学, 2012. http://cdmd.cnki.com.cn/Article/CDMD-10003-1013016818.htm

QU X L. Detection of Driver Drowsiness Based on Steering Operation and Vehicle State [D]. Beijing: Tsinghua Univesity, 2012.(in Chinese)

邓正宏, 黄一杰, 李翔, 等.基于视频的驾驶疲劳检测技术的研究[J].西北工业大学学报, 2015, 33(6): 1001-1006.

DENG ZH H, HUANG Y J, LI X, et al .. Researching driver fatigue detection using video technology[J]. Journal of Northwestern Polytechnical University , 2015, 33(6): 1001-1006. (in Chinese)

徐欢, 高雁凤, 郑恩辉, 等.一种用于驾驶员疲劳检测的人眼检测方法[J].计算机工程, 2013, 39(9): 254-257, 276.

XU H, GAO Y F, ZHENG E H, et al .. An eye detection method for driver fatigue detection[J]. Computer Engineering , 2013, 39(9): 254-257, 276. (in Chinese)

王福旺, 王宏.长途客车驾驶员疲劳状态脑电特征分析[J].仪器仪表学报, 2013, 34(5): 1146-1152.

WANG F W, WANG H. EEG characteristic analysis of coach bus drivers in fatigue state[J]. Chinese Journal of Scientific Instrument , 2013, 34(5): 1146-1152.(in Chinese)

吴文娴.基于被动视觉的机车驾驶疲劳实时检测系统的研究[J].铁路计算机应用, 2011, 20(2): 5-9.

WU W X. Research on real-time detection system of locomotive drivers 'fatigue based on passive vision[J]. Railway Computer Application , 2011, 20(2): 5-9.(in Chinese)

WIERWILLE W W, ELLSWORTH L A. Evaluation of driver drowsiness by trained raters[J]. Accident Analysis & Prevention , 1994, 26(5): 571-581.

孙瑞山, 陈农田.眼动分析技术及其在航空领域的应用进展[J].中国民航大学学报, 2009, 27(4): 1-4, 10.

SUN R SH, CHEN N T. Progress of eye analysis techniques and its application in aviation[J]. Journal of Civil Aviation University of China , 2009, 27(4): 1-4, 10.(in Chinese)

汪磊, 孙瑞山.空中交通管制员疲劳状态实时监测方法的实现[J].安全与环境工程, 2013, 20(4): 87-91.

WANG L, SUN R SH. Implementation of real-time monitoring method for the fatigue of air traffic controllers[J]. Safety and Environmental Engineering , 2013, 20(4): 87-91.(in Chinese)

BOWMAN D S, SCHAUDT W A, HANOWSKI R J. Advances in Drowsy Driver Assistance Systems Through Data Fusion [M]//Handbook of Intelligent Vehicles. London: Springer London, 2012: 895-912.

NGUYEN H T, ISAACOWITZ D M, RUBIN P A D. Age- and fatigue-related markers of human faces: an eye-tracking study[J] . Ophthalmology , 2009, 116(2): 355-360.

KURYLYAK Y, LAMONACA F, MIRABELLI G. Detection of the eye blinks for human's fatigue monitoring[C]//2012 IEEE International Symposium on Medical Measurements and Applications Proceedings , May 18-19, 2012. Budapest , Hungary . New York , USA : IEEE , 2012.

ZENG S H, LI J L, JIANG L, et al.. A driving assistant safety method based on human eye fatigue detection[C]//2017 29 th Chinese Control And Decision Conference ( CCDC ), May 28-30, 2017. Chongqing , China . New York , USA : IEEE , 2017.

WANG J, LIU Q, ZHAO H. Based on the human eye fatigue detection system of recognition and FPGA technology[J]. Applied Mechanics and Materials , 2014, 672/673/674: 1995-1998.

千承辉, 王政, 左濂锐, 等.基于人眼识别的防疲劳驾驶系统设计与研究[J].吉林大学学报:信息科学版, 2016, 34(4): 522-527.

QIAN CH H, WANG ZH, ZUO L R, et al ... Design and research of anti-fatigue driving system based on human eye recognition[J]. Journal of Jilin University:Information Science Edition , 2016, 34(4): 522-527.(in Chinese)

李杏清, 王志兵.一种基于人眼状态的疲劳驾驶检测系统研究[J].信息与电脑(理论版), 2017(23): 73-75.

LI X Q, WANG ZH B. Study of fatigue driving detection system based on human eye[J]. China Computer & Communication , 2017(23): 73-75.(in Chinese)

黎明华, 罗李焱, 陈雅琳.驾驶员疲劳状态的检测[J].技术与市场, 2010, 17(8):17-19.

LI M H, LUO L Y, CHEN Y L. Detection of driver fatigue[J]. Technology and Market , 2010, 17(8): 17-19. (in Chinese)

杨秋芬, 桂卫华, 周书仁.疲劳驾驶面部表情识别算法[J].计算机应用研究, 2008, 25(10): 3039-3041.

YANG Q F, GUI W H, ZHOU SH R. Facial expression recognition algorithm for fatigue driving[J]. Application Research of Computers , 2008, 25(10): 3039-3041.(in Chinese)

XIE J F, XIE M, ZHU W. Driver fatigue detection based on head gesture and PERCLOS[C]//2012 International Conference on Wavelet Active Media Technology and Information Processing ( ICWAMTIP ), December 17-19, 2012. Chengdu , China . New York , USA : IEEE , 2012.

DHAR S, PRADHAN T, GUPTA S, et al .. Implementation of real time visual attention monitoring algorithm of human drivers on an embedded platform[C]//2010 IEEE Students Technology Symposium ( TechSym ), April 3-4, 2010. Kharagpur , India . New York , USA : IEEE , 2010.

OTSU N. A threshold selection method from gray-level histograms[J]. IEEE Transactions on Systems, Man, and Cybernetics , 1979, 9(1): 62-66.

MATHEWS E. Language proficiency requirements of the international civil aviation organization[C]// International Professional Communication Conference, IPCC 2004. Proceedings., Minneapolis, MN, USA. New York, USA: IEEE, 2004.

万玉丽, 谢金法.一种基于PERCLOS驾驶员疲劳检测方法的实现算法[J].农业装备技术, 2009, 35(2): 25-28.

WAN Y L, XIE J F. One algorithm of driver fatigue detecting based on PERCLOS[J]. Agricultural Equipment & Technology , 2009, 35(2): 25-28.(in Chinese)

PUSPASARI M A, IRIDIASTADI H, SUTALAKSANA I Z, et al .. Fatigue classification of ocular indicators using support vector machine[C]// 2018 International Conference on Intelligent Informatics and Biomedical Sciences (ICⅡBMS), October 21-24, 2018. Bangkok. New York, USA: IEEE , 2018.

唐杰, 陈仁文, 余小庆.基于卷积神经网络的车载疲劳驾驶检测系统的实现[J].国外电子测量技术, 2018, 37(1): 116-121.

TANG J, CHEN R W, YU X Q. Implement of vehicle fatigue driving detection system based on convolutional neural network[J]. Foreign Electronic Measurement Technology , 2018, 37(1): 116-121.(in Chinese)

MCDONALD A D, LEE J D, SCHWARZ C, et al .. A contextual and temporal algorithm for driver drowsiness detection[J]. Accident Analysis & Prevention , 2018, 113: 25-37.

DASGUPTA A, ROUTRAY A. Fast computation of PERCLOS and saccadic ratio[J]. Computer Science , 2015.

CHENG R, ZHAO Y, DAI Y, et al .. An on-board embedded driver fatigue warning system based on adaboost method[J]. Acta Scientiarum Naturalium Universitatis Pekinensis , 2012, 48(5):719-726.

Views

125

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China Postal code：130033
Tel：0431-86176855 Email：gxjmgc@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰