In order to decrease vehicle crashes, a new rear view vehicle detection system based on monocular vision is designed. First, a small and flexible hardware platform based on a DM642 digtal signal processor （DSP） micr...In order to decrease vehicle crashes, a new rear view vehicle detection system based on monocular vision is designed. First, a small and flexible hardware platform based on a DM642 digtal signal processor （DSP） micro-controller is built. Then, a two-step vehicle detection algorithm is proposed. In the first step, a fast vehicle edge and symmetry fusion algorithm is used and a low threshold is set so that all the possible vehicles have a nearly 100% detection rate （TP） and the non-vehicles have a high false detection rate （FP）, i. e., all the possible vehicles can be obtained. In the second step, a classifier using a probabilistic neural network （PNN） which is based on multiple scales and an orientation Gabor feature is trained to classify the possible vehicles and eliminate the false detected vehicles from the candidate vehicles generated in the first step. Experimental results demonstrate that the proposed system maintains a high detection rate and a low false detection rate under different road, weather and lighting conditions.展开更多
A system for mobile robot localization and navigation was presented.With the proposed system,the robot can be located and navigated by a single landmark in a single image.And the navigation mode may be following-track...A system for mobile robot localization and navigation was presented.With the proposed system,the robot can be located and navigated by a single landmark in a single image.And the navigation mode may be following-track,teaching and playback,or programming.The basic idea is that the system computes the differences between the expected and the recognized position at each time and then controls the robot in a direction to reduce those differences.To minimize the robot sensor equipment,only one omnidirectional camera was used.Experiments in disturbing environments show that the presented algorithm is robust and easy to implement,without camera rectification.The rootmean-square error(RMSE) of localization is 1.4,cm,and the navigation error in teaching and playback is within 10,cm.展开更多
Building fences to manage the cattle grazing can be very expensive;cost inefficient. These do not provide dynamic control over the area in which the cattle are grazing. Existing virtual fencing techniques for the cont...Building fences to manage the cattle grazing can be very expensive;cost inefficient. These do not provide dynamic control over the area in which the cattle are grazing. Existing virtual fencing techniques for the control of herds of cattle, based on polygon coordinate definition of boundaries is limited in the area of land mass coverage and dynamism. This work seeks to develop a more robust and an improved monocular vision based boundary avoidance for non-invasive stray control system for cattle, with a view to increase land mass coverage in virtual fencing techniques and dynamism. The monocular vision based depth estimation will be modeled using concept of global Fourier Transform (FT) and local Wavelet Transform (WT) of image structure of scenes (boundaries). The magnitude of the global Fourier Transform gives the dominant orientations and textual patterns of the image;while the local Wavelet Transform gives the dominant spectral features of the image and their spatial distribution. Each scene picture or image is defined by features v, which contain the set of global (FT) and local (WT) statistics of the image. Scenes or boundaries distances are given by estimating the depth D by means of the image features v. Sound cues of intensity equivalent to the magnitude of the depth D are applied to the animal ears as stimuli. This brings about the desired control as animals tend to move away from uncomfortable sounds.展开更多
In the laser displacement sensors measurement system,the laser beam direction is an important parameter.Particularly,the azimuth and pitch angles are the most important parameters to a laser beam.In this paper,based o...In the laser displacement sensors measurement system,the laser beam direction is an important parameter.Particularly,the azimuth and pitch angles are the most important parameters to a laser beam.In this paper,based on monocular vision,a laser beam direction measurement method is proposed.First,place the charge coupled device(CCD)camera above the base plane,and adjust and fix the camera position so that the optical axis is nearly perpendicular to the base plane.The monocular vision localization model is established by using circular aperture calibration board.Then the laser beam generating device is placed and maintained on the base plane at fixed position.At the same time a special target block is placed on the base plane so that the laser beam can project to the special target and form a laser spot.The CCD camera placed above the base plane can acquire the laser spot and the image of the target block clearly,so the two-dimensional(2D)image coordinate of the centroid of the laser spot can be extracted by correlation algorithm.The target is moved at an equal distance along the laser beam direction,and the spots and target images of each moving under the current position are collected by the CCD camera.By using the relevant transformation formula and combining the intrinsic parameters of the target block,the2D coordinates of the gravity center of the spot are converted to the three-dimensional(3D)coordinate in the base plane.Because of the moving of the target,the3D coordinates of the gravity center of the laser spot at different positions are obtained,and these3D coordinates are synthesized into a space straight line to represent the laser beam to be measured.In the experiment,the target parameters are measured by high-precision instruments,and the calibration parameters of the camera are calibrated by a high-precision calibration board to establish the corresponding positioning model.The measurement accuracy is mainly guaranteed by the monocular vision positioning accuracy and the gravity center extraction accuracy.The experimental results show the maximum error of the angle between laser beams reaches to0.04°and the maximum error of beam pitch angle reaches to0.02°.展开更多
Vehicle anti-collision technique is a hot topic in the research area of Intelligent Transport System. The research on preceding vehicles detection and the distance measurement, which are the key techniques, makes grea...Vehicle anti-collision technique is a hot topic in the research area of Intelligent Transport System. The research on preceding vehicles detection and the distance measurement, which are the key techniques, makes great contributions to safe-driving. This paper presents a method which can be used to detect preceding vehicles and get the distance between own car and the car ahead. Firstly, an adaptive threshold method is used to get shadow feature, and a shadow!area merging approach is used to deal with the distortion of the shadow border. Region of interest(ROI) is obtained using shadow feature. Then in the ROI, symmetry feature is analyzed to verify whether there are vehicles and to locate the vehicles. Finally, using monocular vision distance measurement based on camera interior parameters and geometrical reasoning, we get the distance between own car and the preceding one. Experimental results show that the proposed method can detect the preceding vehicle effectively and get the distance between vehicles accurately.展开更多
The accurate measurement of kinematic parameters in satellite separation tests has great significance in evaluating separation performance. A novel study is made on the measuring accuracy of monocular and binocular, w...The accurate measurement of kinematic parameters in satellite separation tests has great significance in evaluating separation performance. A novel study is made on the measuring accuracy of monocular and binocular, which are the two main vision measurement methods used for kinematic parameters. As satellite separation process is transient and high-dynamic, it will bring more extraction errors to the binocular. Based on the design approach of intersection measure and variance ratio, the monocular method reflects higher precision, simpler structure and easier calibration for level satellite separation. In ground separation tests, a high-speed monocular system is developed to gain and analyze twelve kinematic parameters of a small satellite. Research shows that this monocular method can be widely applied for its high precision, with position accuracy of 0.5 mm, speed accuracy of 5 mm/s, and angular velocity accuracy of 1 (°)/s.展开更多
With the high focus on autonomous aerial refueling(AAR), it becomes increasingly urgent to design efficient methods or algorithms for solving the AAR problems in complicated aerial environments. A vision-based technol...With the high focus on autonomous aerial refueling(AAR), it becomes increasingly urgent to design efficient methods or algorithms for solving the AAR problems in complicated aerial environments. A vision-based technology for AAR is developed in this paper, and five monocular and binocular visual algorithms for pose estimation of the unmanned aerial vehicles(UAVs) are adopted and verified in this AAR system. The real-time on-board vision system is also designed for precise navigation in the UAVs docking phase. A series of out-door comparative experiments for different pose estimation algorithms are conducted to verify the feasibility and accuracy of the vision algorithms in AAR.展开更多
The monocular vision-based system can obtain the leaf wall area characterizing the canopy parameter for online detection and real-time variable spraying,aiming to improve the accuracy of orchard spraying equipment and...The monocular vision-based system can obtain the leaf wall area characterizing the canopy parameter for online detection and real-time variable spraying,aiming to improve the accuracy of orchard spraying equipment and the utilization efficiency of pesticide.This study established a spraying system,in which canopy parameters were collected by monocular vision,and the spray volume decision coefficient was constructed by the leaf wall area and the L^(*)value in International Commission on Illumination Lab color space to control the duty cycle of each solenoid valve to achieve variable spraying.Four spray flow models were designed to determine the spray volume decision coefficient.The coefficients of determination of the spray volumes with the duty cycle range of 15%to 65%were all over 94 and the error of the leaf wall area values obtained using the improved super green algorithm(calculated as ExG=2.1G–1.1R–1.1B)was only 0.5%.The test showed that there is a negative relationship between canopy denseness and L^(*),and the value of L^(*)is smaller in the dense area compared with the sparse area;the actual flow generated by the system is similar to the theoretical flow when the duty cycle is 65%.The field validation tests showed that the variable spraying system could refine the droplet size and increase the droplet density to a certain extent with the same coverage rate,which had advantages over the continuous spraying.In terms of droplet deposition,DV0.1 and DV0.9 were reduced by 2μm and 18μm,respectively,and the increase of droplet density to 75 droplets/cm2.At the same time,the improvement of droplet distribution uniformity and droplet penetration by 16%and 3%,respectively.Compared with continuous spraying,variable spraying can achieve 55.64%savings.The study demonstrates the feasibility of monocular vision in guiding spraying operations and provides a reference for the use of monocular vision in plant protection operations.展开更多
Visual sensors are used to measure the relative state of the chaser spacecraft to the target spacecraft during close range ren- dezvous phases. This article proposes a two-stage iterative algorithm based on an inverse...Visual sensors are used to measure the relative state of the chaser spacecraft to the target spacecraft during close range ren- dezvous phases. This article proposes a two-stage iterative algorithm based on an inverse projection ray approach to address the relative position and attitude estimation by using feature points and monocular vision. It consists of two stages： absolute orienta- tion and depth recovery. In the first stage, Umeyama＇s algorithm is used to fit the three-dimensional （3D） model set and estimate the 3D point set while in the second stage, the depths of the observed feature points are estimated. This procedure is repeated until the result converges. Moreover, the effectiveness and convergence of the proposed algorithm are verified through theoreti- cal analysis and mathematical simulation.展开更多
基金The National Key Technology R&D Program of China during the 11th Five-Year Plan Period(2009BAG13A04)Jiangsu Transportation Science Research Program(No.08X09)Program of Suzhou Science and Technology(No.SG201076)
文摘In order to decrease vehicle crashes, a new rear view vehicle detection system based on monocular vision is designed. First, a small and flexible hardware platform based on a DM642 digtal signal processor （DSP） micro-controller is built. Then, a two-step vehicle detection algorithm is proposed. In the first step, a fast vehicle edge and symmetry fusion algorithm is used and a low threshold is set so that all the possible vehicles have a nearly 100% detection rate （TP） and the non-vehicles have a high false detection rate （FP）, i. e., all the possible vehicles can be obtained. In the second step, a classifier using a probabilistic neural network （PNN） which is based on multiple scales and an orientation Gabor feature is trained to classify the possible vehicles and eliminate the false detected vehicles from the candidate vehicles generated in the first step. Experimental results demonstrate that the proposed system maintains a high detection rate and a low false detection rate under different road, weather and lighting conditions.
基金Supported by National Natural Science Foundation of China (No. 31000422 and No. 61201081)Tianjin Municipal Education Commission(No.20110829)Tianjin Science and Technology Committee(No. 10JCZDJC22800)
文摘A system for mobile robot localization and navigation was presented.With the proposed system,the robot can be located and navigated by a single landmark in a single image.And the navigation mode may be following-track,teaching and playback,or programming.The basic idea is that the system computes the differences between the expected and the recognized position at each time and then controls the robot in a direction to reduce those differences.To minimize the robot sensor equipment,only one omnidirectional camera was used.Experiments in disturbing environments show that the presented algorithm is robust and easy to implement,without camera rectification.The rootmean-square error(RMSE) of localization is 1.4,cm,and the navigation error in teaching and playback is within 10,cm.
文摘Building fences to manage the cattle grazing can be very expensive;cost inefficient. These do not provide dynamic control over the area in which the cattle are grazing. Existing virtual fencing techniques for the control of herds of cattle, based on polygon coordinate definition of boundaries is limited in the area of land mass coverage and dynamism. This work seeks to develop a more robust and an improved monocular vision based boundary avoidance for non-invasive stray control system for cattle, with a view to increase land mass coverage in virtual fencing techniques and dynamism. The monocular vision based depth estimation will be modeled using concept of global Fourier Transform (FT) and local Wavelet Transform (WT) of image structure of scenes (boundaries). The magnitude of the global Fourier Transform gives the dominant orientations and textual patterns of the image;while the local Wavelet Transform gives the dominant spectral features of the image and their spatial distribution. Each scene picture or image is defined by features v, which contain the set of global (FT) and local (WT) statistics of the image. Scenes or boundaries distances are given by estimating the depth D by means of the image features v. Sound cues of intensity equivalent to the magnitude of the depth D are applied to the animal ears as stimuli. This brings about the desired control as animals tend to move away from uncomfortable sounds.
基金National Science and Technology Major Project of China(No.2016ZX04003001)Tianjin Research Program of Application Foundation and Advanced Technology(No.14JCZDJC39700)
文摘In the laser displacement sensors measurement system,the laser beam direction is an important parameter.Particularly,the azimuth and pitch angles are the most important parameters to a laser beam.In this paper,based on monocular vision,a laser beam direction measurement method is proposed.First,place the charge coupled device(CCD)camera above the base plane,and adjust and fix the camera position so that the optical axis is nearly perpendicular to the base plane.The monocular vision localization model is established by using circular aperture calibration board.Then the laser beam generating device is placed and maintained on the base plane at fixed position.At the same time a special target block is placed on the base plane so that the laser beam can project to the special target and form a laser spot.The CCD camera placed above the base plane can acquire the laser spot and the image of the target block clearly,so the two-dimensional(2D)image coordinate of the centroid of the laser spot can be extracted by correlation algorithm.The target is moved at an equal distance along the laser beam direction,and the spots and target images of each moving under the current position are collected by the CCD camera.By using the relevant transformation formula and combining the intrinsic parameters of the target block,the2D coordinates of the gravity center of the spot are converted to the three-dimensional(3D)coordinate in the base plane.Because of the moving of the target,the3D coordinates of the gravity center of the laser spot at different positions are obtained,and these3D coordinates are synthesized into a space straight line to represent the laser beam to be measured.In the experiment,the target parameters are measured by high-precision instruments,and the calibration parameters of the camera are calibrated by a high-precision calibration board to establish the corresponding positioning model.The measurement accuracy is mainly guaranteed by the monocular vision positioning accuracy and the gravity center extraction accuracy.The experimental results show the maximum error of the angle between laser beams reaches to0.04°and the maximum error of beam pitch angle reaches to0.02°.
基金Key Projects in the Tianjin Science & Technology Pillay Program
文摘Vehicle anti-collision technique is a hot topic in the research area of Intelligent Transport System. The research on preceding vehicles detection and the distance measurement, which are the key techniques, makes great contributions to safe-driving. This paper presents a method which can be used to detect preceding vehicles and get the distance between own car and the car ahead. Firstly, an adaptive threshold method is used to get shadow feature, and a shadow!area merging approach is used to deal with the distortion of the shadow border. Region of interest(ROI) is obtained using shadow feature. Then in the ROI, symmetry feature is analyzed to verify whether there are vehicles and to locate the vehicles. Finally, using monocular vision distance measurement based on camera interior parameters and geometrical reasoning, we get the distance between own car and the preceding one. Experimental results show that the proposed method can detect the preceding vehicle effectively and get the distance between vehicles accurately.
基金Project(50975280)supported by the National Natural Science Foundation of ChinaProject(NCET-08-0149)supported by Program for New Century Excellent Talents in Universities of China
文摘The accurate measurement of kinematic parameters in satellite separation tests has great significance in evaluating separation performance. A novel study is made on the measuring accuracy of monocular and binocular, which are the two main vision measurement methods used for kinematic parameters. As satellite separation process is transient and high-dynamic, it will bring more extraction errors to the binocular. Based on the design approach of intersection measure and variance ratio, the monocular method reflects higher precision, simpler structure and easier calibration for level satellite separation. In ground separation tests, a high-speed monocular system is developed to gain and analyze twelve kinematic parameters of a small satellite. Research shows that this monocular method can be widely applied for its high precision, with position accuracy of 0.5 mm, speed accuracy of 5 mm/s, and angular velocity accuracy of 1 (°)/s.
基金supported by the National Natural Science Foundation of China(Grant Nos.61425008,61333004&61273054)the Aeronautical Foundation of China(Grant No.2015ZA51013)
文摘With the high focus on autonomous aerial refueling(AAR), it becomes increasingly urgent to design efficient methods or algorithms for solving the AAR problems in complicated aerial environments. A vision-based technology for AAR is developed in this paper, and five monocular and binocular visual algorithms for pose estimation of the unmanned aerial vehicles(UAVs) are adopted and verified in this AAR system. The real-time on-board vision system is also designed for precise navigation in the UAVs docking phase. A series of out-door comparative experiments for different pose estimation algorithms are conducted to verify the feasibility and accuracy of the vision algorithms in AAR.
基金supported by Guangzhou Science and Technology Plan Project(Grant No.202002030245)supported by the National Natural Science Foundation of China(Grant No.31671591,31971797)+4 种基金Guangdong Province Modern Agricultural Key Technology Model Integration and Demonstration and Promotion Project(2021)Guangdong Province Modern Agricultural Industry Technology System Innovation Team Construction Special Fund(Grant No.2021KJ108)Guangdong Provincial Education Department Special Innovation Category Project(Grant No.2019KTSCX013)Guangdong Provincial Science and Technology Innovation Strategy Special Funds in 2020(“Climbing Plan”Special Funds,Grant No.pdjh2020a0084)Guangdong Provincial Students’Innovation and Entrepreneurship Project in 2020(Grant No.S202010564150)。
文摘The monocular vision-based system can obtain the leaf wall area characterizing the canopy parameter for online detection and real-time variable spraying,aiming to improve the accuracy of orchard spraying equipment and the utilization efficiency of pesticide.This study established a spraying system,in which canopy parameters were collected by monocular vision,and the spray volume decision coefficient was constructed by the leaf wall area and the L^(*)value in International Commission on Illumination Lab color space to control the duty cycle of each solenoid valve to achieve variable spraying.Four spray flow models were designed to determine the spray volume decision coefficient.The coefficients of determination of the spray volumes with the duty cycle range of 15%to 65%were all over 94 and the error of the leaf wall area values obtained using the improved super green algorithm(calculated as ExG=2.1G–1.1R–1.1B)was only 0.5%.The test showed that there is a negative relationship between canopy denseness and L^(*),and the value of L^(*)is smaller in the dense area compared with the sparse area;the actual flow generated by the system is similar to the theoretical flow when the duty cycle is 65%.The field validation tests showed that the variable spraying system could refine the droplet size and increase the droplet density to a certain extent with the same coverage rate,which had advantages over the continuous spraying.In terms of droplet deposition,DV0.1 and DV0.9 were reduced by 2μm and 18μm,respectively,and the increase of droplet density to 75 droplets/cm2.At the same time,the improvement of droplet distribution uniformity and droplet penetration by 16%and 3%,respectively.Compared with continuous spraying,variable spraying can achieve 55.64%savings.The study demonstrates the feasibility of monocular vision in guiding spraying operations and provides a reference for the use of monocular vision in plant protection operations.
基金Program for Changjiang Scholars and Innovative Research Team in University (IRT0520)Ph.D.Programs Foundation of Ministry of Education of China (20070213055)
文摘Visual sensors are used to measure the relative state of the chaser spacecraft to the target spacecraft during close range ren- dezvous phases. This article proposes a two-stage iterative algorithm based on an inverse projection ray approach to address the relative position and attitude estimation by using feature points and monocular vision. It consists of two stages： absolute orienta- tion and depth recovery. In the first stage, Umeyama＇s algorithm is used to fit the three-dimensional （3D） model set and estimate the 3D point set while in the second stage, the depths of the observed feature points are estimated. This procedure is repeated until the result converges. Moreover, the effectiveness and convergence of the proposed algorithm are verified through theoreti- cal analysis and mathematical simulation.
