A real-time tracking system for the fast moving object on the complex background is proposed.The Markov random filed（MRF）model based background subtraction algorithm is used to detect the changing pixels and track t...A real-time tracking system for the fast moving object on the complex background is proposed.The Markov random filed（MRF）model based background subtraction algorithm is used to detect the changing pixels and track the moving object.The prior probability of the segmentation mask is modeled by using MRF,and the object tracking task is translated into the maximum a-posterior（MAP）problem.Experimental results show that the method is efficient at both offline and online moving objects on simple and complex background.展开更多
A thunderstorm tracking algorithm is proposed to nowcast the possibility of lightning activity over an area of concern by using the total lightning data and neighborhood technique.The lightning radiation sources obser...A thunderstorm tracking algorithm is proposed to nowcast the possibility of lightning activity over an area of concern by using the total lightning data and neighborhood technique.The lightning radiation sources observed from the Beijing Lightning Network(BLNET)were used to obtain information about the thunderstorm cells,which are significantly valuable in real-time.The boundaries of thunderstorm cells were obtained through the neighborhood technique.After smoothing,these boundaries were used to track the movement of thunderstorms and then extrapolated to nowcast the lightning approaching in an area of concern.The algorithm can deliver creditable results prior to a thunderstorm arriving at the area of concern,with accuracies of 63%,80%,and 91%for lead times of 30,15,and 5 minutes,respectively.The real-time observations of total lightning appear to be significant for thunderstorm tracking and lightning nowcasting,as total lightning tracking could help to fill the observational gaps in radar reflectivity due to the attenuation by hills or other obstacles.The lightning data used in the algorithm performs well in tracking the active thunderstorm cells associated with lightning activities.展开更多
Real-time seam tracking can improve welding quality and enhance welding efficiency during the welding process in automobile manufacturing.However,the teaching-playing welding process,an off-line seam tracking method,i...Real-time seam tracking can improve welding quality and enhance welding efficiency during the welding process in automobile manufacturing.However,the teaching-playing welding process,an off-line seam tracking method,is still dominant in automobile industry,which is less flexible when welding objects or situation change.A novel real-time algorithm consisting of seam detection and generation is proposed to track seam.Using captured 3D points,space vectors were created between two adjacent points along each laser line and then a vector angle based algorithm was developed to detect target points on the seam.Least square method was used to fit target points to a welding trajectory for seam tracking.Furthermore,the real-time seam tracking process was simulated in MATLAB/Simulink.The trend of joint angles vs.time was logged and a comparison between the off-line and the proposed seam tracking algorithm was conducted.Results show that the proposed real-time seam tracking algorithm can work in a real-time scenario and have high accuracy in welding point positioning.展开更多
Manual monitoring and seam tracking through watching weld pool images in real-time, by naked eyes or by industrial TV, are experience-depended, subjective, labor intensive, and sometimes biased. So it is necessary to ...Manual monitoring and seam tracking through watching weld pool images in real-time, by naked eyes or by industrial TV, are experience-depended, subjective, labor intensive, and sometimes biased. So it is necessary to realize the automation of computer-aided seam tracking. A PAW (plasma arc welding) seam tracking system was developed, which senses the molten pool and the seam in one frame by a vision sensor, and then detects the seam deviation to adjust the work piece motion adaptively to the seam position sensed by vision sensor. A novel molten pool area image-processing algorithm based on machine vision was proposed. The algorithm processes each image at the speed of 20 frames/second in real-time to extract three feature variables to get the seam deviation. It is proved experimentally that the algorithm is very fast and effective. Issues related to the algorithm are also discussed.展开更多
This paper proposes an algorithm that extracts features of back side of the vehicle and detects the front vehicle in real-time by local feature tracking of vehicle in the continuous images.The features in back side of...This paper proposes an algorithm that extracts features of back side of the vehicle and detects the front vehicle in real-time by local feature tracking of vehicle in the continuous images.The features in back side of the vehicle are vertical and horizontal edges,shadow and symmetry.By comparing local features using the fixed window size,the features in the continuous images are tracked.A robust and fast Haarlike mask is used for detecting vertical and horizontal edges,and shadow is extracted by histogram equalization,and the sliding window method is used to compare both side templates of the detected candidates for extracting symmetry.The features for tracking are vertical edges,and histogram is used to compare location of the peak and magnitude of the edges.The method using local feature tracking in the continuous images is more robust for detecting vehicle than the method using single image,and the proposed algorithm is evaluated by continuous images obtained on the expressway and downtown.And it can be performed on real-time through applying it to the embedded system.展开更多
Conventional, grid-based sampling location tracking approach with GPS or topographic maps is time-consuming and inconvenient. Therefore, this study combined the freely available virtual/digital globe with recent advan...Conventional, grid-based sampling location tracking approach with GPS or topographic maps is time-consuming and inconvenient. Therefore, this study combined the freely available virtual/digital globe with recent advancements of smartphone geo-browsers to develop a new sampling location tracking approach. The sampling frame was developed with pre-uploaded point map formulated in GIS environment by combining land-use map and one-kilometer grid with center coordinates. The sampling location grid was uploaded to smartphone and each point was tracked with Google Map path finder using point ID (coded grid coordinate) when searching each sampling location. The suitability of the new approach was tested for soil sample collection from paddy lands distributed in 0.9 million hectares in Sri Lanka. The sampling locations could be reached conveniently with the help of Google path-finder voice direction guide and optional routes. The efficiency of new approach was found to be remarkably high, <em>i.e</em>., over 99% of the 9000 sampling points, which were spread across Sri Lanka having an area of 65,610 km<sup>2</sup>. All sampling points in the country could be covered with twelve member field investigation crew who were guided through smartphones uploaded with sampling point grid on six motorbikes within 60 days. The new sampling location tracking approach is effective in terms of cost, time, human resource requirements, thus can be adopted in large-scale soil/plant sampling frames with high accuracy.展开更多
Previously, researchers raised the accuracy for a robot′s hand to track a specified path in Car-tesian space mainly through increasing the number of knots on the path and the number of the path′s segments, which res...Previously, researchers raised the accuracy for a robot′s hand to track a specified path in Car-tesian space mainly through increasing the number of knots on the path and the number of the path′s segments, which results in the heavier online computational burden for the robot controller. Aiming at overcoming this drawback, the authors propose a new kind of real-time accurate hand path tracking and joint trajectory planning method. Through selecting some extra knots on the specified hand path by a certain rule and introducing a sinusoidal function to the joint displacement equation of each segment, this method can greatly raise the path tracking accuracy of robot′s hand and does not change the number of the path′s segments. It also does not increase markedly the computational burden of robot controller. The result of simulation indicates that this method is very effective, and has important value in increasing the application of industrial robots.展开更多
This paper introduces a new Chinese Sign Language recognition (CSLR) system and a method of real time tracking face and hand applied in the system. In the method, an improved agent algorithm is used to extract the reg...This paper introduces a new Chinese Sign Language recognition (CSLR) system and a method of real time tracking face and hand applied in the system. In the method, an improved agent algorithm is used to extract the region of face and hand and track them. Kalman filter is introduced to forecast the position and rectangle of search, and self adapting of target color is designed to counteract the effect of illumination.展开更多
Previously, researchers raised the accuracy for a robot′s hand to track a specified path in Cartesian space mainly through increasing the number of knots on the path and the segments of the path. But, this method res...Previously, researchers raised the accuracy for a robot′s hand to track a specified path in Cartesian space mainly through increasing the number of knots on the path and the segments of the path. But, this method resulted in the heavier on line computational burden for the robot controller. In this paper, aiming at this drawback, the authors propose a new kind of real time accurate hand path tracking and joint trajectory planning method for robots. Through selecting some extra knots on the specified hand path by a certain rule, which enables the number of knots on each segment to increase from two to four, and through introducing a sinusoidal function and a cosinoidal function to the joint displacement equation of each segment, this method can raise the path tracking accuracy of robot′s hand greatly but does not increase the computational burden of robot controller markedly.展开更多
The traditional oriented FAST and rotated BRIEF（ORB） algorithm has problems of instability and repetition of keypoints and it does not possess scale invariance. In order to deal with these drawbacks, a modified ORB...The traditional oriented FAST and rotated BRIEF（ORB） algorithm has problems of instability and repetition of keypoints and it does not possess scale invariance. In order to deal with these drawbacks, a modified ORB（MORB） algorithm is proposed. In order to improve the precision of matching and tracking, this paper puts forward an MOK algorithm that fuses MORB and Kanade-Lucas-Tomasi（KLT）. By using Kalman, the object＇s state in the next frame is predicted in order to reduce the size of search window and improve the real-time performance of object tracking. The experimental results show that the MOK algorithm can accurately track objects with deformation or with background clutters, exhibiting higher robustness and accuracy on diverse datasets. Also, the MOK algorithm has a good real-time performance with the average frame rate reaching 90.8 fps.展开更多
Local control parameters such as instantaneous delay and instantaneous amplitude play an essential role in evaluating the performance and maintaining the stability of real-time hybrid simulation(RTHS).However,existing...Local control parameters such as instantaneous delay and instantaneous amplitude play an essential role in evaluating the performance and maintaining the stability of real-time hybrid simulation(RTHS).However,existing methods have limitations in obtaining this local assessment in either the time domain or frequency domain.In this study,the instantaneous frequency is introduced to determine local control parameters for actuator tracking assessment in a real-time hybrid simulation.Instantaneous properties,including amplitude,delay,frequency and phase,are then calculated based on analytic signals translated from actuator tracking signals through the Hilbert transform.Potential issues are discussed and solutions are proposed for calculation of local control parameters.Numerical simulations are first conducted for sinusoidal and chirp signals with time varying amplitude error and delay to demonstrate the potential of the proposed method.Laboratory tests also are conducted for a predefined random signal as well as the RTHS of a single degree of freedom structure with a self-centering viscous damper to experimentally verify the effectiveness of the proposed use of the instantaneous frequency.Results from the ensuing analysis clearly demonstrate that the instantaneous frequency provides great potential for local control assessment,and the proposed method enables local tracking parameters with good accuracy.展开更多
Complex event processing (CEP) can extract meaningful events for real-time locating system (RTLS) applications. To identify complex event accurately in RTLS, we propose a new RFID complex event processing method GEEP,...Complex event processing (CEP) can extract meaningful events for real-time locating system (RTLS) applications. To identify complex event accurately in RTLS, we propose a new RFID complex event processing method GEEP, which is based on the timed automata (TA) theory. By devising RFID locating application into complex events, we model the timing diagram of RFID data streams based on the TA. We optimize the constraint of the event streams and propose a novel method to derive the constraint between objects, as well as the constraint between object and location. Experiments prove the proposed method reduces the cost of RFID complex event processing, and improves the efficiency of the RTLS.展开更多
Fire rescue challenges and solutions have evolved from straightfor-ward plane rescue to encompass 3D space due to the rise of high-rise city buildings.Hence,this study facilitates a system with quick and simplified on...Fire rescue challenges and solutions have evolved from straightfor-ward plane rescue to encompass 3D space due to the rise of high-rise city buildings.Hence,this study facilitates a system with quick and simplified on-site launching and generates real-time location data,enabling fire rescuers to arrive at the intended spot faster and correctly for effective and precise rescue.Auto-positioning with step-by-step instructions is proposed when launching the locating system,while no extra measuring instrument like Total Station(TS)is needed.Real-time location tracking is provided via a 3D space real-time locating system(RTLS)constructed using Ultra-wide Bandwidth technology(UWB),which requires electromagnetic waves to pass through concrete walls.A hybrid weighted least squares with a time difference of arrival(WLS/TDOA)positioning method is proposed to address real path-tracking issues in 3D space and to meet RTLS requirements for quick computing in real-world applications.The 3D WLS/TDOA algorithm is theoretically constructed with the Cramer-Rao lower bound(CRLB).The computing complexity is reduced to the lower bound for embedded hardware to directly compute the time differential of the arriving signals using the time-to-digital converter(TDC).The results of the experiments show that the errors are controlled when the positioning algorithm is applied in various complicated situations to fulfill the requirements of engineering applications.The statistical analysis of the data reveals that the proposed UWB RTLS auto-positioning system can track target tags with an accuracy of 0.20 m.展开更多
This study analyzes landfall locations of tropical cyclones(TCs)over the western North Pacific during 1979–2018.Results demonstrate that the landfall locations of TCs over this region have shifted northward during th...This study analyzes landfall locations of tropical cyclones(TCs)over the western North Pacific during 1979–2018.Results demonstrate that the landfall locations of TCs over this region have shifted northward during the last four decades,primarily due to the shift of landfalling TC tracks,with the decreasing/increasing proportion of westward/northward TC tracks.In particular,the northward shift of the landfalling TCs was not related to their formation locations,which have not markedly changed,whereas"no-landed"TCs have significantly shifted northward.TC movement was significantly and positively correlated to the zonal component of the steering flow,while the correlation between TC movement and the meridional component of the steering flow was relatively unobvious.The westward steering flow in the tropical central Pacific that occurred around the formation and early development of the westward TCs was significantly weakened,which was unfavorable for their westward movement,thereby,causing the higher proportions of northward moving tracks.This weakened westward flow was related to the northward shift of the subtropical high ridge,which was caused by significant weakening of the southern part of the subtropical high.The vertical wind shear,sea surface temperature,and convective available potential energy also showed that the northern region of the western North Pacific became more favorable for TC development,whereas the upper divergence,low-layer relative vorticity,and accumulated water vapor content were not obviously related to the northward shift of TCs.展开更多
The method of acquiring the real-time data has influenced the implementation of the manufacturing execution system （MES）. Accompanied with turning the MES into service-oriented manufacturing execution system （so-ME...The method of acquiring the real-time data has influenced the implementation of the manufacturing execution system （MES）. Accompanied with turning the MES into service-oriented manufacturing execution system （so-MES）, real-time e-quality tracking （e-QT）, in which real-time data are computed, has played more and more important roles in manufacturing. This paper presents an e-QT model through the study of real-time status data tracking and quality data collecting. An implementing architecture of the e-QT model is constructed on the basis of radio frequency identification devices （RFID） data-tracking network. In order to develop the e-QT system, some key enabling technologies, such as configuration, data collection, and data processing, etc, are studied. The relation schema between hardware is built for the RFID data-tracking network based on the configuration technique. Real-time data are sampled by using data collecting technique. Furthermore, real-time status and quality data in a shop-floor can be acquired in terms of using the real-time data computing method. Finally, a prototype system is developed and a running example is given so as to verify the feasibility of methods proposed in this paper. The proposed research provides effective e-quality tracking theoretical foundation through the use of RFID technology for the discrete manufacturing.展开更多
A new real-time underwater equipment location method adopting an electric field induced by a standard current source is proposed.Our goals were real-time tracking and location of stationary or moving underwater equipm...A new real-time underwater equipment location method adopting an electric field induced by a standard current source is proposed.Our goals were real-time tracking and location of stationary or moving underwater equipment both in shallow and deep seas,under noisy conditions.The main features of this method are as follows:(1)a standard current source on the water surface,which can be towed by a vehicle,consisting of two electrodes,a signal generator,and a GPS unit;(2)measurement of the extremely low frequency(ELF)electric field emitted by the current source,made possible by electric field sensors on the underwater equipment;(3)position of the underwater equipment is estimated in real time based on a progressive update extended Kalman filter(PUEKF),which is carried out using the propagation model of an ELF electric field because the electric field at the position of the underwater equipment and the current source position are known.We verified the accuracy of our method and confirmed real-time location feasibility through numerical,physical scale,and real-time sea experiments.Through numerical experiments,we verified that our method works for underwater equipment location in real-world conditions,and the location error can be less than 0.2 m.Next,real-time location experiments for stationary underwater measuring equipment in water tank were conducted.The result shows that the location error can be less than 0.1 m.We also confirmed real-time location feasibility through the use of offshore experiment.We expect that our method will complement conventional underwater acoustic location methods for underwater equipment in acoustically noisy environments.展开更多
A new vision-based long-distance lane perception and front vehicle location method was developed for decision making of full autonomous vehicles on highway roads,Firstly,a real-time long-distance lane detection approa...A new vision-based long-distance lane perception and front vehicle location method was developed for decision making of full autonomous vehicles on highway roads,Firstly,a real-time long-distance lane detection approach was presented based on a linear-cubic road model for two-lane highways.By using a novel robust lane marking feature which combines the constraints of intensity,edge and width,the lane markings in far regions were extracted accurately and efficiently.Next,the detected lane lines were selected and tracked by estimating the lateral offset and heading angle of ego vehicle with a Kalman filter,Finally,front vehicles were located on correct lanes using the tracked lane lines,Experiment results show that the proposed lane perception approach can achieve an average correct detection rate of 94.37% with an average false positive detection rate of 0.35%,The proposed approaches for long-distance lane perception and front vehicle location were validated in a 286 km full autonomous drive experiment under real traffic conditions.This successful experiment shows that the approaches are effective and robust enough for full autonomous vehicles on highway roads.展开更多
With the continuous development of digital medicine,minimally invasive precision and safety have become the primary development trends in hepatobiliary surgery.Due to the specificity and complexity of hepatobiliary su...With the continuous development of digital medicine,minimally invasive precision and safety have become the primary development trends in hepatobiliary surgery.Due to the specificity and complexity of hepatobiliary surgery,traditional preoperative imaging techniques such as computed tomography and magnetic resonance imaging cannot meet the need for identification of fine anatomical regions.Imaging-based three-dimensional(3D)reconstruction,virtual simulation of surgery and 3D printing optimize the surgical plan through preoperative assessment,improving the controllability and safety of intraoperative operations,and in difficult-to-reach areas of the posterior and superior liver,assistive robots reproduce the surgeon’s natural movements with stable cameras,reducing natural vibrations.Electromagnetic navigation in abdominal surgery solves the problem of conventional surgery still relying on direct visual observation or preoperative image assessment.We summarize and compare these recent trends in digital medical solutions for the future development and refinement of digital medicine in hepatobiliary surgery.展开更多
Based on digital image processing technique, a real-time system is developed to monitor and detect the dynamic displacement of engineering structures. By processing pictures with a self-programmed software, the real-t...Based on digital image processing technique, a real-time system is developed to monitor and detect the dynamic displacement of engineering structures. By processing pictures with a self-programmed software, the real-time coordinate of an object in a certain coordinate system can be obtained, and further dynamic displacement data and curve of the object can also be achieved. That is, automatic gathering and real-time processing of data can be carried out by this system simultaneously. For this system, first, an untouched monitoring technique is adopted, which can monitor or detect objects several to hundreds of meters apart; second, it has flexible installation condition and good monitoring precision of sub-millimeter degree; third, it is fit for dynamic, quasi-dynamic and static monitoring of large engineering structures. Through several tests and applications in large bridges, good reliability and dominance of the system is proved.展开更多
文摘A real-time tracking system for the fast moving object on the complex background is proposed.The Markov random filed（MRF）model based background subtraction algorithm is used to detect the changing pixels and track the moving object.The prior probability of the segmentation mask is modeled by using MRF,and the object tracking task is translated into the maximum a-posterior（MAP）problem.Experimental results show that the method is efficient at both offline and online moving objects on simple and complex background.
基金The National Natural Science Foundation of China(Grant Nos.41630425,41761144074 and 41875007)supported the researchthe Chinese Academy of Sciences for the CAS-PIFI fellowship grant。
文摘A thunderstorm tracking algorithm is proposed to nowcast the possibility of lightning activity over an area of concern by using the total lightning data and neighborhood technique.The lightning radiation sources observed from the Beijing Lightning Network(BLNET)were used to obtain information about the thunderstorm cells,which are significantly valuable in real-time.The boundaries of thunderstorm cells were obtained through the neighborhood technique.After smoothing,these boundaries were used to track the movement of thunderstorms and then extrapolated to nowcast the lightning approaching in an area of concern.The algorithm can deliver creditable results prior to a thunderstorm arriving at the area of concern,with accuracies of 63%,80%,and 91%for lead times of 30,15,and 5 minutes,respectively.The real-time observations of total lightning appear to be significant for thunderstorm tracking and lightning nowcasting,as total lightning tracking could help to fill the observational gaps in radar reflectivity due to the attenuation by hills or other obstacles.The lightning data used in the algorithm performs well in tracking the active thunderstorm cells associated with lightning activities.
基金Supported by Ministerial Level Advanced Research Foundation(65822576)Beijing Municipal Education Commission(KM201310858004,KM201310858001)
文摘Real-time seam tracking can improve welding quality and enhance welding efficiency during the welding process in automobile manufacturing.However,the teaching-playing welding process,an off-line seam tracking method,is still dominant in automobile industry,which is less flexible when welding objects or situation change.A novel real-time algorithm consisting of seam detection and generation is proposed to track seam.Using captured 3D points,space vectors were created between two adjacent points along each laser line and then a vector angle based algorithm was developed to detect target points on the seam.Least square method was used to fit target points to a welding trajectory for seam tracking.Furthermore,the real-time seam tracking process was simulated in MATLAB/Simulink.The trend of joint angles vs.time was logged and a comparison between the off-line and the proposed seam tracking algorithm was conducted.Results show that the proposed real-time seam tracking algorithm can work in a real-time scenario and have high accuracy in welding point positioning.
文摘Manual monitoring and seam tracking through watching weld pool images in real-time, by naked eyes or by industrial TV, are experience-depended, subjective, labor intensive, and sometimes biased. So it is necessary to realize the automation of computer-aided seam tracking. A PAW (plasma arc welding) seam tracking system was developed, which senses the molten pool and the seam in one frame by a vision sensor, and then detects the seam deviation to adjust the work piece motion adaptively to the seam position sensed by vision sensor. A novel molten pool area image-processing algorithm based on machine vision was proposed. The algorithm processes each image at the speed of 20 frames/second in real-time to extract three feature variables to get the seam deviation. It is proved experimentally that the algorithm is very fast and effective. Issues related to the algorithm are also discussed.
基金supported by the Brain Korea 21 Project in 2011 and MKE(The Ministry of Knowledge Economy),Korea,under the ITRC(Infor mation Technology Research Center)support program supervised by the NIPA(National IT Industry Promotion Agency)(NIPA-2011-C1090-1121-0010)
文摘This paper proposes an algorithm that extracts features of back side of the vehicle and detects the front vehicle in real-time by local feature tracking of vehicle in the continuous images.The features in back side of the vehicle are vertical and horizontal edges,shadow and symmetry.By comparing local features using the fixed window size,the features in the continuous images are tracked.A robust and fast Haarlike mask is used for detecting vertical and horizontal edges,and shadow is extracted by histogram equalization,and the sliding window method is used to compare both side templates of the detected candidates for extracting symmetry.The features for tracking are vertical edges,and histogram is used to compare location of the peak and magnitude of the edges.The method using local feature tracking in the continuous images is more robust for detecting vehicle than the method using single image,and the proposed algorithm is evaluated by continuous images obtained on the expressway and downtown.And it can be performed on real-time through applying it to the embedded system.
文摘Conventional, grid-based sampling location tracking approach with GPS or topographic maps is time-consuming and inconvenient. Therefore, this study combined the freely available virtual/digital globe with recent advancements of smartphone geo-browsers to develop a new sampling location tracking approach. The sampling frame was developed with pre-uploaded point map formulated in GIS environment by combining land-use map and one-kilometer grid with center coordinates. The sampling location grid was uploaded to smartphone and each point was tracked with Google Map path finder using point ID (coded grid coordinate) when searching each sampling location. The suitability of the new approach was tested for soil sample collection from paddy lands distributed in 0.9 million hectares in Sri Lanka. The sampling locations could be reached conveniently with the help of Google path-finder voice direction guide and optional routes. The efficiency of new approach was found to be remarkably high, <em>i.e</em>., over 99% of the 9000 sampling points, which were spread across Sri Lanka having an area of 65,610 km<sup>2</sup>. All sampling points in the country could be covered with twelve member field investigation crew who were guided through smartphones uploaded with sampling point grid on six motorbikes within 60 days. The new sampling location tracking approach is effective in terms of cost, time, human resource requirements, thus can be adopted in large-scale soil/plant sampling frames with high accuracy.
基金Foundation of the Robotics Laboratory, Chinese Academy of Sciences (No: RL200002)
文摘Previously, researchers raised the accuracy for a robot′s hand to track a specified path in Car-tesian space mainly through increasing the number of knots on the path and the number of the path′s segments, which results in the heavier online computational burden for the robot controller. Aiming at overcoming this drawback, the authors propose a new kind of real-time accurate hand path tracking and joint trajectory planning method. Through selecting some extra knots on the specified hand path by a certain rule and introducing a sinusoidal function to the joint displacement equation of each segment, this method can greatly raise the path tracking accuracy of robot′s hand and does not change the number of the path′s segments. It also does not increase markedly the computational burden of robot controller. The result of simulation indicates that this method is very effective, and has important value in increasing the application of industrial robots.
文摘This paper introduces a new Chinese Sign Language recognition (CSLR) system and a method of real time tracking face and hand applied in the system. In the method, an improved agent algorithm is used to extract the region of face and hand and track them. Kalman filter is introduced to forecast the position and rectangle of search, and self adapting of target color is designed to counteract the effect of illumination.
基金FoundationoftheRoboticsLaboratoryChineseAcademyofSciences (No :RL2 0 0 0 0 2 )
文摘Previously, researchers raised the accuracy for a robot′s hand to track a specified path in Cartesian space mainly through increasing the number of knots on the path and the segments of the path. But, this method resulted in the heavier on line computational burden for the robot controller. In this paper, aiming at this drawback, the authors propose a new kind of real time accurate hand path tracking and joint trajectory planning method for robots. Through selecting some extra knots on the specified hand path by a certain rule, which enables the number of knots on each segment to increase from two to four, and through introducing a sinusoidal function and a cosinoidal function to the joint displacement equation of each segment, this method can raise the path tracking accuracy of robot′s hand greatly but does not increase the computational burden of robot controller markedly.
基金supported by the National Natural Science Foundation of China(61471194)the Fundamental Research Funds for the Central Universities+2 种基金the Science and Technology on Avionics Integration Laboratory and Aeronautical Science Foundation of China(20155552050)the CASC(China Aerospace Science and Technology Corporation) Aerospace Science and Technology Innovation Foundation Projectthe Nanjing University of Aeronautics And Astronautics Graduate School Innovation Base(Laboratory)Open Foundation Program(kfjj20151505)
文摘The traditional oriented FAST and rotated BRIEF（ORB） algorithm has problems of instability and repetition of keypoints and it does not possess scale invariance. In order to deal with these drawbacks, a modified ORB（MORB） algorithm is proposed. In order to improve the precision of matching and tracking, this paper puts forward an MOK algorithm that fuses MORB and Kanade-Lucas-Tomasi（KLT）. By using Kalman, the object＇s state in the next frame is predicted in order to reduce the size of search window and improve the real-time performance of object tracking. The experimental results show that the MOK algorithm can accurately track objects with deformation or with background clutters, exhibiting higher robustness and accuracy on diverse datasets. Also, the MOK algorithm has a good real-time performance with the average frame rate reaching 90.8 fps.
基金National Natural Science Foundation of China under Grant No.52178114Jiangsu Association for Science and Technology Youth Science and Technology Talent Support Project No.2021-79。
文摘Local control parameters such as instantaneous delay and instantaneous amplitude play an essential role in evaluating the performance and maintaining the stability of real-time hybrid simulation(RTHS).However,existing methods have limitations in obtaining this local assessment in either the time domain or frequency domain.In this study,the instantaneous frequency is introduced to determine local control parameters for actuator tracking assessment in a real-time hybrid simulation.Instantaneous properties,including amplitude,delay,frequency and phase,are then calculated based on analytic signals translated from actuator tracking signals through the Hilbert transform.Potential issues are discussed and solutions are proposed for calculation of local control parameters.Numerical simulations are first conducted for sinusoidal and chirp signals with time varying amplitude error and delay to demonstrate the potential of the proposed method.Laboratory tests also are conducted for a predefined random signal as well as the RTHS of a single degree of freedom structure with a self-centering viscous damper to experimentally verify the effectiveness of the proposed use of the instantaneous frequency.Results from the ensuing analysis clearly demonstrate that the instantaneous frequency provides great potential for local control assessment,and the proposed method enables local tracking parameters with good accuracy.
文摘Complex event processing (CEP) can extract meaningful events for real-time locating system (RTLS) applications. To identify complex event accurately in RTLS, we propose a new RFID complex event processing method GEEP, which is based on the timed automata (TA) theory. By devising RFID locating application into complex events, we model the timing diagram of RFID data streams based on the TA. We optimize the constraint of the event streams and propose a novel method to derive the constraint between objects, as well as the constraint between object and location. Experiments prove the proposed method reduces the cost of RFID complex event processing, and improves the efficiency of the RTLS.
文摘Fire rescue challenges and solutions have evolved from straightfor-ward plane rescue to encompass 3D space due to the rise of high-rise city buildings.Hence,this study facilitates a system with quick and simplified on-site launching and generates real-time location data,enabling fire rescuers to arrive at the intended spot faster and correctly for effective and precise rescue.Auto-positioning with step-by-step instructions is proposed when launching the locating system,while no extra measuring instrument like Total Station(TS)is needed.Real-time location tracking is provided via a 3D space real-time locating system(RTLS)constructed using Ultra-wide Bandwidth technology(UWB),which requires electromagnetic waves to pass through concrete walls.A hybrid weighted least squares with a time difference of arrival(WLS/TDOA)positioning method is proposed to address real path-tracking issues in 3D space and to meet RTLS requirements for quick computing in real-world applications.The 3D WLS/TDOA algorithm is theoretically constructed with the Cramer-Rao lower bound(CRLB).The computing complexity is reduced to the lower bound for embedded hardware to directly compute the time differential of the arriving signals using the time-to-digital converter(TDC).The results of the experiments show that the errors are controlled when the positioning algorithm is applied in various complicated situations to fulfill the requirements of engineering applications.The statistical analysis of the data reveals that the proposed UWB RTLS auto-positioning system can track target tags with an accuracy of 0.20 m.
基金supported by the Fundamental Research Funds of the Special Program for Key Research and Development of Guangdong Province(Grant No.2019B111101002)Guangzhou Science and Technology Planning Project(Grant No.201903010036)+2 种基金China Postdoctoral Science Foundation(Grant No.2020M683021)National Natural Science Foundation of China(Grant Nos.42075004,41875021,and 41830533)Key Laboratory of Tropical Atmosphere-Ocean System(Sun Yat-sen University),Ministry of Education。
文摘This study analyzes landfall locations of tropical cyclones(TCs)over the western North Pacific during 1979–2018.Results demonstrate that the landfall locations of TCs over this region have shifted northward during the last four decades,primarily due to the shift of landfalling TC tracks,with the decreasing/increasing proportion of westward/northward TC tracks.In particular,the northward shift of the landfalling TCs was not related to their formation locations,which have not markedly changed,whereas"no-landed"TCs have significantly shifted northward.TC movement was significantly and positively correlated to the zonal component of the steering flow,while the correlation between TC movement and the meridional component of the steering flow was relatively unobvious.The westward steering flow in the tropical central Pacific that occurred around the formation and early development of the westward TCs was significantly weakened,which was unfavorable for their westward movement,thereby,causing the higher proportions of northward moving tracks.This weakened westward flow was related to the northward shift of the subtropical high ridge,which was caused by significant weakening of the southern part of the subtropical high.The vertical wind shear,sea surface temperature,and convective available potential energy also showed that the northern region of the western North Pacific became more favorable for TC development,whereas the upper divergence,low-layer relative vorticity,and accumulated water vapor content were not obviously related to the northward shift of TCs.
基金supported by Natinoal Basic Research Program of China (973 Program, Grant No. 2011CB706805)National Natural Science Foundation of China (Grant No. 50875204)
文摘The method of acquiring the real-time data has influenced the implementation of the manufacturing execution system （MES）. Accompanied with turning the MES into service-oriented manufacturing execution system （so-MES）, real-time e-quality tracking （e-QT）, in which real-time data are computed, has played more and more important roles in manufacturing. This paper presents an e-QT model through the study of real-time status data tracking and quality data collecting. An implementing architecture of the e-QT model is constructed on the basis of radio frequency identification devices （RFID） data-tracking network. In order to develop the e-QT system, some key enabling technologies, such as configuration, data collection, and data processing, etc, are studied. The relation schema between hardware is built for the RFID data-tracking network based on the configuration technique. Real-time data are sampled by using data collecting technique. Furthermore, real-time status and quality data in a shop-floor can be acquired in terms of using the real-time data computing method. Finally, a prototype system is developed and a running example is given so as to verify the feasibility of methods proposed in this paper. The proposed research provides effective e-quality tracking theoretical foundation through the use of RFID technology for the discrete manufacturing.
基金supported by the Youth Foundation of the National Natural Science Foundation of China(Grant No.51509252)。
文摘A new real-time underwater equipment location method adopting an electric field induced by a standard current source is proposed.Our goals were real-time tracking and location of stationary or moving underwater equipment both in shallow and deep seas,under noisy conditions.The main features of this method are as follows:(1)a standard current source on the water surface,which can be towed by a vehicle,consisting of two electrodes,a signal generator,and a GPS unit;(2)measurement of the extremely low frequency(ELF)electric field emitted by the current source,made possible by electric field sensors on the underwater equipment;(3)position of the underwater equipment is estimated in real time based on a progressive update extended Kalman filter(PUEKF),which is carried out using the propagation model of an ELF electric field because the electric field at the position of the underwater equipment and the current source position are known.We verified the accuracy of our method and confirmed real-time location feasibility through numerical,physical scale,and real-time sea experiments.Through numerical experiments,we verified that our method works for underwater equipment location in real-world conditions,and the location error can be less than 0.2 m.Next,real-time location experiments for stationary underwater measuring equipment in water tank were conducted.The result shows that the location error can be less than 0.1 m.We also confirmed real-time location feasibility through the use of offshore experiment.We expect that our method will complement conventional underwater acoustic location methods for underwater equipment in acoustically noisy environments.
基金Project(90820302) supported by the National Natural Science Foundation of China
文摘A new vision-based long-distance lane perception and front vehicle location method was developed for decision making of full autonomous vehicles on highway roads,Firstly,a real-time long-distance lane detection approach was presented based on a linear-cubic road model for two-lane highways.By using a novel robust lane marking feature which combines the constraints of intensity,edge and width,the lane markings in far regions were extracted accurately and efficiently.Next,the detected lane lines were selected and tracked by estimating the lateral offset and heading angle of ego vehicle with a Kalman filter,Finally,front vehicles were located on correct lanes using the tracked lane lines,Experiment results show that the proposed lane perception approach can achieve an average correct detection rate of 94.37% with an average false positive detection rate of 0.35%,The proposed approaches for long-distance lane perception and front vehicle location were validated in a 286 km full autonomous drive experiment under real traffic conditions.This successful experiment shows that the approaches are effective and robust enough for full autonomous vehicles on highway roads.
基金Supported by National Natural Science Foundation of China,No.82070638 and No.81770621and JSPS KAKENHI,No.JP18H02866.
文摘With the continuous development of digital medicine,minimally invasive precision and safety have become the primary development trends in hepatobiliary surgery.Due to the specificity and complexity of hepatobiliary surgery,traditional preoperative imaging techniques such as computed tomography and magnetic resonance imaging cannot meet the need for identification of fine anatomical regions.Imaging-based three-dimensional(3D)reconstruction,virtual simulation of surgery and 3D printing optimize the surgical plan through preoperative assessment,improving the controllability and safety of intraoperative operations,and in difficult-to-reach areas of the posterior and superior liver,assistive robots reproduce the surgeon’s natural movements with stable cameras,reducing natural vibrations.Electromagnetic navigation in abdominal surgery solves the problem of conventional surgery still relying on direct visual observation or preoperative image assessment.We summarize and compare these recent trends in digital medical solutions for the future development and refinement of digital medicine in hepatobiliary surgery.
基金Supported by the National Natural Science Foundation of China （No.50378041） and the Specialized Research Fund for the Doctoral Program of Higher Education （No.2003487016）.
文摘Based on digital image processing technique, a real-time system is developed to monitor and detect the dynamic displacement of engineering structures. By processing pictures with a self-programmed software, the real-time coordinate of an object in a certain coordinate system can be obtained, and further dynamic displacement data and curve of the object can also be achieved. That is, automatic gathering and real-time processing of data can be carried out by this system simultaneously. For this system, first, an untouched monitoring technique is adopted, which can monitor or detect objects several to hundreds of meters apart; second, it has flexible installation condition and good monitoring precision of sub-millimeter degree; third, it is fit for dynamic, quasi-dynamic and static monitoring of large engineering structures. Through several tests and applications in large bridges, good reliability and dominance of the system is proved.
