Abstract: This paper is motivated by the importance of multi-sensor image fusion with specific focus on Infrared (IR) and Visible image (VI) fusion for various applications including military reconnaissance. Image fusion can be defined as the process of combining two or more source images into a single composite image with extended information content that improves visual perception or feature extraction. These images can be from different modalities like Visible camera & IR Thermal Imager. While visible images are captured by reflected radiations in the visible spectrum, the thermal images are formed from thermal radiation (IR) that may be reflected or self-emitted. A digital color camera captures the visible source image and a thermal IR camera acquires the thermal source image. In this paper, some image fusion algorithms based upon Multi-Scale Transform (MST) and region-based selection rule with consistency verification have been proposed and presented. This research includes implementation of the proposed image fusion algorithm in MATLAB along with a comparative analysis to decide the optimum number of levels for MST and the coefficient fusion rule. The results are presented, and several commonly used evaluation metrics are used to assess the suggested method's validity. Experiments show that the proposed approach is capable of producing good fusion results. While deploying our image fusion algorithm approaches, we observe several challenges from the popular image fusion methods. While high computational cost and complex processing steps of image fusion algorithms provide accurate fused results, but they also make it hard to become deployed in system and applications that require real-time operation, high flexibility and low computation ability. So, the methods presented in this paper offer good results with minimum time complexity.
Abstract: Multiple classifier systems combine several individual classifiers to deliver a final classification decision. However, an increasingly controversial question is whether such systems can outperform the single best classifier, and if so, what form of multiple classifiers system yields the most significant benefit. Also, multi-target tracking detection using multiple sensors is an important research field in mobile techniques and military applications. In this paper, several multiple classifiers systems are evaluated in terms of their ability to predict a system’s failure or success for multi-sensor target tracking tasks. The Bristol Eden project dataset is utilised for this task. Experimental and simulation results show that the human activity identification system can fulfil requirements of target tracking due to improved sensors classification performances with multiple classifier systems constructed using boosting achieving higher accuracy rates.
Abstract: Recent development of AI and edge computing plays a critical role to capture meaningful events such as detection of an unattended bag. One of the core problems is re-identification across multiple CCTVs. Immediately following the detection of a meaningful event is to track and trace the objects related to the event. In an extensive environment, the challenge becomes severe when the number of CCTVs increases substantially, imposing difficulties in achieving high accuracy while maintaining real-time performance. The algorithm that re-identifies cross-boundary objects for extensive tracking is referred to Extensive Re-Identification, which emphasizes the issues related to the complexity behind a great number of CCTVs. The Spatial-Temporal Awareness approach challenges the conventional thinking and concept of operations which is labor intensive and time consuming. The ability to perform Extensive Re-Identification through a multi-sensory network provides the next-level insights – creating value beyond traditional risk management.
Abstract: During the last few decades, the continuously increasing demand for accurate and reliable magnetic measurements has paved the way for the development of different types of magnetic sensing systems as well as different measurement techniques. Sensor sensitivity and linearity, signal-to-noise ratio, measurement range, cross-talk between sensors in multi-sensor applications are only some of the aspects that have been examined in the past. In this paper, a fully analog closed loop system in order to optimize the performance of AMR sensors has been developed. The operation of the proposed system has been tested using a Helmholtz coil calibration setup in order to control both the amplitude and direction of magnetic field in the vicinity of the AMR sensor. Experimental testing indicated that improved linearity of sensor response, as well as low noise levels can be achieved, when the system is employed.
Abstract: Visually impaired people, in their daily lives, face struggles and spatial barriers because the built environment is often designed with an extreme focus on the visual element, causing what is called architectural visual bias or ocularcentrism. The aim of the study is to holistically understand the world of the visually impaired as an attempt to extract the qualities of space that accommodate their needs, and to show the importance of multi-sensory, holistic designs for the blind. Within the framework of existential phenomenology, common themes are reached through "intersubjectivity": experience descriptions by blind people and blind architects, observation of how blind children learn to perceive their surrounding environment, and a personal lived blind-folded experience are analyzed. The extracted themes show how visually impaired people filter out and prioritize tactile (active, passive and dynamic touch), acoustic and olfactory spatial qualities respectively, and how this happened during the personal lived blind folded experience. The themes clarify that haptic and aural inclusive designs are essential to create environments suitable for the visually impaired to empower them towards an independent, safe and efficient life.
Abstract: This paper discusses the question whether a person
diagnosed with dyslexia will necessarily have difficulty in reading
musical notes. The author specifies the characteristics of alphabet
reading in comparison to musical notation reading, and concludes
that there should be no contra-indication for teaching standard music
reading to children with dyslexia if an appropriate process is offered.
This conclusion is based on a long term case study and relies on two
main characteristics of music reading: (1) musical notation system is
a systematic, logical, relative set of symbols written on a staff; and
(2) music reading learning connected with playing a musical
instrument is a multi-sensory activity that combines sight, hearing,
touch, and movement. The paper describes music reading teaching
procedures, using soprano recorders, and provides unique teaching
methods that have been found to be effective for students who were
diagnosed with dyslexia. It provides theoretical explanations in
addition to guidelines for music education practices.
Abstract: In this paper, we present a four-step ortho-rectification
procedure for real-time geo-referencing of video data from a low-cost
UAV equipped with a multi-sensor system. The basic procedures for
the real-time ortho-rectification are: (1) decompilation of the video
stream into individual frames; (2) establishing the interior camera
orientation parameters; (3) determining the relative orientation
parameters for each video frame with respect to each other; (4)
finding the absolute orientation parameters, using a self-calibration
bundle and adjustment with the aid of a mathematical model. Each
ortho-rectified video frame is then mosaicked together to produce a
mosaic image of the test area, which is then merged with a well
referenced existing digital map for the purpose of geo-referencing
and aerial surveillance. A test field located in Abuja, Nigeria was
used to evaluate our method. Video and telemetry data were collected
for about fifteen minutes, and they were processed using the four-step
ortho-rectification procedure. The results demonstrated that the
geometric measurement of the control field from ortho-images is
more accurate when compared with those from original perspective
images when used to pin point the exact location of targets on the
video imagery acquired by the UAV. The 2-D planimetric accuracy
when compared with the 6 control points measured by a GPS receiver
is between 3 to 5 metres.
Abstract: This paper addresses the issue of the autonomous
mobile robot (AMR) navigation task based on the hybrid control
modes. The novel hybrid control mode, based on multi-sensors
information by using the fuzzy approach, has been presented in this
research. The system operates in real time, is robust, enables the robot
to operate with imprecise knowledge, and takes into account the
physical limitations of the environment in which the robot moves,
obtaining satisfactory responses for a large number of different
situations. An experiment is simulated and carried out with a pioneer
mobile robot. From the experimental results, the effectiveness and
usefulness of the proposed AMR obstacle avoidance and navigation
scheme are confirmed. The experimental results show the feasibility,
and the control system has improved the navigation accuracy. The
implementation of the controller is robust, has a low execution time,
and allows an easy design and tuning of the fuzzy knowledge base.
Abstract: This paper presents a novel Global Navigation Satellite System (GNSS) Avionics Based Integrity Augmentation (ABIA) system architecture suitable for civil and military air platforms, including Unmanned Aircraft Systems (UAS). Taking the move from previous research on high-accuracy Differential GNSS (DGNSS) systems design, integration and experimental flight test activities conducted at the Italian Air Force Flight Test Centre (CSV-RSV), our research focused on the development of a novel approach to the problem of GNSS ABIA for mission- and safety-critical air vehicle applications and for multi-sensor avionics architectures based on GNSS. Detailed mathematical models were developed to describe the main causes of GNSS signal outages and degradation in flight, namely: antenna obscuration, multipath, fading due to adverse geometry and Doppler shift. Adopting these models in association with suitable integrity thresholds and guidance algorithms, the ABIA system is able to generate integrity cautions (predictive flags) and warnings (reactive flags), as well as providing steering information to the pilot and electronic commands to the aircraft/UAS flight control systems. These features allow real-time avoidance of safety-critical flight conditions and fast recovery of the required navigation performance in case of GNSS data losses. In other words, this novel ABIA system addresses all three cornerstones of GNSS integrity augmentation in mission- and safety-critical applications: prediction (caution flags), reaction (warning flags) and correction (alternate flight path computation).
Abstract: An optimal mean-square fusion formulas with scalar
and matrix weights are presented. The relationship between them is
established. The fusion formulas are compared on the continuous-time
filtering problem. The basic differential equation for cross-covariance
of the local errors being the key quantity for distributed fusion is
derived. It is shown that the fusion filters are effective for multi-sensor
systems containing different types of sensors. An example
demonstrating the reasonable good accuracy of the proposed filters is
given.
Abstract: For most image fusion algorithms separate
relationship by pixels in the image and treat them more or less
independently. In addition, they have to be adjusted different
parameters in different time or weather. In this paper, we propose a
region–based image fusion which combines aspects of feature and
pixel-level fusion method to replace only by pixel. The basic idea is
to segment far infrared image only and to add information of each
region from segmented image to visual image respectively. Then we
determine different fused parameters according different region. At
last, we adopt artificial neural network to deal with the problems of
different time or weather, because the relationship between fused
parameters and image features are nonlinear. It render the fused
parameters can be produce automatically according different states.
The experimental results present the method we proposed indeed
have good adaptive capacity with automatic determined fused
parameters. And the architecture can be used for lots of applications.
Abstract: Omni directional mobile robots have been popularly
employed in several applications especially in soccer player robots
considered in Robocup competitions. However, Omni directional
navigation system, Omni-vision system and solenoid kicking
mechanism in such mobile robots have not ever been combined. This
situation brings the idea of a robot with no head direction into
existence, a comprehensive Omni directional mobile robot. Such a
robot can respond more quickly and it would be capable for more
sophisticated behaviors with multi-sensor data fusion algorithm for
global localization base on the data fusion. This paper has tried to
focus on the research improvements in the mechanical, electrical and
software design of the robots of team ADRO Iran. The main
improvements are the world model, the new strategy framework,
mechanical structure, Omni-vision sensor for object detection, robot
path planning, active ball handling mechanism and the new kicker
design, , and other subjects related to mobile robot
Abstract: This paper presents a real time force sensing
instrument that is designed for human gait analysis purposes. It is
capable of recording and monitoring ground reaction forces exerted
by human foot during various activities such as walking, running and
jumping in real time. In overall, force sensing mat mainly consists of
three elements: the force sensing mat, signal conditioning circuit and
data acquisition device. Force sensing mat is the mat that contains an
array of force sensing elements. To control and process the incoming
signal from the force sensing mat, Force-Logger and Force-Reloader
are developed using National Instrument Labview. This paper
describes the architecture of the force sensing mat, signal
conditioning circuit and the real time streaming of the incoming data
from the force sensing mat. Additionally, a preliminary experiment
dataset is presented in this paper.