Cognitive Sensing Technologies and Applications

2: School of Electrical Sciences, Indian Institute of Technology (IIT), India
3: Department of Electrical Engineering, National Chung Hsing University, Taiwan
4: Department of Electronic Engineering, Universiti Tunku Abdul Rahman, Malaysia
Cognitive sensing systems combined with IoTs and smart technologies are used in countless applications such as industrial robotics, computer-aided diagnosis, brain-computer interface (BCI), human-computer interaction (HCI), telemedicine, driverless cars and smart energy systems.
With contributions from an international team of experts from a wide range of research areas including sensing, computer vision, signal processing and device and control applications, this book highlights the emerging role of cognitive sensors in a growing number of real time applications including smart health, smart cities, smart transportation and smart agriculture.
The volume will be suitable for a broad audience of researchers in the fields of smart sensing, signal processing, automation and robotics, environmental engineering, energy engineering, biomedical engineering and allied disciplines where smart sensors are part of the curriculum.
- Book DOI: 10.1049/PBCE135E
- Chapter DOI: 10.1049/PBCE135E
- ISBN: 9781839536892
- e-ISBN: 9781839536908
- Page count: 502
- Format: PDF
-
Front Matter
- + Show details - Hide details
-
p.
(1)
-
1 Introduction to cognitive sensing technologies and applications
- + Show details - Hide details
-
p.
1
–26
(26)
This chapter introduces cognitive sensing technologies and related terminologies with their adequate introduction, significance and applications. Cognitive sensing is incomplete without smart sensors and Artificial Intelligence (AI) and thus the role of AI is immense in demonstrating the capabilities of modern sensors in numerous applications such as driverless cars and humanoid robots. Sensing technologies and intelligent data processing make the applications more accurate and meaningful, in other words, cognitive sensing technology has a significant role to play in making automated and smart systems; realizable and functional. The overview of cognitive sensing covers cognitive sensors; cognitive Internet of Things (CoIT); issues and challenges in cognitive sensing and IoTs; and emerging applications of cognitive sensing technologies.
-
2 Hardware architectures for some sparse signal recovery approaches
- + Show details - Hide details
-
p.
27
–72
(46)
Over the last couple of decades, sparse signal processing has been constantly the focus of research interests aiming to exploit all benefits of sparseness property. Particularly, the sparsity has been utilized in numerous applications such as compression and coding, spectral analysis, channel estimation, and recently for the development of compressive sensing (CS) approaches and signal reconstruction algorithms. Indeed, intensive development of the approaches for sparse signal recovery in the CS scenario has created a new sensing paradigm and opened up a new perspective of sensing technology design. Moreover, a variety of CS scenarios have been exploited in different real-world applications, not only for sensing purposes but for example in signal/image denoising problems. A number of approaches and algorithms have been designed to cope with under-sampled and random-sampled signal recovery, depending on the signal nature.
Although signal processing algorithms can be tested in software, there is a growing need for hardware realizations. Namely, software implementations of those approaches are generally not suitable enough for real-time applications. Therefore, the necessity for hardware implementations was raised due to the requirement of fast testing, which is hardly accomplished in software. There are various approaches starting from the less complex and much faster analog-circuits-based solutions to the more complex, slower but more precise digital approaches. Depending on the system requirements, analog or digital implementation is used. Generally, for fast and less complex circuits, analog implementation is better, while for slower circuits, a digital implementation is more suitable.
In this chapter, we will provide an overview of the hardware architectures for several approaches based on the gradient descent algorithm. The algorithm belongs to the group of convex optimizations and provides successful signal recovery from a relatively small number of acquired samples.
-
3 Performance evaluation of cognitive sensor frameworks for IoT applications in healthcare and environment monitoring
- + Show details - Hide details
-
p.
73
–97
(25)
Wireless Internet of Things (WIoT), based on the concept of ubiquitous computing, attempts to create communication networks by embedding microchips in everyday consumer electronic devices and to set those devices up to share data with each other to provide innovative connected solutions. With the explosion in the number and variety of wireless applications in the last two decades, all of them face a major challenge of availability of frequency spectrum. This challenge can be addressed by resorting to cognitive radio. The cognitive radio scheme uses a radio system that can make an informed decision to dynamically fine-tune its radio operation metrics as it can sense and is mindful of its operational setting. Combining the cognitive radio technology with WIoT can make the application design more robust and universal. In this paper, we discuss the possibilities and challenges involving such cognitive sensors, used for environmental sensing and healthcare applications.
-
4 Cognitive sensors for rehabilitation and therapeutic treatment
- + Show details - Hide details
-
p.
99
–118
(20)
Cognitive sensors (CS) for healthcare are devices that utilize various sensor technologies to monitor a person's health condition and provide them with appropriate rehabilitation services. These sensors can be worn on the body, embedded in clothing, or integrated into other devices such as smartphones, smartwatches, and tablets. These sensors can monitor various indices of health and diseased conditions. Data related to human health are increasingly integrated with cognitive sensors, which facilitates decision-making and better disease treatment. Further, real-time communication and patient monitoring devices have become a central concept of smart healthcare services. The CS networks consist of a large number of sensors that can collect localized information automatically and intelligently. In addition to information fusion, intelligent sensors, sensing grids, communication protocols, network routing, and complex event processing architectures, CS intersects with other trends in computing. It has been shown that such CS can significantly improve the quality of life and support for the elderly and physically handicapped by designing interactive, adaptable, and intelligent multisensory surveillance systems, which can be equipped with panic buttons, current, bed, and water flow sensors. The use of CS technology, such as sensors, can reduce directional errors and assist in the neural health of patients. Many cognitive sensor systems have been developed for rehabilitation purposes to assist various groups of individuals in overcoming physical or mental health conditions. However, only a few attempts have been made to assist individuals with traumatic brain damage, schizophrenia, or dementia.
-
5 An ensemble machine learning-based intelligent system for human activity recognition using sensory data
- + Show details - Hide details
-
p.
119
–130
(12)
Human activity recognition (HAR) from sensor data has become an attractive research topic due to its application in areas such as healthcare, human-computer interaction and smart environments. Although several research works have been done on HAR, the current studies are not enough to produce optimised performance balancing efficiency and accuracy. To solve this issue, this chapter proposes a new hybrid scheme based on permutation entropy integrated with quadratic sample entropy and ensemble classifier. First, the data are segmented into intervals, then, a combination of entropy features is extracted and evaluated. The extracted features are fed to an ensemble machine learning algorithm to classify the features vector into different activities. The proposed model is tested on a publicly available sensor dataset. The results demonstrate that the proposed scheme is efficient to improve HAR while obtaining an accuracy between 95% and 96% and outperforms considerably the existing methods.
-
6 Challenges in the acquisition of non-invasive brain signals - electroencephalographic signals (EEG)
- + Show details - Hide details
-
p.
131
–161
(31)
The most prominent issue in the acquisition of biomedical signals, apart from the problems associated with the sensors for capturing these signals, is the presence of artifacts. In this chapter, these artifacts are discussed mainly with respect to electroencephalographic (EEG) signals. The chapter introduces EEG and the different methods employed to capture the EEG signals. In particular, the advantages of non-invasive EEG and the challenges associated with the captured signals are highlighted. The artifacts present in EEG can be broadly classified as (a) physiological and (b) non-physiological. The physiological artifacts such as ocular cardiac artifacts and non-physiological artifacts such as power line interference are elaborated along with the reason for such artifacts. In this chapter, three physiological artifacts, namely, ocular, cardiac, and electromyogenic, are explained along with two non-physiological artifacts, namely, electrode movement and power line interference. To effectively utilise EEG, the signals need to undergo artifact removal. Multiple methodologies are employed to remove the artifacts from EEG, and the most widely used methods involve Independent Component Analysis (ICA) and Wavelets. The ocular and electromyogenic artifacts can be handled using a range of methods such as adaptive filtering, blind source separation, wavelet transform, Riemannian Geometry, and deep learning approaches. Cardiac artifacts are commonly eliminated using adaptive filtering as well as blind source separation and deep learning approaches. One commonly used method to tackle the electrode placement artifact is independent component analysis. Power line interference is mainly eliminated using notch filters, however, adaptive filtering and hybrid methods of wavelet and blind source separation are also explored in multiple works. These methods are explained and analysed in this chapter, highlighting each one's advantages and disadvantages. Additionally, the challenges in employing a commercial EEG headset compared to a medical EEG headset are also explored. The chapter concludes with an overview of various methods employed for artifact removal in EEG and associated active research areas.
-
7 Cognitive task and workload classification using EEG signal
- + Show details - Hide details
-
p.
163
–192
(30)
Cognitive workload is defined as the load generated within our brain as a result of cognitive and psychological effort which is given to accomplish the desired task. Analysis of mental workload and cognitive stress monitoring is extremely crucial as it directly impacts humans' performance in executing the tasks as well as in mental health. Recent studies in neuroscience have differentiated various cognitive states by analyzing local changes in neuronal activity in human brain. Given cost-effectiveness and high sensitivity to detect brain activity fluctuations for varieties of cognitive tasks, electroencephalography (EEG) analysis has been widely studied by researchers in order to understand the information about brain functionality that EEG signal contains. Here we present a comprehensive overview on how EEG can be utilized to identify different cognitive states for assessing mental workload. A systematic review of the literature was performed on EEG signal for different mental stress tasks, where the subjects undergo with varying degrees of task complexity. In the present study, the results are analyzed based on the type of tasks, different EEG preprocessing methods and classification models. The study summarizes the recent practices and performance outcomes for mental workload classification using EEG signal.
-
8 Automatic detection of Parkinson's disease using non-linear signal decomposition and machine learning techniques
- + Show details - Hide details
-
p.
193
–215
(23)
The manual techniques for detecting Parkinson's disease (PD) include computer examination tests, interviews, and activity-based recognition. However, such methods are burdensome, error-prone, and time-consuming. Therefore, there is a need for an automatic decision-making support system for the timely detection of PD. This chapter explores the utility of electroencephalogram (EEG) signals for accurate PD detection. The EEG provides detailed information about distinct neural characteristics during PD. But, the nonstationary and nonlinear nature of EEG makes its analysis difficult, resulting in reduced system performance. Therefore, this chapter presents an empirical wavelet transform-based nonlinear analysis of EEG signals. Various hidden characteristics (statistical features) are extracted from the decomposed multi-component EEG and classified using nonlinear multiple machine learning techniques. The effectiveness of the proposed model is tested by evaluating various performance measures and comparing them with existing state-of-the-art methods. The proposed model has obtained the highest accuracy of 98.22% and 98.65% in classifying EEG events of healthy control (HC) subjects vs. PD patients with the absence of medication (PDAM) and HC vs. PD with medication (PDOM). In addition to this, five performance matrices are also evaluated to test system performance. The developed model automatically detects PD from different brain regions. The brain's frontal area provides insightful information in PD detection with the highest accuracy. In contrast, the temporal part of the brain has obtained the least accuracy of PD detection. The developed model is ready to be deployed for PD detection by neuro experts in real-time scenarios.
-
9 A review on gait kinematics acquisition sensors and its advancements in IoT and machine learning
- + Show details - Hide details
-
p.
217
–255
(39)
The increasing need for analyzing lower limb kinematics urges the application of Internet of Things (IoT) and machine learning for advancement in sensors, towards accurate, real-time, fast, and easy access measurements. Lower limb kinematics such as joint angles and motion trajectories are necessary to distinctly explain the functionality of the locomotion. In clinical gait analysis, the details of locomotor function are important to identify abnormalities such as cerebral palsy, hip osteoarthritis and stroke. In sports, lower limb kinematics are used to evaluate the performances of sports' athletes. On the other hand, robotic prosthesis devices use joint kinematics for movement control. Among the kinematics sensors, laboratory systems are the gold standard which attaches reflective markers on the wearer and capture movement using infrared camera systems. However, laboratory systems are expensive, time consuming, require experienced professionals for data recording, and limited in space which has a tendency to alter natural walking patterns. Furthermore, laboratory systems are not real time analyzed with IoT or advanced protocols. Applications of wearable kinematics sensors (e.g., inertial measurement units and force-sensitive resistor instrumented foot insoles), enabled with IoT are recognized as an emerging field for outdoor gait monitoring. Current research trends towards applications of machine learning to enhance and improve the quality of kinematics data acquisition and analysis of wearable sensors. As such, this chapter presents a detailed systematic review of kinematics systems (from traditional to the latest advancements), its potentials, limitations, and future trends especially in the IoT and machine learning field. A detailed understanding of available methodologies is important to investigate possible directions and areas to be improved.
-
10 Cognitive IoT sensors for smart industrial and biomedical applications
- + Show details - Hide details
-
p.
257
–275
(19)
Cognitive Internet of Things (IoT) sensors are advanced sensing devices that incorporate artificial intelligence (AI) and machine learning (ML) algorithms to process and analyze real-time data from various sources. These sensors are widely used in smart industrial and biomedical applications for their ability to provide real-time information and improve operational efficiency. In industrial applications, cognitive IoT sensors can be used to monitor production processes and provide predictive maintenance. In biomedical applications, they can be used to monitor patient health and improve diagnosis and treatment. With the continued growth of the IoT and advancements in AI and ML, the use of cognitive IoT sensors is expected to increase in both industrial and biomedical applications in the coming years. This book chapter presents the innovative approach to decision making in healthcare and industrial settings, focusing on the handling of data transmission, trade, and record keeping through a cost-effective preservation method. The chapter serves as an overview of cognitive sensors and the current state of IoT in smart industries. It also delves into the impact of cognitive sensors on the operations of hospitals and industrial organizations, and explores the use of these sensors to understand the reasons behind resistance to smart products among both producers and consumers.
-
11 Intelligent automation using IoT and machine learning
- + Show details - Hide details
-
p.
277
–301
(25)
Internet of Things (IoT) is an ecosystem of vast connected devices known as objects that continuously generate data. Very large data come from these devices through various sensors. Machine learning (ML) is data-driven and generates meaningful insights from it. ML tries to find patterns from past data and build predictive models that are useful in predicting future behavior and events. There are various machine-learning techniques and approaches to analyze this huge data such as K-Nearest neighbors, Naïve Bayes, Support Vector Machine, Classification trees, Random forests, Bagging, Feedforward neural network, Linear regression, Support vector regression, Regression trees, and Random forests. The ML algorithms examine the data to derive valuable information for a better user experience. With the advancement of ML in IoT, the devices can inspect the data collected, derive meaningful information, create smart applications, and be autonomous. These devices can make decisions and learn from the data collected. Further enhancements in the domains of IoT and ML are making the applications smarter and smarter. As it is said, "Work smarter not harder." ML and IoT are playing a major role in making applications smarter. IoT helps collect data, and ML analyses this data to make smarter decisions. The underlying philosophy of IoT and ML is that smart equipment is not only better than humans at data capturing and analyzing in real-time, but they are also better at communicating critical information that can be used to fast driving and more accurate business decisions. IoT with ML will change everything without the need for human-to-human collaboration making human life much simpler and easy by automating everything. All of the devices in an IoT system would collect data from our living patterns in real-time, adjusting their settings or features to optimize our living experience and ensure the products work best for our life needs. All of the devices in an IoT system would collect data from our living patterns, modify their settings or features to improve our lifestyle, and ensure the best commodity for our life. When these applications are integrated into the housing, industries, and financial applications, they provide significant value to end users while providing new revenue opportunities to service and system providers. The futuristic applications of IoT and ML are smart homes, smart cities, etc. These IoT and ML applications are going to be epic in the field of innovation.
-
12 Recent trends in applications of cognitive sensors for smart manufacturing and control
- + Show details - Hide details
-
p.
303
–334
(32)
Industrial Internet of Things (IIoT) is focused on optimization of industrial working in several fields including assembly lines, manufacturing processes and production of any kind, including agriculture. As the equipment and system are data intensive and largely dependent on wireless transmission of data from the interface point of the primary sensing element to where it is going to be utilised, adding cognitive capabilities to the radio system involved can add benefits of optimal utilisation of the frequency spectrum and faster transmission of critical process data. IIoT also offers advanced functionalities such as preventive maintenance, asset tracking and better optimized resources in the operation and control of industrial processes for manufacturing, production, or processing. This chapter focuses on the evolution of the sensors and process control equipment from traditional versions to those being used today for IIoT.
-
13 A systematic study on cognitive sensors in robotics, UAVs, and drones
- + Show details - Hide details
-
p.
335
–361
(27)
Cognitive sensor technologies are a vital basis for a robust, powerful economy in terms of digital transformation. Cooperative processing of complicated tasks comprising multiple agents, such as humans, robots, or both, can aid cognitive Internet of Things (IoT) control. Aerial robots (UAVs, RPVs, drones) and nano-satellites are fast gaining in popularity, and why accelerating in adoption is explained in the study. By aligning reserves to the scenario at hand, sensors as robots will enable the proper progressive application of remote sensing assets. Cognitive robots and drones with the ability to interpret the analog output from non-digitized industrial machinery employed in industry 4.0 are being discussed in the study. The study sheds some light on how concepts like aerial robotics, cognitive architecture, object-oriented design and cognitive deep learning algorithms, and autonomous drones use cognitive sensors. We have discussed how cognitive sensor technology enables us to cover the broad spectrum of healthcare, industry, and agriculture applications. We addressed the factors in this examination, which are the number one factors that may be advanced with using cognitive sensors when transforming traditional drones, robotics, and UAVs with the help of cognitive sensors.
-
14 Sensor data fusion and processing in smart agriculture: crop quality assessment, crop damage, smart planning
- + Show details - Hide details
-
p.
363
–390
(28)
Agricultural lands are generally vast, remote, and sensitive to weather, making data collection difficult. Despite these limitations, additional data are being captured as technologies evolve and prices reduce. Proximal, aerial, satellite, and ancillary data are obtained to study the crop for various objectives of smart agriculture. Geographically unequal areas lack vital data to address their challenges. Even in regions with adequate infrastructure and resources, data being obtained for agricultural environments produce knowledge gaps. Many aspects must be considered and measured for a region's whole description or examination of the targeted problem. Data from a single type of sensor is not very effective for algorithms, and results are imprecise. However, fusing sensor data is one of the key approaches for crops' quality assessment, damage, and smart planning for their management. The data fusion explores complementarities and synergies of extracting trustworthy and relevant information from data. Exploring the correspondence and interactions between various types of data is the core concept behind data fusion, which aims to derive more trustworthy and applicable information regarding the topics being investigated. Despite some success, several obstacles still limit a more general adoption of this type of strategy. This is especially true for the highly complicated ecosystems that can be found in rural and agricultural settings. In this part of book, we provide a comprehensive review on data fusion to agricultural problems and study of plant disease using different sensor data for smart agriculture. Conclusively, the study contributes on emphasizing the data acquisition scales, data types, and their fusion for decision making in smart agriculture.
Ghulam Mustafa1 and Qurban Ali contributed equally to this chapter.
-
15 Incremental learning of plant diseases and new plant types: moving towards a smart agriculture system
- + Show details - Hide details
-
p.
391
–410
(20)
In machine learning (ML) and deep learning, once a model has been trained and deployed, learning new classes is difficult. In this context, class incremental learning has traditionally been accomplished by retraining an already existing deep neural network (DNN) across newly added classes using either fine tuning techniques, partially freezing the DNN, or by joint training. The drawback of traditional approaches is that either accuracy dramatically declines when adding new classes one at a time or compute power gradually increases. In this work, three conventional and ten continuous ML algorithms have been compared based on online learning techniques for class incremental learning in the plant domain. The basic premise is to initially learn healthy plants leaf data from publicly available Plant Village dataset and subsequently incrementally learn new plants leaf diseases in the first set of experiments. In a separate second series of experiments, the models were trained with plants leaf data from Plant Seedling dataset available in the public domain. Then, the models incrementally learned new plants on the go. The current comparison is motivated by the aforementioned caveats. Task agnostic accuracy and forgetting metrics were utilized to evaluate and compare results of all the algorithms used in the experiments.
Experimental results revealed that incremental ML models may learn new classes of plant diseases and plant types (as classes) incrementally and continually with only an insignificant forgetting, without retraining the model from scratch. These models tend to save the compute resources and training time without any downtime in the current system. Models' performance in terms of overall average accuracy did not degrade even after adding multiple plants-related diseases and new plants. This study highlighted the value of incremental class learning as a significant advancement in the field of agricultural plants that can pave the way for smart agriculture.
-
16 Disaster susceptibility analysis in remote sensing
- + Show details - Hide details
-
p.
411
–435
(25)
Natural disasters such as floods, landslides, and forest fires have caused infrastructure destruction, damage to property, injuries, and casualties worldwide. With the advent of sensing technology and data science methodologies, the impact of a disaster can be lessened through in-depth retrospective analysis. Of these, a priori hazard susceptibility analysis, which includes spatial analysis using remotely sensed images of the terrain, is widely adopted. Susceptibility analysis is thus related to spatial aspects of hazard analysis using data captured using both active and passive sensing. In the case of certain disasters, temporal information plays the role of causality owing to which spatiotemporal aspects are relevant. Historical data of occurrences play a vital role in determining the likelihood of disaster occurrence in a new area, or recurrences in an affected site. Such hazard mapping also helps in predicting the degree of the aftermath of a hazardous process in those areas. Overall, state-of-the-art susceptibility analysis uses remote sensing images, land survey data, and other related geospatial and non-spatial data in performing data preprocessing and analysis to calculate the probability of forthcoming hazard events. Data preprocessing involves noise removal, the transformation of raw data to the desired data structure or computed values, dimensionality reduction, feature ranking, and so on. Data analysis includes statistical, machine learning, and deep learning approaches. In this chapter, the widely used preprocessing and data analysis techniques applied in disaster susceptibility analysis are discussed. Additionally, disaster susceptibility analysis-related case studies, e.g. flood and landslide, are presented to elaborate the data science workflows. The resultant maps of the disaster susceptibility analysis are intended to be used by land developers, urban planners, and related authorities in innovating the land use planning and smarter disaster management.
-
17 Topological assessment of road transportation network
- + Show details - Hide details
-
p.
437
–455
(19)
Land areas in urban agglomerations and metropolitan cities have been increasing worldwide, and cities are witnessing rise in both number and their corresponding populations, with an average annual growth rate of 1.7% in 2021. As a consequence, larger cities are facing significant challenges in road transportation system, urban mobility and traffic flow. Road transportation system is one of the most important subsystems in any city because it ensures better accessibility and connectivity between different geographic spaces and improves the travel demands in cities. However, urban mobility is impacted by the topology of transportation networks, therefore, understanding the topological patterns of the road and street networks is essential for enhancing vehicular transportation performance. In this chapter, we discuss various forms of spatial networks that are practiced in the real-world scenarios, and elucidate on the road transportation network structures and their properties. Several measures used for quantifying the transportation network performance such as connectivity and coverage using graph theory are deliberated.
-
18 Future perspective and research direction in cognitive sensing technologies
- + Show details - Hide details
-
p.
457
–464
(8)
Detailed discussion of cognitive sensing technologies, their fundamentals, review and appropriate applications provide lot of insights as what would be future applications of smart and cognitive sensing. In years to come, the sensing technologies are going to dominate various industries such as driver-less cars, environment monitoring, smart transport, and smart city. In all such applications, unlimited automation, control, and monitoring shall be salient features that are expected to be realized in Metaverse, Web 3.0 and similar technologies using digital twins, digital avatars, etc. This chapter presents future direction of smart and cognitive sensing for various sectors and their sustainable growth through digital transformation and Industry 4.0.
-
Back Matter
- + Show details - Hide details
-
p.
(1)
Related content
