Electrical and Electronic Engineering - Research Publications

Permanent URI for this collection

Search Results

Now showing 1 - 10 of 16
  • Item
    Thumbnail Image
    An efficient deep neural model for detecting crowd anomalies in videos
    Yang, M ; Tian, S ; Rao, AS ; Rajasegarar, S ; Palaniswami, M ; Zhou, Z (Springer, 2023-06-01)
    Identifying unusual crowd events is highly challenging, laborious, and prone to errors in video surveillance applications. We propose a novel end-to-end deep learning architecture called Stacked Denoising Auto-Encoder (DeepSDAE) to address these challenges, comprising SDAE, VGG16 and Plane-based one-class Support Vector Machine (SVM), abbreviated as PSVM, to detect anomalies such as stationary people in an active scene or loitering activities in a crowded scene. The DeepSDAE framework is a hybrid deep learning architecture. It consists of a four-layered SDAE and an enhanced convolutional neural network (CNN) model. Our framework employs Reinforcement Learning to optimise the learning parameters to detect crowd anomalies. We use the Markov Decision Process (MDP) with Deep Q-learning to find the optimal Q value. We also present a late fusion procedure to combine individual decisions from the intermediate and final layers of the SDAE and VGG16 networks to detect different anomalies. Our experiments on four real-world datasets reveal the superior performance of our proposed framework in detecting (frame-level and pixel-level) anomalies.
  • Item
    Thumbnail Image
    Network Resource Allocation for Industry 4.0 with Delay and Safety Constraints
    Sardar, AA ; Rao, AS ; Alpcan, T ; Das, G ; Palaniswami, M (Institute of Electrical and Electronics Engineers, 2023)
    In this paper, we model a futuristic factory floor equipped with Automated Guided Vehicles (AGVs), cameras, and a Virtual Reality (VR) surveillance system; and connected to a 5G network for communication purposes. Motion planning of AGVs and VR applications is offloaded to an edge server for computational flexibility and reduced hardware on the factory floor. Decisions on the edge server are made using the video feed provided by the cameras in a controlled manner. Our objectives are to ensure factory floor safety and provide smooth VR experience in the surveillance room. Providing proper and timely allocation of network resources is of utmost importance to maintain the end-to-end delay necessary to achieve these objectives. We provide a statistical analysis to estimate the bandwidth required by a factory to satisfy the delay requirements 99.999 percent of the time. We formulate a nonconvex integer nonlinear problem aiming to minimize the safety and delay violations. To solve it, we propose a real-time network resource allocation algorithm that has linear time complexity in terms of the number of components connected to the wireless network. Our algorithm significantly outperforms existing solvers (genetic algorithm, surrogate optimizer) and meets the objectives using less bandwidth compared to existing methods.
  • Item
    Thumbnail Image
    Real-time monitoring of construction sites: Sensors, methods, and applications
    Rao, AS ; Radanovic, M ; Liu, Y ; Hu, S ; Fang, Y ; Khoshelham, K ; Palaniswami, M ; Tuan, N (ELSEVIER, 2022-04)
    The construction industry is one of the world's largest industries, with an annual budget of $10 trillion globally. Despite its size, the efficiency and growth in labour productivity in the construction industry have been relatively low compared to other sectors, such as manufacturing and agriculture. To this extent, many studies have recognised the role of automation in improving the efficiency and safety of construction projects. In particular, automated monitoring of construction sites is a significant research challenge. This paper provides a comprehensive review of recent research on the real-time monitoring of construction projects. The review focuses on sensor technologies and methodologies for real-time mapping, scene understanding, positioning, and tracking of construction activities in indoor and outdoor environments. The review also covers various case studies of applying these technologies and methodologies for real-time hazard identification, monitoring workers’ behaviour, workers’ health, and monitoring static and dynamic construction environments.
  • Item
    Thumbnail Image
    Achieving AI-Enabled Robust End-to-End Quality of Experience Over Backhaul Radio Access Networks
    Roy, D ; Rao, AS ; Alpcan, T ; Das, G ; Palaniswami, M (IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 2022-09)
    Emerging applications such as Augmented Reality, the Internet of Vehicles and Remote Surgery require both computing and networking functions working in harmony. The End-to-end (E2E) quality of experience (QoE) for these applications depends on the synchronous allocation of networking and computing resources. However, the relationship between the resources and the E2E QoE outcomes is typically stochastic and non-linear. In order to make efficient resource allocation decisions, it is essential to model these relationships. This article presents a novel machine-learning based approach to learn these relationships and concurrently orchestrate both resources for this purpose. The machine learning models further help make robust allocation decisions regarding stochastic variations and simplify robust optimization to a conventional constrained optimization. When resources are insufficient to accommodate all application requirements, our framework supports executing some of the applications with minimal degradation (graceful degradation) of E2E QoE. We also show how we can implement the learning and optimization methods in a distributed fashion by the Software-Defined Network (SDN) and Kubernetes technologies. Our results show that deep learning-based modelling achieves E2E QoE with approximately 99.8% accuracy, and our robust joint-optimization technique allocates resources efficiently when compared to existing differential services alternatives.
  • Item
    Thumbnail Image
    Achieving QoS for bursty uRLLC applications over passive optical networks
    Roy, D ; Rao, AS ; Alpcan, T ; Das, G ; Palaniswami, M (Optica Publishing Group, 2022-05)
    Emerging real-time applications such as those classified under ultra-reliable low latency (uRLLC) generate bursty traffic and have strict quality of service (QoS) requirements. The passive optical network (PON) is a popular access network technology, which is envisioned to handle such applications at the access segment of the network. However, the existing standards cannot handle strict QoS constraints for such applications. The available solutions rely on instantaneous heuristic decisions and maintain QoS constraints (mostly bandwidth) in an average sense. Existing proposals in generic networks with optimal strategies are computationally complex and are, therefore, not suitable for uRLLC applications. This paper presents a novel computationally efficient, far-sighted bandwidth allocation policy design for facilitating bursty uRLLC traffic in a PON framework while satisfying strict QoS (age of information/delay and bandwidth) requirements. To this purpose, first we design a delay-tracking mechanism, which allows us to model the resource allocation problem from a control-theoretic viewpoint as a model predictive control (MPC) problem. MPC helps in making far-sighted decisions regarding resource allocations and captures the time-varying dynamics of the network. We provide computationally efficient polynomial time solutions and show their implementation in the PON framework. Compared to existing approaches, MPC can improve delay violations by 15% and 45% at loads of 0.8 and 0.9, respectively, for delay-constrained applications of 1 ms and 4 ms. Our approach is also robust to varying traffic arrivals.
  • Item
    Thumbnail Image
    Automatic Detection and Classification of Convulsive Psychogenic Nonepileptic Seizures Using a Wearable Device
    Gubbi, J ; Kusmakar, S ; Rao, AS ; Yan, B ; O'Brien, T ; Palaniswami, M (IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 2016-07)
    Epilepsy is one of the most common neurological disorders and patients suffer from unprovoked seizures. In contrast, psychogenic nonepileptic seizures (PNES) are another class of seizures that are involuntary events not caused by abnormal electrical discharges but are a manifestation of psychological distress. The similarity of these two types of seizures poses diagnostic challenges that often leads in delayed diagnosis of PNES. Further, the diagnosis of PNES involves high-cost hospital admission and monitoring using video-electroencephalogram machines. A wearable device that can monitor the patient in natural setting is a desired solution for diagnosis of convulsive PNES. A wearable device with an accelerometer sensor is proposed as a new solution in the detection and diagnosis of PNES. The seizure detection algorithm and PNES classification algorithm are developed. The developed algorithms are tested on data collected from convulsive epileptic patients. A very high seizure detection rate is achieved with 100% sensitivity and few false alarms. A leave-one-out error of 6.67% is achieved in PNES classification, demonstrating the usefulness of wearable device in the diagnosis of PNES.
  • Item
    Thumbnail Image
    Crowd Event Detection on Optical Flow Manifolds
    Rao, AS ; Gubbi, J ; Marusic, S ; Palaniswami, M (IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 2016-07)
    Analyzing crowd events in a video is key to understanding the behavioral characteristics of people (humans). Detecting crowd events in videos is challenging because of articulated human movements and occlusions. The aim of this paper is to detect the events in a probabilistic framework for automatically interpreting the visual crowd behavior. In this paper, crowd event detection and classification in optical flow manifolds (OFMs) are addressed. A new algorithm to detect walking and running events has been proposed, which uses optical flow vector lengths in OFMs. Furthermore, a new algorithm to detect merging and splitting events has been proposed, which uses Riemannian connections in the optical flow bundle (OFB). The longest vector from the OFB provides a key feature for distinguishing walking and running events. Using a Riemannian connection, the optical flow vectors are parallel transported to localize the crowd groups. The geodesic lengths among the groups provide a criterion for merging and splitting events. Dispersion and evacuation events are jointly modeled from the walking/running and merging/splitting events. Our results show that the proposed approach delivers a comparable model to detect crowd events. Using the performance evaluation of tracking and surveillance 2009 dataset, the proposed method is shown to produce the best results in merging, splitting, and dispersion events, and comparable results in walking, running, and evacuation events when compared with other methods.
  • Item
    Thumbnail Image
    Real-Time Urban Microclimate Analysis Using Internet of Things
    Rathore, P ; Rao, AS ; Rajasegarar, S ; Vanz, E ; Gubbi, J ; Palaniswami, M (IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 2018-04)
    Real-time environment monitoring and analysis is an important research area of Internet of Things (IoT). Understanding the behavior of the complex ecosystem requires analysis of detailed observations of an environment over a range of different conditions. One such example in urban areas includes the study of tree canopy cover over the microclimate environment using heterogeneous sensor data. There are several challenges that need to be addressed, such as obtaining reliable and detailed observations over monitoring area, detecting unusual events from data, and visualizing events in real-time in a way that is easily understandable by the end users (e.g., city councils). In this regard, we propose an integrated geovisualization framework, built for real-time wireless sensor network data on the synergy of computational intelligence and visual methods, to analyze complex patterns of urban microclimate. A Bayesian maximum entropy-based method and a hyperellipsoidal model-based algorithm have been build in our integrated framework to address above challenges. The proposed integrated framework was verified using the dataset from an indoor and two outdoor network of IoT devices deployed at two strategically selected locations in Melbourne, Australia. The data from these deployments are used for evaluation and demonstration of these components' functionality along with the designed interactive visualization components.
  • Item
    Thumbnail Image
    Real-time Monitoring of the Great Barrier Reef Using Internet of Things with Big Data Analytics
    Palaniswami, M ; Sridhara Rao, A ; Bainbridge, S (International Telecommunication Union, 2017)
    The Great Barrier Reef (GBR) of Australia is the largest size of coral reef system on the planet stretching over 2300 kilometers. Coral reefs are experiencing a range of stresses including climate change, which has resulted in episodes of coral bleaching and ocean acidification where increased levels of carbon dioxide from the burning of fossil fuels are reducing the calcification mechanism of corals. In this article, we present a successful application of big data analytics with Internet of Things (IoT)/wireless sensor networks (WSNs) technology to monitor complex marine environments of the GBR. The paper presents a two-tiered IoT/WSN network architecture used to monitor the GBR and the role of artificial intelligence (AI) algorithms with big data analytics to detect events of interest. The case study presents the deployment of a WSN at Heron Island in the southern GBR in 2009. It is shown that we are able to detect Cyclone Hamish patterns as an anomaly using the sensor time series of temperature, pressure and humidity data. The article also gives a perspective of AI algorithms from the viewpoint to monitor, manage and understand complex marine ecosystems. The knowledge obtained from the large-scale implementation of IoT with big data analytics will continue to act as a feedback mechanism for managing a complex system of systems (SoS) in our marine ecosystem.
  • Item
    Thumbnail Image
    The Role of Visual Assessment of Clusters for Big Data Analysis: From Real-World Internet of Things
    Palaniswami, M ; Rao, AS ; Kumar, D ; Rathore, P ; Rajasegarar, S (Institute of Electrical and Electronics Engineers (IEEE), 2020-10)
    The Internet of Things (IoT) is playing a vital role in shaping today?s technological world, including our daily lives. By 2025, the number of connected devices due to the IoT is estimated to surpass a whopping 75 billion. It is a challenging task to discover, integrate, and interpret processed big data from such ubiquitously available heterogeneous and actively natural resources and devices. Cluster analysis of IoT-generated big data is essential for the meaningful interpretation of such complex data. However, we often have very limited knowledge of the number of clusters actually present in the given data. The problem of finding whether clusters are present even before applying clustering algorithms is termed the assessment of clustering tendency. In this article, we present a set of useful visual assessment of cluster tendency (VAT) tools and techniques developed with major contributions from James C. Bezdek. The article further highlights how these techniques are advancing the IoT through large-scale IoT implementations.