Show simple item record

dc.contributor.advisorTapamo, Jules-Raymond.
dc.creatorToudjeu, Tchangou Ignance.
dc.date.accessioned2021-01-27T13:19:52Z
dc.date.available2021-01-27T13:19:52Z
dc.date.created2020
dc.date.issued2020
dc.identifier.urihttps://researchspace.ukzn.ac.za/handle/10413/19089
dc.descriptionDoctoral Degrees. University of KwaZulu-Natal, Durban.en_US
dc.description.abstractIn this thesis we holistically investigate the interpretation of human actions in both still images and videos. Human action recognition is currently a research problem of great interest both in academia and industry due to its potential applications which include security surveillances, sports annotation, human-computer interaction, and robotics. Action recognition, being a process of labelling actions using sensory observations, can be defined as a sequence of movements engendered by a human during an executed task. Such a process, when considering visual observations, is quite challenging and faces issues such as background clutter, shadows, illumination variations, occlusions, changes in scale, changes in the person performing the action, and viewpoint variations. Although many approaches to development of human action recognition systems have been proposed in the literature, they focused more on recognition accuracy while ignoring the computational complexity accompanying the recognition process. However, a human action recognition system which is both effective and efficient and can be operated real-time is needed. Firstly, we review, evaluate and compare the most prominent state-of-the-art feature extraction representations categorized between handcrafted feature based techniques and deep learning feature based techniques. Secondly, we propose holistic approaches in each of the categories. The first holistic approach takes advantage of existing slope patterns in the motion history images, which are a simple two dimensional representation of video, and reduces the running time of action recognition. The second one based on circular derivative local binary patterns outperforms the LBP based state-of-the-art techniques and addresses the issues of dimensionality by producing feature descriptor with minimal dimension size with less compromise on the recognition accuracy. The third one introduces a preprocessing step in a proposed 2D-convolutional neural network to deal with the same issue of dimensionality differently in the deep learning techniques. Here the temporal dimension is embedded into motion history images before being learned by a two dimensional convolutional neural network. Thirdly, three datasets (JAFFE, KTH and Pedestrian Action dataset) were used to validate the proposed human action recognition models. Finally, we show that better performance in comparison to the state-of-the-art methods can be achieved using holistic feature based techniques.en_US
dc.language.isoenen_US
dc.subject.otherHuman action recognition.en_US
dc.subject.otherFacial expression recognition.en_US
dc.subject.otherRobotics.en_US
dc.subject.otherComputer vision.en_US
dc.titleContributions into holistic human action recognition.en_US
dc.typeThesisen_US
dc.description.notesAuthor's Keywords : Human Action Recognition; Motion History Image; Circular Derivative Local BinaryPattern; Convolutional Neural Network; Facial Expression Recognition; Spatio-Temporal features.en_US


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record