MVS-using-CNN-and-LSTM

Cloud-Assisted Multi-View Video Summarization using CNN and Bi-Directional LSTM

Paper

https://ieeexplore.ieee.org/abstract/document/8765236

The package contains the following three files.

1. FullDatasetFeatures.py

It contains the code to extract features from the overall dataset.

2. LSTM.py

It contains code to train the extracted features using Bi-directional LSTM. Splitting the code into train, test and validation is already included in this code.

3. OneFileOnlineTest.py

This is to test one video file on the trained model and write its output video.

Notice

We are really sorry to have the raw code, but to ensure the availability of an easy and understandable code we need some time. Feel free to contact me at tanveerkhattak3797@gmail.com if you have any queries or you will be okay with raw format code. Thanks

Demo Results

Dummy link:

https://www.youtube.com/watch?v=aHvTtb8MbnQ

Citation

T. Hussain, K. Muhammad, A. Ullah, Z. Cao, S. W. Baik and V. H. C. de Albuquerque, "Cloud-Assisted Multi-View Video Summarization using CNN and Bi-Directional LSTM," in IEEE Transactions on Industrial Informatics.
doi: 10.1109/TII.2019.2929228

If you are interested in Video Summarization domain you may find some of my other recent papers worthy to read:

K. Muhammad, T. Hussain, and S. W. Baik, "Efficient CNN based summarization of surveillance videos for resource-constrained devices," Pattern Recognition Letters, 2018/08/07/ 2018

Hussain, T., Muhammad, K., Del Ser, J., Baik, S. W., & de Albuquerque, V. H. C. (2019). Intelligent Embedded Vision for Summarization of Multi-View Videos in IIoT. IEEE Transactions on Industrial Informatics.

K. Muhammad, T. Hussain, M. Tanveer, G. Sannino and V. H. C. de Albuquerque, "Cost-Effective Video Summarization using Deep CNN with Hierarchical Weighted Fusion for IoT Surveillance Networks," in IEEE Internet of Things Journal.
doi: 10.1109/JIOT.2019.2950469

K. Muhammad, H. Tanveer, J. Del Ser, V. Palade and V. H. C. De Albuquerque, "DeepReS: A Deep Learning-based Video Summarization Strategy for Resource-Constrained Industrial Surveillance Scenarios," in IEEE Transactions on Industrial Informatics.
doi: 10.1109/TII.2019.2960536
keywords: {Big Data;Computer Vision;Deep Learning;Video Summarization;IIoT;Resource-Constrained Devices},
URL: http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=8936419&isnumber=4389054