Multimodal Learning toward Micro-Video Understanding

Multimodal Learning toward Micro-Video Understanding
Author :
Publisher : Springer Nature
Total Pages : 170
Release :
ISBN-10 : 9783031022555
ISBN-13 : 3031022556
Rating : 4/5 (55 Downloads)

Book Synopsis Multimodal Learning toward Micro-Video Understanding by : Liqiang Nie

Download or read book Multimodal Learning toward Micro-Video Understanding written by Liqiang Nie and published by Springer Nature. This book was released on 2022-05-31 with total page 170 pages. Available in PDF, EPUB and Kindle. Book excerpt: Micro-videos, a new form of user-generated contents, have been spreading widely across various social platforms, such as Vine, Kuaishou, and Tik Tok. Different from traditional long videos, micro-videos are usually recorded by smart mobile devices at any place within a few seconds. Due to its brevity and low bandwidth cost, micro-videos are gaining increasing user enthusiasm. The blossoming of micro-videos opens the door to the possibility of many promising applications, ranging from network content caching to online advertising. Thus, it is highly desirable to develop an effective scheme for the high-order micro-video understanding. Micro-video understanding is, however, non-trivial due to the following challenges: (1) how to represent micro-videos that only convey one or few high-level themes or concepts; (2) how to utilize the hierarchical structure of the venue categories to guide the micro-video analysis; (3) how to alleviate the influence of low-quality caused by complex surrounding environments and the camera shake; (4) how to model the multimodal sequential data, {i.e.}, textual, acoustic, visual, and social modalities, to enhance the micro-video understanding; and (5) how to construct large-scale benchmark datasets for the analysis? These challenges have been largely unexplored to date. In this book, we focus on addressing the challenges presented above by proposing some state-of-the-art multimodal learning theories. To demonstrate the effectiveness of these models, we apply them to three practical tasks of micro-video understanding: popularity prediction, venue category estimation, and micro-video routing. Particularly, we first build three large-scale real-world micro-video datasets for these practical tasks. We then present a multimodal transductive learning framework for micro-video popularity prediction. Furthermore, we introduce several multimodal cooperative learning approaches and a multimodal transfer learning scheme for micro-video venue category estimation. Meanwhile, we develop a multimodal sequential learning approach for micro-video recommendation. Finally, we conclude the book and figure out the future research directions in multimodal learning toward micro-video understanding.


Multimodal Learning toward Micro-Video Understanding Related Books

Multimodal Learning toward Micro-Video Understanding
Language: en
Pages: 170
Authors: Liqiang Nie
Categories: Technology & Engineering
Type: BOOK - Published: 2022-05-31 - Publisher: Springer Nature

DOWNLOAD EBOOK

Micro-videos, a new form of user-generated contents, have been spreading widely across various social platforms, such as Vine, Kuaishou, and Tik Tok. Different
Image Fusion in Remote Sensing
Language: en
Pages: 89
Authors: Arian Azarang
Categories: Technology & Engineering
Type: BOOK - Published: 2022-05-31 - Publisher: Springer Nature

DOWNLOAD EBOOK

Image fusion in remote sensing or pansharpening involves fusing spatial (panchromatic) and spectral (multispectral) images that are captured by different sensor
ECAI 2023
Language: en
Pages: 3328
Authors: K. Gal
Categories: Computers
Type: BOOK - Published: 2023-10-18 - Publisher: IOS Press

DOWNLOAD EBOOK

Artificial intelligence, or AI, now affects the day-to-day life of almost everyone on the planet, and continues to be a perennial hot topic in the news. This bo
Graph Learning for Fashion Compatibility Modeling
Language: en
Pages: 120
Authors: Weili Guan
Categories: Computers
Type: BOOK - Published: 2022-11-02 - Publisher: Springer Nature

DOWNLOAD EBOOK

This book sheds light on state-of-the-art theories for more challenging outfit compatibility modeling scenarios. In particular, this book presents several cutti
Pattern Recognition and Computer Vision
Language: en
Pages: 842
Authors: Shiqi Yu
Categories: Computers
Type: BOOK - Published: 2022-10-27 - Publisher: Springer Nature

DOWNLOAD EBOOK

The 4-volume set LNCS 13534, 13535, 13536 and 13537 constitutes the refereed proceedings of the 5th Chinese Conference on Pattern Recognition and Computer Visio