https://scholars.lib.ntu.edu.tw/handle/123456789/581416
標題: | Query-driven multi-instance learning | 作者: | Hsu Y.-C Hong C.-Y Lee M.-S Liu T.-L. MING-SUI LEE |
關鍵字: | Artificial intelligence; Classification (of information); Iterative methods; Action classifications; Binary labels; Compatibility measures; Multi-instance learning; Multi-instance multi-label learning; Query-driven approach; Querying process; Weighted Sum; Query processing | 公開日期: | 2020 | 起(迄)頁: | 4158-4165 | 來源出版物: | AAAI 2020 - 34th AAAI Conference on Artificial Intelligence | 摘要: | We introduce a query-driven approach (qMIL) to multiinstance learning where the queries aim to uncover the class labels embodied in a given bag of instances. Specifically, it solves a multi-instance multi-label learning (MIML) problem with a more challenging setting than the conventional one. Each MIML bag in our formulation is annotated only with a binary label indicating whether the bag contains the instance of a certain class and the query is specified by the word2vec of a class label/name. To learn a deep-net model for qMIL, we construct a network component that achieves a generalized compatibility measure for query-visual co-embedding and yields proper instance attentions to the given query. The bag representation is then formed as the attention-weighted sum of the instances' weights, and passed to the classification layer at the end of the network. In addition, the qMIL formulation is flexible for extending the network to classify unseen class labels, leading to a new technique to solve the zero-shot MIML task through an iterative querying process. Experimental results on action classification over video clips and three MIML datasets from MNIST, CIFAR10 and Scene are provided to demonstrate the effectiveness of our method. ? 2020, Association for the Advancement of Artificial Intelligence. |
URI: | https://www.scopus.com/inward/record.uri?eid=2-s2.0-85098397130&partnerID=40&md5=5120a16ef6ec02bdea3d547bd2afae67 https://scholars.lib.ntu.edu.tw/handle/123456789/581416 |
顯示於: | 資訊工程學系 |
在 IR 系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。