Colorizing tags in tag cloud: A novel query-by-tag music search system
Journal
MM'11 - Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops
Pages
293-302
Date Issued
2011
Author(s)
Abstract
This paper presents a novel content-based query-by-tag music search system for an untagged music database. We design a new tag query interface that allows users to input multiple tags with multiple levels of preference (denoted as an MTML query) by colorizing desired tags in a web-based tag cloud interface. When a user clicks and holds the left mouse button (or presses and holds his/her finger on a touch screen) on a desired tag, the color of the tag will change cyclically according to a color map (from dark blue to bright red), which represents the level of preference (from 0 to 1). In this way, the user can easily organize and check the query of multiple tags with multiple levels of preference through the colored tags. To effect the MTML content-based music retrieval, we introduce a probabilistic fusion model (denoted as GMFM), which consists of two mixture models, namely a Gaussian mixture model and a multinomial mixture model. GMFM can jointly model the auditory features and tag labels of a song. Two indexing methods and their corresponding matching methods, namely pseudo song-based matching and tag affinity-based matching, are incorporated into the pre-learned GMFM. We evaluate the proposed system on the MajorMiner and CAL-500 datasets. The experimental results demonstrate the effectiveness of GMFM and the potential of using MTML queries to search music from an untagged music database. © 2011 ACM.
Subjects
Contentbased music information retrieval; MTML query; Probabilistic fusion model; Tag cloud-based music query interface
SDGs
Other Subjects
Auditory feature; Color map; Content-based; Content-based music retrieval; Data sets; Fusion model; Gaussian Mixture Model; Indexing methods; Matching methods; Mixture model; MTML query; Multinomial mixture models; Multiple levels; Music database; Music information retrieval; Probabilistic fusion model; Query interfaces; Search system; TO effect; Touch screen; Data processing; Information retrieval; Query languages; Safety devices; Search engines
Type
conference paper