首页 > 最新文献
paperpass

Proceedings of the 19th ACM international conference on Multimedia最新文献

英文 中文
Scenic photo quality assessment with bag of aesthetics-preserving features 景观照片质量评估,具有美学保护功能
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2071977
Hsiao-Hang Su, Tse-Wei Chen, Chieh-Chi Kao, Winston H. Hsu, Shao-Yi Chien
In this paper, an aesthetic modeling method for scenic photographs is proposed. A bottom-up approach is developed to construct an aesthetic library with bag-of-aesthetics preserving features instead of top-down methods that implement the heuristic guidelines (rule-specific features) listed in the photography literature, which is employed in previous works. The proposed method can cover both implicit and explicit aesthetic features with a learning process. The experimental results show that the proposed features in the library (92.06% in accuracy) outperform the state-of-the-art rule-specific features (83.63% in accuracy) significantly in the aesthetic quality assessment for scenic photos, and the rule-specific features are also proved to be encompassed by the proposed features. Meanwhile, it is observed from experiments that the features extracted for contrast information are more effective than those for absolute information, which is consistent with the properties of human visual systems.
本文提出了一种风景摄影的美学建模方法。本文提出了一种自下而上的方法来构建具有美学袋保留特征的美学库,而不是像以前的作品那样采用自上而下的方法来实现摄影文献中列出的启发式指南(规则特定特征)。该方法可以在学习过程中涵盖内隐和外显的美学特征。实验结果表明,本文提出的特征库(准确率为92.06%)在风景照片的审美质量评价中显著优于目前最先进的规则特定特征(准确率为83.63%),并且规则特定特征也被本文提出的特征所包含。同时,从实验中观察到,对比信息提取的特征比绝对信息提取的特征更有效,这与人类视觉系统的特性是一致的。
{"title":"Scenic photo quality assessment with bag of aesthetics-preserving features","authors":"Hsiao-Hang Su, Tse-Wei Chen, Chieh-Chi Kao, Winston H. Hsu, Shao-Yi Chien","doi":"10.1145/2072298.2071977","DOIUrl":"https://doi.org/10.1145/2072298.2071977","url":null,"abstract":"In this paper, an aesthetic modeling method for scenic photographs is proposed. A bottom-up approach is developed to construct an aesthetic library with bag-of-aesthetics preserving features instead of top-down methods that implement the heuristic guidelines (rule-specific features) listed in the photography literature, which is employed in previous works. The proposed method can cover both implicit and explicit aesthetic features with a learning process. The experimental results show that the proposed features in the library (92.06% in accuracy) outperform the state-of-the-art rule-specific features (83.63% in accuracy) significantly in the aesthetic quality assessment for scenic photos, and the rule-specific features are also proved to be encompassed by the proposed features. Meanwhile, it is observed from experiments that the features extracted for contrast information are more effective than those for absolute information, which is consistent with the properties of human visual systems.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133522213","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 78
Bilinear deep learning for image classification 用于图像分类的双线性深度学习
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072505
S. Zhong, Y. Liu, Yang Liu
{"title":"Bilinear deep learning for image classification","authors":"S. Zhong, Y. Liu, Yang Liu","doi":"10.1145/2072298.2072505","DOIUrl":"https://doi.org/10.1145/2072298.2072505","url":null,"abstract":"","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"28 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131704598","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Automatic concept-to-query mapping for web-based concept detector training 用于基于web的概念检测器训练的自动概念到查询映射
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072038
Damian Borth, A. Ulges, T. Breuel
Nowadays, online platforms like YouTube provide massive content for training of visual concept detectors. However, it remains a difficult challenge to retrieve the right training content from such platforms since the underlying query construction can be arbitrarily complex. In this paper we present an approach, which offers an automatic concept-to-query mapping for training data acquisition from such platforms. Queries are automatically constructed by a keyword selection and a category assignment using ImageNet and Google Sets as external sources. Our results demonstrate that the proposed method is able to reach retrieval results comparable to queries constructed by humans providing 76% more relevant content for detector training than a one-to-one mapping of concept names to retrieval queries would do.
如今,像YouTube这样的在线平台为视觉概念检测器的训练提供了大量的内容。然而,从这些平台检索正确的训练内容仍然是一个困难的挑战,因为底层的查询结构可能非常复杂。在本文中,我们提出了一种方法,该方法为从这些平台获取训练数据提供了一个自动的概念到查询映射。使用ImageNet和Google Sets作为外部源,通过关键字选择和类别分配自动构建查询。我们的结果表明,所提出的方法能够达到与人类构造的查询相当的检索结果,为检测器训练提供的相关内容比概念名称到检索查询的一对一映射多76%。
{"title":"Automatic concept-to-query mapping for web-based concept detector training","authors":"Damian Borth, A. Ulges, T. Breuel","doi":"10.1145/2072298.2072038","DOIUrl":"https://doi.org/10.1145/2072298.2072038","url":null,"abstract":"Nowadays, online platforms like YouTube provide massive content for training of visual concept detectors. However, it remains a difficult challenge to retrieve the right training content from such platforms since the underlying query construction can be arbitrarily complex. In this paper we present an approach, which offers an automatic concept-to-query mapping for training data acquisition from such platforms. Queries are automatically constructed by a keyword selection and a category assignment using ImageNet and Google Sets as external sources. Our results demonstrate that the proposed method is able to reach retrieval results comparable to queries constructed by humans providing 76% more relevant content for detector training than a one-to-one mapping of concept names to retrieval queries would do.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"28 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122522547","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Unsupervised fast anomaly detection in crowds 人群中无监督快速异常检测
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072042
Xiaoshuai Sun, H. Yao, R. Ji, Xianming Liu, Pengfei Xu
In this paper, we proposed a fast and robust unsupervised framework for anomaly detection and localization in crowed scenes. Our method avoids modeling the normal state of the crowds which is a very complex task due to the large within class variance of the normal target appearance and motion patterns. For each video frame, we extract the spatial temporal features of 3D blocks and generate the saliency map using a block-based center-surround difference operator. Then, motion vector matrix is obtained by adaptive rood pattern search block-matching algorithm and distance normalization. Attractive motion disorder descriptor is proposed to measure the global intensity of anomalies in the scene. Finally, we classify the frames into normal and anomalous ones by a binary classifier. In the experiments, we compared our method against several state-of-the-art approaches on UCSD dataset which is a widely used anomaly detection and localization benchmark. As the only unsupervised approach, our method outputs competitive results with near real-time processing speed
本文提出了一种快速鲁棒的无监督框架,用于拥挤场景下的异常检测和定位。我们的方法避免了对人群的正常状态建模,这是一项非常复杂的任务,因为正常目标的外观和运动模式的类内方差很大。对于每个视频帧,我们提取3D块的时空特征,并使用基于块的中心-环绕差分算子生成显著性图。然后,采用自适应道路模式搜索分块匹配算法和距离归一化得到运动向量矩阵;提出了吸引运动障碍描述符,用于测量场景中异常的整体强度。最后,利用二值分类器将图像分为正常帧和异常帧。在实验中,我们将该方法与UCSD数据集上的几种最新方法进行了比较,UCSD数据集是广泛使用的异常检测和定位基准。作为唯一的无监督方法,我们的方法以接近实时的处理速度输出竞争结果
{"title":"Unsupervised fast anomaly detection in crowds","authors":"Xiaoshuai Sun, H. Yao, R. Ji, Xianming Liu, Pengfei Xu","doi":"10.1145/2072298.2072042","DOIUrl":"https://doi.org/10.1145/2072298.2072042","url":null,"abstract":"In this paper, we proposed a fast and robust unsupervised framework for anomaly detection and localization in crowed scenes. Our method avoids modeling the normal state of the crowds which is a very complex task due to the large within class variance of the normal target appearance and motion patterns. For each video frame, we extract the spatial temporal features of 3D blocks and generate the saliency map using a block-based center-surround difference operator. Then, motion vector matrix is obtained by adaptive rood pattern search block-matching algorithm and distance normalization. Attractive motion disorder descriptor is proposed to measure the global intensity of anomalies in the scene. Finally, we classify the frames into normal and anomalous ones by a binary classifier. In the experiments, we compared our method against several state-of-the-art approaches on UCSD dataset which is a widely used anomaly detection and localization benchmark. As the only unsupervised approach, our method outputs competitive results with near real-time processing speed","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"47 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115955000","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 20
3D object retrieval with semantic attributes 基于语义属性的三维对象检索
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072442
Boqing Gong, Jianzhuang Liu, Xiaogang Wang, Xiaoou Tang
Humans are capable of describing objects using attributes, such as "the object looks circular and is man-made". Motivated by these high-level descriptions, we build a user-friendly 3D object retrieval system, where the user can browse the database and search for targeted objects using semantic attributes. The main advantage of our system is that it does not require the user to find or sketch a 3D object as the query for 3D object retrieval. Besides, to the best of our knowledge, our system has obtained the best retrieval performance on three popular benchmarks.
人类能够使用属性来描述物体,比如“这个物体看起来是圆形的,是人造的”。在这些高级描述的激励下,我们构建了一个用户友好的3D对象检索系统,用户可以浏览数据库并使用语义属性搜索目标对象。我们的系统的主要优点是它不需要用户查找或绘制3D对象作为3D对象检索的查询。此外,据我们所知,我们的系统在三个流行的基准测试中获得了最佳的检索性能。
{"title":"3D object retrieval with semantic attributes","authors":"Boqing Gong, Jianzhuang Liu, Xiaogang Wang, Xiaoou Tang","doi":"10.1145/2072298.2072442","DOIUrl":"https://doi.org/10.1145/2072298.2072442","url":null,"abstract":"Humans are capable of describing objects using attributes, such as \"the object looks circular and is man-made\". Motivated by these high-level descriptions, we build a user-friendly 3D object retrieval system, where the user can browse the database and search for targeted objects using semantic attributes. The main advantage of our system is that it does not require the user to find or sketch a 3D object as the query for 3D object retrieval. Besides, to the best of our knowledge, our system has obtained the best retrieval performance on three popular benchmarks.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115994924","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Snap & play: auto-generate personalized find-the-difference mobile game Snap & play:自动生成个性化的finthe -difference手机游戏
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2071921
Si Liu, Qiang Chen, Jian Dong, Shuicheng Yan, Changsheng Xu, Hanqing Lu
According to the year 2010 report of the Entertainment Software Association [5], 42% of USA heads of households reported playing games on mobile devices, rising quickly from the 20% in 2002 and bringing huge market for mobile games. In this paper, by taking the popular game, Find-the-Difference (FiDi), as a concrete example, we explore new mobile game design principles and techniques for enhancing player's gaming experience in personalized, automatic, and dynamic aspects. Unlike traditional FiDi game, where image pairs (source image vs. target image) with M different patches are manually produced by game developer and players may feel boring or cheat after practicing all image pairs, our proposed Personalized FiDi (P-FiDi) mobile game may be played under a new Snap & Play mode. The player may first take photos with one s mobile device (or select from one's own albums). Then, these photos serve as source images, and the P-FiDi system automatically generates the counterpart target images by sequential operations of aesthetic image quality enhancement, image patch and differentiating style joint selection, music adaptation, dynamic difficulty level determination, and ultimate automatic image editing with a rich set of popular differentiating styles used in traditional FiDi game. Finally, the player enjoys the unique gaming with one's own (instant) photos and music, and the freedom to have new gaming image pairs any time. The user studies show that the P-FiDi mobile game is satisfying in terms of player experience.
根据美国娱乐软件协会2010年的报告,42%的美国家庭表示在移动设备上玩游戏,这一比例从2002年的20%迅速上升,为移动游戏带来了巨大的市场。本文以时下流行的手机游戏FiDi为例,从个性化、自动化、动态性三个方面探索手机游戏设计的新原则和新技术,以提升玩家的游戏体验。传统的FiDi游戏中,有M个不同补丁的图像对(源图像与目标图像)是由游戏开发者手工制作的,玩家在练习完所有图像对后可能会感到无聊或作弊,而我们提出的个性化FiDi (P-FiDi)手机游戏可能会在一种新的Snap & Play模式下进行。玩家可以先用自己的移动设备(或从自己的相册中选择)拍照。然后将这些照片作为源图像,P-FiDi系统利用传统FiDi游戏中丰富的流行区分风格,通过美学图像质量增强、图像补丁和区分风格联合选择、音乐适配、动态难度等级确定、最终自动编辑等顺序操作,自动生成对应的目标图像。最后,玩家享受独特的游戏与自己的(即时)照片和音乐,并自由地拥有新的游戏图像对任何时间。用户研究表明,P-FiDi手机游戏在玩家体验方面是令人满意的。
{"title":"Snap & play: auto-generate personalized find-the-difference mobile game","authors":"Si Liu, Qiang Chen, Jian Dong, Shuicheng Yan, Changsheng Xu, Hanqing Lu","doi":"10.1145/2072298.2071921","DOIUrl":"https://doi.org/10.1145/2072298.2071921","url":null,"abstract":"According to the year 2010 report of the Entertainment Software Association [5], 42% of USA heads of households reported playing games on mobile devices, rising quickly from the 20% in 2002 and bringing huge market for mobile games. In this paper, by taking the popular game, Find-the-Difference (FiDi), as a concrete example, we explore new mobile game design principles and techniques for enhancing player's gaming experience in personalized, automatic, and dynamic aspects. Unlike traditional FiDi game, where image pairs (source image vs. target image) with M different patches are manually produced by game developer and players may feel boring or cheat after practicing all image pairs, our proposed Personalized FiDi (P-FiDi) mobile game may be played under a new Snap & Play mode. The player may first take photos with one s mobile device (or select from one's own albums). Then, these photos serve as source images, and the P-FiDi system automatically generates the counterpart target images by sequential operations of aesthetic image quality enhancement, image patch and differentiating style joint selection, music adaptation, dynamic difficulty level determination, and ultimate automatic image editing with a rich set of popular differentiating styles used in traditional FiDi game. Finally, the player enjoys the unique gaming with one's own (instant) photos and music, and the freedom to have new gaming image pairs any time. The user studies show that the P-FiDi mobile game is satisfying in terms of player experience.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116696695","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
A home-based adaptive mixed reality rehabilitation system 基于家庭的自适应混合现实康复系统
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072456
Diana Siwiak, N. Lehrer, Michael Baran, Yinpeng Chen, Margaret Duff, T. Ingalls, T. Rikakis
This paper presents an interactive home-based adaptive mixed reality system (HAMRR) for upper extremity stroke rehabilitation. This home-based system is an extension of a previously designed and currently implemented clinical system. The goal of HAMRR is to restore motor function to chronic stroke survivors by providing an engaging long-term reaching task therapy at home. The HAMMR system tracks movement of the wrist and torso, and provides real-time, post-trial, and post-set multimodal feedback to encourage the stroke survivor to self-assess his or her movement and engage in active learning of new movement strategies. This experiential media system uses a computational adaptation scheme to create a continuously challenging and unique multi-year therapy experience through the use of multiple, integrated audio and visual feedback streams. Novel design features include creating an over-arching story for the participant, the ability of the system to adapt the feedback over multiple time scales, and the ability for this system to integrate into any home.
提出了一种用于上肢卒中康复的交互式家庭自适应混合现实系统(HAMRR)。这种以家庭为基础的系统是以前设计和目前实施的临床系统的扩展。HAMRR的目标是通过在家中提供长期有效的任务治疗来恢复慢性中风幸存者的运动功能。HAMMR系统跟踪手腕和躯干的运动,并提供实时、试验后和设置后的多模态反馈,以鼓励中风幸存者自我评估他或她的运动,并积极学习新的运动策略。这种体验式媒体系统使用计算适应方案,通过使用多种集成的音频和视觉反馈流来创造持续具有挑战性和独特的多年治疗体验。新颖的设计特点包括为参与者创造一个总体故事,系统在多个时间尺度上适应反馈的能力,以及该系统集成到任何家庭的能力。
{"title":"A home-based adaptive mixed reality rehabilitation system","authors":"Diana Siwiak, N. Lehrer, Michael Baran, Yinpeng Chen, Margaret Duff, T. Ingalls, T. Rikakis","doi":"10.1145/2072298.2072456","DOIUrl":"https://doi.org/10.1145/2072298.2072456","url":null,"abstract":"This paper presents an interactive home-based adaptive mixed reality system (HAMRR) for upper extremity stroke rehabilitation. This home-based system is an extension of a previously designed and currently implemented clinical system. The goal of HAMRR is to restore motor function to chronic stroke survivors by providing an engaging long-term reaching task therapy at home. The HAMMR system tracks movement of the wrist and torso, and provides real-time, post-trial, and post-set multimodal feedback to encourage the stroke survivor to self-assess his or her movement and engage in active learning of new movement strategies. This experiential media system uses a computational adaptation scheme to create a continuously challenging and unique multi-year therapy experience through the use of multiple, integrated audio and visual feedback streams. Novel design features include creating an over-arching story for the participant, the ability of the system to adapt the feedback over multiple time scales, and the ability for this system to integrate into any home.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116540208","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Optimal batch selection for active learning in multi-label classification 多标签分类中主动学习的最优批选择
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072028
Shayok Chakraborty, V. Balasubramanian, S. Panchanathan
Multi-label classification is a generalization of conventional classification, where it is possible for a single data point to have multiple labels. Manual annotation of a multi-label data point requires a human oracle to consider the presence/absence of every possible class separately, which involves significant labor. Active learning techniques are effective in reducing human labeling effort to induce a classification model. When exposed to large quantities of unlabeled data, such algorithms automatically select the salient and representative instances for manual annotation. Further, to address the high redundancy in data such as image or video sequences as well as the availability of multiple labeling agents, there have been recent attempts towards a batch mode form of active learning, where a batch of data points is selected simultaneously from an unlabeled set. In this work, we propose a novel optimization based batch mode active learning strategy to minimize human labeling effort in multi-label classification problems. To the best of our knowledge, this is the first attempt to develop such a scheme primarily intended for the multi-label context. The proposed framework is computationally simple, easy to implement and can be suitably modified to perform batch mode active learning in other formulations, such as single-label classification or problems involving hierarchical label spaces. Our results corroborate the efficacy of the proposed algorithm and certify the potential of the framework in being used for real world applications.
多标签分类是传统分类的泛化,其中单个数据点可能具有多个标签。多标签数据点的手动注释需要人工oracle单独考虑每个可能的类的存在/不存在,这需要大量的劳动。主动学习技术可以有效地减少人类标记的努力,以诱导分类模型。当面对大量未标记的数据时,这些算法会自动选择显著和有代表性的实例进行手动注释。此外,为了解决图像或视频序列等数据中的高冗余以及多个标记代理的可用性,最近有人尝试采用批量模式形式的主动学习,其中从未标记的集合中同时选择一批数据点。在这项工作中,我们提出了一种新的基于优化的批处理模式主动学习策略,以最大限度地减少人类在多标签分类问题中的标注工作量。据我们所知,这是第一次尝试开发这样一个主要用于多标签上下文的方案。所提出的框架计算简单,易于实现,并且可以适当修改以在其他公式中执行批处理模式主动学习,例如单标签分类或涉及分层标签空间的问题。我们的结果证实了所提出算法的有效性,并证明了该框架在实际应用中的潜力。
{"title":"Optimal batch selection for active learning in multi-label classification","authors":"Shayok Chakraborty, V. Balasubramanian, S. Panchanathan","doi":"10.1145/2072298.2072028","DOIUrl":"https://doi.org/10.1145/2072298.2072028","url":null,"abstract":"Multi-label classification is a generalization of conventional classification, where it is possible for a single data point to have multiple labels. Manual annotation of a multi-label data point requires a human oracle to consider the presence/absence of every possible class separately, which involves significant labor. Active learning techniques are effective in reducing human labeling effort to induce a classification model. When exposed to large quantities of unlabeled data, such algorithms automatically select the salient and representative instances for manual annotation. Further, to address the high redundancy in data such as image or video sequences as well as the availability of multiple labeling agents, there have been recent attempts towards a batch mode form of active learning, where a batch of data points is selected simultaneously from an unlabeled set. In this work, we propose a novel optimization based batch mode active learning strategy to minimize human labeling effort in multi-label classification problems. To the best of our knowledge, this is the first attempt to develop such a scheme primarily intended for the multi-label context. The proposed framework is computationally simple, easy to implement and can be suitably modified to perform batch mode active learning in other formulations, such as single-label classification or problems involving hierarchical label spaces. Our results corroborate the efficacy of the proposed algorithm and certify the potential of the framework in being used for real world applications.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"67 4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116558646","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 22
Nonparametric bottom-up saliency detection using hypercomplex spectral contrast 使用超复光谱对比的非参数自下而上显著性检测
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2071963
Ce Li, Jianru Xue, Nanning Zheng, Zhiqiang Tian
Saliency detection is an useful technique for image semantic analysis such as auto image segmentation, image retargeting, advertising design and image compression. Inspired by two existing saliency detection algorithms, named spectral residual (SR) and phase spectrum of quaternion Fourier transform (PQFT), we propose a new bottom-up saliency detection method which is featured with the introduction of hypercomplex spectral contrast (HSC) in saliency detection. The proposed HSC algorithm introduces the HSV color image vector space in hypercomplex number, and is better comprehensive to consider amplitude spectral contrast into saliency model as well as phase spectral contrast. Meanwhile, we also incorporate the human vision nonuniform sampling into our model, which is a common phenomenon that directs visual attention to the logarithmic center of image in natural scenes. Experimental results on two public saliency detection datasets show that our approach performs better than four state-of-the art approaches remarkably.
显著性检测是图像语义分析的一项重要技术,可用于图像自动分割、图像重定位、广告设计和图像压缩等。在现有的两种显著性检测算法——谱残差(SR)和四元数傅里叶变换相谱(PQFT)的启发下,我们提出了一种新的自下而上的显著性检测方法,该方法的特点是在显著性检测中引入超复光谱对比度(HSC)。提出的HSC算法引入了超复数的HSV彩色图像向量空间,在显著性模型中考虑幅度谱对比和相位谱对比,具有较好的综合性。同时,我们还将人类视觉的非均匀采样引入到我们的模型中,这是一种在自然场景中将视觉注意力引向图像对数中心的常见现象。在两个公共显著性检测数据集上的实验结果表明,我们的方法明显优于四种最先进的方法。
{"title":"Nonparametric bottom-up saliency detection using hypercomplex spectral contrast","authors":"Ce Li, Jianru Xue, Nanning Zheng, Zhiqiang Tian","doi":"10.1145/2072298.2071963","DOIUrl":"https://doi.org/10.1145/2072298.2071963","url":null,"abstract":"Saliency detection is an useful technique for image semantic analysis such as auto image segmentation, image retargeting, advertising design and image compression. Inspired by two existing saliency detection algorithms, named spectral residual (SR) and phase spectrum of quaternion Fourier transform (PQFT), we propose a new bottom-up saliency detection method which is featured with the introduction of hypercomplex spectral contrast (HSC) in saliency detection. The proposed HSC algorithm introduces the HSV color image vector space in hypercomplex number, and is better comprehensive to consider amplitude spectral contrast into saliency model as well as phase spectral contrast. Meanwhile, we also incorporate the human vision nonuniform sampling into our model, which is a common phenomenon that directs visual attention to the logarithmic center of image in natural scenes. Experimental results on two public saliency detection datasets show that our approach performs better than four state-of-the art approaches remarkably.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124124381","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Resource allocation for cloud-based free viewpoint video rendering for mobile phones 基于云的手机免费视点视频渲染的资源分配
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2071983
Dan Miao, Wenwu Zhu, Chong Luo, Chang Wen Chen
Free viewpoint video (FVV) / Free viewpoint TV (FTV) on mobile devices over cellular networks is very challenging due to the requirement for large bandwidth and limitations in computation and battery life on mobile phones. To address such challenges, in this paper we propose a cloud-based FVV / FTV rendering framework for mobile devices over cellular networks. In this framework, cloud performs rendering for mobile devices. In order to achieve maximum QoE (Quality of Experience) for mobile users, we propose a novel resource allocation scheme, which jointly considers rendering allocation between cloud and client based on user's QoE and rate allocation among texture, depth, and channel rate based on rate-distortion analysis. We formulate this resource allocation scheme as an optimization problem which can then be transformed into a convex optimization for the given rate ratio. Experimental results demonstrate that the proposed cloud-based FVV rendering solution can substantially improve video quality on mobile devices comparing with traditional approaches.
免费视点视频(FVV) /免费视点电视(FTV)在移动设备上通过蜂窝网络是非常具有挑战性的,因为需要大带宽和限制的计算和电池寿命的移动电话。为了解决这些挑战,在本文中,我们提出了一种基于云的蜂窝网络移动设备FVV / FTV渲染框架。在这个框架中,云为移动设备执行渲染。为了实现移动用户最大的QoE(体验质量),我们提出了一种新的资源分配方案,该方案基于用户的QoE在云和客户端之间进行渲染分配,基于速率失真分析在纹理、深度和通道速率之间进行速率分配。我们将此资源分配方案表述为一个优化问题,然后可以将其转化为给定比率的凸优化问题。实验结果表明,与传统方法相比,本文提出的基于云的FVV渲染方案可以显著提高移动设备上的视频质量。
{"title":"Resource allocation for cloud-based free viewpoint video rendering for mobile phones","authors":"Dan Miao, Wenwu Zhu, Chong Luo, Chang Wen Chen","doi":"10.1145/2072298.2071983","DOIUrl":"https://doi.org/10.1145/2072298.2071983","url":null,"abstract":"Free viewpoint video (FVV) / Free viewpoint TV (FTV) on mobile devices over cellular networks is very challenging due to the requirement for large bandwidth and limitations in computation and battery life on mobile phones. To address such challenges, in this paper we propose a cloud-based FVV / FTV rendering framework for mobile devices over cellular networks. In this framework, cloud performs rendering for mobile devices. In order to achieve maximum QoE (Quality of Experience) for mobile users, we propose a novel resource allocation scheme, which jointly considers rendering allocation between cloud and client based on user's QoE and rate allocation among texture, depth, and channel rate based on rate-distortion analysis. We formulate this resource allocation scheme as an optimization problem which can then be transformed into a convex optimization for the given rate ratio. Experimental results demonstrate that the proposed cloud-based FVV rendering solution can substantially improve video quality on mobile devices comparing with traditional approaches.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"100 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124563817","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 43
期刊
Proceedings of the 19th ACM international conference on Multimedia
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
﹀
mjeditor
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1