首页 > 最新文献
paperpass

Proceedings of the 19th ACM international conference on Multimedia最新文献

英文 中文
A mobile interactive robot for gathering structured social video 用于收集结构化社交视频的移动交互机器人
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2071902
Alexander Reben, J. Paradiso
Documentaries are typically captured in a very structured way, using teams to film and interview people. We developed an autonomous method for capturing structured cinéma vérité style documentaries through an interactive robotic camera, which was used as a mobile physical agent to facilitate interaction and story gathering within a ubiquitous media framework. We sent this robot out to autonomously gather human narrative about its environment. The robot had a specific story capture goal and leveraged humans to attain that goal. The robot collected a 1st person view of stories unfolding in real life, and as it engaged with its subjects via a preset dialog, these media clips were intrinsically structured. We evaluated this agent by way of determining "complete" vs. "incomplete" interactions. "Complete" interactions were those that generated viable and interesting videos, which could be edited together into a larger narrative. It was found that 30% of the interactions captured were "complete" interactions. Our results suggested that changes in the system would only produce incrementally more "complete" interactions, as external factors like natural bias or busyness of the user come into play. The types of users who encountered the robot were fairly polar; either they wanted to interact or did not - very few partial interactions went on for more than 1 minute. Users who partially interacted with the robot were found to treat it rougher than those who completed the full interaction. It was also determined that this type of limited-interaction system is best suited for short-term encounters. At the end of the study, a short cinéma vérité documentary showcasing the people and activity in our building was easily produced from the structured videos that were captured, indicating the utility of this approach.
纪录片通常以一种非常结构化的方式拍摄,使用团队拍摄和采访人物。我们开发了一种自主的方法,通过一个交互式机器人摄像机来捕捉结构化的cinsamma vsamri风格的纪录片,该摄像机被用作移动物理代理,以促进无处不在的媒体框架内的互动和故事收集。我们让这个机器人自动收集人类对环境的描述。机器人有一个特定的故事捕捉目标,并利用人类来实现这个目标。机器人收集现实生活中故事的第一人称视角,并通过预设的对话与主题互动,这些媒体片段本质上是结构化的。我们通过确定“完全”vs来评估这种药物。“不完整”的交互。“完整的”互动是指那些能够生成可行且有趣的视频的互动,这些视频可以被编辑成一个更大的故事。发现捕获的交互中有30%是“完整的”交互。我们的研究结果表明,系统的变化只会产生越来越“完整”的交互,因为外部因素,如自然偏见或用户的忙碌开始发挥作用。遇到机器人的用户类型相当极端;他们要么想要互动,要么不想——很少有部分互动持续超过1分钟。研究发现,与机器人进行部分互动的用户对机器人的态度比完成全部互动的用户更粗鲁。还确定这种有限互动系统最适合于短期接触。在研究的最后,一个简短的cinsama v纪录片展示了我们大楼里的人和活动,很容易从被捕获的结构化视频中制作出来,这表明了这种方法的实用性。
{"title":"A mobile interactive robot for gathering structured social video","authors":"Alexander Reben, J. Paradiso","doi":"10.1145/2072298.2071902","DOIUrl":"https://doi.org/10.1145/2072298.2071902","url":null,"abstract":"Documentaries are typically captured in a very structured way, using teams to film and interview people. We developed an autonomous method for capturing structured cinéma vérité style documentaries through an interactive robotic camera, which was used as a mobile physical agent to facilitate interaction and story gathering within a ubiquitous media framework. We sent this robot out to autonomously gather human narrative about its environment. The robot had a specific story capture goal and leveraged humans to attain that goal. The robot collected a 1st person view of stories unfolding in real life, and as it engaged with its subjects via a preset dialog, these media clips were intrinsically structured. We evaluated this agent by way of determining \"complete\" vs. \"incomplete\" interactions. \"Complete\" interactions were those that generated viable and interesting videos, which could be edited together into a larger narrative. It was found that 30% of the interactions captured were \"complete\" interactions. Our results suggested that changes in the system would only produce incrementally more \"complete\" interactions, as external factors like natural bias or busyness of the user come into play. The types of users who encountered the robot were fairly polar; either they wanted to interact or did not - very few partial interactions went on for more than 1 minute. Users who partially interacted with the robot were found to treat it rougher than those who completed the full interaction. It was also determined that this type of limited-interaction system is best suited for short-term encounters. At the end of the study, a short cinéma vérité documentary showcasing the people and activity in our building was easily produced from the structured videos that were captured, indicating the utility of this approach.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121659963","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Towards a real time public transport awareness system: case study in dublin 迈向实时公共交通意识系统:都柏林案例研究
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072463
E. Bouillet, L. Gasparini, O. Verscheure
In this paper we discuss our experience with the design of a public transport awareness application developed for the city of Dublin. The application is capable to ingest, analyze and visualize in real-time high volumes of traffic data coming from a variety of sources. We address the challenges encountered during the design of the application and propose novel solutions to tackle those challenges.
在本文中,我们讨论了为都柏林市开发的公共交通感知应用程序的设计经验。该应用程序能够摄取、分析和实时可视化来自各种来源的大量交通数据。我们解决了在应用程序设计过程中遇到的挑战,并提出了解决这些挑战的新颖解决方案。
{"title":"Towards a real time public transport awareness system: case study in dublin","authors":"E. Bouillet, L. Gasparini, O. Verscheure","doi":"10.1145/2072298.2072463","DOIUrl":"https://doi.org/10.1145/2072298.2072463","url":null,"abstract":"In this paper we discuss our experience with the design of a public transport awareness application developed for the city of Dublin. The application is capable to ingest, analyze and visualize in real-time high volumes of traffic data coming from a variety of sources. We address the challenges encountered during the design of the application and propose novel solutions to tackle those challenges.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121828683","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Learning concept bundles for video search with complex queries 学习具有复杂查询的视频搜索概念包
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072357
Jin Yuan, Zhengjun Zha, Yantao Zheng, Meng Wang, Xiangdong Zhou, Tat-Seng Chua
Classifiers for primitive visual concepts like "car", "sky" have been well developed and widely used to support video search on simple queries. However, it is usually ineffective for complex queries like "one or more people at a table or desk with a computer visible", as they carry semantics far more complex and different from simply aggregating the meanings of their constituent primitive concepts. To facilitate video search of complex queries, we propose a higher-level semantic descriptor named "concept bundle", which integrates multiple primitive concepts, such as "(soccer, fighting)", "(lion, hunting, zebra)" etc, to describe the visual representation of the complex semantics. The proposed approach first automatically selects informative concept bundles. It then builds a novel concept bundle classifier based on multi-task learning by exploiting the relatedness between concept bundle and its primitive concepts. To model a complex query, it proposes an optimal selection strategy to select related primitive concepts and concept bundles by considering both their classifier performance and semantic relatedness with respect to the query. The final results are generated by fusing the individual results from these selected primitive concepts and concept bundles. Extensive experiments are conducted on two video datasets: TRECVID 2008 and YouTube datasets. The experimental results indicate that: (a) our concept bundle learning approach outperforms the state-of-the-art methods by at least 19% and 29% on TRECVID 2008 and YouTube datasets, respectively; and (b) the use of concept bundles can improve the search performance for complex queries by at least 37.5% on TRECVID 2008 and 52% on YouTube datasets.
针对“汽车”、“天空”等原始视觉概念的分类器已经得到了很好的发展,并广泛用于支持简单查询的视频搜索。然而,对于复杂的查询,如“一个或多个人坐在一张桌子上,可以看到一台计算机”,它通常是无效的,因为它们所携带的语义要复杂得多,并且与简单地聚合其组成基本概念的含义不同。为了方便复杂查询的视频搜索,我们提出了一种更高层次的语义描述符“概念包”,它集成了多个原始概念,如“(足球、战斗)”、“(狮子、狩猎、斑马)”等,来描述复杂语义的视觉表示。该方法首先自动选择信息概念包。然后利用概念束与其原始概念之间的相关性,构建基于多任务学习的概念束分类器。为了对复杂查询建模,提出了一种最优选择策略,通过考虑分类器性能和相对于查询的语义相关性来选择相关的原语概念和概念束。最终结果是通过融合这些选定的原始概念和概念包的单个结果来生成的。在TRECVID 2008和YouTube两个视频数据集上进行了大量的实验。实验结果表明:(a)我们的概念束学习方法在TRECVID 2008和YouTube数据集上分别比最先进的方法高出至少19%和29%;(b)概念包的使用可以在TRECVID 2008上提高复杂查询的搜索性能至少37.5%,在YouTube数据集上提高52%。
{"title":"Learning concept bundles for video search with complex queries","authors":"Jin Yuan, Zhengjun Zha, Yantao Zheng, Meng Wang, Xiangdong Zhou, Tat-Seng Chua","doi":"10.1145/2072298.2072357","DOIUrl":"https://doi.org/10.1145/2072298.2072357","url":null,"abstract":"Classifiers for primitive visual concepts like \"car\", \"sky\" have been well developed and widely used to support video search on simple queries. However, it is usually ineffective for complex queries like \"one or more people at a table or desk with a computer visible\", as they carry semantics far more complex and different from simply aggregating the meanings of their constituent primitive concepts. To facilitate video search of complex queries, we propose a higher-level semantic descriptor named \"concept bundle\", which integrates multiple primitive concepts, such as \"(soccer, fighting)\", \"(lion, hunting, zebra)\" etc, to describe the visual representation of the complex semantics. The proposed approach first automatically selects informative concept bundles. It then builds a novel concept bundle classifier based on multi-task learning by exploiting the relatedness between concept bundle and its primitive concepts. To model a complex query, it proposes an optimal selection strategy to select related primitive concepts and concept bundles by considering both their classifier performance and semantic relatedness with respect to the query. The final results are generated by fusing the individual results from these selected primitive concepts and concept bundles. Extensive experiments are conducted on two video datasets: TRECVID 2008 and YouTube datasets. The experimental results indicate that: (a) our concept bundle learning approach outperforms the state-of-the-art methods by at least 19% and 29% on TRECVID 2008 and YouTube datasets, respectively; and (b) the use of concept bundles can improve the search performance for complex queries by at least 37.5% on TRECVID 2008 and 52% on YouTube datasets.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125318656","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 21
Edge-preserving single image super-resolution 保持边缘的单幅图像超分辨率
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2071932
Qiang-feng Zhou, Shifeng Chen, Jianzhuang Liu, Xiaoou Tang
This paper proposes a novel approach to single image super-resolution. First, an image up-sampling scheme is proposed which takes the advantages of both bilateral filtering and mean shift image segmentation. Then we use a shock filter to enhance strong edges in the initial up-sampling result and obtain an intermediate high-resolution image. Finally, we enforce a reconstruction constraint on the high-resolution image so that fine details can be inferred by back projection. Since strong edges in the intermediate result are enhanced, ringing artifacts can be suppressed in the back projection step. We compare our algorithm with several state-of-the-art image super-resolution algorithms. Qualitative and quantitative experimental results demonstrate that our approach performs the best.
提出了一种单幅图像超分辨的新方法。首先,提出了一种结合双边滤波和均值移位图像分割优点的图像上采样方案。然后使用冲击滤波器增强初始上采样结果中的强边缘,得到中等分辨率的图像。最后,我们对高分辨率图像实施重建约束,以便通过反向投影推断出精细细节。由于中间结果中的强边缘得到增强,因此可以在反向投影步骤中抑制环形伪影。我们将我们的算法与几种最先进的图像超分辨率算法进行了比较。定性和定量实验结果表明,我们的方法是最好的。
{"title":"Edge-preserving single image super-resolution","authors":"Qiang-feng Zhou, Shifeng Chen, Jianzhuang Liu, Xiaoou Tang","doi":"10.1145/2072298.2071932","DOIUrl":"https://doi.org/10.1145/2072298.2071932","url":null,"abstract":"This paper proposes a novel approach to single image super-resolution. First, an image up-sampling scheme is proposed which takes the advantages of both bilateral filtering and mean shift image segmentation. Then we use a shock filter to enhance strong edges in the initial up-sampling result and obtain an intermediate high-resolution image. Finally, we enforce a reconstruction constraint on the high-resolution image so that fine details can be inferred by back projection. Since strong edges in the intermediate result are enhanced, ringing artifacts can be suppressed in the back projection step. We compare our algorithm with several state-of-the-art image super-resolution algorithms. Qualitative and quantitative experimental results demonstrate that our approach performs the best.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"108 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122498496","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 16
Video-to-shot tag allocation by weighted sparse group lasso 基于加权稀疏组套索的视频到镜头标签分配
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072050
Xiaofeng Zhu, Zi Huang, Heng Tao Shen
Traditional shot tagging techniques are focused on learning and propagating the tags at the same level, that is from labeled training shots to the unknown test shots. Due to the lack of sufficient labeled video shots, effective shot tagging remains challenging. By observing that video-level tags are more widely provided, we design a novel approach to propagate video-level tags to the test shots. A weighted sparse group lasso method (WSGL) is proposed for shot reconstruction, which well preserves the structural sparsity to reduce the noise in tag propagation. Meanwhile, it simultaneously considers the spatial-temporal information within the video corpus to enhance the tagging performance. Extensive experiments are conducted on two public video datasets to demonstrate the effectiveness of the proposed method.
传统的镜头标注技术关注的是同一层次的标签学习和传播,即从标记好的训练镜头到未知的测试镜头。由于缺乏足够的标记视频镜头,有效的镜头标记仍然具有挑战性。通过观察视频级标签被更广泛地提供,我们设计了一种新的方法来传播视频级标签到测试镜头。提出了一种加权稀疏组套索方法(WSGL),该方法很好地保留了标签传播过程中的结构稀疏性,降低了标签传播过程中的噪声。同时考虑视频语料库中的时空信息,提高标注性能。在两个公开的视频数据集上进行了大量的实验,以证明该方法的有效性。
{"title":"Video-to-shot tag allocation by weighted sparse group lasso","authors":"Xiaofeng Zhu, Zi Huang, Heng Tao Shen","doi":"10.1145/2072298.2072050","DOIUrl":"https://doi.org/10.1145/2072298.2072050","url":null,"abstract":"Traditional shot tagging techniques are focused on learning and propagating the tags at the same level, that is from labeled training shots to the unknown test shots. Due to the lack of sufficient labeled video shots, effective shot tagging remains challenging. By observing that video-level tags are more widely provided, we design a novel approach to propagate video-level tags to the test shots. A weighted sparse group lasso method (WSGL) is proposed for shot reconstruction, which well preserves the structural sparsity to reduce the noise in tag propagation. Meanwhile, it simultaneously considers the spatial-temporal information within the video corpus to enhance the tagging performance. Extensive experiments are conducted on two public video datasets to demonstrate the effectiveness of the proposed method.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131263720","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Query expansion by spatial co-occurrence for image retrieval 基于空间共现的图像检索查询扩展
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2071968
Yingfei Li, Bo Geng, Zhengjun Zha, Yangxi Li, D. Tao, Chao Xu
The well-known bag-of-features (BoF) model is widely utilized for large scale image retrieval. However, BoF model lacks the spatial information of visual words, which is informative for local features to build up meaningful visual patches. To compensate for the spatial information loss, in this paper, we propose a novel query expansion method called Spatial Co-occurrence Query Expansion (SCQE), by utilizing the spatial co-occurrence information of visual words mined from the database images to boost the retrieval performance. In offline phase, for each visual word in the vocabulary, we treat the visual words that are frequently co-occurred with it in the database images as neighbors, base on which a spatial co-occurrence graph is built. In online phase, a query image can be expanded with some spatial co-occurred but unseen visual words according to the spatial co-occurrence graph, and the retrieval performance can be improved by expanding these visual words appropriately. Experimental results demonstrate that, SCQE achieves promising improvements over the typical BoF baseline on two datasets comprising 5K and 505K images respectively.
众所周知的特征袋模型(BoF)被广泛应用于大规模图像检索。然而,BoF模型缺乏视觉词的空间信息,这对局部特征构建有意义的视觉斑块是有帮助的。为了弥补空间信息的损失,本文提出了一种新的查询扩展方法,即空间共现查询扩展(SCQE),利用从数据库图像中挖掘的视觉词的空间共现信息来提高检索性能。在离线阶段,对于词汇表中的每个视觉词,我们将数据库图像中与它共现频率高的视觉词作为邻居,在此基础上构建空间共现图。在在线阶段,可以根据空间共现图将查询图像扩展为一些空间共现但未见的视觉词,通过对这些视觉词的适当扩展,可以提高检索性能。实验结果表明,SCQE在分别包含5K和505K图像的两个数据集上取得了比典型BoF基线有希望的改进。
{"title":"Query expansion by spatial co-occurrence for image retrieval","authors":"Yingfei Li, Bo Geng, Zhengjun Zha, Yangxi Li, D. Tao, Chao Xu","doi":"10.1145/2072298.2071968","DOIUrl":"https://doi.org/10.1145/2072298.2071968","url":null,"abstract":"The well-known bag-of-features (BoF) model is widely utilized for large scale image retrieval. However, BoF model lacks the spatial information of visual words, which is informative for local features to build up meaningful visual patches. To compensate for the spatial information loss, in this paper, we propose a novel query expansion method called Spatial Co-occurrence Query Expansion (SCQE), by utilizing the spatial co-occurrence information of visual words mined from the database images to boost the retrieval performance. In offline phase, for each visual word in the vocabulary, we treat the visual words that are frequently co-occurred with it in the database images as neighbors, base on which a spatial co-occurrence graph is built. In online phase, a query image can be expanded with some spatial co-occurred but unseen visual words according to the spatial co-occurrence graph, and the retrieval performance can be improved by expanding these visual words appropriately. Experimental results demonstrate that, SCQE achieves promising improvements over the typical BoF baseline on two datasets comprising 5K and 505K images respectively.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131373337","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
Compositional object pattern: a new model for album event recognition 组合对象模式:一种新的专辑事件识别模型
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072015
S. Tsai, Liangliang Cao, Feng Tang, Thomas S. Huang
In this paper, we study the problem of recognizing events in personal photo albums. In consumer photo collections or online photo communities, photos are usually organized in albums according to their events. However, interpreting photo albums is more complicated than the traditional problem of understanding single photos, because albums generally exhibit much more varieties than single image. To solve this challenge, we propose a novel representation, called Compositional Object Pattern, which characterizes object level pattern conveying much richer semantic than low level visual feature. To interpret the rich semantics in albums, we mine frequent object patterns in the training set, and then rank them by their discriminating power. The album feature is then set as the frequencies of these frequent and discriminative patterns, called Compositional Object Pattern Frequency(COPF). We show with experimental result that our algorithm is capable of recognizing holidays with accuracy higher than the baseline method.
本文研究了个人相册中事件的识别问题。在消费者照片收藏或在线照片社区中,照片通常根据其事件组织在相册中。然而,与传统的单张照片理解问题相比,相册的解释要复杂得多,因为相册通常比单张图像呈现出更多的多样性。为了解决这一挑战,我们提出了一种新的表示方法,称为组合对象模式,它的特点是对象级模式比低级视觉特征传达更丰富的语义。为了解释专辑中丰富的语义,我们在训练集中挖掘频繁的对象模式,然后根据它们的判别能力对它们进行排序。然后将专辑特性设置为这些频繁和判别模式的频率,称为组合对象模式频率(COPF)。实验结果表明,该算法能够较基线方法更准确地识别节假日。
{"title":"Compositional object pattern: a new model for album event recognition","authors":"S. Tsai, Liangliang Cao, Feng Tang, Thomas S. Huang","doi":"10.1145/2072298.2072015","DOIUrl":"https://doi.org/10.1145/2072298.2072015","url":null,"abstract":"In this paper, we study the problem of recognizing events in personal photo albums. In consumer photo collections or online photo communities, photos are usually organized in albums according to their events. However, interpreting photo albums is more complicated than the traditional problem of understanding single photos, because albums generally exhibit much more varieties than single image. To solve this challenge, we propose a novel representation, called Compositional Object Pattern, which characterizes object level pattern conveying much richer semantic than low level visual feature. To interpret the rich semantics in albums, we mine frequent object patterns in the training set, and then rank them by their discriminating power. The album feature is then set as the frequencies of these frequent and discriminative patterns, called Compositional Object Pattern Frequency(COPF). We show with experimental result that our algorithm is capable of recognizing holidays with accuracy higher than the baseline method.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131542335","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 20
A real-time bimanual 3D interaction method based on bare-hand tracking 一种基于徒手跟踪的实时双手三维交互方法
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2071941
Junhao Shi, Mingmin Zhang, Zhigeng Pan
We present a vision-based gesture interaction technique that is capable of tracking both hands in real-time. By only recovering features calculated from images, large amount of computation for 3D reconstructing and features tracking in 3D voxel grid is avoided. Thus, our system becomes an ideal tool for bimanual 3D gesture interaction, which needs neither markers nor gloves. Experimental results show that our method can complete the same pipeline with much less computational resource compared to existing ones. What's more, the application interface shows the effectiveness and intuitiveness of our bimanual tracking method.
我们提出了一种基于视觉的手势交互技术,能够实时跟踪双手。通过只恢复从图像中计算出的特征,避免了在三维体素网格中进行三维重建和特征跟踪的大量计算。因此,我们的系统成为一个理想的工具,手动3D手势交互,既不需要标记,也不需要手套。实验结果表明,与现有方法相比,我们的方法可以用更少的计算资源完成相同的管道。应用界面验证了该方法的有效性和直观性。
{"title":"A real-time bimanual 3D interaction method based on bare-hand tracking","authors":"Junhao Shi, Mingmin Zhang, Zhigeng Pan","doi":"10.1145/2072298.2071941","DOIUrl":"https://doi.org/10.1145/2072298.2071941","url":null,"abstract":"We present a vision-based gesture interaction technique that is capable of tracking both hands in real-time. By only recovering features calculated from images, large amount of computation for 3D reconstructing and features tracking in 3D voxel grid is avoided. Thus, our system becomes an ideal tool for bimanual 3D gesture interaction, which needs neither markers nor gloves. Experimental results show that our method can complete the same pipeline with much less computational resource compared to existing ones. What's more, the application interface shows the effectiveness and intuitiveness of our bimanual tracking method.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121769962","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Kinship verification from facial images under uncontrolled conditions 非受控条件下面部图像的亲属关系验证
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2071911
Xiuzhuang Zhou, Junlin Hu, Jiwen Lu, Yuanyuan Shang, Yong Guan
In this paper, we present an automatic kinship verification system based on facial image analysis under uncontrolled conditions. While a large number of studies on human face analysis have been performed in the literature, there are a few attempts on automatic face analysis for kinship verification, possibly due to lacking of such publicly available databases and great challenges of this problem. To this end, we collect a kinship face database by searching 400+ pairs of public figures and celebrities from the internet, and automatically detect them with the Viola-Jones face detector. Then, we propose a new spatial pyramid learning-based (SPLE) feature descriptor for face representation and apply support vector machine (SVM) for kinship verification. The proposed system has the following three characteristics: 1) no manual human annotation of face landmarks is required and the kinship information is automatically obtained from the original pair of images; 2) both local appearance information and global spatial information have been effectively utilized in the proposed SPLE feature descriptor, and better performance can be obtained than state-of-the-art feature descriptors in our application; 3) the performance of our proposed system is comparable to that of human observers.
本文提出了一种基于人脸图像分析的非受控条件下亲属关系自动验证系统。虽然文献中对人脸分析进行了大量的研究,但可能由于缺乏公开的数据库和该问题的巨大挑战,对亲属关系验证的自动人脸分析的尝试很少。为此,我们从网络上搜索了400多对公众人物和名人,收集了一个亲属面孔数据库,并使用Viola-Jones人脸检测器自动检测。然后,我们提出了一种新的基于空间金字塔学习(SPLE)的人脸特征描述符,并应用支持向量机(SVM)进行亲属关系验证。该系统具有以下三个特点:1)不需要人工标注人脸地标,从原始图像对中自动获取亲属关系信息;2)所提出的SPLE特征描述符有效地利用了局部外观信息和全局空间信息,在我们的应用中可以获得比现有特征描述符更好的性能;3)我们提出的系统的性能与人类观察者的性能相当。
{"title":"Kinship verification from facial images under uncontrolled conditions","authors":"Xiuzhuang Zhou, Junlin Hu, Jiwen Lu, Yuanyuan Shang, Yong Guan","doi":"10.1145/2072298.2071911","DOIUrl":"https://doi.org/10.1145/2072298.2071911","url":null,"abstract":"In this paper, we present an automatic kinship verification system based on facial image analysis under uncontrolled conditions. While a large number of studies on human face analysis have been performed in the literature, there are a few attempts on automatic face analysis for kinship verification, possibly due to lacking of such publicly available databases and great challenges of this problem. To this end, we collect a kinship face database by searching 400+ pairs of public figures and celebrities from the internet, and automatically detect them with the Viola-Jones face detector. Then, we propose a new spatial pyramid learning-based (SPLE) feature descriptor for face representation and apply support vector machine (SVM) for kinship verification. The proposed system has the following three characteristics: 1) no manual human annotation of face landmarks is required and the kinship information is automatically obtained from the original pair of images; 2) both local appearance information and global spatial information have been effectively utilized in the proposed SPLE feature descriptor, and better performance can be obtained than state-of-the-art feature descriptors in our application; 3) the performance of our proposed system is comparable to that of human observers.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127743845","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 146
Multimodal QoE evaluation in P2P-based IPTV systems 基于p2p的IPTV系统的多模态QoE评估
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072004
Mu Mu, J. Ishmael, Keith Mitchell, N. Race, A. Mauthe
Peer-to-Peer (P2P) technologies provide efficient and low-cost delivery for commercial and user-generated content. Although a number of audio-visual content distribution services have been developed using P2P-based mechanisms, it is still a challenge to guarantee satisfactory user experience on high quality video streaming services due to the dynamic nature of P2P distribution. An objective assessment service is the key enabler of service quality monitoring and management. However, this complex task can not be achieved by any individual objective model that only captures a certain aspect of service quality. This paper introduces a multimodal quality evaluation framework that is specifically designed and implemented for the assessment of video streaming services in P2P-based IPTV systems. Results of initial experiments show the effectiveness of this framework.
点对点(P2P)技术为商业和用户生成的内容提供了高效和低成本的交付。尽管许多视听内容分发服务已经使用基于P2P的机制开发出来,但由于P2P分发的动态性,保证高质量视频流服务的满意用户体验仍然是一个挑战。客观的评估服务是服务质量监控和管理的关键推动者。然而,这个复杂的任务不能通过任何只捕获服务质量的某个方面的单个目标模型来实现。本文介绍了一个多模态质量评估框架,该框架是专门为评估基于p2p的IPTV系统中的视频流服务而设计和实现的。初步实验结果表明了该框架的有效性。
{"title":"Multimodal QoE evaluation in P2P-based IPTV systems","authors":"Mu Mu, J. Ishmael, Keith Mitchell, N. Race, A. Mauthe","doi":"10.1145/2072298.2072004","DOIUrl":"https://doi.org/10.1145/2072298.2072004","url":null,"abstract":"Peer-to-Peer (P2P) technologies provide efficient and low-cost delivery for commercial and user-generated content. Although a number of audio-visual content distribution services have been developed using P2P-based mechanisms, it is still a challenge to guarantee satisfactory user experience on high quality video streaming services due to the dynamic nature of P2P distribution. An objective assessment service is the key enabler of service quality monitoring and management. However, this complex task can not be achieved by any individual objective model that only captures a certain aspect of service quality. This paper introduces a multimodal quality evaluation framework that is specifically designed and implemented for the assessment of video streaming services in P2P-based IPTV systems. Results of initial experiments show the effectiveness of this framework.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133125597","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
期刊
Proceedings of the 19th ACM international conference on Multimedia
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
﹀
mjeditor
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1