首页 > 最新文献
paperpass

Proceedings of the 19th ACM international conference on Multimedia最新文献

英文 中文
COZI: crowdsourced and content-based zoomable video player COZI:众包和基于内容的可缩放视频播放器
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072480
A. Carlier, Arash Shafiei, Julien Badie, Salim Bensiali, Wei Tsang Ooi
We present a new user interface designed to allow easy yet effective zooming and panning into high-definition videos for playback on low resolution displays. Our system first applies state-of-the-art video analysis algorithms to detect salient regions of interest and recommends them to users. These recommendations help users to quickly identify important regions in the video and zoom into the regions with a single mouse click. The salient regions may moves according to the movement of track objects, further reducing the need for users to manually pan to track an object of interests. To further improve the relevance of the recommended regions, users' interactions are logged and analyzed. The actual regions selected and viewed by users serve as a feedback and is integrated into the system to improve the recommendations. We have implemented a Web-based version of the user interface, running on modern browsers supporting HTML5. We describe the algorithms and optimizations used to implement and improve the system.
我们提出了一个新的用户界面,旨在允许简单而有效的缩放和平移到高清视频播放在低分辨率显示器。我们的系统首先应用最先进的视频分析算法来检测感兴趣的突出区域并向用户推荐它们。这些建议可以帮助用户快速识别视频中的重要区域,并通过一次鼠标点击放大区域。突出区域可以根据跟踪对象的运动而移动,进一步减少了用户手动平移来跟踪感兴趣对象的需要。为了进一步提高推荐区域的相关性,用户的交互被记录和分析。用户选择和查看的实际区域作为反馈,并集成到系统中以改进建议。我们已经实现了一个基于web的用户界面版本,运行在支持HTML5的现代浏览器上。我们描述了用于实现和改进系统的算法和优化。
{"title":"COZI: crowdsourced and content-based zoomable video player","authors":"A. Carlier, Arash Shafiei, Julien Badie, Salim Bensiali, Wei Tsang Ooi","doi":"10.1145/2072298.2072480","DOIUrl":"https://doi.org/10.1145/2072298.2072480","url":null,"abstract":"We present a new user interface designed to allow easy yet effective zooming and panning into high-definition videos for playback on low resolution displays. Our system first applies state-of-the-art video analysis algorithms to detect salient regions of interest and recommends them to users. These recommendations help users to quickly identify important regions in the video and zoom into the regions with a single mouse click. The salient regions may moves according to the movement of track objects, further reducing the need for users to manually pan to track an object of interests. To further improve the relevance of the recommended regions, users' interactions are logged and analyzed. The actual regions selected and viewed by users serve as a feedback and is integrated into the system to improve the recommendations. We have implemented a Web-based version of the user interface, running on modern browsers supporting HTML5. We describe the algorithms and optimizations used to implement and improve the system.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133302181","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Dynamic media show drivable by semantics 动态媒体显示由语义驱动
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072473
V. Singh, Jiebo Luo, D. Joshi, M. Das, Phoury Lei, Peter O. Stubler
We demonstrate a system to generate dynamic media shows that are significantly richer than static slide shows, which are currently the most popular form of photo playback. The goal is to enable media reliving experiences that are aesthetically pleasing, interactive, and semantically drivable as they center on people, locations, time, and events discovered in a media collection. Dynamic shows allow for better sharing of one's media collections in diverse social networks because people have different time availabilities and perspectives, and hence may want to interact, customize, and reroute the media flow per their individual needs.
我们演示了一个生成动态媒体显示的系统,它比静态幻灯片显示更丰富,静态幻灯片显示是目前最流行的照片播放形式。我们的目标是让媒体重新体验美学上令人愉悦的、互动性的、语义上可驱动的体验,因为它们以媒体集合中的人物、地点、时间和事件为中心。动态展示允许在不同的社会网络中更好地共享一个人的媒体集合,因为人们有不同的时间可用性和视角,因此可能希望根据他们的个人需求进行交互、自定义和重新路由媒体流。
{"title":"Dynamic media show drivable by semantics","authors":"V. Singh, Jiebo Luo, D. Joshi, M. Das, Phoury Lei, Peter O. Stubler","doi":"10.1145/2072298.2072473","DOIUrl":"https://doi.org/10.1145/2072298.2072473","url":null,"abstract":"We demonstrate a system to generate dynamic media shows that are significantly richer than static slide shows, which are currently the most popular form of photo playback. The goal is to enable media reliving experiences that are aesthetically pleasing, interactive, and semantically drivable as they center on people, locations, time, and events discovered in a media collection. Dynamic shows allow for better sharing of one's media collections in diverse social networks because people have different time availabilities and perspectives, and hence may want to interact, customize, and reroute the media flow per their individual needs.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"38 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133417857","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Key object-based static video summarization 关键是基于对象的静态视频摘要
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2071999
Zhiqiang Tian, Jianru Xue, Xuguang Lan, Ce Li, Nanning Zheng
In this paper, we present a system for object-based video summarization facilitated by an efficient video object segmentation system. We eliminate the redundancy not only from spatial and temporal domain, but also from content domain. First, we detect shot boundaries and extract video objects by a 3D graph-based algorithm. Once the objects are obtained, the shape of the objects need to be represented. The key objects are extracted in a global manner by K-means clustering of shapes. Experimental results on the proposed object-based scheme combined with efficient video object segmentation show desirable summarization.
在本文中,我们提出了一个基于对象的视频摘要系统,该系统由一个高效的视频对象分割系统提供支持。我们不仅消除了空间和时间域的冗余,而且消除了内容域的冗余。首先,我们通过基于三维图形的算法检测镜头边界并提取视频对象。一旦获得了对象,就需要表示对象的形状。通过形状的K-means聚类,以全局方式提取关键对象。实验结果表明,该方法结合高效的视频目标分割,具有良好的摘要效果。
{"title":"Key object-based static video summarization","authors":"Zhiqiang Tian, Jianru Xue, Xuguang Lan, Ce Li, Nanning Zheng","doi":"10.1145/2072298.2071999","DOIUrl":"https://doi.org/10.1145/2072298.2071999","url":null,"abstract":"In this paper, we present a system for object-based video summarization facilitated by an efficient video object segmentation system. We eliminate the redundancy not only from spatial and temporal domain, but also from content domain. First, we detect shot boundaries and extract video objects by a 3D graph-based algorithm. Once the objects are obtained, the shape of the objects need to be represented. The key objects are extracted in a global manner by K-means clustering of shapes. Experimental results on the proposed object-based scheme combined with efficient video object segmentation show desirable summarization.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133514547","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 18
Kooaba interactive posters Kooaba互动海报
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072440
C. Wengert, T. Jaeggli, P. Messmer, Till Quack, Peter Cech, C. Prodan, Tomas Carnecky, Franco Sebregondi, David Wisti
There is an ever increasing amount of digital visual information being produced. For instance, there are over 800 million mobile phones with integrated cameras. These cameras are increasingly used as a tool in order to remember and share things by just snapping pictures. Have a look at your digital photo collection today, and imagine how large it is going to be in 30 years. The Kooaba Interactive Posters are built around our large-scale image recognition platform and provides a tool that enable you to share, explore and remember things visually. The image recognition allows for identifying objects in images. Once an image or object is identified, additional information about them is provided, e.g. related web-pages, description, tags etc which helps the user to better organize and remember these items. In the context of an academic conference, the objects to be recognized are the conference posters, thus rendring them interactive by providing additional content such as the original paper, videos, source code etc.
数字视觉信息的数量在不断增加。例如,现在有超过8亿部手机带有集成摄像头。这些相机越来越多地被用作一种工具,通过拍照来记忆和分享事物。看看你今天的数码照片集,想象一下30年后它会有多大。Kooaba互动海报是围绕我们的大型图像识别平台构建的,它提供了一个工具,使您能够在视觉上分享、探索和记忆事物。图像识别允许识别图像中的对象。一旦识别出图像或物体,就会提供有关它们的附加信息,例如相关的网页、描述、标签等,帮助用户更好地组织和记住这些项目。在学术会议的背景下,要识别的对象是会议海报,从而通过提供原始论文,视频,源代码等附加内容使其具有互动性。
{"title":"Kooaba interactive posters","authors":"C. Wengert, T. Jaeggli, P. Messmer, Till Quack, Peter Cech, C. Prodan, Tomas Carnecky, Franco Sebregondi, David Wisti","doi":"10.1145/2072298.2072440","DOIUrl":"https://doi.org/10.1145/2072298.2072440","url":null,"abstract":"There is an ever increasing amount of digital visual information being produced. For instance, there are over 800 million mobile phones with integrated cameras. These cameras are increasingly used as a tool in order to remember and share things by just snapping pictures. Have a look at your digital photo collection today, and imagine how large it is going to be in 30 years. The Kooaba Interactive Posters are built around our large-scale image recognition platform and provides a tool that enable you to share, explore and remember things visually. The image recognition allows for identifying objects in images. Once an image or object is identified, additional information about them is provided, e.g. related web-pages, description, tags etc which helps the user to better organize and remember these items. In the context of an academic conference, the objects to be recognized are the conference posters, thus rendring them interactive by providing additional content such as the original paper, videos, source code etc.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"200 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134042066","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Multiple object localization by context-aware adaptive window search and search-based object recognition 基于上下文感知的自适应窗口搜索和基于搜索的目标识别的多目标定位
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2071928
Fang-Erh Lin, Y. Kuo, Winston H. Hsu
Multiple object localization and recognition has been an important problem in recent years not only because of its difficulty to be time efficient but also due to many different schemes of widespread applications. In many previous works, only a limited amount of object models contribute to less computational time. However, they tend to not work efficiently together with large-scale database. In this paper, we propose a context-aware adaptive window search algorithm and search-based object recognition system to recognize and localize multiple objects in an image with a large-scale database. Since we tackle this problem with the idea that users can get brief information of an item immediately after taking only a snapshot, a low response time is also taken into account. We implement the algorithm within a large-scale book recognition system and present experimental results that demonstrate the efficiency of our algorithm in terms of detection recall, precision, and speed compared to the baseline and efficient subwindow search (ESS) approaches.
近年来,多目标定位和识别一直是一个重要的问题,这不仅是因为多目标定位和识别在时间效率上的困难,而且由于许多不同的定位和识别方案得到了广泛的应用。在许多以前的工作中,只有有限数量的对象模型有助于减少计算时间。然而,它们往往不能有效地与大型数据库一起工作。本文提出了一种基于上下文感知的自适应窗口搜索算法和基于搜索的目标识别系统,在大规模数据库中对图像中的多个目标进行识别和定位。由于我们解决这个问题的想法是,用户可以在拍摄快照后立即获得项目的简要信息,因此也考虑了低响应时间。我们在一个大规模的图书识别系统中实现了该算法,并给出了实验结果,证明了与基线和高效子窗口搜索(ESS)方法相比,该算法在检测召回率、精度和速度方面的效率。
{"title":"Multiple object localization by context-aware adaptive window search and search-based object recognition","authors":"Fang-Erh Lin, Y. Kuo, Winston H. Hsu","doi":"10.1145/2072298.2071928","DOIUrl":"https://doi.org/10.1145/2072298.2071928","url":null,"abstract":"Multiple object localization and recognition has been an important problem in recent years not only because of its difficulty to be time efficient but also due to many different schemes of widespread applications. In many previous works, only a limited amount of object models contribute to less computational time. However, they tend to not work efficiently together with large-scale database. In this paper, we propose a context-aware adaptive window search algorithm and search-based object recognition system to recognize and localize multiple objects in an image with a large-scale database. Since we tackle this problem with the idea that users can get brief information of an item immediately after taking only a snapshot, a low response time is also taken into account. We implement the algorithm within a large-scale book recognition system and present experimental results that demonstrate the efficiency of our algorithm in terms of detection recall, precision, and speed compared to the baseline and efficient subwindow search (ESS) approaches.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115724429","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Just-in-time adaptive decoder engine: a universal video decoder based on MPEG RVC 实时自适应解码器引擎:基于MPEG RVC的通用视频解码器
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072426
J. Gorin, H. Yviquel, F. Prêteux, M. Raulet
In this paper, we introduce the Just-In-Time Adaptive Decoder Engine (Jade) project, which is shipped as part of the Open RVC-CAL Compiler (Orcc) project. Orcc provides a set of open-source software tools for managing decoders standardized within MPEG by the Reconfigurable Video Coding (RVC) experts. In this framework, Jade acts as a Virtual Machine for any decoder description that uses the MPEG RVC paradigm. Jade dynamically generates a native decoder representation suitable for X86, ARM and CELL platforms with a possibility of exploiting multi-core CPUs. Thus, according to the MPEG RVC decoder description coupled with a video coded stream, Jade can create, configure and re-configure video decompression algorithms adapting to the video content.
在本文中,我们介绍了即时自适应解码器引擎(Jade)项目,它作为Open RVC-CAL编译器(Orcc)项目的一部分发布。Orcc提供了一套开源软件工具,用于管理由可重构视频编码(RVC)专家在MPEG中标准化的解码器。在这个框架中,Jade充当任何使用MPEG RVC范式的解码器描述的虚拟机。Jade动态生成适合X86、ARM和CELL平台的本机解码器表示,并可能利用多核cpu。因此,根据MPEG RVC解码器描述和视频编码流,Jade可以创建、配置和重新配置适应视频内容的视频解压缩算法。
{"title":"Just-in-time adaptive decoder engine: a universal video decoder based on MPEG RVC","authors":"J. Gorin, H. Yviquel, F. Prêteux, M. Raulet","doi":"10.1145/2072298.2072426","DOIUrl":"https://doi.org/10.1145/2072298.2072426","url":null,"abstract":"In this paper, we introduce the Just-In-Time Adaptive Decoder Engine (Jade) project, which is shipped as part of the Open RVC-CAL Compiler (Orcc) project. Orcc provides a set of open-source software tools for managing decoders standardized within MPEG by the Reconfigurable Video Coding (RVC) experts. In this framework, Jade acts as a Virtual Machine for any decoder description that uses the MPEG RVC paradigm. Jade dynamically generates a native decoder representation suitable for X86, ARM and CELL platforms with a possibility of exploiting multi-core CPUs. Thus, according to the MPEG RVC decoder description coupled with a video coded stream, Jade can create, configure and re-configure video decompression algorithms adapting to the video content.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"65 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115823742","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
MMSI talk: an applicative use case of quaero media monitoring & social impact MMSI讲座:quaero媒体监控和社会影响的应用案例
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072437
R. Blouet, Charlotte Juan
MMSI (Media Monitoring: Social impact) is an applicative project that is part of the European project Quaero. MMSI aims at developing a cross-media analysis and monitoring platform that enables to measure and understand information life-cycle within a set of radio, tv, newspaper and web sources. MMSI allows to quickly build ad-hoc web applications that implements study according to customers needs. We here present MMSI Talk, a platform for quantitative and qualitative analysis of political talks. MMSI Talk is a web interface that allows a global monitoring of broadcasted political content over a set of french radio. MMSI Talk allows intuitive search through queries by media, named entities, political party and/or politician. It includes access to talks, cumulative measure of speech duration at the politician or political party level. Moreover MMSI Talk provides a set of statistical and visualization tools that allow an advance understanding of political communication strategies. We first describe the context and motivation of the MMSI Talk talk platform. We then describe the global architecture of the platform before presenting the user interface through several concrete use cases.
MMSI(媒体监测:社会影响)是一个应用项目,是欧洲Quaero项目的一部分。MMSI旨在开发一个跨媒体分析和监测平台,以测量和了解一系列广播、电视、报纸和网络资源中的信息生命周期。MMSI允许根据客户需求快速构建特定的web应用程序来实现学习。我们在这里介绍MMSI谈话,一个定量和定性分析政治会谈的平台。MMSI Talk是一个网络界面,允许通过一套法国电台对广播的政治内容进行全球监测。MMSI Talk允许通过媒体、命名实体、政党和/或政治家的查询进行直观搜索。它包括参加会谈的机会,政治家或政党层面的演讲时间累积衡量标准。此外,MMSI Talk提供了一套统计和可视化工具,可以提前了解政治传播策略。我们首先描述了MMSI Talk Talk平台的背景和动机。然后,在通过几个具体用例展示用户界面之前,我们描述了平台的全局体系结构。
{"title":"MMSI talk: an applicative use case of quaero media monitoring & social impact","authors":"R. Blouet, Charlotte Juan","doi":"10.1145/2072298.2072437","DOIUrl":"https://doi.org/10.1145/2072298.2072437","url":null,"abstract":"MMSI (Media Monitoring: Social impact) is an applicative project that is part of the European project Quaero. MMSI aims at developing a cross-media analysis and monitoring platform that enables to measure and understand information life-cycle within a set of radio, tv, newspaper and web sources. MMSI allows to quickly build ad-hoc web applications that implements study according to customers needs. We here present MMSI Talk, a platform for quantitative and qualitative analysis of political talks. MMSI Talk is a web interface that allows a global monitoring of broadcasted political content over a set of french radio. MMSI Talk allows intuitive search through queries by media, named entities, political party and/or politician. It includes access to talks, cumulative measure of speech duration at the politician or political party level. Moreover MMSI Talk provides a set of statistical and visualization tools that allow an advance understanding of political communication strategies. We first describe the context and motivation of the MMSI Talk talk platform. We then describe the global architecture of the platform before presenting the user interface through several concrete use cases.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"74 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124810342","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
OpenCast Matterhorn 1.1: reaching new heights OpenCast Matterhorn 1.1:达到新的高度
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072424
Christopher A. Brooks, M. Ketterl, Adam Hochman, Josh Holtzman, Judy Stern, Tobias Wunden, Kristofor Amundson, Greg Logan, Kenneth Lui, Adam McKenzie, Denis Meyer, M. Moormann, M. Rihtar, Rüdiger Rolf, Nejc Skofic, Micah Sutton, Ruben Perez Vazquez, Benjamin Wulff
This paper gives a short overview of the Opencast Matterhorn system. Built by an open community of individuals and institutions, Matterhorn provides a lecture capture platform for both research and production environments. Matterhorn is comprehensive and scalable, and includes components for the acquisition, processing, and playback of content. Matterhorn is licensed under the liberal Educational Community License (ECL 2.0), a flexible OSI approved open source license, and the Opencast community is free for all institutions, corporations, or individuals to join.
本文简要介绍了Opencast Matterhorn系统。Matterhorn是一个由个人和机构组成的开放社区,为研究和生产环境提供了一个讲座捕捉平台。Matterhorn是全面和可扩展的,包括用于获取、处理和播放内容的组件。Matterhorn在自由的教育社区许可证(ECL 2.0)下获得许可,这是一个灵活的OSI批准的开源许可证,并且Opencast社区对所有机构,公司或个人免费加入。
{"title":"OpenCast Matterhorn 1.1: reaching new heights","authors":"Christopher A. Brooks, M. Ketterl, Adam Hochman, Josh Holtzman, Judy Stern, Tobias Wunden, Kristofor Amundson, Greg Logan, Kenneth Lui, Adam McKenzie, Denis Meyer, M. Moormann, M. Rihtar, Rüdiger Rolf, Nejc Skofic, Micah Sutton, Ruben Perez Vazquez, Benjamin Wulff","doi":"10.1145/2072298.2072424","DOIUrl":"https://doi.org/10.1145/2072298.2072424","url":null,"abstract":"This paper gives a short overview of the Opencast Matterhorn system. Built by an open community of individuals and institutions, Matterhorn provides a lecture capture platform for both research and production environments. Matterhorn is comprehensive and scalable, and includes components for the acquisition, processing, and playback of content. Matterhorn is licensed under the liberal Educational Community License (ECL 2.0), a flexible OSI approved open source license, and the Opencast community is free for all institutions, corporations, or individuals to join.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"83 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124800427","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 18
Colorizing tags in tag cloud: a novel query-by-tag music search system 标签云中的标签着色:一种新颖的按标签查询的音乐搜索系统
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072337
Ju-Chiang Wang, Yu-Chin Shih, Meng-Sung Wu, H. Wang, Shyh-Kang Jeng
This paper presents a novel content-based query-by-tag music search system for an untagged music database. We design a new tag query interface that allows users to input multiple tags with multiple levels of preference (denoted as an MTML query) by colorizing desired tags in a web-based tag cloud interface. When a user clicks and holds the left mouse button (or presses and holds his/her finger on a touch screen) on a desired tag, the color of the tag will change cyclically according to a color map (from dark blue to bright red), which represents the level of preference (from 0 to 1). In this way, the user can easily organize and check the query of multiple tags with multiple levels of preference through the colored tags. To effect the MTML content-based music retrieval, we introduce a probabilistic fusion model (denoted as GMFM), which consists of two mixture models, namely a Gaussian mixture model and a multinomial mixture model. GMFM can jointly model the auditory features and tag labels of a song. Two indexing methods and their corresponding matching methods, namely pseudo song-based matching and tag affinity-based matching, are incorporated into the pre-learned GMFM. We evaluate the proposed system on the MajorMiner and CAL-500 datasets. The experimental results demonstrate the effectiveness of GMFM and the potential of using MTML queries to search music from an untagged music database.
针对无标签音乐数据库,提出了一种基于内容的按标签查询音乐搜索系统。我们设计了一个新的标签查询界面,允许用户通过在基于web的标签云界面中为所需标签着色,输入具有多个偏好级别的多个标签(表示为MTML查询)。当用户在想要的标签上点击并按住鼠标左键(或在触摸屏上按住手指),标签的颜色会按照一个颜色图(从深蓝色到鲜红色)循环变化,这个颜色图代表了用户的偏好等级(从0到1)。这样用户就可以通过彩色标签方便地组织和查看对多个不同偏好等级的标签的查询。为了实现基于MTML内容的音乐检索,我们引入了一个概率融合模型(GMFM),该模型由两个混合模型组成,即高斯混合模型和多项混合模型。GMFM可以联合对歌曲的听觉特征进行建模和标记标签。在预学习GMFM中引入了基于伪歌曲的匹配和基于标签亲和力的匹配两种索引方法及其对应的匹配方法。我们在MajorMiner和CAL-500数据集上评估了所提出的系统。实验结果证明了GMFM的有效性,以及使用MTML查询从未标记的音乐数据库中搜索音乐的潜力。
{"title":"Colorizing tags in tag cloud: a novel query-by-tag music search system","authors":"Ju-Chiang Wang, Yu-Chin Shih, Meng-Sung Wu, H. Wang, Shyh-Kang Jeng","doi":"10.1145/2072298.2072337","DOIUrl":"https://doi.org/10.1145/2072298.2072337","url":null,"abstract":"This paper presents a novel content-based query-by-tag music search system for an untagged music database. We design a new tag query interface that allows users to input multiple tags with multiple levels of preference (denoted as an MTML query) by colorizing desired tags in a web-based tag cloud interface. When a user clicks and holds the left mouse button (or presses and holds his/her finger on a touch screen) on a desired tag, the color of the tag will change cyclically according to a color map (from dark blue to bright red), which represents the level of preference (from 0 to 1). In this way, the user can easily organize and check the query of multiple tags with multiple levels of preference through the colored tags. To effect the MTML content-based music retrieval, we introduce a probabilistic fusion model (denoted as GMFM), which consists of two mixture models, namely a Gaussian mixture model and a multinomial mixture model. GMFM can jointly model the auditory features and tag labels of a song. Two indexing methods and their corresponding matching methods, namely pseudo song-based matching and tag affinity-based matching, are incorporated into the pre-learned GMFM. We evaluate the proposed system on the MajorMiner and CAL-500 datasets. The experimental results demonstrate the effectiveness of GMFM and the potential of using MTML queries to search music from an untagged music database.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"208 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131546034","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 21
Session management of correlated multi-stream 3D tele-immersive environments 相关多流三维远程沉浸环境的会话管理
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072489
A. Arefin
Quality control and resource optimization are challenging problems in 3D tele-immersive (3DTI) environments due to their large scale, multi-stream dependencies and dynamic peer (viewer) behavior. Such systems are also prone to performance degradation due to undesired behavior in the event of drastic demand changes, such as view change and large-scale simultaneous viewer arrivals or departures. Therefore, it is crucial to localize undesired behavior inside the system and re-organize the streaming overlay structures accordingly. Doing this accurately for a large scale is even more challenging and it requires to capture all events effecting the data plan and control plan of the system. Moreover, to do this, we need to understand the desired behavior of the application first, which is defined by the dependency patterns of performance and configuration metadata at each participating peers. To assist that, we propose a learning framework that discovers metadata dependency patterns from the time series metadata and uses an online profiler to detect undesired behavior of the system during run-time. Such universal protocol also enables the prediction of large scale performance degradation due to irregular dependencies. Finally an adaptation is proposed that reallocates the resources and rearranges overlay structures to overcome the undesired behavior. In summary, our goal is to provide a universal session monitoring and management framework for complex multi-stream 3DTI environments to support large number of concurrent viewers. We consider the difficulty in overlay construction, collecting metadata, answering queries, learning patterns, detecting undesired behavior at the participating peers and finally overlay adaptation considering multi-stream dependencies.
由于3D远程沉浸(3DTI)环境的大规模、多流依赖和动态对等(观众)行为,质量控制和资源优化是具有挑战性的问题。这样的系统也很容易性能下降,因为在剧烈的需求变化的情况下,不希望的行为,如视图变化和大规模的同时观众到达或离开。因此,定位系统内部的不良行为并相应地重新组织流覆盖结构是至关重要的。在大规模情况下准确地做到这一点更具挑战性,它需要捕获影响系统数据计划和控制计划的所有事件。此外,要做到这一点,我们需要首先了解应用程序的预期行为,这是由每个参与节点的性能和配置元数据的依赖模式定义的。为了帮助实现这一点,我们提出了一个学习框架,该框架可以从时间序列元数据中发现元数据依赖模式,并使用在线分析器在运行时检测系统的不良行为。这种通用协议还可以预测由于不规则依赖而导致的大规模性能下降。最后提出了一种重新分配资源和重新排列覆盖结构的自适应方法来克服不期望的行为。总之,我们的目标是为复杂的多流3DTI环境提供一个通用的会话监控和管理框架,以支持大量并发观看者。我们考虑了覆盖构建、收集元数据、回答查询、学习模式、检测参与节点的不良行为以及考虑多流依赖性的覆盖自适应等方面的困难。
{"title":"Session management of correlated multi-stream 3D tele-immersive environments","authors":"A. Arefin","doi":"10.1145/2072298.2072489","DOIUrl":"https://doi.org/10.1145/2072298.2072489","url":null,"abstract":"Quality control and resource optimization are challenging problems in 3D tele-immersive (3DTI) environments due to their large scale, multi-stream dependencies and dynamic peer (viewer) behavior. Such systems are also prone to performance degradation due to undesired behavior in the event of drastic demand changes, such as view change and large-scale simultaneous viewer arrivals or departures. Therefore, it is crucial to localize undesired behavior inside the system and re-organize the streaming overlay structures accordingly. Doing this accurately for a large scale is even more challenging and it requires to capture all events effecting the data plan and control plan of the system. Moreover, to do this, we need to understand the desired behavior of the application first, which is defined by the dependency patterns of performance and configuration metadata at each participating peers. To assist that, we propose a learning framework that discovers metadata dependency patterns from the time series metadata and uses an online profiler to detect undesired behavior of the system during run-time. Such universal protocol also enables the prediction of large scale performance degradation due to irregular dependencies. Finally an adaptation is proposed that reallocates the resources and rearranges overlay structures to overcome the undesired behavior. In summary, our goal is to provide a universal session monitoring and management framework for complex multi-stream 3DTI environments to support large number of concurrent viewers. We consider the difficulty in overlay construction, collecting metadata, answering queries, learning patterns, detecting undesired behavior at the participating peers and finally overlay adaptation considering multi-stream dependencies.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"281 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131426079","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Proceedings of the 19th ACM international conference on Multimedia
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
﹀
mjeditor
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1