首页 > 最新文献
paperpass

Proceedings of the 19th ACM international conference on Multimedia最新文献

英文 中文
JIGSAW: interactive mobile visual search with multimodal queries JIGSAW:具有多模式查询的交互式移动视觉搜索
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072310
Yang Wang, Tao Mei, Jingdong Wang, Houqiang Li, Shipeng Li
The traditional text-based visual search has not been sufficiently improved over the years to accommodate the new emerging demand of mobile users. While on the go, searching on one's phone is becoming pervasive. This paper presents an innovative application for mobile phone users to facilitate their visual search experience. By taking advantage of smart phone functionalities such as multi-modal and multi-touch interactions, users can more conveniently formulate their search intent, and thus search performance can be significantly improved. The system, called JIGSAW (Joint search with ImaGe, Speech, And Words), represents one of the first attempts to create an interactive and multi-modal mobile visual search application. The key of JIGSAW is the composition of an exemplary image query generated from the raw speech via multi-touch user interaction, as well as the visual search based on the exemplary image. Through JIGSAW, users can formulate their search intent in a natural way like playing a jigsaw puzzle on the phone screen: 1) a user speaks a natural sentence as the query, 2) the speech is recognized and transferred to text which is further decomposed to keywords through entity extraction, 3) the user selects preferred exemplary images that can visually represent his/her intent and composes a query image via multi-touch, and 4) the composite image is then used as a visual query to search similar images. We have deployed JIGSAW on a real-world phone system, evaluated the performance on one million images, and demonstrated that it is an effective complement to existing mobile visual search applications.
传统的基于文本的视觉搜索多年来没有得到充分的改进,以适应移动用户的新需求。在旅途中,用手机搜索正变得越来越普遍。本文为手机用户提供了一个创新的应用程序,以方便他们的视觉搜索体验。利用智能手机的多模态、多点触摸交互等功能,用户可以更方便地制定自己的搜索意图,从而显著提高搜索性能。这个系统被称为JIGSAW(图像、语音和文字联合搜索),它代表了创建交互式和多模态移动视觉搜索应用程序的首次尝试之一。JIGSAW的关键是通过多点触控用户交互从原始语音生成示例性图像查询,以及基于示例性图像的视觉搜索。通过JIGSAW,用户可以像在手机屏幕上玩拼图游戏一样,以一种自然的方式制定自己的搜索意图:1)用户说出自然的句子作为查询,2)语音被识别并转化为文本,文本通过实体提取进一步分解为关键词,3)用户选择能够直观表达其意图的首选示例图像,通过多点触控合成查询图像,4)合成图像作为视觉查询,搜索类似图像。我们已经在一个真实的电话系统上部署了JIGSAW,在一百万张图片上评估了它的性能,并证明了它是对现有移动视觉搜索应用程序的有效补充。
{"title":"JIGSAW: interactive mobile visual search with multimodal queries","authors":"Yang Wang, Tao Mei, Jingdong Wang, Houqiang Li, Shipeng Li","doi":"10.1145/2072298.2072310","DOIUrl":"https://doi.org/10.1145/2072298.2072310","url":null,"abstract":"The traditional text-based visual search has not been sufficiently improved over the years to accommodate the new emerging demand of mobile users. While on the go, searching on one's phone is becoming pervasive. This paper presents an innovative application for mobile phone users to facilitate their visual search experience. By taking advantage of smart phone functionalities such as multi-modal and multi-touch interactions, users can more conveniently formulate their search intent, and thus search performance can be significantly improved. The system, called JIGSAW (Joint search with ImaGe, Speech, And Words), represents one of the first attempts to create an interactive and multi-modal mobile visual search application. The key of JIGSAW is the composition of an exemplary image query generated from the raw speech via multi-touch user interaction, as well as the visual search based on the exemplary image. Through JIGSAW, users can formulate their search intent in a natural way like playing a jigsaw puzzle on the phone screen: 1) a user speaks a natural sentence as the query, 2) the speech is recognized and transferred to text which is further decomposed to keywords through entity extraction, 3) the user selects preferred exemplary images that can visually represent his/her intent and composes a query image via multi-touch, and 4) the composite image is then used as a visual query to search similar images. We have deployed JIGSAW on a real-world phone system, evaluated the performance on one million images, and demonstrated that it is an effective complement to existing mobile visual search applications.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"77 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133740153","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 26
Location-aware system based on a dynamic 3D model to help in live broadcasting of sport events 基于动态3D模型的位置感知系统,有助于体育赛事的直播
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2071924
Roberto Yus, E. Mena, Jordi Bernad, S. Ilarri, A. Illarramendi
Broadcasting sport events in live is a challenging task because obtaining the best views requires taking into account many dynamic factors, such as: the location and movement of interesting objects, all the views provided by cameras in the scenario (some of them wireless, mobile, or attached to moving objects), possible occlusions, etc. Therefore, a technical director needs to manage a great amount of continuously changing information to quickly select the camera whose view should be broadcasted. In this paper, we present a location-aware system that helps technical directors in the broadcasting task, using a 3D model updated continuously with real-time location data retrieved from the scenario. They can indicate in run-time their interest in certain moving objects and the system is in charge of selecting the cameras that provide the kind of views required.
直播体育赛事是一项具有挑战性的任务,因为获得最佳视角需要考虑许多动态因素,例如:有趣物体的位置和运动,场景中摄像机提供的所有视角(其中一些是无线的、移动的或连接到移动物体上的),可能的遮挡等。因此,技术总监需要管理大量不断变化的信息,以便快速选择需要播放其视图的摄像机。在本文中,我们提出了一个位置感知系统,该系统使用从场景中检索的实时位置数据不断更新的3D模型来帮助技术主管完成广播任务。他们可以在运行时表明他们对某些移动物体的兴趣,系统负责选择提供所需视图的摄像机。
{"title":"Location-aware system based on a dynamic 3D model to help in live broadcasting of sport events","authors":"Roberto Yus, E. Mena, Jordi Bernad, S. Ilarri, A. Illarramendi","doi":"10.1145/2072298.2071924","DOIUrl":"https://doi.org/10.1145/2072298.2071924","url":null,"abstract":"Broadcasting sport events in live is a challenging task because obtaining the best views requires taking into account many dynamic factors, such as: the location and movement of interesting objects, all the views provided by cameras in the scenario (some of them wireless, mobile, or attached to moving objects), possible occlusions, etc. Therefore, a technical director needs to manage a great amount of continuously changing information to quickly select the camera whose view should be broadcasted. In this paper, we present a location-aware system that helps technical directors in the broadcasting task, using a 3D model updated continuously with real-time location data retrieved from the scenario. They can indicate in run-time their interest in certain moving objects and the system is in charge of selecting the cameras that provide the kind of views required.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"56 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133722654","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Reliving on demand: a total viewer experience 按需重温:一个完整的观众体验
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072342
V. Singh, Jiebo Luo, D. Joshi, Phoury Lei, M. Das, Peter O. Stubler
Billions of people worldwide use images and videos to capture various events in their lives. The primary purpose of the proposed media sharing application is digital re-living of those events by the photographers and their families and friends. The most popular tools for achieving this today are still static slide-shows (SSS) which primarily focus on visual effects rather than understanding the semantics of the media assets being used, or allowing different viewers (e.g. friends, family, who have different relationships, interests, time availabilities, and familiarities) any control over the flow of the show. We present a novel system that generates an aesthetically appealing and semantically drivable audio-visual media show based on several reliving dimensions of events, people, locations, and time. We allow each viewer to interact with the default presentation to 'on-the-fly' redirect the flow of reliving as desired from their individual perspectives. Moreover, each reliving session is logged and can be shared with other people over a wide array of platforms and devices, allowing sharing experience to go beyond the sharing of the media assets themselves. From a detailed analysis of the logged sessions across different user categories, we have obtained many interesting findings on the reliving needs, behaviors and patterns, which in turn validate our design motivations and principles.
全世界数十亿人使用图像和视频来捕捉他们生活中的各种事件。这个媒体共享应用程序的主要目的是让摄影师和他们的家人和朋友以数字方式再现这些事件。实现这一目标的最流行工具仍然是静态幻灯片(SSS),它主要关注视觉效果,而不是理解所使用的媒体资产的语义,或者允许不同的观众(例如朋友,家人,他们有不同的关系,兴趣,时间可用性和熟悉度)控制节目的流程。我们提出了一种新颖的系统,该系统基于事件、人物、地点和时间的几个再现维度,产生具有美学吸引力和语义驱动的视听媒体节目。我们允许每个观众与默认的演示交互,以“即时”从他们个人的角度重新定向体验流。此外,每个重温会话都被记录下来,可以通过各种平台和设备与其他人共享,从而使分享体验超越了媒体资产本身的共享。通过对不同用户类别的日志会话的详细分析,我们获得了许多关于再现需求、行为和模式的有趣发现,这些发现反过来验证了我们的设计动机和原则。
{"title":"Reliving on demand: a total viewer experience","authors":"V. Singh, Jiebo Luo, D. Joshi, Phoury Lei, M. Das, Peter O. Stubler","doi":"10.1145/2072298.2072342","DOIUrl":"https://doi.org/10.1145/2072298.2072342","url":null,"abstract":"Billions of people worldwide use images and videos to capture various events in their lives. The primary purpose of the proposed media sharing application is digital re-living of those events by the photographers and their families and friends. The most popular tools for achieving this today are still static slide-shows (SSS) which primarily focus on visual effects rather than understanding the semantics of the media assets being used, or allowing different viewers (e.g. friends, family, who have different relationships, interests, time availabilities, and familiarities) any control over the flow of the show. We present a novel system that generates an aesthetically appealing and semantically drivable audio-visual media show based on several reliving dimensions of events, people, locations, and time. We allow each viewer to interact with the default presentation to 'on-the-fly' redirect the flow of reliving as desired from their individual perspectives. Moreover, each reliving session is logged and can be shared with other people over a wide array of platforms and devices, allowing sharing experience to go beyond the sharing of the media assets themselves. From a detailed analysis of the logged sessions across different user categories, we have obtained many interesting findings on the reliving needs, behaviors and patterns, which in turn validate our design motivations and principles.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115753711","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Low-cost creation of a 3D interactive museum exhibition 低成本创建一个3D互动博物馆展览
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072477
David S. Monaghan, James O'Sullivan, N. O’Connor, Bridget Kelly, Olivier Kazmierczak, Lorraine Comer
We present a demonstration of a multi-sensory virtual experience that accurately reflects the experience of a real visit to a museum. We have developed a 3D interactive digital museum exhibition corresponding to a photo-realistic 3D reconstruction of the Iconic Treasures exhibition at the National Museum of Ireland's archaeology building. Users can explore the 3D virtual environment and interact with the displays by accessing high resolution photographs and historical descriptions of the artefacts. This demo will showcase the experience on a 3D laptop with the use of active shutter LCD glasses to create an immersive experience. A key aspect of the demonstration is that it was developed using low-cost or freely available OTS tools wherever possible putting the creation of such digital exhibitions within reach of even modest budgets.
我们展示了一个多感官虚拟体验的演示,它准确地反映了真实参观博物馆的体验。我们开发了一个3D互动数字博物馆展览,对应于爱尔兰国家博物馆考古大楼的标志性宝藏展览的逼真3D重建。用户可以探索3D虚拟环境,并通过访问高分辨率照片和文物的历史描述与显示器互动。该演示将展示3D笔记本电脑上的体验,并使用主动快门LCD眼镜来创造身临其境的体验。该演示的一个关键方面是,它是使用低成本或免费提供的OTS工具开发的,因此即使预算有限,也可以创建此类数字展览。
{"title":"Low-cost creation of a 3D interactive museum exhibition","authors":"David S. Monaghan, James O'Sullivan, N. O’Connor, Bridget Kelly, Olivier Kazmierczak, Lorraine Comer","doi":"10.1145/2072298.2072477","DOIUrl":"https://doi.org/10.1145/2072298.2072477","url":null,"abstract":"We present a demonstration of a multi-sensory virtual experience that accurately reflects the experience of a real visit to a museum. We have developed a 3D interactive digital museum exhibition corresponding to a photo-realistic 3D reconstruction of the Iconic Treasures exhibition at the National Museum of Ireland's archaeology building. Users can explore the 3D virtual environment and interact with the displays by accessing high resolution photographs and historical descriptions of the artefacts. This demo will showcase the experience on a 3D laptop with the use of active shutter LCD glasses to create an immersive experience. A key aspect of the demonstration is that it was developed using low-cost or freely available OTS tools wherever possible putting the creation of such digital exhibitions within reach of even modest budgets.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123917547","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Galaxy browser: exploratory search of web videos 银河浏览器:探索性搜索网络视频
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072467
Lei Pang, Song Tan, Hung-Khoon Tan, C. Ngo
Most search engines return a ranked list of items in response to a query. The list however tells very little about the relationship among items. For videos especially, users often read to spend significant amount of time to navigate the search result. Exploratory search presents a new paradigm for browsing where the browser takes up the role of information exploring and presents a well-organized browsing structure for users to navigate. The proposed interface Galaxy Browser adopts the recent advances in near-duplicate detection and then synchronizes the detected near-duplicate information with comprehensive background knowledge derived from online external resources. The result is a topic structure on which users can easily browse and explore.
大多数搜索引擎在响应查询时返回一个项目排序列表。然而,该列表几乎没有说明项目之间的关系。特别是对于视频,用户通常会花大量时间浏览搜索结果。探索性搜索提供了一种新的浏览模式,其中浏览器承担了信息探索的角色,并为用户提供了一个组织良好的浏览结构。所提出的银河浏览器接口采用了近重复检测的最新进展,将检测到的近重复信息与从在线外部资源中获取的综合背景知识进行同步。其结果是用户可以轻松浏览和探索的主题结构。
{"title":"Galaxy browser: exploratory search of web videos","authors":"Lei Pang, Song Tan, Hung-Khoon Tan, C. Ngo","doi":"10.1145/2072298.2072467","DOIUrl":"https://doi.org/10.1145/2072298.2072467","url":null,"abstract":"Most search engines return a ranked list of items in response to a query. The list however tells very little about the relationship among items. For videos especially, users often read to spend significant amount of time to navigate the search result. Exploratory search presents a new paradigm for browsing where the browser takes up the role of information exploring and presents a well-organized browsing structure for users to navigate. The proposed interface Galaxy Browser adopts the recent advances in near-duplicate detection and then synchronizes the detected near-duplicate information with comprehensive background knowledge derived from online external resources. The result is a topic structure on which users can easily browse and explore.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"74 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124551950","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Digital media distribution: the future 数字媒体发行:未来
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072376
A. Robert
Consumer devices and technologies are evolving faster than ever, allowing for rich, interactive user experiences. But more importantly, media consumption behavior and expectations are changing and the promise of digital media remains to be fulfilled. In this presentation, we will explore major technology trends, consumer trends, and how they intersect with the future digital media experiences and business models.
消费者设备和技术的发展速度比以往任何时候都要快,这使得丰富的交互式用户体验成为可能。但更重要的是,媒体消费行为和期望正在发生变化,数字媒体的承诺仍有待实现。在本次演讲中,我们将探讨主要的技术趋势、消费趋势,以及它们如何与未来的数字媒体体验和商业模式相结合。
{"title":"Digital media distribution: the future","authors":"A. Robert","doi":"10.1145/2072298.2072376","DOIUrl":"https://doi.org/10.1145/2072298.2072376","url":null,"abstract":"Consumer devices and technologies are evolving faster than ever, allowing for rich, interactive user experiences. But more importantly, media consumption behavior and expectations are changing and the promise of digital media remains to be fulfilled. In this presentation, we will explore major technology trends, consumer trends, and how they intersect with the future digital media experiences and business models.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"114 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114449814","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A VLC media player plugin enabling dynamic adaptive streaming over HTTP 一个VLC媒体播放器插件,支持HTTP上的动态自适应流
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072429
Christopher Müller, C. Timmerer
This paper describes the implementation of a VLC media player plugin enabling Dynamic Adaptive Streaming over HTTP (DASH). DASH is an emerging ISO/IEC MPEG and 3GPP standard for HTTP streaming. It aims to standardize formats enabling segmented progressive download by exploiting existing Internet infrastructure as such. Our implementation of these formats as described in this paper is based on the well-known VLC. Hence, it is fully integrated into the VLC structure and has been also submitted to the VLC development team for consideration in future releases of VLC. Therefore, it is licensed under the GNU Lesser General Public License (LGPL). The plugin provides a very flexible structure that could be easily extended with respect to different adaptation logics or profiles of the DASH standard. As a consequence, the plugin enables the integration of a variety of adaptation logics and comparison thereof, making it attractive for the research community.
本文描述了一个支持HTTP动态自适应流(DASH)的VLC媒体播放器插件的实现。DASH是一种新兴的用于HTTP流的ISO/IEC MPEG和3GPP标准。它的目标是通过利用现有的互联网基础设施来实现分段渐进式下载的格式标准化。本文中描述的这些格式的实现是基于众所周知的VLC。因此,它完全集成到VLC结构中,并已提交给VLC开发团队,以便在未来的VLC版本中考虑。因此,它是在GNU较宽松通用公共许可证(LGPL)下授权的。该插件提供了一个非常灵活的结构,可以根据DASH标准的不同适应逻辑或配置文件轻松扩展。因此,该插件可以集成各种适应逻辑并对其进行比较,使其对研究界具有吸引力。
{"title":"A VLC media player plugin enabling dynamic adaptive streaming over HTTP","authors":"Christopher Müller, C. Timmerer","doi":"10.1145/2072298.2072429","DOIUrl":"https://doi.org/10.1145/2072298.2072429","url":null,"abstract":"This paper describes the implementation of a VLC media player plugin enabling Dynamic Adaptive Streaming over HTTP (DASH). DASH is an emerging ISO/IEC MPEG and 3GPP standard for HTTP streaming. It aims to standardize formats enabling segmented progressive download by exploiting existing Internet infrastructure as such. Our implementation of these formats as described in this paper is based on the well-known VLC. Hence, it is fully integrated into the VLC structure and has been also submitted to the VLC development team for consideration in future releases of VLC. Therefore, it is licensed under the GNU Lesser General Public License (LGPL). The plugin provides a very flexible structure that could be easily extended with respect to different adaptation logics or profiles of the DASH standard. As a consequence, the plugin enables the integration of a variety of adaptation logics and comparison thereof, making it attractive for the research community.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114713855","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 112
Innovating the multimedia experience 创新多媒体体验
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072384
K. El-Maleh, Haohong Wang, Susie Wee, H. Yu, James D. Johnston, Zhengyou Zhang
In this panel, each panelist will present their view of the current state-of-the-art of research and product innovations in the three major areas of multimedia experience: visual, auditory and gaming. We will discuss examples of innovation that enhance the consumption and sharing of multimedia (video, audio, graphics etc.) and thus increase quality of user experience. Another major focus of this panel is to open the discussion on how to innovate new multimedia user experiences.
在本次专题讨论中,每位嘉宾将介绍他们对多媒体体验的三个主要领域(视觉、听觉和游戏)的最新研究和产品创新的看法。我们将讨论增强多媒体(视频、音频、图形等)的消费和共享,从而提高用户体验质量的创新实例。本次专题讨论会的另一个重点是就如何创新新的多媒体用户体验展开讨论。
{"title":"Innovating the multimedia experience","authors":"K. El-Maleh, Haohong Wang, Susie Wee, H. Yu, James D. Johnston, Zhengyou Zhang","doi":"10.1145/2072298.2072384","DOIUrl":"https://doi.org/10.1145/2072298.2072384","url":null,"abstract":"In this panel, each panelist will present their view of the current state-of-the-art of research and product innovations in the three major areas of multimedia experience: visual, auditory and gaming. We will discuss examples of innovation that enhance the consumption and sharing of multimedia (video, audio, graphics etc.) and thus increase quality of user experience. Another major focus of this panel is to open the discussion on how to innovate new multimedia user experiences.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123964254","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Analysis, indexing and visualization of presentation videos 分析,索引和可视化演示视频
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072499
Michele Merler
The exponential diffusion of unstructured multimedia content on sites such as YouTube has lately fostered a rapid growth of interest in the multimedia community toward a new line of systems to recognize visual content "in the wild", that is, in less structured, unconstrained and more realistic domains. Due to the lack of structure and to the low quality of the data, algorithms and paradigms designed for professional content often cannot directly be applied to the aforementioned domains, thus presenting a new challenge. One particular instance of such "wild videos" is represented by unstructured presentation videos, which are tools nowadays employed in a large variety of systems for different purposes, spanning from distance or e-learning to generation of conference proceedings, from corporate talks to student presentations. We are interested in helping users efficiently and effectively access visual information, in particular technical information, and learn from such online multimedia sources. Our proposed system aims at summarizing, indexing, cross- referencing and browsing unstructured ("wild") presentation videos, with a focus on the quality of the produced indexes as perceived by the end users.
在YouTube等网站上,非结构化多媒体内容呈指数级扩散,最近促进了多媒体社区对识别“野外”视觉内容的新系统的兴趣的快速增长,即在较少结构化、不受约束和更现实的领域。由于缺乏结构化和低质量的数据,为专业内容设计的算法和范式往往不能直接应用于上述领域,从而提出了新的挑战。这种“疯狂视频”的一个特殊实例是由非结构化的演示视频代表的,这些视频是当今用于各种不同目的的各种系统的工具,从远程或电子学习到会议记录生成,从公司会谈到学生演示。我们感兴趣的是帮助用户高效和有效地访问视觉信息,特别是技术信息,并从这种在线多媒体资源中学习。我们提出的系统旨在总结、索引、交叉引用和浏览非结构化(“野生”)演示视频,重点关注最终用户所感知的生成索引的质量。
{"title":"Analysis, indexing and visualization of presentation videos","authors":"Michele Merler","doi":"10.1145/2072298.2072499","DOIUrl":"https://doi.org/10.1145/2072298.2072499","url":null,"abstract":"The exponential diffusion of unstructured multimedia content on sites such as YouTube has lately fostered a rapid growth of interest in the multimedia community toward a new line of systems to recognize visual content \"in the wild\", that is, in less structured, unconstrained and more realistic domains. Due to the lack of structure and to the low quality of the data, algorithms and paradigms designed for professional content often cannot directly be applied to the aforementioned domains, thus presenting a new challenge. One particular instance of such \"wild videos\" is represented by unstructured presentation videos, which are tools nowadays employed in a large variety of systems for different purposes, spanning from distance or e-learning to generation of conference proceedings, from corporate talks to student presentations. We are interested in helping users efficiently and effectively access visual information, in particular technical information, and learn from such online multimedia sources. Our proposed system aims at summarizing, indexing, cross- referencing and browsing unstructured (\"wild\") presentation videos, with a focus on the quality of the produced indexes as perceived by the end users.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"144 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125900952","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Towards textually describing complex video contents with audio-visual concept classifiers 利用视听概念分类器对复杂视频内容进行文本化描述
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072411
Chun-Chet Tan, Yu-Gang Jiang, C. Ngo
Automatically generating compact textual descriptions of complex video contents has wide applications. With the recent advancements in automatic audio-visual content recognition, in this paper we explore the technical feasibility of the challenging issue of precisely recounting video contents. Based on cutting-edge automatic recognition techniques, we start from classifying a variety of visual and audio concepts in video contents. According to the classification results, we apply simple rule-based methods to generate textual descriptions of video contents. Results are evaluated by conducting carefully designed user studies. We find that the state-of-the-art visual and audio concept classification, although far from perfect, is able to provide very useful clues indicating what is happening in the videos. Most users involved in the evaluation confirmed the informativeness of our machine-generated descriptions.
自动生成复杂视频内容的紧凑文本描述具有广泛的应用前景。随着自动视听内容识别技术的发展,本文探讨了视频内容精确复述这一具有挑战性的问题的技术可行性。基于前沿的自动识别技术,我们从对视频内容中的各种视听概念进行分类入手。根据分类结果,我们应用简单的基于规则的方法生成视频内容的文本描述。通过进行精心设计的用户研究来评估结果。我们发现,最先进的视觉和音频概念分类虽然远非完美,但能够提供非常有用的线索,表明视频中发生了什么。大多数参与评估的用户都确认了我们机器生成描述的信息量。
{"title":"Towards textually describing complex video contents with audio-visual concept classifiers","authors":"Chun-Chet Tan, Yu-Gang Jiang, C. Ngo","doi":"10.1145/2072298.2072411","DOIUrl":"https://doi.org/10.1145/2072298.2072411","url":null,"abstract":"Automatically generating compact textual descriptions of complex video contents has wide applications. With the recent advancements in automatic audio-visual content recognition, in this paper we explore the technical feasibility of the challenging issue of precisely recounting video contents. Based on cutting-edge automatic recognition techniques, we start from classifying a variety of visual and audio concepts in video contents. According to the classification results, we apply simple rule-based methods to generate textual descriptions of video contents. Results are evaluated by conducting carefully designed user studies. We find that the state-of-the-art visual and audio concept classification, although far from perfect, is able to provide very useful clues indicating what is happening in the videos. Most users involved in the evaluation confirmed the informativeness of our machine-generated descriptions.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"126 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127482796","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 41
期刊
Proceedings of the 19th ACM international conference on Multimedia
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
﹀
mjeditor
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1