首页 > 最新文献
paperpass

Proceedings of the 19th ACM international conference on Multimedia最新文献

英文 中文
Saving bitrate vs. pleasing users: where is the break-even point in mobile video quality? 节省比特率vs取悦用户:移动视频质量的盈亏平衡点在哪里?
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072351
Wei Song, D. Tjondronegoro, M. Docherty
This paper presents a comprehensive study to find the most efficient bitrate requirement to deliver mobile video that optimizes bandwidth, while at the same time maintains good user viewing experience. In the study, forty participants were asked to choose the lowest quality video that would still provide for a comfortable and long-term viewing experience, knowing that higher video quality is more expensive and bandwidth intensive. This paper proposes the lowest pleasing bitrates and corresponding encoding parameters for five different content types: cartoon, movie, music, news and sports. It also explores how the lowest pleasing quality is influenced by content type, image resolution, bitrate, and user gender, prior viewing experience, and preference. In addition, it analyzes the trajectory of users' progression while selecting the lowest pleasing quality. The findings reveal that the lowest bitrate requirement for a pleasing viewing experience is much higher than that of the lowest acceptable quality. Users' criteria for the lowest pleasing video quality are related to the video's content features, as well as its usage purpose and the user's personal preferences. These findings can provide video providers guidance on what quality they should offer to please mobile users.
本文提出了一项全面的研究,以找到最有效的比特率要求,以提供优化带宽的移动视频,同时保持良好的用户观看体验。在这项研究中,40名参与者被要求选择质量最低但仍能提供舒适和长期观看体验的视频,他们知道高质量的视频更昂贵,带宽也更密集。本文提出了卡通、电影、音乐、新闻和体育五种不同内容类型的最低满意比特率和相应的编码参数。它还探讨了最低令人满意的质量如何受到内容类型、图像分辨率、比特率、用户性别、先前观看经验和偏好的影响。此外,它还分析了用户进程的轨迹,同时选择了最低的愉悦质量。研究结果表明,令人愉悦的观看体验所需的最低比特率远高于可接受的最低质量。用户对最低满意视频质量的标准与视频的内容特征、使用目的和用户的个人偏好有关。这些发现可以为视频提供商提供指导,他们应该提供什么样的质量来取悦移动用户。
{"title":"Saving bitrate vs. pleasing users: where is the break-even point in mobile video quality?","authors":"Wei Song, D. Tjondronegoro, M. Docherty","doi":"10.1145/2072298.2072351","DOIUrl":"https://doi.org/10.1145/2072298.2072351","url":null,"abstract":"This paper presents a comprehensive study to find the most efficient bitrate requirement to deliver mobile video that optimizes bandwidth, while at the same time maintains good user viewing experience. In the study, forty participants were asked to choose the lowest quality video that would still provide for a comfortable and long-term viewing experience, knowing that higher video quality is more expensive and bandwidth intensive. This paper proposes the lowest pleasing bitrates and corresponding encoding parameters for five different content types: cartoon, movie, music, news and sports. It also explores how the lowest pleasing quality is influenced by content type, image resolution, bitrate, and user gender, prior viewing experience, and preference. In addition, it analyzes the trajectory of users' progression while selecting the lowest pleasing quality. The findings reveal that the lowest bitrate requirement for a pleasing viewing experience is much higher than that of the lowest acceptable quality. Users' criteria for the lowest pleasing video quality are related to the video's content features, as well as its usage purpose and the user's personal preferences. These findings can provide video providers guidance on what quality they should offer to please mobile users.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"87 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130471867","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 40
OpenMusic: visual programming environment for music composition, analysis and research OpenMusic:用于音乐创作、分析和研究的可视化编程环境
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072434
J. Bresson, C. Agón, G. Assayag
OpenMusic is an open source environment dedicated to music composition. The core of this environment is a full-featured visual programming language based on Common Lisp and CLOS (Common Lisp Object System) allowing to design processes for the generation or manipulation of musical material. This language can also be used for general purpose visual programming and other (possibly extra-musical) applications.
OpenMusic是一个致力于音乐创作的开源环境。该环境的核心是基于Common Lisp和CLOS (Common Lisp Object System)的全功能可视化编程语言,允许为音乐素材的生成或操作设计过程。这种语言也可以用于通用的可视化编程和其他(可能是音乐以外的)应用程序。
{"title":"OpenMusic: visual programming environment for music composition, analysis and research","authors":"J. Bresson, C. Agón, G. Assayag","doi":"10.1145/2072298.2072434","DOIUrl":"https://doi.org/10.1145/2072298.2072434","url":null,"abstract":"OpenMusic is an open source environment dedicated to music composition. The core of this environment is a full-featured visual programming language based on Common Lisp and CLOS (Common Lisp Object System) allowing to design processes for the generation or manipulation of musical material. This language can also be used for general purpose visual programming and other (possibly extra-musical) applications.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"74 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134165162","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 95
Sensor-rich video exploration on a map interface 传感器丰富的视频探索地图界面
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072459
Beomjoo Seo, Jia Hao, Guanfeng Wang
Result presentations from searches into video repositories is still a challenging problem. Current systems usually display a ranked list that shows the first frame of each video. Users then explore the videos one-by-one. In our recent work we have investigated the fusion of captured video with a continuous stream of sensor meta-data. These so-called sensor-rich videos can conveniently be captured with today's smartphones. Importantly, the recorded sensor-data streams enable processing and result resentation in novel and useful ways. In this demonstration we present a system that provides an integrated solution to present videos based on keyframe extraction and interactive, map-based browsing. As a key feature, the system automatically computes popular places based on the collective information from all the available videos. For each video it then extracts keyframes and renders them at their proper location on the map synchronously with the video playback. All the processing is performed in real-time, which allows for an interactive exploration of all the videos in a geographic area.
从搜索到视频库的结果呈现仍然是一个具有挑战性的问题。当前的系统通常显示一个排名列表,显示每个视频的第一帧。然后用户逐个浏览视频。在我们最近的工作中,我们研究了捕获视频与连续传感器元数据流的融合。这些所谓的传感器丰富的视频可以方便地用今天的智能手机拍摄。重要的是,记录的传感器数据流能够以新颖和有用的方式进行处理和结果表示。在这个演示中,我们展示了一个系统,该系统提供了一个基于关键帧提取和交互式、基于地图的浏览的集成解决方案来呈现视频。该系统的一个关键功能是,根据所有可用视频的集体信息,自动计算出热门地点。对于每个视频,它然后提取关键帧,并在地图上与视频播放同步的适当位置呈现它们。所有的处理都是实时执行的,这允许在一个地理区域内对所有视频进行交互式探索。
{"title":"Sensor-rich video exploration on a map interface","authors":"Beomjoo Seo, Jia Hao, Guanfeng Wang","doi":"10.1145/2072298.2072459","DOIUrl":"https://doi.org/10.1145/2072298.2072459","url":null,"abstract":"Result presentations from searches into video repositories is still a challenging problem. Current systems usually display a ranked list that shows the first frame of each video. Users then explore the videos one-by-one. In our recent work we have investigated the fusion of captured video with a continuous stream of sensor meta-data. These so-called sensor-rich videos can conveniently be captured with today's smartphones. Importantly, the recorded sensor-data streams enable processing and result resentation in novel and useful ways. In this demonstration we present a system that provides an integrated solution to present videos based on keyframe extraction and interactive, map-based browsing. As a key feature, the system automatically computes popular places based on the collective information from all the available videos. For each video it then extracts keyframes and renders them at their proper location on the map synchronously with the video playback. All the processing is performed in real-time, which allows for an interactive exploration of all the videos in a geographic area.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131172155","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 12
Video anatomy: cutting video volume for profile 视频解剖:切割视频体积的轮廓
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2071939
H. Cai, J. Zheng
This work takes a new aspect view to profile a video volume to a video track as a digest for video preview. Our projected video profile contains both spatial and temporal information inclusively in a 2D image scroll that is continuous, compact, scalable, and indexing to each frame. To profile various types of video clips, we investigate the global flow field under all camera actions, and propose a uniformed scheme that uses a sampling line to cut the video volume across the major optical flow field. The resulting profile obtains an intrinsic scene space less influenced by the camera actions, and can be displayed in a video track to guide the access to video frames, and facilitate video browsing, editing, and retrieval.
这项工作采用了一种新的方面视图,将视频卷配置为视频轨道,作为视频预览的摘要。我们的投影视频配置文件包含空间和时间信息,包括二维图像滚动,连续,紧凑,可扩展,并索引到每一帧。为了分析各种类型的视频剪辑,我们研究了所有摄像机动作下的全局流场,并提出了一种统一的方案,该方案使用采样线在主要光流场上切割视频体积。所得到的轮廓获得受摄像机动作影响较小的内在场景空间,并且可以显示在视频轨迹中,以指导对视频帧的访问,并便于视频浏览、编辑和检索。
{"title":"Video anatomy: cutting video volume for profile","authors":"H. Cai, J. Zheng","doi":"10.1145/2072298.2071939","DOIUrl":"https://doi.org/10.1145/2072298.2071939","url":null,"abstract":"This work takes a new aspect view to profile a video volume to a video track as a digest for video preview. Our projected video profile contains both spatial and temporal information inclusively in a 2D image scroll that is continuous, compact, scalable, and indexing to each frame. To profile various types of video clips, we investigate the global flow field under all camera actions, and propose a uniformed scheme that uses a sampling line to cut the video volume across the major optical flow field. The resulting profile obtains an intrinsic scene space less influenced by the camera actions, and can be displayed in a video track to guide the access to video frames, and facilitate video browsing, editing, and retrieval.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130976166","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
WSM2011: third ACM workshop on social media WSM2011:第三届ACM社会媒体研讨会
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072389
S. Hoi, Michal Jacovi, Y. Kompatsiaris, Jiebo Luo, K. Tserpes
The Third Workshop on Social Media (WSM2011) continues the series of Workshops on Social Media in 2009 and 2010 and has been established as a platform for the presentation and discussion of the latest, key research issues in social media analysis, exploration, search, mining, and emerging new social media applications. It is held in conjunction with the ACM International Multimedia Conference (MM'11) at Scottsdale, Arizona, USA, 2011 and has attracted contributions on various aspects of social media including data mining from social media, content organization, geo-localization, personalization, recommendation systems, user experience, machine learning and social media approaches and architectures for large-scale data processing.
第三届社交媒体研讨会(WSM2011)延续了2009年和2010年的社交媒体系列研讨会,并建立了一个展示和讨论社交媒体分析、探索、搜索、挖掘和新兴社交媒体应用方面最新、关键研究问题的平台。它与2011年在美国亚利桑那州斯科茨代尔举行的ACM国际多媒体会议(MM'11)同时举行,吸引了来自社交媒体各个方面的贡献,包括来自社交媒体的数据挖掘、内容组织、地理定位、个性化、推荐系统、用户体验、机器学习和大规模数据处理的社交媒体方法和架构。
{"title":"WSM2011: third ACM workshop on social media","authors":"S. Hoi, Michal Jacovi, Y. Kompatsiaris, Jiebo Luo, K. Tserpes","doi":"10.1145/2072298.2072389","DOIUrl":"https://doi.org/10.1145/2072298.2072389","url":null,"abstract":"The Third Workshop on Social Media (WSM2011) continues the series of Workshops on Social Media in 2009 and 2010 and has been established as a platform for the presentation and discussion of the latest, key research issues in social media analysis, exploration, search, mining, and emerging new social media applications. It is held in conjunction with the ACM International Multimedia Conference (MM'11) at Scottsdale, Arizona, USA, 2011 and has attracted contributions on various aspects of social media including data mining from social media, content organization, geo-localization, personalization, recommendation systems, user experience, machine learning and social media approaches and architectures for large-scale data processing.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"605 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133342245","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Towards peer-assisted rendering in networked virtual environments 网络虚拟环境中的对等辅助渲染
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072324
Minhui Zhu, S. Mondet, Géraldine Morin, Wei Tsang Ooi, Weiwei Cheng
This paper introduces a new technique, called peer-assisted rendering, that aims to enable interactive navigation in a 3D networked virtual environment using a resource-constrained device, by speeding up the rendering. A resource-constrained client requests part of the rendered scenes from other peers with similar viewpoints within the virtual environment, and merges the rendered parts into its own view. This approach is more scalable than previous solutions based on server-based pre-rendering. The goal of this paper is to make a strong case for the feasibility of peer-assisted rendering through the following two messages. First, by analyzing a large number of user traces from a popular virtual world called Second Life, we show that there are surprisingly many users with similar viewpoints and encompass large number of common objects in their viewing areas, indicating that a client can potentially find multiple other peers that can assist in rendering. Second, by combining three different rendering methods, each contributing to rendering of different classes of objects in the scene, we show that it is possible for a client to render the scene efficiently with little visual artifacts.
本文介绍了一种称为“对等辅助渲染”的新技术,该技术旨在利用资源受限的设备,通过加快渲染速度,在3D网络虚拟环境中实现交互式导航。资源受限的客户端从虚拟环境中具有类似视点的其他节点请求渲染场景的一部分,并将渲染部分合并到自己的视图中。这种方法比以前基于服务器的预呈现的解决方案更具可伸缩性。本文的目标是通过以下两条消息为对等辅助渲染的可行性提供强有力的案例。首先,通过分析来自流行的虚拟世界“第二人生”(Second Life)的大量用户痕迹,我们发现,令人惊讶的是,有许多用户具有相似的视点,并且在他们的观看区域中包含大量常见对象,这表明客户端可能会找到多个可以帮助渲染的其他对等体。其次,通过结合三种不同的渲染方法,每种方法都有助于渲染场景中不同类别的对象,我们表明客户端可以用很少的视觉伪影高效地渲染场景。
{"title":"Towards peer-assisted rendering in networked virtual environments","authors":"Minhui Zhu, S. Mondet, Géraldine Morin, Wei Tsang Ooi, Weiwei Cheng","doi":"10.1145/2072298.2072324","DOIUrl":"https://doi.org/10.1145/2072298.2072324","url":null,"abstract":"This paper introduces a new technique, called peer-assisted rendering, that aims to enable interactive navigation in a 3D networked virtual environment using a resource-constrained device, by speeding up the rendering. A resource-constrained client requests part of the rendered scenes from other peers with similar viewpoints within the virtual environment, and merges the rendered parts into its own view. This approach is more scalable than previous solutions based on server-based pre-rendering. The goal of this paper is to make a strong case for the feasibility of peer-assisted rendering through the following two messages. First, by analyzing a large number of user traces from a popular virtual world called Second Life, we show that there are surprisingly many users with similar viewpoints and encompass large number of common objects in their viewing areas, indicating that a client can potentially find multiple other peers that can assist in rendering. Second, by combining three different rendering methods, each contributing to rendering of different classes of objects in the scene, we show that it is possible for a client to render the scene efficiently with little visual artifacts.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"96 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132138950","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 15
Augmented makeover based on 3D morphable model 基于三维变形模型的增强改造
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072067
P. P. Wang, Xiaofeng Tong, Yangzhou Du, Jianguo Li, Wei Hu, Yimin Zhang
Avatar is the virtual representation of user's facial, body, and motion characteristics in computer game, social network, and augmented reality. Facial modeling needs enormous efforts to achieve immersive experience in applications like avatar chatting or online makeover. Great challenge exists in robust detection of 2D facial prominent points and mapping them to 3D models in a parameterized manner. Another challenge is how to characterize semantic components of eyes, mouth, nose, and cheek rather than low level mesh geometries. In this paper, we proposed an augmented makeover framework to deal with aforementioned challenges. Aiming to provide amateurs with flexible customizations, morphable model is constructed from a set of scanned 3D face data set. Appearance personalization is carried out in the offline phase where single image and multiple views are discussed respectively to generate deformative shape in a progressive manner. Augmentation is implemented in the online phase where a fast and robust 3D tracking is used to balance the tradeoff between accuracy and real-time requirements. By this means, immersive Human Computer Interaction such as virtual makeover and photo-realistic avatar chatting could be achieved.
虚拟化身是计算机游戏、社交网络和增强现实中用户面部、身体和动作特征的虚拟表示。面部建模需要付出巨大的努力,才能在头像聊天或在线化妆等应用程序中实现身临其境的体验。如何对二维面部突出点进行鲁棒检测,并以参数化的方式将其映射到三维模型中,是一个很大的挑战。另一个挑战是如何表征眼睛、嘴巴、鼻子和脸颊的语义成分,而不是低级的网格几何形状。在本文中,我们提出了一个增强改造框架来应对上述挑战。为了给业余爱好者提供灵活的定制,从一组扫描的三维人脸数据集构建变形模型。在离线阶段进行外观个性化,分别讨论单幅图像和多幅视图,逐步生成变形形状。增强是在在线阶段实现的,其中使用快速和强大的3D跟踪来平衡精度和实时要求之间的权衡。通过这种方式,可以实现虚拟化妆、逼真头像聊天等沉浸式人机交互。
{"title":"Augmented makeover based on 3D morphable model","authors":"P. P. Wang, Xiaofeng Tong, Yangzhou Du, Jianguo Li, Wei Hu, Yimin Zhang","doi":"10.1145/2072298.2072067","DOIUrl":"https://doi.org/10.1145/2072298.2072067","url":null,"abstract":"Avatar is the virtual representation of user's facial, body, and motion characteristics in computer game, social network, and augmented reality. Facial modeling needs enormous efforts to achieve immersive experience in applications like avatar chatting or online makeover. Great challenge exists in robust detection of 2D facial prominent points and mapping them to 3D models in a parameterized manner. Another challenge is how to characterize semantic components of eyes, mouth, nose, and cheek rather than low level mesh geometries. In this paper, we proposed an augmented makeover framework to deal with aforementioned challenges. Aiming to provide amateurs with flexible customizations, morphable model is constructed from a set of scanned 3D face data set. Appearance personalization is carried out in the offline phase where single image and multiple views are discussed respectively to generate deformative shape in a progressive manner. Augmentation is implemented in the online phase where a fast and robust 3D tracking is used to balance the tradeoff between accuracy and real-time requirements. By this means, immersive Human Computer Interaction such as virtual makeover and photo-realistic avatar chatting could be achieved.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"134 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132672685","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Automatic object segmentation from large scale 3D urban point clouds through manifold embedded mode seeking 基于流形嵌入模式搜索的大规模三维城市点云目标自动分割
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2071998
Zhiding Yu, Chunjing Xu, Jianzhuang Liu, O. Au, Xiaoou Tang
This paper presents a system that can automatically segment objects in large scale 3D point clouds obtained from urban ranging images. The system consists of three steps: The first one involves a ground detection process that can detect relatively complex terrain and separate it from other objects. The second step superpixelizes the remaining objects to speed up the segmentation process. In the final step, a manifold embedded mode seeking method is adopted to segment the point clouds. Even though the segmentation of urban objects is a challenging problem in terms of accuracy and problem scale, our system can efficiently generate very good segmentation results. The proposed manifold learning effectively improves the segmentation performance due to the fact that continuous artificial objects often have manifold-like structures.
提出了一种基于城市测距图像的大尺度三维点云的目标自动分割系统。该系统包括三个步骤:第一步是地面探测过程,可以探测到相对复杂的地形,并将其与其他物体分开。第二步对剩余对象进行超像素化处理,加快分割速度。最后,采用流形嵌入模式搜索方法对点云进行分割。尽管城市物体的分割在精度和问题规模上都是一个具有挑战性的问题,但我们的系统可以高效地产生非常好的分割结果。由于连续的人工对象通常具有流形结构,本文提出的流形学习方法有效地提高了分割性能。
{"title":"Automatic object segmentation from large scale 3D urban point clouds through manifold embedded mode seeking","authors":"Zhiding Yu, Chunjing Xu, Jianzhuang Liu, O. Au, Xiaoou Tang","doi":"10.1145/2072298.2071998","DOIUrl":"https://doi.org/10.1145/2072298.2071998","url":null,"abstract":"This paper presents a system that can automatically segment objects in large scale 3D point clouds obtained from urban ranging images. The system consists of three steps: The first one involves a ground detection process that can detect relatively complex terrain and separate it from other objects. The second step superpixelizes the remaining objects to speed up the segmentation process. In the final step, a manifold embedded mode seeking method is adopted to segment the point clouds. Even though the segmentation of urban objects is a challenging problem in terms of accuracy and problem scale, our system can efficiently generate very good segmentation results. The proposed manifold learning effectively improves the segmentation performance due to the fact that continuous artificial objects often have manifold-like structures.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"169 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132742162","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Dynamic social network for narrative video analysis 动态社交网络叙事视频分析
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072413
Tsung-Hung Tsai, Wen-Huang Cheng, Yung-Huan Hsieh
Narrative video analysis has attracted much research attention, for narrative scenes can provide meaningful representations of multimedia contents. To go beyond the limitations of content based appraoches, social network techniques was introduced in the literature to explore the high-level narrative structures by mining the relations between video characters. Taking into account the fact that such a social network is not static but changes over time as the video narrative evolves, in this work, we develop a novel social network model, namely dynamic social network, for capturing the spatiotemporal dynamics in the social network of video characters so as to enable the automatic segmentation of a video into a sequence of narrative scenes. The proposed approach is experimented with various genres of movies and the results demonstrate our effectiveness.
叙事视频分析一直备受关注,因为叙事场景能够为多媒体内容提供有意义的表征。为了超越基于内容的方法的局限性,文献中引入了社交网络技术,通过挖掘视频角色之间的关系来探索高层次的叙事结构。考虑到这种社会网络不是静态的,而是随着视频叙事的发展而随着时间的推移而变化的事实,在本工作中,我们开发了一种新的社会网络模型,即动态社会网络,用于捕捉视频角色的社会网络中的时空动态,从而实现视频自动分割成一系列叙事场景。对不同类型的电影进行了实验,结果证明了我们的有效性。
{"title":"Dynamic social network for narrative video analysis","authors":"Tsung-Hung Tsai, Wen-Huang Cheng, Yung-Huan Hsieh","doi":"10.1145/2072298.2072413","DOIUrl":"https://doi.org/10.1145/2072298.2072413","url":null,"abstract":"Narrative video analysis has attracted much research attention, for narrative scenes can provide meaningful representations of multimedia contents. To go beyond the limitations of content based appraoches, social network techniques was introduced in the literature to explore the high-level narrative structures by mining the relations between video characters. Taking into account the fact that such a social network is not static but changes over time as the video narrative evolves, in this work, we develop a novel social network model, namely dynamic social network, for capturing the spatiotemporal dynamics in the social network of video characters so as to enable the automatic segmentation of a video into a sequence of narrative scenes. The proposed approach is experimented with various genres of movies and the results demonstrate our effectiveness.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131437397","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Tag-based social image search with visual-text joint hypergraph learning 基于标签的视觉-文本联合超图学习社交图像搜索
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072054
Yue Gao, Meng Wang, Huanbo Luan, Jialie Shen, Shuicheng Yan, D. Tao
Tag-based social image search has attracted great interest and how to order the search results based on relevance level is a research problem. Visual content of images and tags have both been investigated. However, existing methods usually employ tags and visual content separately or sequentially to learn the image relevance. This paper proposes a tag-based image search with visual-text joint hypergraph learning. We simultaneously investigate the bag-of-words and bag-of-visual-words representations of images and accomplish the relevance estimation with a hypergraph learning approach. Each textual or visual word generates a hyperedge in the constructed hypergraph. We conduct experiments with a real-world data set and experimental results demonstrate the effectiveness of our approach.
基于标签的社交图像搜索引起了人们的极大兴趣,如何根据相关度对搜索结果进行排序是一个研究课题。图像和标签的视觉内容都进行了研究。然而,现有的方法通常是分别或依次使用标签和视觉内容来学习图像相关性。本文提出了一种基于标签的视觉文本联合超图学习的图像搜索方法。我们同时研究了图像的词袋表示和视觉词袋表示,并利用超图学习方法完成了相关性估计。每个文本或视觉词在构造的超图中生成一个超边。我们用真实世界的数据集进行了实验,实验结果证明了我们方法的有效性。
{"title":"Tag-based social image search with visual-text joint hypergraph learning","authors":"Yue Gao, Meng Wang, Huanbo Luan, Jialie Shen, Shuicheng Yan, D. Tao","doi":"10.1145/2072298.2072054","DOIUrl":"https://doi.org/10.1145/2072298.2072054","url":null,"abstract":"Tag-based social image search has attracted great interest and how to order the search results based on relevance level is a research problem. Visual content of images and tags have both been investigated. However, existing methods usually employ tags and visual content separately or sequentially to learn the image relevance. This paper proposes a tag-based image search with visual-text joint hypergraph learning. We simultaneously investigate the bag-of-words and bag-of-visual-words representations of images and accomplish the relevance estimation with a hypergraph learning approach. Each textual or visual word generates a hyperedge in the constructed hypergraph. We conduct experiments with a real-world data set and experimental results demonstrate the effectiveness of our approach.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"98 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131447404","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 90
期刊
Proceedings of the 19th ACM international conference on Multimedia
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
﹀
mjeditor
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1