首页 > 最新文献
paperpass

Proceedings of the 19th ACM international conference on Multimedia最新文献

英文 中文
A smart assistant for shooting virtual cinematography with motion-tracked cameras 一个智能助手,可以用动态跟踪摄像机拍摄虚拟电影
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072481
Christophe Lino, M. Christie, R. Ranon, William H. Bares
This demonstration shows how an automated assistant encoded with knowledge of cinematography practice can offer suggested viewpoints to a filmmaker operating a hand-held motion-tracked virtual camera device. Our system, called Director's Lens, uses an intelligent cinematography engine to compute, at the request of the filmmaker, a set of suitable camera placements for starting a shot that represent semantically and cinematically distinct choices for visualizing the current narrative. Editing decisions and hand-held camera compositions made by the user in turn influence the system's suggestions for subsequent shots. The result is a novel virtual cinematography workflow that enhances the filmmaker's creative potential by enabling efficient exploration of a wide range of computer-suggested cinematographic possibilities.
这个演示展示了一个具有电影摄影实践知识的自动助理如何为操作手持运动跟踪虚拟摄像机设备的电影制作人提供建议的观点。我们的系统叫做“导演镜头”(Director’s Lens),它使用一个智能摄影引擎,根据电影制作人的要求,计算出一组合适的摄像机位置,以开始一个镜头,这些镜头代表了语义上和电影上不同的选择,从而使当前的叙事可视化。用户做出的编辑决定和手持相机构图反过来影响系统对后续拍摄的建议。其结果是一种新颖的虚拟电影摄影工作流程,通过有效地探索广泛的计算机建议的电影可能性,增强了电影制作人的创造潜力。
{"title":"A smart assistant for shooting virtual cinematography with motion-tracked cameras","authors":"Christophe Lino, M. Christie, R. Ranon, William H. Bares","doi":"10.1145/2072298.2072481","DOIUrl":"https://doi.org/10.1145/2072298.2072481","url":null,"abstract":"This demonstration shows how an automated assistant encoded with knowledge of cinematography practice can offer suggested viewpoints to a filmmaker operating a hand-held motion-tracked virtual camera device. Our system, called Director's Lens, uses an intelligent cinematography engine to compute, at the request of the filmmaker, a set of suitable camera placements for starting a shot that represent semantically and cinematically distinct choices for visualizing the current narrative. Editing decisions and hand-held camera compositions made by the user in turn influence the system's suggestions for subsequent shots. The result is a novel virtual cinematography workflow that enhances the filmmaker's creative potential by enabling efficient exploration of a wide range of computer-suggested cinematographic possibilities.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121894807","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Asymmetric hamming embedding: taking the best of our bits for large scale image search 不对称汉明嵌入:利用我们最好的比特进行大规模图像搜索
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072035
Mihir Jain, H. Jégou, P. Gros
This paper proposes an asymmetric Hamming Embedding scheme for large scale image search based on local descriptors. The comparison of two descriptors relies on an vector-to-binary code comparison, which limits the quantization error associated with the query compared with the original Hamming Embedding method. The approach is used in combination with an inverted file structure that offers high efficiency, comparable to that of a regular bag-of-features retrieval system. The comparison is performed on two popular datasets. Our method consistently improves the search quality over the symmetric version. The trade-off between memory usage and precision is evaluated, showing that the method is especially useful for short binary signatures.
提出了一种基于局部描述符的非对称汉明嵌入方案,用于大规模图像搜索。两个描述符的比较依赖于矢量与二进制代码的比较,与原始的汉明嵌入方法相比,这限制了与查询相关的量化误差。该方法与倒置文件结构结合使用,提供了与常规特征袋检索系统相当的高效率。在两个流行的数据集上进行比较。与对称版本相比,我们的方法始终提高了搜索质量。评估了内存使用和精度之间的权衡,表明该方法对短二进制签名特别有用。
{"title":"Asymmetric hamming embedding: taking the best of our bits for large scale image search","authors":"Mihir Jain, H. Jégou, P. Gros","doi":"10.1145/2072298.2072035","DOIUrl":"https://doi.org/10.1145/2072298.2072035","url":null,"abstract":"This paper proposes an asymmetric Hamming Embedding scheme for large scale image search based on local descriptors. The comparison of two descriptors relies on an vector-to-binary code comparison, which limits the quantization error associated with the query compared with the original Hamming Embedding method. The approach is used in combination with an inverted file structure that offers high efficiency, comparable to that of a regular bag-of-features retrieval system. The comparison is performed on two popular datasets. Our method consistently improves the search quality over the symmetric version. The trade-off between memory usage and precision is evaluated, showing that the method is especially useful for short binary signatures.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122047881","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 69
Socially relevant simulation games: a design study 社交相关模拟游戏的设计研究
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2071908
Ramin Tadayon, Ashish Amresh, W. Burleson
Socially Relevant Simulation Games (SRSG), a new medium for social interaction, based on real-world skills and skill development, creates a single gaming framework that connects both serious and casual players. Through a detailed case study this paper presents a design process and framework for SRSG, in the context of mixed-reality golf swing simulations. The SRSG, entitled "World of Golf", utilizes a real-time expert system to capture, analyze, and evaluate golf swing metrics. The game combines swing data with players' backgrounds, e.g., handicaps, to form individual profiles. These profiles are then used to implement a golf simulation game using artificially controlled agents who inherit the skill levels of their corresponding human users. The simulation and assessment modules provide the serious player with tools to build golf skills while allowing casual players to engage within a simulated social world. A framework that incorporates simulated golf competitions among these social agents is presented and validated by comparing the usage statistics of 10 PGA Golf Management (PGM) students with 10 non-professional students.
社交相关模拟游戏(social Relevant Simulation Games,简称SRSG)是一种基于现实世界技能和技能发展的社交互动新媒介,它创造了一个连接严肃和休闲玩家的单一游戏框架。通过详细的案例研究,给出了混合现实高尔夫挥杆仿真中SRSG的设计过程和框架。名为“高尔夫世界”的SRSG利用实时专家系统捕捉、分析和评估高尔夫挥杆指标。该游戏将挥杆数据与球员的背景相结合,例如,障碍,形成个人资料。然后使用这些配置文件来实现高尔夫模拟游戏,使用人工控制的代理,这些代理继承相应人类用户的技能水平。模拟和评估模块为认真的玩家提供了建立高尔夫技能的工具,同时允许休闲玩家参与模拟的社交世界。通过比较10名PGA高尔夫管理(PGM)学生和10名非专业学生的使用统计数据,提出并验证了一个包含这些社会代理人之间模拟高尔夫比赛的框架。
{"title":"Socially relevant simulation games: a design study","authors":"Ramin Tadayon, Ashish Amresh, W. Burleson","doi":"10.1145/2072298.2071908","DOIUrl":"https://doi.org/10.1145/2072298.2071908","url":null,"abstract":"Socially Relevant Simulation Games (SRSG), a new medium for social interaction, based on real-world skills and skill development, creates a single gaming framework that connects both serious and casual players. Through a detailed case study this paper presents a design process and framework for SRSG, in the context of mixed-reality golf swing simulations. The SRSG, entitled \"World of Golf\", utilizes a real-time expert system to capture, analyze, and evaluate golf swing metrics. The game combines swing data with players' backgrounds, e.g., handicaps, to form individual profiles. These profiles are then used to implement a golf simulation game using artificially controlled agents who inherit the skill levels of their corresponding human users. The simulation and assessment modules provide the serious player with tools to build golf skills while allowing casual players to engage within a simulated social world. A framework that incorporates simulated golf competitions among these social agents is presented and validated by comparing the usage statistics of 10 PGA Golf Management (PGM) students with 10 non-professional students.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"59 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129865786","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Bag-of-colors for improved image search 用于改进图像搜索的色袋
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072034
C. Wengert, Matthijs Douze, H. Jégou
This paper investigates the use of color information when used within a state-of-the-art large scale image search system. We introduce a simple yet effective and efficient color signature generation procedure. It is used either to produce global or local descriptors. As a global descriptor, it outperforms several state-of-the-art color description methods, in particular the bag-of-words method based on color SIFT. As a local descriptor, our signature is used jointly with SIFT descriptors (no color) to provide complementary information. This significantly improves the recognition rate, outperforming the state of the art on two image search benchmarks. We provide an open source package of our signature (http://www.kooaba.com/en/learnmore/labs/).
本文研究了在最先进的大规模图像搜索系统中使用颜色信息的情况。我们介绍了一个简单而有效的颜色签名生成程序。它用于生成全局描述符或局部描述符。作为一种全局描述符,它优于几种最先进的颜色描述方法,特别是基于颜色SIFT的词袋方法。作为局部描述符,我们的签名与SIFT描述符(无颜色)联合使用,以提供补充信息。这大大提高了识别率,在两个图像搜索基准上优于目前的水平。我们提供了一个签名的开源包(http://www.kooaba.com/en/learnmore/labs/)。
{"title":"Bag-of-colors for improved image search","authors":"C. Wengert, Matthijs Douze, H. Jégou","doi":"10.1145/2072298.2072034","DOIUrl":"https://doi.org/10.1145/2072298.2072034","url":null,"abstract":"This paper investigates the use of color information when used within a state-of-the-art large scale image search system. We introduce a simple yet effective and efficient color signature generation procedure. It is used either to produce global or local descriptors. As a global descriptor, it outperforms several state-of-the-art color description methods, in particular the bag-of-words method based on color SIFT. As a local descriptor, our signature is used jointly with SIFT descriptors (no color) to provide complementary information. This significantly improves the recognition rate, outperforming the state of the art on two image search benchmarks. We provide an open source package of our signature (http://www.kooaba.com/en/learnmore/labs/).","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"29 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130533313","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 170
Fast detection of noisy GPS and magnetometer tags in wide-baseline multi-views 宽基线多视图下GPS和磁力计标签噪声的快速检测
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2071922
Aveek Shankar Brahmachari, Sudeep Sarkar
We propose an algorithm for detection of noisy GPS and magnetometer tags in wide-baseline camera views. Our algorithm neither needs densely sampled views nor does it need a single visually connected path through all the views in the dataset. We use vision-based estimates of mutual rotation and translation between cameras to compute a measure of confidence on the correctness of the associated GPS and magnetometer tags. The vision algorithm can find the epipolar geometry between two wide-baseline images without needing pre-specified correspondences. We have two versions of our approach; one that requires geometric pose estimation between all pairs of images and a faster version that uses a pre-filter based on photometric comparison of images to quickly reject non-overlapping views from further geometric consideration. We show qualitative and quantitative results on the Nokia Grand Challenge 2010 Dataset. We find that magnetometer readings are more accurate than GPS readings.
我们提出了一种在宽基线相机视图中检测噪声GPS和磁力计标签的算法。我们的算法既不需要密集采样视图,也不需要通过数据集中所有视图的单一视觉连接路径。我们使用基于视觉的相机之间相互旋转和平移的估计来计算相关GPS和磁力计标签正确性的置信度。该视觉算法可以在不需要预先指定对应关系的情况下找到两幅宽基线图像之间的极线几何。我们的方法有两个版本;一种需要在所有对图像之间进行几何姿态估计,另一种更快的版本使用基于图像光度比较的预过滤器,从进一步的几何考虑中快速拒绝非重叠视图。我们在Nokia Grand Challenge 2010数据集上展示了定性和定量结果。我们发现磁力计的读数比GPS的读数更准确。
{"title":"Fast detection of noisy GPS and magnetometer tags in wide-baseline multi-views","authors":"Aveek Shankar Brahmachari, Sudeep Sarkar","doi":"10.1145/2072298.2071922","DOIUrl":"https://doi.org/10.1145/2072298.2071922","url":null,"abstract":"We propose an algorithm for detection of noisy GPS and magnetometer tags in wide-baseline camera views. Our algorithm neither needs densely sampled views nor does it need a single visually connected path through all the views in the dataset. We use vision-based estimates of mutual rotation and translation between cameras to compute a measure of confidence on the correctness of the associated GPS and magnetometer tags. The vision algorithm can find the epipolar geometry between two wide-baseline images without needing pre-specified correspondences. We have two versions of our approach; one that requires geometric pose estimation between all pairs of images and a faster version that uses a pre-filter based on photometric comparison of images to quickly reject non-overlapping views from further geometric consideration. We show qualitative and quantitative results on the Nokia Grand Challenge 2010 Dataset. We find that magnetometer readings are more accurate than GPS readings.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130543965","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Photo search by face positions and facial attributes on touch devices 照片搜索的面部位置和面部属性的触摸设备
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072410
Yu-Heng Lei, Yan-Ying Chen, Lime Iida, Bor-Chun Chen, Hsiao-Hang Su, Winston H. Hsu
With the explosive growth of camera devices, people can freely take photos to capture moments of life, especially the ones accompanied with friends and family. Therefore, a better solution to organize the increasing number of personal or group photos is highly required. In this paper, we propose a novel way to search for face images according facial attributes and face similarity of the target persons. To better match the face layout in mind, our system allows the user to graphically specify the face positions and sizes on a query "canvas," where each attribute or identity is defined as an "icon" for easier representation. Moreover, we provide aesthetics filtering to enhance visual experience by removing candidates of poor photographic qualities. The scenario has been realized on a touch device with an intuitive user interface. With the proposed block-based indexing approach, we can achieve near real-time retrieval (0.1 second on average) in a large-scale dataset (more than 200k faces in Flickr images).
随着相机设备的爆炸式增长,人们可以自由地拍照来捕捉生活中的瞬间,尤其是与朋友和家人在一起的时刻。因此,一个更好的解决方案来组织越来越多的个人或团体照片是非常必要的。本文提出了一种基于人脸特征和人脸相似度的人脸图像搜索方法。为了更好地匹配面部布局,我们的系统允许用户在查询“画布”上以图形方式指定面部位置和大小,其中每个属性或标识都定义为一个“图标”,以便于表示。此外,我们提供美学过滤,以增强视觉体验,通过删除候选人的摄影质量差。该场景已在具有直观用户界面的触摸设备上实现。使用提出的基于块的索引方法,我们可以在大规模数据集(Flickr图像中超过20万张面孔)中实现接近实时的检索(平均0.1秒)。
{"title":"Photo search by face positions and facial attributes on touch devices","authors":"Yu-Heng Lei, Yan-Ying Chen, Lime Iida, Bor-Chun Chen, Hsiao-Hang Su, Winston H. Hsu","doi":"10.1145/2072298.2072410","DOIUrl":"https://doi.org/10.1145/2072298.2072410","url":null,"abstract":"With the explosive growth of camera devices, people can freely take photos to capture moments of life, especially the ones accompanied with friends and family. Therefore, a better solution to organize the increasing number of personal or group photos is highly required. In this paper, we propose a novel way to search for face images according facial attributes and face similarity of the target persons. To better match the face layout in mind, our system allows the user to graphically specify the face positions and sizes on a query \"canvas,\" where each attribute or identity is defined as an \"icon\" for easier representation. Moreover, we provide aesthetics filtering to enhance visual experience by removing candidates of poor photographic qualities. The scenario has been realized on a touch device with an intuitive user interface. With the proposed block-based indexing approach, we can achieve near real-time retrieval (0.1 second on average) in a large-scale dataset (more than 200k faces in Flickr images).","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130611672","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 38
Tutorial on multimedia music signal processing 多媒体音乐信号处理教程
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072402
G. Richard
The enormous amount of unstructured audio data available nowadays and the spread of its use as a data source in many applications are introducing new challenges to researchers in information and multimedia signal processing. Automatic analysis of audio documents (music, radio broadcast audio streams,...) gathers several research directions including audio indexing and transcription (extraction of informative features leading to audio content recognition or to the estimation of high level concepts such as melody, rhythm, instrumentation or harmony,...), audio classification (grouping by similarity, by music genre or by audio events categories) and content-based retrieval (such as query by example or query by humming approaches). In this context, the general field of Music signal Processing is receiving a growing interest and becomes more relevant and more visible in the audio community. Nevertheless, if much work is tackled in audio and music signal processing it is somewhat often presented only in specialized music or audio signal processing conferences. In the multimedia community, the focus of interest is often on the image or video signal with less emphasis on the audio signal and its potential for analyzing or interpreting a multimedia scene. The aim of the proposed tutorial is then to provide a general introduction of audio signal processing which should be of broad interest for the multimedia community, to review the state of the art in music signal processing (this will be largely based on [1]) and to highlight with some examples the potential of music signal processing for multimedia streams.
当前大量的非结构化音频数据及其作为数据源在许多应用中的广泛应用,给信息和多媒体信号处理的研究人员带来了新的挑战。音频文档(音乐、广播音频流等)的自动分析汇集了几个研究方向,包括音频索引和转录(提取信息特征,从而识别音频内容或估计旋律、节奏、乐器或和声等高级概念)、音频分类(按相似性分组)、按音乐类型或按音频事件类别)和基于内容的检索(例如按示例查询或按哼唱方法查询)。在这种背景下,音乐信号处理的一般领域正受到越来越多的关注,并在音频社区中变得更加相关和可见。然而,如果在音频和音乐信号处理中处理了很多工作,那么它通常只在专门的音乐或音频信号处理会议上提出。在多媒体社区中,关注的焦点往往集中在图像或视频信号上,而较少强调音频信号及其分析或解释多媒体场景的潜力。建议的教程的目的是然后提供音频信号处理的一般介绍,这应该是多媒体社区广泛感兴趣的,回顾音乐信号处理的艺术状态(这将主要基于[1]),并通过一些例子强调音乐信号处理多媒体流的潜力。
{"title":"Tutorial on multimedia music signal processing","authors":"G. Richard","doi":"10.1145/2072298.2072402","DOIUrl":"https://doi.org/10.1145/2072298.2072402","url":null,"abstract":"The enormous amount of unstructured audio data available nowadays and the spread of its use as a data source in many applications are introducing new challenges to researchers in information and multimedia signal processing. Automatic analysis of audio documents (music, radio broadcast audio streams,...) gathers several research directions including audio indexing and transcription (extraction of informative features leading to audio content recognition or to the estimation of high level concepts such as melody, rhythm, instrumentation or harmony,...), audio classification (grouping by similarity, by music genre or by audio events categories) and content-based retrieval (such as query by example or query by humming approaches). In this context, the general field of Music signal Processing is receiving a growing interest and becomes more relevant and more visible in the audio community. Nevertheless, if much work is tackled in audio and music signal processing it is somewhat often presented only in specialized music or audio signal processing conferences. In the multimedia community, the focus of interest is often on the image or video signal with less emphasis on the audio signal and its potential for analyzing or interpreting a multimedia scene. The aim of the proposed tutorial is then to provide a general introduction of audio signal processing which should be of broad interest for the multimedia community, to review the state of the art in music signal processing (this will be largely based on [1]) and to highlight with some examples the potential of music signal processing for multimedia streams.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":" 8","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120828685","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Fast frame-rate up-conversion of depth video via video coding 通过视频编码实现深度视频的快速帧率上转换
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072003
Yanjie Li, Lifeng Sun, Tianfan Xue
Recent development of depth sensors has facilitated the progress of 2D-plus-depth methods for 3D video representation, for which frame-rate up-conversion (FRUC) of depth video is a critical step. However, due to the computational cost of state-of-the-art FRUC methods, real time applications of 2D-plus-depth is still limited. In this paper, we present a method of speeding up the FRUC of the depth video by treating it as part of a video coding process, combined with a novel color-mapping algorithm is adopted to improve the quality of temporal upsampling. Experiments show that the proposed systems saves up to 99.5% of the frame interpolation time, while achieving virtually identical reconstructed depth video as state-of-the-art methods.
近年来深度传感器的发展促进了3D视频表示的2d加深度方法的发展,其中深度视频的帧率上转换(FRUC)是其中的关键步骤。然而,由于最先进的FRUC方法的计算成本,2D-plus-depth的实时应用仍然有限。在本文中,我们提出了一种加速深度视频的FRUC的方法,将其作为视频编码过程的一部分,并结合一种新的颜色映射算法来提高时间上采样的质量。实验表明,该系统可节省高达99.5%的帧插值时间,同时获得与最先进方法几乎相同的重建深度视频。
{"title":"Fast frame-rate up-conversion of depth video via video coding","authors":"Yanjie Li, Lifeng Sun, Tianfan Xue","doi":"10.1145/2072298.2072003","DOIUrl":"https://doi.org/10.1145/2072298.2072003","url":null,"abstract":"Recent development of depth sensors has facilitated the progress of 2D-plus-depth methods for 3D video representation, for which frame-rate up-conversion (FRUC) of depth video is a critical step. However, due to the computational cost of state-of-the-art FRUC methods, real time applications of 2D-plus-depth is still limited. In this paper, we present a method of speeding up the FRUC of the depth video by treating it as part of a video coding process, combined with a novel color-mapping algorithm is adopted to improve the quality of temporal upsampling. Experiments show that the proposed systems saves up to 99.5% of the frame interpolation time, while achieving virtually identical reconstructed depth video as state-of-the-art methods.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126342399","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Spatial pooling for transformation invariant image representation 变换不变图像表示的空间池化
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072052
Xia Li, Yan Song, Yijuan Lu, Q. Tian
Spatial Pyramid Matching (SPM) [2] has been proposed to extend the Bag-of-Word (BoW) model for object classification. By re-serving the finer level information, it makes image matching more accurate. However, for not well-aligned images, where the object is rotated, flipped or translated, SPM may lose its discrimination power. To tackle this problem, we propose novel spatial pooling layouts to address various transformations, and generate a more general image representation. To evaluate the effectiveness of the proposed approach, we conduct extensive experiments on three transformation emphasized datasets for object classification task. Experimental results demonstrate its superiority over the state-of-the-arts. Besides, the proposed image representation is compact and consistent with the BoW model, which makes it applicable to image retrieval task as well.
空间金字塔匹配(Spatial Pyramid Matching, SPM)[2]被提出用于扩展词袋(Bag-of-Word, BoW)模型用于目标分类。通过保留更精细的层次信息,使图像匹配更加准确。然而,对于不对齐的图像,当物体被旋转、翻转或平移时,SPM可能会失去其识别能力。为了解决这个问题,我们提出了新的空间池布局来处理各种转换,并生成更通用的图像表示。为了评估该方法的有效性,我们在三个变换强调的数据集上进行了大量的实验。实验结果证明了该方法的优越性。此外,所提出的图像表示结构紧凑,与BoW模型一致,也适用于图像检索任务。
{"title":"Spatial pooling for transformation invariant image representation","authors":"Xia Li, Yan Song, Yijuan Lu, Q. Tian","doi":"10.1145/2072298.2072052","DOIUrl":"https://doi.org/10.1145/2072298.2072052","url":null,"abstract":"Spatial Pyramid Matching (SPM) [2] has been proposed to extend the Bag-of-Word (BoW) model for object classification. By re-serving the finer level information, it makes image matching more accurate. However, for not well-aligned images, where the object is rotated, flipped or translated, SPM may lose its discrimination power. To tackle this problem, we propose novel spatial pooling layouts to address various transformations, and generate a more general image representation. To evaluate the effectiveness of the proposed approach, we conduct extensive experiments on three transformation emphasized datasets for object classification task. Experimental results demonstrate its superiority over the state-of-the-arts. Besides, the proposed image representation is compact and consistent with the BoW model, which makes it applicable to image retrieval task as well.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125794796","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Color-plus-depth level-of-detail in 3D tele-immersive video: a psychophysical approach 色彩加深度的3D远程沉浸式视频细节:一种心理物理学方法
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072302
Wanmin Wu, A. Arefin, G. Kurillo, Pooja Agarwal, K. Nahrstedt, R. Bajcsy
This paper presents a psychophysical study that measures the perceptual thresholds of a new factor called Color-plus-Depth Level-of-Detail peculiar to polygon-based 3D tele-immersive video. The results demonstrate the existence of Just Noticeable Degradation and Just Unacceptable Degradation thresholds on the factor. In light of the results, we describe the design and implementation of a real-time perception-based quality adaptor for 3D tele-immersive video. Our experimental results show that the adaptation scheme can reduce resource usage while considerably enhancing the overall perceived visual quality.
本文提出了一项心理物理学研究,该研究测量了基于多边形的3D远程沉浸式视频特有的一种称为颜色加深度细节水平的新因素的感知阈值。结果表明,在该因子上存在刚好可注意的退化阈值和刚好不可接受的退化阈值。根据结果,我们描述了用于3D远程沉浸式视频的基于实时感知的质量适配器的设计和实现。实验结果表明,该自适应方案在减少资源使用的同时,显著提高了整体感知视觉质量。
{"title":"Color-plus-depth level-of-detail in 3D tele-immersive video: a psychophysical approach","authors":"Wanmin Wu, A. Arefin, G. Kurillo, Pooja Agarwal, K. Nahrstedt, R. Bajcsy","doi":"10.1145/2072298.2072302","DOIUrl":"https://doi.org/10.1145/2072298.2072302","url":null,"abstract":"This paper presents a psychophysical study that measures the perceptual thresholds of a new factor called Color-plus-Depth Level-of-Detail peculiar to polygon-based 3D tele-immersive video. The results demonstrate the existence of Just Noticeable Degradation and Just Unacceptable Degradation thresholds on the factor. In light of the results, we describe the design and implementation of a real-time perception-based quality adaptor for 3D tele-immersive video. Our experimental results show that the adaptation scheme can reduce resource usage while considerably enhancing the overall perceived visual quality.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130076256","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 45
期刊
Proceedings of the 19th ACM international conference on Multimedia
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
﹀
mjeditor
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1