首页 > 最新文献
paperpass

Proceedings of the 19th ACM international conference on Multimedia最新文献

英文 中文
Eventscapes: visualizing events over time with emotive facets 事件场景:随着时间的推移,用情感方面来可视化事件
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072044
Brett Adams, Dinh Q. Phung, S. Venkatesh
The scale and dynamicity of social media, and interaction between traditional news sources and online communities, has created challenges to information retrieval approaches. Users may have no clear information need or be unable to express it in the appropriate idiom, requiring instead to be oriented in an unfamiliar domain, to explore and learn. We present a novel data-driven visualization, termed Eventscape, that combines time, visual media, mood, and controversy. Formative evaluation highlights the value of emotive facets for rapid evaluation of mixed news and social media topics, and a role for such visualizations as pre-cursors to deeper search.
社交媒体的规模和动态,以及传统新闻来源和在线社区之间的互动,给信息检索方法带来了挑战。用户可能没有明确的信息需求,或者无法用适当的习语表达信息,而是需要以不熟悉的领域为导向,进行探索和学习。我们提出了一种新颖的数据驱动可视化,称为事件景观,它结合了时间、视觉媒体、情绪和争议。形成性评估强调了快速评估混合新闻和社交媒体主题的情感方面的价值,以及这种可视化作为更深入搜索的先驱的作用。
{"title":"Eventscapes: visualizing events over time with emotive facets","authors":"Brett Adams, Dinh Q. Phung, S. Venkatesh","doi":"10.1145/2072298.2072044","DOIUrl":"https://doi.org/10.1145/2072298.2072044","url":null,"abstract":"The scale and dynamicity of social media, and interaction between traditional news sources and online communities, has created challenges to information retrieval approaches. Users may have no clear information need or be unable to express it in the appropriate idiom, requiring instead to be oriented in an unfamiliar domain, to explore and learn. We present a novel data-driven visualization, termed Eventscape, that combines time, visual media, mood, and controversy. Formative evaluation highlights the value of emotive facets for rapid evaluation of mixed news and social media topics, and a role for such visualizations as pre-cursors to deeper search.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"87 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115212975","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 29
Understanding images with natural sentences 用自然的句子理解图像
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072417
Y. Ushiku, T. Harada, Y. Kuniyoshi
We propose a novel system which generates sentential captions for general images. For people to use numerous images effectively on the web, technologies must be able to explain image contents and must be capable of searching for data that users need. Moreover, images must be described with natural sentences based not only on the names of objects contained in an image but also on their mutual relations. The proposed system uses general images and captions available on the web as training data to generate captions for new images. Furthermore, because the learning cost is independent from the amount of data, the system has scalability, which makes it useful with large-scale data.
我们提出了一种为一般图像生成句子说明的新系统。为了让人们在网络上有效地使用大量的图像,技术必须能够解释图像内容,并且必须能够搜索用户需要的数据。此外,图像必须用自然的句子来描述,不仅要基于图像中包含的物体的名称,还要基于它们的相互关系。该系统使用网络上可用的一般图像和说明文字作为训练数据,为新图像生成说明文字。此外,由于学习成本与数据量无关,因此系统具有可扩展性,这使得它适用于大规模数据。
{"title":"Understanding images with natural sentences","authors":"Y. Ushiku, T. Harada, Y. Kuniyoshi","doi":"10.1145/2072298.2072417","DOIUrl":"https://doi.org/10.1145/2072298.2072417","url":null,"abstract":"We propose a novel system which generates sentential captions for general images. For people to use numerous images effectively on the web, technologies must be able to explain image contents and must be capable of searching for data that users need. Moreover, images must be described with natural sentences based not only on the names of objects contained in an image but also on their mutual relations. The proposed system uses general images and captions available on the web as training data to generate captions for new images. Furthermore, because the learning cost is independent from the amount of data, the system has scalability, which makes it useful with large-scale data.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115701166","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
An audio-driven virtual dance-teaching assistant 音频驱动的虚拟舞蹈教学助手
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072416
S. Essid, Yves Grenier, M. Maazaoui, G. Richard, R. Tournemenne
This work addresses the Huawei/3Dlife Grand challenge proposing a set of audio tools for a virtual dance-teaching assistant. These tools are meant to help the dance student develop a sense of rhythm to correctly synchronize his/her movements and steps to the musical timing of the choreographies to be executed. They consist of three main components, namely a music (beat) analysis module, a source separation and remastering module and a dance step segmentation module. These components enable to create augmented tutorial videos highlighting the rhythmic information using, for instance, a synthetic dance teacher voice, but also videos highlighting the steps executed by a student to help in the evaluation of his/her performance.
本作品解决了华为/3Dlife大挑战,提出了一套用于虚拟舞蹈教学助手的音频工具。这些工具是为了帮助舞蹈学生发展一种节奏感,以正确地同步他/她的动作和步骤,以执行舞蹈编排的音乐时间。它们由三个主要部分组成,即音乐(节拍)分析模块,源分离和重制版模块和舞步分割模块。这些组件可以创建增强的教程视频,突出节奏信息,例如,使用合成舞蹈教师的声音,还可以突出学生执行的步骤视频,以帮助评估他/她的表现。
{"title":"An audio-driven virtual dance-teaching assistant","authors":"S. Essid, Yves Grenier, M. Maazaoui, G. Richard, R. Tournemenne","doi":"10.1145/2072298.2072416","DOIUrl":"https://doi.org/10.1145/2072298.2072416","url":null,"abstract":"This work addresses the Huawei/3Dlife Grand challenge proposing a set of audio tools for a virtual dance-teaching assistant. These tools are meant to help the dance student develop a sense of rhythm to correctly synchronize his/her movements and steps to the musical timing of the choreographies to be executed. They consist of three main components, namely a music (beat) analysis module, a source separation and remastering module and a dance step segmentation module. These components enable to create augmented tutorial videos highlighting the rhythmic information using, for instance, a synthetic dance teacher voice, but also videos highlighting the steps executed by a student to help in the evaluation of his/her performance.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125220928","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
OpenIMAJ and ImageTerrier: Java libraries and tools for scalable multimedia analysis and indexing of images OpenIMAJ和ImageTerrier:用于可伸缩多媒体分析和图像索引的Java库和工具
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072421
Jonathon S. Hare, Sina Samangooei, D. Dupplaw
OpenIMAJ and ImageTerrier are recently released open-source libraries and tools for experimentation and development of multimedia applications using Java-compatible programming languages. OpenIMAJ (the Open toolkit for Intelligent Multimedia Analysis in Java) is a collection of libraries for multimedia analysis. The image libraries contain methods for processing images and extracting state-of-the-art features, including SIFT. The video and audio libraries support both cross-platform capture and processing. The clustering and nearest-neighbour libraries contain efficient, multi-threaded implementations of clustering algorithms. The clustering library makes it possible to easily create BoVW representations for images and videos. OpenIMAJ also incorporates a number of tools to enable extremely-large-scale multimedia analysis using distributed computing with Apache Hadoop. ImageTerrier is a scalable, high-performance search engine platform for content-based image retrieval applications using features extracted with the OpenIMAJ library and tools. The ImageTerrier platform provides a comprehensive test-bed for experimenting with image retrieval techniques. The platform incorporates a state-of-the-art implementation of the single-pass indexing technique for constructing inverted indexes and is capable of producing highly compressed index data structures.
OpenIMAJ和ImageTerrier是最近发布的开源库和工具,用于使用java兼容的编程语言进行多媒体应用程序的实验和开发。OpenIMAJ (Java中用于智能多媒体分析的开放工具包)是一个用于多媒体分析的库集合。图像库包含处理图像和提取最先进特征的方法,包括SIFT。视频和音频库支持跨平台捕获和处理。集群和最近邻库包含集群算法的高效多线程实现。集群库可以轻松地为图像和视频创建BoVW表示。OpenIMAJ还集成了许多工具,可以使用Apache Hadoop的分布式计算实现大规模的多媒体分析。ImageTerrier是一个可扩展的高性能搜索引擎平台,用于基于内容的图像检索应用程序,使用OpenIMAJ库和工具提取的特征。ImageTerrier平台为实验图像检索技术提供了一个全面的测试平台。该平台集成了用于构造倒排索引的单遍索引技术的最先进实现,并且能够生成高度压缩的索引数据结构。
{"title":"OpenIMAJ and ImageTerrier: Java libraries and tools for scalable multimedia analysis and indexing of images","authors":"Jonathon S. Hare, Sina Samangooei, D. Dupplaw","doi":"10.1145/2072298.2072421","DOIUrl":"https://doi.org/10.1145/2072298.2072421","url":null,"abstract":"OpenIMAJ and ImageTerrier are recently released open-source libraries and tools for experimentation and development of multimedia applications using Java-compatible programming languages. OpenIMAJ (the Open toolkit for Intelligent Multimedia Analysis in Java) is a collection of libraries for multimedia analysis. The image libraries contain methods for processing images and extracting state-of-the-art features, including SIFT. The video and audio libraries support both cross-platform capture and processing. The clustering and nearest-neighbour libraries contain efficient, multi-threaded implementations of clustering algorithms. The clustering library makes it possible to easily create BoVW representations for images and videos. OpenIMAJ also incorporates a number of tools to enable extremely-large-scale multimedia analysis using distributed computing with Apache Hadoop. ImageTerrier is a scalable, high-performance search engine platform for content-based image retrieval applications using features extracted with the OpenIMAJ library and tools. The ImageTerrier platform provides a comprehensive test-bed for experimenting with image retrieval techniques. The platform incorporates a state-of-the-art implementation of the single-pass indexing technique for constructing inverted indexes and is capable of producing highly compressed index data structures.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"31 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121089042","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 82
Learning heterogeneous data for hierarchical web video classification 学习异构数据的分层网络视频分类
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072355
Xianming Liu, H. Yao, R. Ji, Pengfei Xu, Xiaoshuai Sun, Q. Tian
Web videos such as YouTube are hard to obtain sufficient precisely labeled training data and analyze due to the complex ontology. To deal with these problems, we present a hierarchical web video classification framework by learning heterogeneous web data, and construct a bottom-up semantic forest of video concepts by learning from meta-data. The main contributions are two-folds: firstly, analysis about middle-level concepts' distribution is taken based on data collected from web communities, and a concepts redistribution assumption is made to build effective transfer learning algorithm. Furthermore, an AdaBoost-Like transfer learning algorithm is proposed to transfer the knowledge learned from Flickr images to YouTube video domain and thus it facilitates video classification. Secondly, a group of hierarchical taxonomies named Semantic Forest are mined from YouTube and Flickr tags which reflect better user intention on the semantic level. A bottom-up semantic integration is also constructed with the help of semantic forest, in order to analyze video content hierarchically in a novel perspective. A group of experiments are performed on the dataset collected from Flickr and YouTube. Compared with state-of-the-arts, the proposed framework is more robust and tolerant to web noise.
YouTube等网络视频由于本体复杂,难以获得足够精确标记的训练数据并进行分析。为了解决这些问题,我们通过学习异构网络数据,提出了一个分层的网络视频分类框架,并通过学习元数据构建了一个自下而上的视频概念语义森林。主要贡献有两方面:首先,基于网络社区数据,分析了中层概念的分布,提出了概念再分布假设,构建了有效的迁移学习算法;此外,提出了一种类似adaboost的迁移学习算法,将从Flickr图像中学习到的知识转移到YouTube视频域,从而便于视频分类。其次,从YouTube和Flickr标签中挖掘出一组语义森林(Semantic Forest)的分层分类法,这些分类法在语义层面上更好地反映了用户的意图。利用语义森林构造自底向上的语义集成,以新颖的视角对视频内容进行分层分析。对从Flickr和YouTube上收集的数据集进行了一组实验。与最先进的框架相比,该框架具有更强的鲁棒性和对网络噪声的容忍度。
{"title":"Learning heterogeneous data for hierarchical web video classification","authors":"Xianming Liu, H. Yao, R. Ji, Pengfei Xu, Xiaoshuai Sun, Q. Tian","doi":"10.1145/2072298.2072355","DOIUrl":"https://doi.org/10.1145/2072298.2072355","url":null,"abstract":"Web videos such as YouTube are hard to obtain sufficient precisely labeled training data and analyze due to the complex ontology. To deal with these problems, we present a hierarchical web video classification framework by learning heterogeneous web data, and construct a bottom-up semantic forest of video concepts by learning from meta-data. The main contributions are two-folds: firstly, analysis about middle-level concepts' distribution is taken based on data collected from web communities, and a concepts redistribution assumption is made to build effective transfer learning algorithm. Furthermore, an AdaBoost-Like transfer learning algorithm is proposed to transfer the knowledge learned from Flickr images to YouTube video domain and thus it facilitates video classification. Secondly, a group of hierarchical taxonomies named Semantic Forest are mined from YouTube and Flickr tags which reflect better user intention on the semantic level. A bottom-up semantic integration is also constructed with the help of semantic forest, in order to analyze video content hierarchically in a novel perspective. A group of experiments are performed on the dataset collected from Flickr and YouTube. Compared with state-of-the-arts, the proposed framework is more robust and tolerant to web noise.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123746301","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Ztitch: a mobile phone application for 3D scene creation, navigation, and sharing Ztitch:一个用于3D场景创建、导航和共享的手机应用程序
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072460
Andrew Au, Jie Liang
Modern smartphones provide an excellent platform for creating 3D scenes from photos. While there already exists many mobile applications that can stitch a set of photos to create a single, panoramic landscape photo, this paper proposes the creation of panoramic scenes where multiple photos are projected in a 3D space using the pinhole camera model, so that a realistic perspective of the scene is maintained. Our application allows users to automatically create a panoramic 3D scene in real-time using the live images from the phone's camera, and to manually fine-tune each photo's position via the touchscreen if the default position is inaccurate. The application enables scenes to be easily shared to other users, and was developed using the Silverlight framework so that it can run across multiple platforms.
现代智能手机为从照片中创建3D场景提供了一个极好的平台。虽然已经有许多移动应用程序可以将一组照片拼接成一张全景风景照片,但本文建议使用针孔相机模型创建全景场景,将多张照片投影在3D空间中,从而保持场景的逼真视角。我们的应用程序允许用户使用手机摄像头的实时图像自动创建实时全景3D场景,如果默认位置不准确,可以通过触摸屏手动微调每张照片的位置。该应用程序可以轻松地将场景共享给其他用户,并且使用Silverlight框架开发,因此可以跨多个平台运行。
{"title":"Ztitch: a mobile phone application for 3D scene creation, navigation, and sharing","authors":"Andrew Au, Jie Liang","doi":"10.1145/2072298.2072460","DOIUrl":"https://doi.org/10.1145/2072298.2072460","url":null,"abstract":"Modern smartphones provide an excellent platform for creating 3D scenes from photos. While there already exists many mobile applications that can stitch a set of photos to create a single, panoramic landscape photo, this paper proposes the creation of panoramic scenes where multiple photos are projected in a 3D space using the pinhole camera model, so that a realistic perspective of the scene is maintained. Our application allows users to automatically create a panoramic 3D scene in real-time using the live images from the phone's camera, and to manually fine-tune each photo's position via the touchscreen if the default position is inaccurate. The application enables scenes to be easily shared to other users, and was developed using the Silverlight framework so that it can run across multiple platforms.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"38 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122483274","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Keyframe presentation for browsing of user-generated videos on map interfaces 在地图界面上浏览用户生成视频的关键帧演示
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2071926
Jia Hao, Guanfeng Wang, Beomjoo Seo, Roger Zimmermann
To present user-generated videos that relate to geographic areas for easy access and browsing it is often natural to use maps as interfaces. A common approach is to place thumbnail images of video keyframes in appropriate locations. Here we consider the challenge of determining which keyframes to select and where to place them on the map. Our proposed technique leverages sensor-collected meta-data which are automatically acquired as a continuous stream together with the video. Our approach is able to detect interesting regions and objects (hotspots) and their distances from the camera in a fully automated way. Meaningful keyframes are adaptively selected based on the popularity of the hotspots. Our experiments show very promising results and demonstrate excellent utility for the users.
为了呈现与地理区域相关的用户生成视频,以便于访问和浏览,通常很自然地使用地图作为界面。一种常见的方法是将视频关键帧的缩略图放在适当的位置。在这里,我们考虑决定选择哪些关键帧以及在地图上放置它们的位置的挑战。我们提出的技术利用传感器收集的元数据,这些元数据与视频一起作为连续流自动获取。我们的方法能够以完全自动化的方式检测有趣的区域和物体(热点)及其与相机的距离。根据热点的受欢迎程度自适应选择有意义的关键帧。我们的实验显示了非常有希望的结果,并为用户展示了出色的实用性。
{"title":"Keyframe presentation for browsing of user-generated videos on map interfaces","authors":"Jia Hao, Guanfeng Wang, Beomjoo Seo, Roger Zimmermann","doi":"10.1145/2072298.2071926","DOIUrl":"https://doi.org/10.1145/2072298.2071926","url":null,"abstract":"To present user-generated videos that relate to geographic areas for easy access and browsing it is often natural to use maps as interfaces. A common approach is to place thumbnail images of video keyframes in appropriate locations. Here we consider the challenge of determining which keyframes to select and where to place them on the map. Our proposed technique leverages sensor-collected meta-data which are automatically acquired as a continuous stream together with the video. Our approach is able to detect interesting regions and objects (hotspots) and their distances from the camera in a fully automated way. Meaningful keyframes are adaptively selected based on the popularity of the hotspots. Our experiments show very promising results and demonstrate excellent utility for the users.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"146 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122611151","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 13
ImagiLight: a vision approach to lighting scene setting ImagiLight:一种视觉方法来照明场景设置
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2071995
T. Gritti, G. Monaci
The advent of integrated lighting installations, consisting of individually controllable lamps with advanced rendering capabilities, is fundamentally transforming lighting. This brings a need for an intuitive control capable of fully exploiting the rendering capabilities of the complete lighting infrastructure. In this paper we present a new method to automatically create lighting atmospheres in any type of environment, that allows for an natural interaction with the lighting system and generates unique, suggestive effects. To prove the effectiveness and versatility of the proposed solution, we deploy the system in several application scenarios, and discuss the results.
集成照明装置的出现,由具有先进渲染能力的独立可控灯具组成,从根本上改变了照明。这带来了一个直观的控制,能够充分利用完整的照明基础设施的渲染能力的需求。在本文中,我们提出了一种在任何类型的环境中自动创建照明氛围的新方法,该方法允许与照明系统自然交互,并产生独特的暗示效果。为了证明所提出的解决方案的有效性和通用性,我们将系统部署在几个应用场景中,并讨论了结果。
{"title":"ImagiLight: a vision approach to lighting scene setting","authors":"T. Gritti, G. Monaci","doi":"10.1145/2072298.2071995","DOIUrl":"https://doi.org/10.1145/2072298.2071995","url":null,"abstract":"The advent of integrated lighting installations, consisting of individually controllable lamps with advanced rendering capabilities, is fundamentally transforming lighting. This brings a need for an intuitive control capable of fully exploiting the rendering capabilities of the complete lighting infrastructure. In this paper we present a new method to automatically create lighting atmospheres in any type of environment, that allows for an natural interaction with the lighting system and generates unique, suggestive effects. To prove the effectiveness and versatility of the proposed solution, we deploy the system in several application scenarios, and discuss the results.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"449 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122825880","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Cognitive intervention in autism using multimedia stimulus 多媒体刺激对自闭症的认知干预
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2072448
S. Venkatesh, S. Greenhill, Dinh Q. Phung, Brett Adams
We demonstrate an open multimedia-based system for delivering early intervention therapy for autism. Using flexible multi-touch interfaces together with principled ways to access rich content and tasks, we show how a syllabus can be translated into stimulus sets for early intervention. Media stimuli are able to be presented agnostic to language and media modality due to a semantic network of concepts and relations that are fundamental to language and cognitive development, which enable stimulus complexity to be adjusted to child performance. Being open, the system is able to assemble enough media stimuli to avoid children over-learning, and is able to be customised to a specific child which aids with engagement. Computer-based delivery enables automation of session logging and reporting, a fundamental and time-consuming part of therapy.
我们展示了一个开放的多媒体系统,用于提供自闭症的早期干预治疗。使用灵活的多点触控界面和有原则的方法来访问丰富的内容和任务,我们展示了如何将教学大纲转化为早期干预的刺激集。由于概念和关系的语义网络是语言和认知发展的基础,这使得刺激的复杂性能够根据儿童的表现进行调整,因此媒体刺激能够以语言和媒体形态不可知的方式呈现。该系统是开放的,能够收集足够的媒体刺激,以避免孩子过度学习,并能够为特定的孩子定制,这有助于参与。基于计算机的交付实现了会话记录和报告的自动化,这是治疗的基本和耗时的一部分。
{"title":"Cognitive intervention in autism using multimedia stimulus","authors":"S. Venkatesh, S. Greenhill, Dinh Q. Phung, Brett Adams","doi":"10.1145/2072298.2072448","DOIUrl":"https://doi.org/10.1145/2072298.2072448","url":null,"abstract":"We demonstrate an open multimedia-based system for delivering early intervention therapy for autism. Using flexible multi-touch interfaces together with principled ways to access rich content and tasks, we show how a syllabus can be translated into stimulus sets for early intervention. Media stimuli are able to be presented agnostic to language and media modality due to a semantic network of concepts and relations that are fundamental to language and cognitive development, which enable stimulus complexity to be adjusted to child performance. Being open, the system is able to assemble enough media stimuli to avoid children over-learning, and is able to be customised to a specific child which aids with engagement. Computer-based delivery enables automation of session logging and reporting, a fundamental and time-consuming part of therapy.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"251 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114246815","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Expanding the point: automatic enlargement of presentation video elements 扩展点:自动放大演示视频元素
Pub Date : 2011-11-28 DOI: 10.1145/2072298.2071913
Q. Tung, R. Swaminathan, A. Efrat, Kobus Barnard
We present a system that assists users in viewing videos of lectures on small screen devices, such as cell phones. It automatically identifies semantic units on the slides, such as bullets, groups of bullets, and images. As the participant views the lecture, the system magnifies the appropriate semantic unit while it is the focus of the discussion. The system makes this decision based on cues from laser pointer gestures and spoken words that are read off the slide. It then magnifies the semantic element using the slide image and the homography between the slide image and the video frame. Experiments suggest that the semantic units of laser-based events identified by our algorithm closely match those identified by humans. In the case of identifying bullets through spoken words, results are more limited but are a good starting point for more complex methods. Finally, we show that this kind of magnification has potential for improving learning of technical content from video lectures when the resolution of the video is limited, such as when being viewed on hand held devices.
我们提出了一个系统,可以帮助用户在小屏幕设备(如手机)上观看讲座视频。它可以自动识别幻灯片上的语义单位,如项目符号、项目符号组和图像。当参与者观看讲座时,系统会放大适当的语义单元,而它是讨论的焦点。系统根据激光笔的手势和从幻灯片上读出的语音来做出这个决定。然后,它使用幻灯片图像和幻灯片图像与视频帧之间的单义性来放大语义元素。实验表明,我们的算法识别的基于激光事件的语义单位与人类识别的语义单位非常接近。在通过口语识别子弹的情况下,结果更有限,但对于更复杂的方法来说,这是一个很好的起点。最后,我们表明,当视频分辨率有限时,例如在手持设备上观看时,这种放大具有提高视频讲座技术内容学习的潜力。
{"title":"Expanding the point: automatic enlargement of presentation video elements","authors":"Q. Tung, R. Swaminathan, A. Efrat, Kobus Barnard","doi":"10.1145/2072298.2071913","DOIUrl":"https://doi.org/10.1145/2072298.2071913","url":null,"abstract":"We present a system that assists users in viewing videos of lectures on small screen devices, such as cell phones. It automatically identifies semantic units on the slides, such as bullets, groups of bullets, and images. As the participant views the lecture, the system magnifies the appropriate semantic unit while it is the focus of the discussion. The system makes this decision based on cues from laser pointer gestures and spoken words that are read off the slide. It then magnifies the semantic element using the slide image and the homography between the slide image and the video frame. Experiments suggest that the semantic units of laser-based events identified by our algorithm closely match those identified by humans. In the case of identifying bullets through spoken words, results are more limited but are a good starting point for more complex methods. Finally, we show that this kind of magnification has potential for improving learning of technical content from video lectures when the resolution of the video is limited, such as when being viewed on hand held devices.","PeriodicalId":318758,"journal":{"name":"Proceedings of the 19th ACM international conference on Multimedia","volume":"125 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114594219","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
期刊
Proceedings of the 19th ACM international conference on Multimedia
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
﹀
mjeditor
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1