{"id":324,"date":"2018-03-06T03:08:40","date_gmt":"2018-03-06T10:08:40","guid":{"rendered":"http:\/\/www.williamcherry.com\/?p=324"},"modified":"2018-05-06T03:17:02","modified_gmt":"2018-05-06T10:17:02","slug":"conversational-interfacesvirtual-toursvr","status":"publish","type":"post","link":"https:\/\/www.williamcherry.com\/?p=324","title":{"rendered":"Conversational Interfaces+Virtual Tours+VR"},"content":{"rendered":"

Guest lecturer; storyboard layout, interface design, node development and technology support utilizing After Effects, Mettle and WondaVR for use on Samsung GearVR and Google Cardboard within Pat FitzGerald’s ADN 560 Advanced Animation Studio – a focus on experimental multimedia animation, which looks at developing design solutions in concept and execution through the creative process.<\/p>\n

[ Note: This first appeared in Emerging Technologies Explored<\/em><\/a>. ]<\/p>\n

\"\"<\/a><\/p>\n

For the final studio project for\u00c2\u00a0students were tasked with creating a design solution for the\u00c2\u00a0Gregg Museum of Art & Desig<\/a>n using conversational interface and VR. This project built on the previous learning outcomes and allowed the students to focus on their individual strengths. \u00e2\u20ac\u0153We were more like a four-person design team, rather than a class,\u00e2\u20ac\u009d shares Ehuan. \u00e2\u20ac\u0153We each had specific roles based on our interests and strengths, and since there is a specific sequence of a project, it worked to our advantage.\u00e2\u20ac\u009d<\/p>\n

 <\/p>\n

A conversational interface is a computer user interface that mimics human conversation; however, the human has the ability to direct the conversation, rather than imputing commands through a computer prompt, such as clicking on icons or buttons. There are two types of conversational interfaces including voice assistants that the user talks directly to and \u00e2\u20ac\u0153chatbots,\u00e2\u20ac\u009d which are the most common and require typing such as in an online chat. Voice assistant examples are Siri (Apple) and Echo (Amazon) which can do tasks such as play music and perform a search with only a verbal command by the user.<\/p>\n

\"\"<\/a><\/p>\n

FitzGerald had previously dabbled in using a conversational interface to explore multiple methods of communication that users could toggle between. Various communications modes provide users with options and allow them to better direct the \u00e2\u20ac\u0153conversation.\u00e2\u20ac\u009d In the case of a learning application, users can control the learning outcome based on personal interests. Weidner noted the flexibility and customization potential in a conversational interface\u00e2\u20ac\u201d\u00e2\u20ac\u0153a change in communication methods including video meets you where you [as the participant] are and where you want to go in the realm of a particular topic.\u00e2\u20ac\u009d<\/p>\n

\"\"<\/a><\/p>\n

The Gregg offers a perfect environment for the project. Museum visitors have variable interests, learn differently, and may become interested in seeking unique information associated to an artifact. However, the hours and location of a museum can pose a potential barrier for people who want to learn about a particular artifact or genre.<\/p>\n

The problems the design team wanted to solve \u00e2\u20ac\u0153addressed the museum, visitors, and potential visitors,\u00e2\u20ac\u009d shares Ehuan. \u00e2\u20ac\u0153The museum has the issue of space; they can only show a small sampling of their entire collection simultaneously,\u00e2\u20ac\u009d says Ehuan. Additionally, visitors can be limited by what is currently on display and the inability to garner additional information about an artifact that interests them. \u00e2\u20ac\u0153The solution was to use VR to create a virtual museum, where physical space is not an issue and there are no limitations of showing all the artifacts, or expanding the knowledge base of an artifact,\u00e2\u20ac\u009d FitzGerald says.<\/p>\n

The student team researched various means to deliver information including VR, video, and audio and more linear aspects using popups and icons that lead to additional learning opportunities. They decided to develop an interactive VR learning app that uses multiple modes of communication to explain museum artifacts and information at varying levels of user interest. Secondary-level information using a hierarchy of content delivers a custom contextual experience for participants. \u00e2\u20ac\u0153The options of beginner-, intermediate-, and advanced-level information; the addition of fun facts; and the option to navigate your way through all the levels, skip around, or watch everything available on one object and then move to something else based on your interests, is what makes this so limitless in its application,\u00e2\u20ac\u009d adds Ehuan. The app was also created with the intent that it could be expanded upon as new information or artifacts were accumulated.<\/p>\n

Associate Professor and Art Historian Russell Flinchum, Ph.D<\/a>., was asked to participate as the narrator and educator in this project. FitzGerald says they asked Flinchum to participate in the project because of his knowledge base and expertise. \u00e2\u20ac\u0153He is an expert communicator that speaks to the audience using verbal and nonverbal cues,\u00e2\u20ac\u009d says FitzGerald.<\/p>\n

The VR experience begins outside of the Gregg, as a way of introducing the venue. Users can move inside the museum and start to explore and make content choices. Arrows on the floor allow users, through gaze selection, to advance to the next artifact or room. Gaze selection captures eye movement based on direction or duration of time; it will prompt a user to move in a specific direction. Flinchum appears next to an object and offers detailed information about the artifact at the level that the viewer has selected (beginner, intermediate, or advanced). The use of the secondary learning allows the viewer to also customize their experience.<\/p>\n

\u00e2\u20ac\u0153We have a mostly cohesive tour of the Gregg and are excited about the outcome, and the actualization of the prototype is an excellent proof of concept,\u00e2\u20ac\u009d shares Wiedner. \u00e2\u20ac\u0153 We did this in a short amount of time and the level of difficulty was actually low,\u00e2\u20ac\u009d adds Ehuan. Wiedner and Ehuan both indicate that this project could be easily developed further by adding new artifacts and information. Additionally, it would also be beneficial to apply this to other forms of content topics.<\/p>\n

\u00e2\u20ac\u0153This can be a growing learning archive that can be posted on the web and all you need is a Google Cardboard to view,\u00e2\u20ac\u009d emphasizes FitzGerald. As new content is added, the app just needs to be updated. \u00e2\u20ac\u0153There are several factors that make this a powerful mode of communication in a VR setting including immersion, sensory feedback, and interactivity that are all providing this VR experience with sight and sound.\u00e2\u20ac\u009d<\/p>\n

The team is grateful to be able to use the Gregg in their project. They shared their prototype with Mary Hauser [BID \u00e2\u20ac\u212201, MID \u00e2\u20ac\u02dc04], associate director and registrar at the Gregg. \u00e2\u20ac\u0153The Gregg was so generous in offering the facility and time to us,\u00e2\u20ac\u009d FitzGerald says.<\/p>\n","protected":false},"excerpt":{"rendered":"

Guest lecturer; storyboard layout, interface design, node development and technology support utilizing After Effects, Mettle and…<\/p>\n","protected":false},"author":3,"featured_media":327,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[29,34,49,6,26,10,15,9,35,5,14,48],"tags":[],"class_list":["post-324","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-animation","category-business-development","category-conversational-interface","category-education","category-information-design","category-innovation","category-museum","category-new-media","category-non-profit","category-portfolio","category-programming","category-vr"],"_links":{"self":[{"href":"https:\/\/www.williamcherry.com\/index.php?rest_route=\/wp\/v2\/posts\/324","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.williamcherry.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.williamcherry.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.williamcherry.com\/index.php?rest_route=\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.williamcherry.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=324"}],"version-history":[{"count":8,"href":"https:\/\/www.williamcherry.com\/index.php?rest_route=\/wp\/v2\/posts\/324\/revisions"}],"predecessor-version":[{"id":336,"href":"https:\/\/www.williamcherry.com\/index.php?rest_route=\/wp\/v2\/posts\/324\/revisions\/336"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.williamcherry.com\/index.php?rest_route=\/wp\/v2\/media\/327"}],"wp:attachment":[{"href":"https:\/\/www.williamcherry.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=324"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.williamcherry.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=324"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.williamcherry.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=324"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}