Let’s play some games!<\/h3>\n\n\n\n
The first task was to explore table-top board and card games<\/em> that could be good candidates for our project. We explored games that were suggested by both our advisors and by others. Here are some of the games we tried (more documentation here<\/a>): Blueprint<\/strong> Few more Games<\/strong><\/p>\n\n\n\n After some discussion and research we concluded that the ideal candidate game for our project would have the following characteristics:<\/p>\n\n\n\n Have simple rules<\/em> – to facilitate feasible scope for game logic programming.<\/p> Have easily identifiable game pieces – <\/em>Marker like and feature point rich with Ako is going to be an Augmented Reality agent that helps the players to learn a board game. However, initially, our client did not limit to just an agent that helps you learn but also had other roles (like an opposition) open to be chosen. Once we decided that our agent will be a learning companion<\/strong><\/em>, we went on to brainstorm how this agent might converse with a player. This week, we also had a Design Workshop conducted by Melanie Lam, one of our instructors here at the ETC-SV campus. We went through different fun rounds of learning to brainstorm design ideas that would help us structure and focus on what we aim our project to be. We also were able to get inputs from other teams that made us think of unexplored and interesting ideas.<\/p>\n\n\n\n The main takeaways of the workshop was that it helped us form a clear definition of our project based on what our team members want it to be. We came up with the following goal.<\/p>\n\n\n\n A fun AR companion that helps you learn a board game.<\/p><\/blockquote>\n\n\n\n We believe these values would help us create solid design pillars in the coming weeks.<\/p>\n\n\n\n As seen in the goal above, we aim for our AR agent to be fun to hang out with even if the player is well-versed in playing the game. Therefore, we decided that our character will have a unique personality to it which would make it an interesting companion. We researched on a couple of possible ideas (more on the documentation here<\/a>): Robots:<\/strong> We started off experimenting with a Passthrough VR setup. This setup was initially used by a project team (here<\/a>) last semester.<\/p>\n\n\n\n Pass-through VR is a concept used with Virtual Reality headsets which allow the players to see the world around them within the VR headset. Thus, blurring the boundaries between Augmented Reality and Virtual Reality.<\/p><\/blockquote>\n\n\n\n We use the following components in this setup: Zed Camera<\/strong> While the above setup sounds ideal for an interactive AR application, we realized that our application’s main form of interaction will be through We looked at This week our team dipped our toes into the tech and designs that we hope to use in the following months. We did some demos and prototyping to get ourselves familiar with them. This post will cover the following: Let’s play some games! Brainstorming agent roles The Design Workshop Character design research The Oculus-Zed-LeapMotion setup Speech-Text-Speech…
Set<\/strong>
A pattern identification based card-game that can be played by both one or multiple players.
<\/p>\n\n\n\n![\"\"](\"https:\/\/projects-old.etc.cmu.edu\/ako\/wp-content\/uploads\/2019\/01\/IMG_20190122_160417892-762x1024.jpg\")
A unique turn-based game where players build buildings based on the blueprint on their cards.
<\/p>\n\n\n\n![\"\"](\"https:\/\/projects-old.etc.cmu.edu\/ako\/wp-content\/uploads\/2019\/01\/blueprint-web.jpeg\")
![\"\"](\"https:\/\/projects-old.etc.cmu.edu\/ako\/wp-content\/uploads\/2019\/01\/Sequence-board1.jpg\")
![\"\"](\"https:\/\/projects-old.etc.cmu.edu\/ako\/wp-content\/uploads\/2019\/01\/uno-game.jpg\")
Brainstorming agent roles<\/strong><\/h3>\n\n\n\n
![\"\"](\"https:\/\/projects-old.etc.cmu.edu\/ako\/wp-content\/uploads\/2019\/01\/IMG_20190122_165558370-768x1024.jpg\")
We chose the card game Set<\/a> as our base use case due to a variety of reasons that matched the criteria listed above. While it initially occurred to us that the game rules are simple and concise, drawing out a flowchart of the possible conversations the AR agent could have with the player helped us get a clear idea of the actual game itself.
<\/p>\n\n\n\n![\"\"](\"https:\/\/projects-old.etc.cmu.edu\/ako\/wp-content\/uploads\/2019\/01\/IMG_20190122_165543693-1024x924.jpg\")
The Design Workshop<\/h3>\n\n\n\n
![\"\"](\"https:\/\/projects-old.etc.cmu.edu\/ako\/wp-content\/uploads\/2019\/01\/IMG_20190125_120937143-1024x768.jpg\")
Character design research<\/h3>\n\n\n\n
Humanoid Animal Character:<\/strong>
An animal-based character that is capable of human-like movement due to the following reasons:<\/p>\n\n\n\nClockwise from Bottom: Cube-based characters, Humanoid-Animal characters, Human characters, Robots.<\/pre>\n\n\n\n
![\"\"](\"https:\/\/projects-old.etc.cmu.edu\/ako\/wp-content\/uploads\/2019\/01\/Human-animal-characters.png\")
![\"\"](\"https:\/\/projects-old.etc.cmu.edu\/ako\/wp-content\/uploads\/2019\/01\/Human-characters.png\")
![\"\"](\"https:\/\/projects-old.etc.cmu.edu\/ako\/wp-content\/uploads\/2019\/01\/robot-characters.png\")
![\"\"](\"https:\/\/projects-old.etc.cmu.edu\/ako\/wp-content\/uploads\/2019\/01\/Square-characters.png\")
Generic friendly robot-like characters that might be easier to animate but more difficult to express emotions. They have also been widely used and might not be able to build a connection with the player.
Human Character:<\/strong>
Human models can definitely make cute and toon-like styles but they are significantly harder to model and animate. It might also be disappointing to a player when its behavior doesn’t match their expectations.
Cube Shaped Characters:<\/strong>
Character design super-imposed on a cube-like mesh could be the easiest way to build a character. However, like robots, it might not be able to have a range of emotions and body movement.<\/p>\n\n\n\nThe Oculus-Zed-Leap Motion Setup<\/h3>\n\n\n\n
<\/p>\n\n\n\n
The Zed is a stereo camera that is capable of identifying the depth information of the environment it is capturing as well as do
Leap Motion Controller<\/strong>
While traditional VR applications make use of a hand controller to facilitate interaction, passthrough VR would make more sense if the interactions were through actual hands. Leap Motion is a device which includes an IR camera that captures hand gestures and allows these gestures to be programmed into the application for various interactions. It also has pre-existing gestures as part of its API.<\/p>\n\n\n\nOther possible platforms
<\/h4>\n\n\n\nSpeech-Text-Response pipeline<\/h3>\n\n\n\n
This involves the following steps:
<\/p>\n\n\n\n
Read more<\/a><\/p>\n","protected":false},"author":2,"featured_media":80,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-44","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/projects-old.etc.cmu.edu\/ako\/index.php\/wp-json\/wp\/v2\/posts\/44"}],"collection":[{"href":"https:\/\/projects-old.etc.cmu.edu\/ako\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/projects-old.etc.cmu.edu\/ako\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/ako\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/ako\/index.php\/wp-json\/wp\/v2\/comments?post=44"}],"version-history":[{"count":20,"href":"https:\/\/projects-old.etc.cmu.edu\/ako\/index.php\/wp-json\/wp\/v2\/posts\/44\/revisions"}],"predecessor-version":[{"id":82,"href":"https:\/\/projects-old.etc.cmu.edu\/ako\/index.php\/wp-json\/wp\/v2\/posts\/44\/revisions\/82"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/ako\/index.php\/wp-json\/wp\/v2\/media\/80"}],"wp:attachment":[{"href":"https:\/\/projects-old.etc.cmu.edu\/ako\/index.php\/wp-json\/wp\/v2\/media?parent=44"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/ako\/index.php\/wp-json\/wp\/v2\/categories?post=44"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/ako\/index.php\/wp-json\/wp\/v2\/tags?post=44"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}