This week, we mainly focused on ideation, branding, and preparation for the quarter presentation.<\/p>\n\n\n\n
Our excellent designer prototyped several ideas for our project’s poster and logo, and finally, we decided on the following designs\uff1a<\/p>\n\n\n\n
We tried to present the information that the computer could act like a human being in video games. Even though we might modify our branding more after the Quarters, our current designs are good enough to present to our visitors next week.<\/p>\n\n\n\n
Besides the branding, on Wednesday, our team did a short trip to Google headquarter in Mountain View for the team photo and decoration supplies. We took a very lovely photo in front of the google sign in the convenience store:<\/p>\n\n\n\n
For the preparation of the Quarter, we planned to have four different parts of presentation: introduction, tech demo, design process, and design ideas. We will lead our guests to the introduction section first, by explaining what our project is about and what is reinforcement learning, and the problem we are trying to solve. Secondly, we will show our tech demo, which is a small prototype about a ball and a platform. The platform is the AI, moving against the ball to prevent it from falling down. By showing this demo, we tried to explain that the existing Unity Machine Learning Plugin works for reinforcement learning. Lastly, we want to present the flow chart of our design process and our current stage. We will explain our current stage more by listing our six design ideas.<\/p>\n\n\n\n
The six ideas come from every teammate’s effort. We researched the potential applications of enhancing the relationship and interaction and came up with six ideas:<\/p>\n\n\n\n
In Mario Party mini-game, the player is matched with NPC who might not have the same abilities as the player, or like Overcooked, the player could not play without friends. The problem we are trying to solve is that right now, NPC cannot have the same ability as other teammates and this leads to an unbalanced team. What if the NPC could have the same ability as the player\uff1fThrough creating human-like agents, the goal is not to have a smart agent completing tasks accurate and fast for you, instead, to create agent who shares the same ability as other human players so the teamwork could be more balanced. Because we cannot do real-time training. We will collect data from the human players, train NPCs to act more like a human in the next version. Another aspect is to think the agent has different abilities, so maybe there is clumsy or dictated chef in the game.<\/p>\n\n\n\n
2. Sims- Raise up a kid<\/p>\n\n\n\n
This idea comes from the Sims game. The player is the parent has a kid Sim to raise. They will only give choices to the kid (the NPC), without telling him\/her what is right or what is wrong. The kid, on the other hand, will get their parent’s emotion feedback and make choices. The problem we are trying to solve is to build up the emotion between the player and the NPC throughout the gameplay. Better than a state machine, game designers don\u2019t have to create all the scenarios and edge cases. RL will invent them.<\/p>\n\n\n\n
3. Responsive Canvas<\/p>\n\n\n\n
This idea comes from the game we played in the improv class. The player and the NPC take turns to finish an artwork on a blank canvas. The agent will either add on or erase strokes\/colors after the player’s turn. The player will learn how to paint like a master as Van Gogh or Picasso, with the NPC’s guidance. This idea is very innovative. However, it might meet problems with imaging processing and edge detection technology.<\/p>\n\n\n\n
4. Escape from the fire scene <\/p>\n\n\n\n
A couple is escaping from a building on fire. One of them is the leader, and the other is the follower. The Leader decides the way to run and avoid getting burned within 3-min. The Follower tries to open doors, save people, or grab objects to earn scores<\/strong>. Both of them consume Energy. Whoever has the highest Energy in real-time will be the Leader. The conflict scenario we are trying to develop is when trying to escape within a time limit, follower decides to save a baby, but the other wants to leave the scene asap. The uniqueness of this is that RL might respond differently according to different situations, i.e., the intimacy of the couple, and create tension between the player and the NPC companion. <\/p>\n\n\n\n 5. Plants war <\/p>\n\n\n\n<\/noscript><\/figure><\/div>\n\n\n\nWe want to create a situation that there is a neutral party in the game. The game will have two NPCs. Plus the player, there will be three parties in the game. The player is vegetation fighting animals. The animal is the enemy and the RL agent is the bird. The Player tries to destroy the animal\u2019s base. During the battle, the bird comes out to find food. The player can use bird as decoy or shield. When the Agent needs food, it will try to come out to find the food. During the process, the Agent will interact with the player or other NPCs, it will get rewards (points) for the interaction.<\/p>\n\n\n\n 6. Co-op puzzle game <\/p>\n\n\n\n<\/noscript><\/figure><\/div>\n\n\n\nThe last idea is a co-op puzzle game. In the existing puzzle game, there is limited guidance from the NPC character to solve puzzles. There are only little interaction and character depth. We want to improve the interactions between the player and the NPC using RL. We have an RL-trained companion NPC character who can provide help or solve puzzles with the player more dynamically according to the player\u2019s behavior. It allows real-time feedback between the player and the agent using limited communication such as physical movements and emoji stickers. The player figures out how to help the agent solve a puzzle in order to complete a quest. The agent\u2019s goal is to maximize the player\u2019s experience through guiding and responding in the most effective way according to player behavior and the puzzle-solving progress. They will need to rely on some level of communication to solve the puzzle. <\/p>\n\n\n\nOverall, we hope that we could get feedback from the guests about our six ideas and move forward to design our first chosen idea soon after the Quarters. We are looking forward to the Quarters next week!<\/p>\n","protected":false},"excerpt":{"rendered":"This week, we mainly focused on ideation, branding, and preparation for the quarter presentation. Our excellent designer prototyped several ideas for our project’s poster and logo, and finally, we decided on the following designs\uff1a We tried to present the information that the computer could act like a human being in video games. Even though we… Read more<\/a><\/p>\n","protected":false},"author":2,"featured_media":413,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4,2,3],"tags":[],"class_list":["post-124","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-arts","category-brainstorming","category-engineering"],"_links":{"self":[{"href":"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/index.php\/wp-json\/wp\/v2\/posts\/124"}],"collection":[{"href":"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/index.php\/wp-json\/wp\/v2\/comments?post=124"}],"version-history":[{"count":10,"href":"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/index.php\/wp-json\/wp\/v2\/posts\/124\/revisions"}],"predecessor-version":[{"id":162,"href":"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/index.php\/wp-json\/wp\/v2\/posts\/124\/revisions\/162"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/index.php\/wp-json\/wp\/v2\/media\/413"}],"wp:attachment":[{"href":"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/index.php\/wp-json\/wp\/v2\/media?parent=124"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/index.php\/wp-json\/wp\/v2\/categories?post=124"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/index.php\/wp-json\/wp\/v2\/tags?post=124"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
5. Plants war <\/p>\n\n\n\n
We want to create a situation that there is a neutral party in the game. The game will have two NPCs. Plus the player, there will be three parties in the game. The player is vegetation fighting animals. The animal is the enemy and the RL agent is the bird. The Player tries to destroy the animal\u2019s base. During the battle, the bird comes out to find food. The player can use bird as decoy or shield. When the Agent needs food, it will try to come out to find the food. During the process, the Agent will interact with the player or other NPCs, it will get rewards (points) for the interaction.<\/p>\n\n\n\n
6. Co-op puzzle game <\/p>\n\n\n\n
The last idea is a co-op puzzle game. In the existing puzzle game, there is limited guidance from the NPC character to solve puzzles. There are only little interaction and character depth. We want to improve the interactions between the player and the NPC using RL. We have an RL-trained companion NPC character who can provide help or solve puzzles with the player more dynamically according to the player\u2019s behavior. It allows real-time feedback between the player and the agent using limited communication such as physical movements and emoji stickers. The player figures out how to help the agent solve a puzzle in order to complete a quest. The agent\u2019s goal is to maximize the player\u2019s experience through guiding and responding in the most effective way according to player behavior and the puzzle-solving progress. They will need to rely on some level of communication to solve the puzzle. <\/p>\n\n\n\n
Overall, we hope that we could get feedback from the guests about our six ideas and move forward to design our first chosen idea soon after the Quarters. We are looking forward to the Quarters next week!<\/p>\n","protected":false},"excerpt":{"rendered":"
This week, we mainly focused on ideation, branding, and preparation for the quarter presentation. Our excellent designer prototyped several ideas for our project’s poster and logo, and finally, we decided on the following designs\uff1a We tried to present the information that the computer could act like a human being in video games. Even though we… Read more<\/a><\/p>\n","protected":false},"author":2,"featured_media":413,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4,2,3],"tags":[],"class_list":["post-124","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-arts","category-brainstorming","category-engineering"],"_links":{"self":[{"href":"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/index.php\/wp-json\/wp\/v2\/posts\/124"}],"collection":[{"href":"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/index.php\/wp-json\/wp\/v2\/comments?post=124"}],"version-history":[{"count":10,"href":"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/index.php\/wp-json\/wp\/v2\/posts\/124\/revisions"}],"predecessor-version":[{"id":162,"href":"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/index.php\/wp-json\/wp\/v2\/posts\/124\/revisions\/162"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/index.php\/wp-json\/wp\/v2\/media\/413"}],"wp:attachment":[{"href":"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/index.php\/wp-json\/wp\/v2\/media?parent=124"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/index.php\/wp-json\/wp\/v2\/categories?post=124"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/index.php\/wp-json\/wp\/v2\/tags?post=124"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
![\"\"](\"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/wp-content\/uploads\/2019\/09\/Idea4-1024x791.jpg\")
![\"\"](\"data:image\/gif;base64,R0lGODlhAQABAAAAACH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\")
![\"\"](\"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/wp-content\/uploads\/2019\/09\/Idea5-1024x791.jpg\")
![\"\"](\"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/wp-content\/uploads\/2019\/09\/Idea62-1024x791.jpg\")
![\"\"](\"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/wp-content\/uploads\/2019\/09\/logo-color-1024x411.png\"){kind=logo}
![\"\"](\"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/wp-content\/uploads\/2019\/09\/Screen-Shot-2019-09-23-at-11.47.24-AM-774x1024.png\")
![\"\"](\"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/wp-content\/uploads\/2019\/09\/TeamPhoto_final-1024x665.jpg\")
![\"\"](\"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/wp-content\/uploads\/2019\/09\/Idea1-1024x791.jpg\")
![\"\"](\"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/wp-content\/uploads\/2019\/09\/Idea3-1024x791.jpg\")
![\"\"](\"https:\/\/projects-old.etc.cmu.edu\/shadow-agent\/wp-content\/uploads\/2019\/09\/Idea2-1024x791.jpg\")