{"id":8,"date":"2018-01-29T00:27:41","date_gmt":"2018-01-29T00:27:41","guid":{"rendered":"https:\/\/projects-old.etc.cmu.edu\/music-in-motion\/?p=8"},"modified":"2018-01-29T00:27:49","modified_gmt":"2018-01-29T00:27:49","slug":"team-music-in-motion-gets-moving","status":"publish","type":"post","link":"https:\/\/projects-old.etc.cmu.edu\/music-in-motion\/index.php\/2018\/01\/29\/team-music-in-motion-gets-moving\/","title":{"rendered":"Team Music in Motion Gets Moving"},"content":{"rendered":"<p><span style=\"font-weight: 400;\">Our team was still arranging our new project room for the semester when our first visitor dropped by. We were lucky enough to receive an introduction to the <\/span><a href=\"https:\/\/en.wikipedia.org\/wiki\/Theremin\"><span style=\"font-weight: 400;\">Theremin <\/span><\/a><span style=\"font-weight: 400;\">from virtuoso, <\/span><a href=\"https:\/\/www.ted.com\/talks\/pamelia_kurstin_plays_the_theremin\"><span style=\"font-weight: 400;\">Pamelia Kurstin<\/span><\/a><span style=\"font-weight: 400;\">. She made playing the electronic instrument look natural as she demonstrated her control of pitch with one hand and volume with the other. We were surprised by the Theremin\u2019s versatility. So often it is associated with a \u201csci-fi\u201d sound, however, Pam drew out its musicality with graceful and measured hand-movements. She allowed us each to make an attempt at playing the instrument and to explore its responsiveness.<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-13\" src=\"https:\/\/projects-old.etc.cmu.edu\/music-in-motion\/wp-content\/uploads\/2018\/01\/Pam2-300x225.jpg\" alt=\"\" width=\"300\" height=\"225\" srcset=\"https:\/\/projects-old.etc.cmu.edu\/music-in-motion\/wp-content\/uploads\/2018\/01\/Pam2-300x225.jpg 300w, https:\/\/projects-old.etc.cmu.edu\/music-in-motion\/wp-content\/uploads\/2018\/01\/Pam2-768x576.jpg 768w, https:\/\/projects-old.etc.cmu.edu\/music-in-motion\/wp-content\/uploads\/2018\/01\/Pam2-1024x768.jpg 1024w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/> <img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-12\" src=\"https:\/\/projects-old.etc.cmu.edu\/music-in-motion\/wp-content\/uploads\/2018\/01\/Yujin-300x225.jpg\" alt=\"\" width=\"300\" height=\"225\" srcset=\"https:\/\/projects-old.etc.cmu.edu\/music-in-motion\/wp-content\/uploads\/2018\/01\/Yujin-300x225.jpg 300w, https:\/\/projects-old.etc.cmu.edu\/music-in-motion\/wp-content\/uploads\/2018\/01\/Yujin-768x576.jpg 768w, https:\/\/projects-old.etc.cmu.edu\/music-in-motion\/wp-content\/uploads\/2018\/01\/Yujin-1024x768.jpg 1024w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p>\n<p><span style=\"font-weight: 400;\">This experience quickly became the inspiration for our first gold spike and prototype. We wanted to mimic Pam\u2019s controlled and movement-oriented performance by creating a Theremin ourselves in VR. In the demo, the Vive controllers replaced the hands of the musician, while their distance from virtual antennas determined volume and pitch. However, this experiment surprisingly felt unsuccessful because the concept did not translate into VR as well and the magic of the instrument fell flat. Still, it became clear that what we loved about the Theremin was the nuanced hand gestures and intimate movements that shaped the music.<\/span><\/p>\n<p><iframe loading=\"lazy\" title=\"Music In Motion GoldSpike Theremin\" width=\"640\" height=\"480\" src=\"https:\/\/www.youtube.com\/embed\/vLrso1DIWL4?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<p><span style=\"font-weight: 400;\">This prompted us to reconsider our assumption that our project platform would be solely for Vive.<\/span> <span style=\"font-weight: 400;\">We agreed that it was essential to encourage our guests to use<\/span> <span style=\"font-weight: 400;\">more delicate and refined gestures. The piece \u201c<\/span><a href=\"https:\/\/vimeo.com\/8120954\"><span style=\"font-weight: 400;\">Very Nervous System<\/span><\/a><span style=\"font-weight: 400;\">\u201d (1982-1991), in which performers manipulated musical playback with controlled, dance-like movement, inspired us to focus on more intimate interactions. The natural next step was to consider Leap Motion as an extension to the Vive. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">While we had heard some negative things about <\/span><a href=\"https:\/\/www.leapmotion.com\/\"><span style=\"font-weight: 400;\">Leap Motion<\/span><\/a><span style=\"font-weight: 400;\">, we enjoyed exploring the possibilities it might offer. Although there were some evident issues such as finger occlusion, the tracking felt magical.<\/span> <span style=\"font-weight: 400;\">The most notable problem we encountered however, was that when the guest\u2019s hands fell out of view of the Leap Motion sensor, they stopped existing temporarily. This complicates any interactions that take place out of the guests\u2019 \u201cview.\u201d \u00a0Our team has already begun looking for solutions to this, including using Vive trackers to interpolate hand position. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">In our second week, we had our next project visit from Master\u2019s Student <\/span><a href=\"http:\/\/www.annahenson.com\/\"><span style=\"font-weight: 400;\">Anna Henson<\/span><\/a><span style=\"font-weight: 400;\">. She is currently in the Computational Design program at CMU, and has many years of experience producing installation art pieces. She was able to recommend numerous reference works, from dance artists and action painters, to creative developers in the machine learning space. \u00a0Further, she encouraged us to get away from our computers. Because our project focuses on designing experiences that <\/span><i><span style=\"font-weight: 400;\">look<\/span><\/i><span style=\"font-weight: 400;\"> tactile, Anna helpfully reminded us to play with textures in a hands-on context. We hope to plan some group activities that allow us to brainstorm outside of our project room. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">In terms of project planning, our team nailed down our core hours, roles, and problem statement during our first week. The second week we spent mapping out our semester, including the project phases, goals, and acceptance criteria. We also took time to make sure we had our technology in order. \u00a0As mentioned, we added a Leap Motion alongside our Vive and trackers. We also procured a \u00a04.1 surround sound system, so that we can begin bringing our VR positional sound to life. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">Our final group activity before the end of the week was to brainstorm ideas for our first prototype and sprint. It was not an easy task to agree on a set of interactions and a collective image of our experience. Ultimately we determined that we would explore the concept of creation and the act of bringing harmony to life from a chaos of white noise. From this brainstorm we selected one key interaction to kick-off our sprint and the work for week three.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Our team was still arranging our new project room for the semester when our first visitor dropped by. We were lucky enough to receive an introduction to the Theremin from virtuoso, Pamelia Kurstin. She made playing the electronic instrument look [&hellip;]<\/p>\n","protected":false},"author":5,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-8","post","type-post","status-publish","format-standard","hentry","category-uncategorized","clearfix"],"_links":{"self":[{"href":"https:\/\/projects-old.etc.cmu.edu\/music-in-motion\/index.php\/wp-json\/wp\/v2\/posts\/8"}],"collection":[{"href":"https:\/\/projects-old.etc.cmu.edu\/music-in-motion\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/projects-old.etc.cmu.edu\/music-in-motion\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/music-in-motion\/index.php\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/music-in-motion\/index.php\/wp-json\/wp\/v2\/comments?post=8"}],"version-history":[{"count":2,"href":"https:\/\/projects-old.etc.cmu.edu\/music-in-motion\/index.php\/wp-json\/wp\/v2\/posts\/8\/revisions"}],"predecessor-version":[{"id":14,"href":"https:\/\/projects-old.etc.cmu.edu\/music-in-motion\/index.php\/wp-json\/wp\/v2\/posts\/8\/revisions\/14"}],"wp:attachment":[{"href":"https:\/\/projects-old.etc.cmu.edu\/music-in-motion\/index.php\/wp-json\/wp\/v2\/media?parent=8"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/music-in-motion\/index.php\/wp-json\/wp\/v2\/categories?post=8"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/music-in-motion\/index.php\/wp-json\/wp\/v2\/tags?post=8"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}