{"id":381,"date":"2020-03-05T22:28:31","date_gmt":"2020-03-05T22:28:31","guid":{"rendered":"https:\/\/projects-old.etc.cmu.edu\/foresight\/?page_id=381"},"modified":"2020-05-10T23:25:52","modified_gmt":"2020-05-10T23:25:52","slug":"media","status":"publish","type":"page","link":"https:\/\/projects-old.etc.cmu.edu\/foresight\/index.php\/media\/","title":{"rendered":"Media"},"content":{"rendered":"\n<p style=\"font-size:30px\" class=\"has-text-align-center\"><strong>TEAM POSTER<\/strong><\/p>\n\n\n\n<figure class=\"wp-block-gallery columns-2 is-cropped wp-block-gallery-1 is-layout-flex wp-block-gallery-is-layout-flex\"><ul class=\"blocks-gallery-grid\"><li class=\"blocks-gallery-item\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"683\" height=\"1024\" src=\"https:\/\/www.etc.cmu.edu\/projects\/foresight\/wp-content\/uploads\/2020\/03\/halfsheet-front-1-683x1024.png\" alt=\"\" data-id=\"394\" data-full-url=\"https:\/\/www.etc.cmu.edu\/projects\/foresight\/wp-content\/uploads\/2020\/03\/halfsheet-front-1.png\" data-link=\"https:\/\/www.etc.cmu.edu\/projects\/foresight\/?attachment_id=394\" class=\"wp-image-394\" srcset=\"https:\/\/projects-old.etc.cmu.edu\/foresight\/wp-content\/uploads\/2020\/03\/halfsheet-front-1-683x1024.png 683w, https:\/\/projects-old.etc.cmu.edu\/foresight\/wp-content\/uploads\/2020\/03\/halfsheet-front-1-200x300.png 200w, https:\/\/projects-old.etc.cmu.edu\/foresight\/wp-content\/uploads\/2020\/03\/halfsheet-front-1-768x1152.png 768w, https:\/\/projects-old.etc.cmu.edu\/foresight\/wp-content\/uploads\/2020\/03\/halfsheet-front-1-1024x1536.png 1024w, https:\/\/projects-old.etc.cmu.edu\/foresight\/wp-content\/uploads\/2020\/03\/halfsheet-front-1-1365x2048.png 1365w, https:\/\/projects-old.etc.cmu.edu\/foresight\/wp-content\/uploads\/2020\/03\/halfsheet-front-1-267x400.png 267w\" sizes=\"(max-width: 683px) 100vw, 683px\" \/><\/figure><\/li><li class=\"blocks-gallery-item\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"432\" height=\"648\" src=\"https:\/\/www.etc.cmu.edu\/projects\/foresight\/wp-content\/uploads\/2020\/03\/halfsheet-back-01.png\" alt=\"\" data-id=\"393\" data-full-url=\"https:\/\/www.etc.cmu.edu\/projects\/foresight\/wp-content\/uploads\/2020\/03\/halfsheet-back-01.png\" data-link=\"https:\/\/www.etc.cmu.edu\/projects\/foresight\/?attachment_id=393\" class=\"wp-image-393\" srcset=\"https:\/\/projects-old.etc.cmu.edu\/foresight\/wp-content\/uploads\/2020\/03\/halfsheet-back-01.png 432w, https:\/\/projects-old.etc.cmu.edu\/foresight\/wp-content\/uploads\/2020\/03\/halfsheet-back-01-200x300.png 200w, https:\/\/projects-old.etc.cmu.edu\/foresight\/wp-content\/uploads\/2020\/03\/halfsheet-back-01-267x400.png 267w\" sizes=\"(max-width: 432px) 100vw, 432px\" \/><\/figure><\/li><\/ul><\/figure>\n\n\n\n<p>\u3000<\/p>\n\n\n\n<p>\u3000<\/p>\n\n\n\n<p style=\"font-size:30px\" class=\"has-text-align-center\"><strong>PROJECT TRAILER<\/strong><\/p>\n\n\n\n<p><\/p>\n\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Foresight - Project Trailer\" width=\"1599\" height=\"899\" src=\"https:\/\/www.youtube.com\/embed\/0wtbfggElPg?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>\u3000<\/p>\n\n\n\n<p>\u3000<\/p>\n\n\n\n<p>\u3000<\/p>\n\n\n\n<p style=\"font-size:30px\" class=\"has-text-align-center\"><strong>VIRTUAL CAMERA SYSTEM<\/strong><\/p>\n\n\n\n<p>From our talks with the professionals in the industry, we found that the main goal of our virtual camera system is to empower filmmakers to understand, prototype and control the cinematography elements in the story, namely the space and the camera movements.<\/p>\n\n\n\n<p>To let the users truly understand the space of the set, we chose to implement an immersive VR experience to effectively convey the physical dimensions of the set. We are also running our camera system from the Unity Editor so we can easily rearrange objects to cater to the needs of the filmmaker in real-time.<\/p>\n\n\n\n<p>For the camera movements, we strive to create an adjustable camera that can recreate the properties of real-life cameras and implement different navigation schemes in VR to enable filmmakers to experiment more shots in a fixed amount of time.<\/p>\n\n\n\n<p>Features in the system:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Vertical and Horizontal navigating<\/li><li>Tilting &amp; Panning<\/li><li>Dollying \/ Creating Camera Track<\/li><li>Adjusting Depth of Field &amp; Racking Focus<\/li><li>Saving and loading camera motion<\/li><\/ul>\n\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Final Camera Demo\" width=\"1599\" height=\"899\" src=\"https:\/\/www.youtube.com\/embed\/sDY9eZGMtww?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Camera Motion Recording Demo\" width=\"1599\" height=\"899\" src=\"https:\/\/www.youtube.com\/embed\/8cz6iMOFEls?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>\u3000<\/p>\n\n\n\n<p>\u3000<\/p>\n\n\n\n<p style=\"font-size:30px\" class=\"has-text-align-center\"><strong>MO-CAP SYSTEM<\/strong><\/p>\n\n\n\n<p>Traditional film previz involves either keyframed animation done by hand, which is time consuming, or motion capture, which requires a dedicated space and setup, and requires significant clean-up after. We are using a VR setup to quickly block out character motion using an inverse kinematics driven rig. The animation is expected to look rough and not intended to be a replacement for the real performance an actor would bring to a set.<\/p>\n\n\n\n<p>Earlier, we designed our system to be used by 3 people, with one acting, one operating the controls and one directing the performance. After things went into remote, that changed. We had reserved controllers to capture hand poses, but we&#8217;re now using the trigger to calibrate, and to start and stop recording. We added a countdown so as to get into the right pose when animation begins recording.<\/p>\n\n\n\n<p>We record one animation for one character at a time based on an animation list.&nbsp; Each clip is exported into a file. We do roughly 1 &#8211; 5 takes. Eventually, selected clips are imported manually into a Unity timeline to create a whole sequence of animations. We do not do any cleanup or post processing on the animation apart from editing the start and end times or repositioning the character in space. Since the mocap space is small, there are small time jumps in the sequence, which can be a limitation sometimes from the camera perspective, but it works in previz.<\/p>\n\n\n\n<p>For scenes where interaction between two characters is crucial, we found it useful to record one performance and then play back that recorded performance at will. That way the second character can respond to the first, and match the positioning and timing better.<\/p>\n\n\n\n<p>Here is the demo video:<\/p>\n\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Mo cap final demo\" width=\"1599\" height=\"899\" src=\"https:\/\/www.youtube.com\/embed\/XgHVYrAEWQs?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p> \u3000<\/p>\n\n\n\n<p>\u3000<\/p>\n\n\n\n<p>\u3000<\/p>\n\n\n\n<p style=\"font-size:30px\" class=\"has-text-align-center\"><strong>VISUALIZATION CLIPS<\/strong><\/p>\n\n\n\n<p class=\"has-regular-font-size\"><em>Recreation Practice &#8211; Moonrise Kingdom<\/em><\/p>\n\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Foresight Recreation Practice - Moonrise Kingdom\" width=\"1599\" height=\"899\" src=\"https:\/\/www.youtube.com\/embed\/7qEJpWwVATs?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>\u3000<\/p>\n\n\n\n<p><em>Final visualization clip: Se7en &#8211; ending scene<\/em><\/p>\n\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Foresight Previz -  Se7en ending scene\" width=\"1599\" height=\"899\" src=\"https:\/\/www.youtube.com\/embed\/V5ue7BdabfQ?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>TEAM POSTER \u3000 \u3000 PROJECT TRAILER \u3000 \u3000 \u3000 VIRTUAL CAMERA SYSTEM From our talks with the professionals in the industry, we found that the main goal of our virtual camera system is to empower &hellip;<\/p>\n","protected":false},"author":2,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-381","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/projects-old.etc.cmu.edu\/foresight\/index.php\/wp-json\/wp\/v2\/pages\/381"}],"collection":[{"href":"https:\/\/projects-old.etc.cmu.edu\/foresight\/index.php\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/projects-old.etc.cmu.edu\/foresight\/index.php\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/foresight\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/foresight\/index.php\/wp-json\/wp\/v2\/comments?post=381"}],"version-history":[{"count":31,"href":"https:\/\/projects-old.etc.cmu.edu\/foresight\/index.php\/wp-json\/wp\/v2\/pages\/381\/revisions"}],"predecessor-version":[{"id":542,"href":"https:\/\/projects-old.etc.cmu.edu\/foresight\/index.php\/wp-json\/wp\/v2\/pages\/381\/revisions\/542"}],"wp:attachment":[{"href":"https:\/\/projects-old.etc.cmu.edu\/foresight\/index.php\/wp-json\/wp\/v2\/media?parent=381"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}