TVRSJ_domino_ _final.pdf

Size: px

Start display at page:

Download "TVRSJ_domino_ _final.pdf"

烨藤倪
5 years ago
Views:

1 *1 *1 *1 *1, 2 *1 *1 *1 *3 DOMINO Toppling: An MR Attraction Focusing on R-V Continuum Ryotaro Hirata *1, Tomoka Ishibashi *1, Jianing Qie *1, Shohei Mori *1, 2, Sei Ikeda *1, Fumihisa Shibata *1, Asako Kimura *1, and Hideyuki Tamura *3 Abstract -- In this paper, we present an MR-based attraction, DOMINO (DO MIxed-reality NOn-stop) Toppling, as a case study of MR-based entertainment systems, focusing on the Real Virtual (R V) and Virtual Real (V R) continuum. In this attraction, the user experiences that real and virtual domino blocks seamlessly push each other through a video-seethrough head-mounted display. Therefore, the user may believe that attractive MR effects happen in the real space. To achieve the seamless R V/V R transitions, we designed and implemented simple switching devices. We carried out demonstrations of our system at an international symposium and found such seamless R V/V R transitions effectively entertained people. Keywords: Mixed Reality, MR attraction, R V/V R continuum (Mixed Reality; MR) (Virtual Reality; VR) 1 [1, 2] VR MR & (A&E) CG SIGGRAPH Emerging Technologies [3] Laval Virtual Virtual Fantasy [4] MR Ars Electronica MR [5] MR A&E TV MR *1 *1 *2 *2 *3 *1 Information Science, Ritsumeikan University *1 Graduate School of Information Science & Engineering, *2 Research Organization of Science and Technology, Ritsumeikan University Ritsumeikan University *2 Faculty of Science and Engineering, Keio University *3 Research Organization of Science and Technology, Ritsumeikan University CG HMD MR MR MR MR CG CG CG CG MR AR (Augmented Reality) AV (Augmented Virtuality) (continuum) [6] R-V Continuum MR MR R-V/V-R

2 Vol.21, No.3, 2016 Milgram R-V continuum [6] Fig. 1 Milgram s reality-virtuality continuum [6] MR MR R-V MR MR 2 MR 3 DOMINO Toppling 4 DOMINO Toppling 5 MR A&E [7, 8] MR [9, 10] MR MR Watch the Birdie! [11] Rhythm of the Rain in 3D [12] Kaidan [13] MR Head- Mounted Display (HMD) MR MR 2 2 MR R-V ContinuumR-V/V-R R V V R [14-16] R-V CG R-V V-R MR Leitner COMINO[17, 18] R-V/V-R CG DOMINO (DO MIxed-reality NOn-stop) Toppling HMD MR MR (Real to Virtual; R-V) (Virtual to Real; V-R) HMD MR

3 : Input Real dominoes Virtual dominoes Attractive MR effects Virtual dominoes Real dominoes Output MR system R V switching device (a) HMD DOMINO Toppling Fig. 2 Concept image of DOMINO Toppling (b) V R switching device HMD DOMINO Toppling R-V/V-R (A) (A-1) (A-2) (A-3) (B) (A) (B) DOMINO Toppling 2.2 (A-1) R-V/V-R MR HMD HMD HMD Table. 1 Spec of HMD 60 / HMD HMD MR HMD MREAL HH-A1 HMD MR 5.0m 5.0m 5.3m HMD HMD Vicon Bonita3 Bonita10 HMD HMD HMD HMD 6 MREAL HMD R-V V-R R-V V-R

4 Vol.21, No.3, 2016 R-V V-R HMD 3.2 (A-1) MR HMD 8cm 4cm 2cm 80g 4 MR 3DCG Autodesk Maya 1 MR MR Autodesk Maya MR Phong Fig. 3 Steps for rendering a virtual domino Fig. 4 Overall image of the domino course 1 HMD HMD HMD HMD OpenGL Shading Language (GLSL) 3.2 (A-2)

0 Base 5π rad/sec 64.0 Base 2π rad/sec 70.0 Base π rad/sec 30.0 4cm 2cm Base=0.

5 : Fig. 5 Virtual domino course from user s view MR Fig. 6 MR composited virtual dominos (1) (2) 2 (1) 6 Base 30.0 Base 6π rad/sec 54.0 Base 5π rad/sec 64.0 Base 2π rad/sec 70.0 Base π rad/sec cm 2cm Base= cm/sec (2) 2 1cm 5% 5% 0.5cm 0.5cm 2.5% 0.5cm ±150% 3.2 (A-3) 20 1 (R-V) (V-R) 3.2 (B) R-V R-V R-V (Arduino) MR PC V-R 80g 7 V-R Arduino V-R 8 (b)

device (right) Real to virtual domino Virtual

8 Real and virtual domino transitions DOMINO

6 Vol.21, No.3, 2016 R-V V-R Fig. 7 R-V switching device (left) and V-R switching device (right) Real to virtual domino Virtual to real domino Fig. 8 Real and virtual domino transitions DOMINO Toppling R-V/V-R DOMINO Toppling ISMAR 2015 (The 13th IEEE Int. Symp. on Mixed and Augmented Reality) AR/MR 2 (a) MR (b) R-V Continuum MR PC VST-HMD R-V/V-R Arduino HMD USB

7 : Fig. 9 System configuration PC VICON Bonita HMD VICON VICON TRACKER 3.0 HMD MR PC VICON 6 MR HMD DOMINO Toppling 12 (b) HMD 2 (1) (2) (1) HMD d i (0 i N) N (= N / Σd i ) (2) HMD (d i d max ) HMD HMD (d i d min ) DOMINO Toppling MR %

8 Vol.21, No.3, 2016 Fig. 10 Floor map at the exhibition Fig. 11 Domino course at the exhibition Air course Air to real course Fig. 12 Virtual domino course Exhibition space User seeing dominoes ISMAR2015 Fig. 13 Exhibition at ISMAR 2015 HMD R-V/V-R DOMINO Toppling MR (A-1) (A-3) (B) R-V/V-R R-V V-R, ISMAR 2015 MASH D (Media, Arts, Social Sciences, Humanities & Design) Science & Technology Program Demonstrations 36 DOMINO Toppling BEST DEMO AWARD

9 : R-V/V-R Fig. 14 Acrylic box showing R-V/V-R switching device MR R-V Continuum MR (MR) MR DOMINO (DO MIxed-reality NOn-stop) Toppling (A) (A-1) (A-2) (A-3) (B) DOMINO Toppling DOMINO Toppling 95% MR DOMINO Toppling (S) [1] 1~6 VR ( ) [2] (AR),, Vol. 51, No. 4, [3] A. Israr, S. Zhao, K. McIntosh, J. Kang, Z. Schwemler, E. Brockmeyer, M. Baskinger, and M. Mahler: Po2: Augmented haptics for interactive gameplay, Proc. SIGGRAPH 2015 Emerging Technologies, Article 21, [4] C. Tanaka and T. Ohshima: MR Coral Sea, Laval Virtual 2014, ReVolution Demo, [5] C. Lindinger, R. Haring, H. Hörtner, D. Kuka, K. Kato: Mixed reality installation Gulliver s World : Interactive content creation in nonlinear exhibition design, Technologies for Interactive Digital Storytelling and Entertainment, Vol. 4326, pp , [6] P. Milgram and F. Kishino: A taxonomy of mixed reality visual display, IEICE Trans. Inf. & Sys., vol. E77-D, no. 12, pp , [7] 2001 MR VR Vol. 7 No. 2 pp , [8] T. Ohshima, S. Kawaguchi, and Y. Tanaka: MR coral sea evolved: Mixed reality aquarium with physical MR displays, Proc. SIGGRAPH Posters, No. 27, [9] RV- Border Guards : VR Vol. 4, No. 4, pp , [10] : BLADESHIPS VR Vol. 10, No. 1, pp , [11] Watch the Birdie! VR Vol. 12, No. 3, pp , [12] Rhythm of the Rain in 3D 3D-MR VR pp , [13] K. Inoue, T. Wada, K. Kitamura, S. Nishino, R. Ichikari, R. Tenmoku, T. Ohshima, and H. Tamura: Kaidan: Japanese horror experience in interactive mixed reality space, Proc. SIGGRAPH ASIA, Emerging Technologies, p. 75, [14],,,,,, : Kobito Virtual Brownies, VR Vol. 11, No. 2, pp , [15],,,,, :,, Vol. 48, No. 11, pp , [16] S. Follmer, D. Leithinger, A. Olwal, A. Hogge, and H. Ishii: inform Dynamic physical affordances and constraints, Proc. 26th Symp. on User Interface Software and Technology (UIST 13), pp , 2013.

Haller: Bridging the gap between real and

4 PD IEEE ACM 2001 2003 2006 2007 2011 2015

10 Vol.21, No.3, 2016 [17] J. Leitner, C. Köffel, and M. Haller: Bridging the gap between real and virtual objects for tabletop games, Int. J. Virtual Reality, Vol. 5, No. 3, pp. 1-5, [18] J. Leitner, M. Haller, K. Yun, W. Woo, M. Sugimoto, and M. Inami: IncreTable, A mixed reality tabletop game experience, Proc. Int. Conf. on Advances in Computer Entertainment Technology (ACE2008), pp. 9-16, PD IEEE ACM IEEE ACM IEEE ACM IEEE MR Mixed Reality (Ohmsha & Springer) IEEE ACM

財金資訊-81期.indd

財金資訊-81期.indd 4G 4G / / FIND 2013 2013 49.5 2 1 1,053 SoLoMo (social local mobile) SoLoMo Facebook Facebook Facebook (Application Programming Interface API) (Augmented Reality AR) 3D www.fisc.com.tw 55 4G 3D 4G 100Mbps