GUI PC 3D Interface(VR):
Douglas C. Engelbart First mouse invented
( ) 3D
( 1) In 1989, Jaron Lanier Myron Krueger (1991):.The term (virtual worlds) typically refers to threedimensional realities implemented with stereo viewing goggles and reality gloves. George Coates (1992): Virtual Reality is electronic simulations of environments experienced via head mounted eye goggles and wired clothing enabling the end user to interact in realistic three-dimensional situations. P. Greenbaum (1992): Virtual Reality is an alternate world filled with computergenerated images that respond to human movements. Myron Krueger
( 2) (Cyberspace) (. ) Real in effect; not real in fact,
( 3) ( ) AI CG CHI ( )
( 4) : ( )----- / ( ) ( )
( ) 1956 Sensorama (Morton Heilig) 3D visuals, vibration, stereo sound, wind, smell, little interaction. 1961 Headsight System (Philco Corp.) Head Mounted Display (HMD), head tracking, remote video camera, telepresence. 1965 The Ultimate Display (Ivan Sutherland) Stereoscopic HMD, computer generated images, tracking, visually coupled system. 1967 Grope (University of North Carolina) 6 degree of freedom force feedback. 1977 The Sayre Glove (Sandin, Sayre, DeFanti Univ. Illinois) Gesture recognition. 1987 Virtual Cockpit (British Aerospace) head and hand tracking, eye tracking, 3d visuals, 3D audio, speech recognition, vibro tactile feedback.
( ) (Mixed Reality) NPSNET MUD
( ) (Mixed Reality) Mixed Reality (MR) Real Environment Augmented Reality (AR) Augmented Virtuality (AV) Virtual Environment
( ) Distributed Virtual Environment) : Networked VE(VR), Shared VE(VR), Multi-User VE, etc.
( ) (Desktop VR) (Stereoscopitic) (Immersive VR) (Distributed VR) VR ( )
( ) ( ) (visibility, audibility, touch, smell) (quality, fidelity) ( ) (update rates, time lag) (text, speech, gestures, gaze, complex behavior patterns)
( -3I) Immersion : Interaction : CAD Imagination :,
( ) : ( )-- ( )-- ( ) - -- --,
( ), (visibility) (awareness),, (accountability)
( ) (visibility) (awareness) (accountability)
( ) VR VR (Immersive) (Multi-Sensory)
( ) ( )
( ) ( ) VR
( ) 3D ( )
( ) 1. 2. ; 3. 4. ; 5.
( ) 20
( )
PC /
PC WIMP GOMS (???) (???) GOMS GOMS
(MHP) Model Human Processor GOMS (Stuart Card Tom Moran Allen Newell 1983 ) WIMP MHP----GOMS-----WIMP
Desktop GOMS (App. Prog.) GOMS Goals Operators Methods ( ) Selection Rules
GOMS GOAL: CLOSE-WINDOW. [select GOAL: USE-MENU-METHOD. MOVE-MOUSE-TO-FILE-MENU. PULL-DOWN-FILE-MENU. CLICK-OVER-CLOSE-OPTION GOAL: USE-CTRL-W-METHOD. PRESS-CONTROL-W-KEYS] operator : Rule 1: Select USE-MENU-METHOD unless another rule applies Rule 2: If the application is GAME, select CTRL-W-METHOD
GOMS
VR GOMS :
- ( ) ( )
GOMS Goals Operations Modals Synergy f(a,c,e,l) Attention Cognitive load Effectiveness of interaction Learnability:
Simon Simon
egoms
Affordance
3D visual displays auditory output tactile and haptic output discrete event devices continuous event devices combination devices speech input
head mounted display(hmd) : many HMDs arm mounted display : BOOM surround screen virtual environment : CAVE projection-based : ImmersaDesk, WorkBench stereo monitor : use shutter glasses
: (beep) iconic : :
/ : Phantom : CyberGrasp : CyberTouch
keyboard, pinch glove
:,,,, /,
/ /,,,, ring mouse, fly mouse, BAT, Wand, Flex and Pinch
: :
VR (Viewpoint) (Navigation) (Manipulation) (Immersion)
/ (Selection/ Manipulation) (Navigation) (System Control) /
/, ( ),,,
Way-Finding Travel way-finding : travel:,
( ) walkthrough trackball exploded view
( ) Steering : (steering wheel, flight sticks), Mine, 1995 [P-40]
3DUI 3D 3D
3D UI UI
3DWM 3D 3D 2D Microsoft Task Gallery
Room-based Workbench-based
ACM CHI2005 Workshop on Future User Interface Toolkits Tangible User Interface Camera-based User interface Haptic User Interface
ACM CHI2005 Workshop on Future User Interface Toolkit]
WIMP GUI WIMP / WIMP
WIMP Non-WIMP [Mark Green et al, SIGGRAPH 1991] Post-WIMP [Van Dam, COMMUNICATIONS OF THE ACM 1997] WIMP
PIBG (Physical Object Icon Button Gesture) WIMP PIBG(Post WIMP) PG(Non-WIMP) W P P I M I B P G G <50% >80% 100% >50% <20%
??? ( )? (..)??