untitled

Size: px

Start display at page:

Download "untitled"

段虞
5 years ago
Views:

3 GUI PC 3D Interface(VR):

4 Douglas C. Engelbart First mouse invented

6 ( ) 3D

7 ( 1) In 1989, Jaron Lanier Myron Krueger (1991):.The term (virtual worlds) typically refers to threedimensional realities implemented with stereo viewing goggles and reality gloves. George Coates (1992): Virtual Reality is electronic simulations of environments experienced via head mounted eye goggles and wired clothing enabling the end user to interact in realistic three-dimensional situations. P. Greenbaum (1992): Virtual Reality is an alternate world filled with computergenerated images that respond to human movements. Myron Krueger

8 ( 2) (Cyberspace) (. ) Real in effect; not real in fact,

9 ( 3) ( ) AI CG CHI ( )

10 ( 4) : ( )----- / ( ) ( )

11 ( ) 1956 Sensorama (Morton Heilig) 3D visuals, vibration, stereo sound, wind, smell, little interaction Headsight System (Philco Corp.) Head Mounted Display (HMD), head tracking, remote video camera, telepresence The Ultimate Display (Ivan Sutherland) Stereoscopic HMD, computer generated images, tracking, visually coupled system Grope (University of North Carolina) 6 degree of freedom force feedback The Sayre Glove (Sandin, Sayre, DeFanti Univ. Illinois) Gesture recognition Virtual Cockpit (British Aerospace) head and hand tracking, eye tracking, 3d visuals, 3D audio, speech recognition, vibro tactile feedback.

12 ( ) (Mixed Reality) NPSNET MUD

13 ( ) (Mixed Reality) Mixed Reality (MR) Real Environment Augmented Reality (AR) Augmented Virtuality (AV) Virtual Environment

14 ( ) Distributed Virtual Environment) : Networked VE(VR), Shared VE(VR), Multi-User VE, etc.

15 ( ) (Desktop VR) (Stereoscopitic) (Immersive VR) (Distributed VR) VR ( )

16 ( ) ( ) (visibility, audibility, touch, smell) (quality, fidelity) ( ) (update rates, time lag) (text, speech, gestures, gaze, complex behavior patterns)

17 ( -3I) Immersion : Interaction : CAD Imagination :,

18 ( ) : ( )-- ( )-- ( ) ,

19 ( ), (visibility) (awareness),, (accountability)

20 ( ) (visibility) (awareness) (accountability)

21 ( ) VR VR (Immersive) (Multi-Sensory)

22 ( ) ( )

23 ( ) ( ) VR

24 ( ) 3D ( )

25 ( ) ; ; 5.

26 ( ) 20

27 ( )

28 PC /

29 PC WIMP GOMS (???) (???) GOMS GOMS

30 (MHP) Model Human Processor GOMS (Stuart Card Tom Moran Allen Newell 1983 ) WIMP MHP----GOMS-----WIMP

31 Desktop GOMS (App. Prog.) GOMS Goals Operators Methods ( ) Selection Rules

32 GOMS GOAL: CLOSE-WINDOW. [select GOAL: USE-MENU-METHOD. MOVE-MOUSE-TO-FILE-MENU. PULL-DOWN-FILE-MENU. CLICK-OVER-CLOSE-OPTION GOAL: USE-CTRL-W-METHOD. PRESS-CONTROL-W-KEYS] operator : Rule 1: Select USE-MENU-METHOD unless another rule applies Rule 2: If the application is GAME, select CTRL-W-METHOD

33 GOMS

34 VR GOMS :

35 - ( ) ( )

36 GOMS Goals Operations Modals Synergy f(a,c,e,l) Attention Cognitive load Effectiveness of interaction Learnability:

37 Simon Simon

38 egoms

39 Affordance

40 3D visual displays auditory output tactile and haptic output discrete event devices continuous event devices combination devices speech input

41 head mounted display(hmd) : many HMDs arm mounted display : BOOM surround screen virtual environment : CAVE projection-based : ImmersaDesk, WorkBench stereo monitor : use shutter glasses

42 : (beep) iconic : :

43 / : Phantom : CyberGrasp : CyberTouch

44 keyboard, pinch glove

45 :,,,, /,

46 / /,,,, ring mouse, fly mouse, BAT, Wand, Flex and Pinch

47 : :

48 VR (Viewpoint) (Navigation) (Manipulation) (Immersion)

49 / (Selection/ Manipulation) (Navigation) (System Control) /

50 /, ( ),,,

51 Way-Finding Travel way-finding : travel:,

52 ( ) walkthrough trackball exploded view

53 ( ) Steering : (steering wheel, flight sticks), Mine, 1995 [P-40]

55 3DUI 3D 3D

56 3D UI UI

57 3DWM 3D 3D 2D Microsoft Task Gallery

58 Room-based Workbench-based

59 ACM CHI2005 Workshop on Future User Interface Toolkits Tangible User Interface Camera-based User interface Haptic User Interface

60 ACM CHI2005 Workshop on Future User Interface Toolkit]

61 WIMP GUI WIMP / WIMP

62 WIMP Non-WIMP [Mark Green et al, SIGGRAPH 1991] Post-WIMP [Van Dam, COMMUNICATIONS OF THE ACM 1997] WIMP

63 PIBG (Physical Object Icon Button Gesture) WIMP PIBG(Post WIMP) PG(Non-WIMP) W P P I M I B P G G <50% >80% 100% >50% <20%

64 ??? ( )? (..)??

mvc

mvc Build an application Tutor : Michael Pan Application Source codes - - Frameworks Xib files - - Resources - ( ) info.plist - UIKit Framework UIApplication Event status bar, icon... delegation [UIApplication