中文模板

Size: px

Start display at page:

Download "中文模板"

墨宿
5 years ago
Views:

1 ISSN , CODEN RUXUEW Journal of Software, Vol17, No4, April 2006, pp DOI: /jos Tel/Fax: by Journal of Software All rights reserved Post-WIMP +,,, (,100080) An Interaction-Centered Hierarchical Post-WIMP User Interface Model QIN Yan-Yan +, TIAN Feng, WANG Xiao-Chun, DAI Guo-Zhong (Laboratory of Human-Computer Interaction and Intelligent Information Processing, Institute of Software, The Chinese Academy of Sciences, Beijing , China) + Corresponding author: Phn: ext 8031, Fax: , yanyan02@iscascn, Qin YY, Tian F, Wang XC, Dai GZ An interaction-centered hierarchical Post-WIMP user interface model Journal of Software, 2006,17(4): Abstract: Following the great improvement in interaction devices and software technologies, lots of novel interaction technologies which are based on Post-WIMP user interface are studied It is crucial that the designer chooses the interaction component or the interaction technology properly and efficiently to adapt to the various interaction devices and environments in the user interface designing According to the analysis of the interaction process and the design level of the Post-WIMP user interface, an interaction-centered Hierarchical Post-WIMP User Interface Model is presented It is described and analyzed from the aspects of the user, task, device, behaviors and entity in interaction Moreover, a Post-WIMP user interface auto-generate tool is designed and implemented based on the model, to help the designers to insert those novel interaction technologies into the system flexibly, and to develop and evaluate the prototype quickly and efficiently Experiments show that, the model can guide the process of user interface design, the implement of prototype, and the evaluation of the result of design Key words: : Post-WIMP user interface; UI design; hierarchical model; interaction-centered, Post-WIMP,,,, Post-WIMP, Post-WIMP, Post-WIMP,, Post-WIMP,,,Post-WIMP, Supported by the National Natural Science Foundation of China under Grant No ( ); the National Grand Fundamental Research 973 Program of China under Grant No2002CB ( (973)); the Key Innovation Project from Institute of Software Research on Pen-Based Interactive System and Its Applications in Personal Office Environment, the Chinese Academy of Sciences ( ) Received ; Accepted

2 692 Journal of Software Vol17, No4, April 2006 : Post-WIMP ; ; ; : TP391 : A,, WIMP [1] Post-WIMP,,,, [2],, Post-WIMP,,, [3],Post-WIMP Post-WIMP,,,, Post-WIMP, Post-WIMP, Post-WIMP, Post-WIMP, Post-WIMP, 1 11 Post-WIMP, WIMP Nielsen :,, [4] ;van Dam WIMP, Post-WIMP, [5] 20 90, Post-WIMP [6] Post-WIMP WIMP, Post-WIMP WIMP [5,7,8] ( 1) Table 1 The interaction characteristic between WIMP user interface and Post-WIMP user interface 1 WIMP Post-WIMP User interface Interaction characteristic WIMP user interface Post-WIMP user interface Continuous Discrete event Discrete event+continuous event Process sequence Step-By-Step Synchronous Device Keyboard+mouse Multi-Modal device Time sequence Online process events Offline process events with time-sequence, without time-sequence Real-Time feedback Probabilistic interaction Precise tokens Probabilistic input Post-WIMP,

3 : Post-WIMP 693 Translucent Patch,Tool Glasses,ZUI,Pie Menu [9 12],,,, Post-WIMP, 12, Brad Myers :, Post-WIMP [13], Post-WIMP, :Beaudouin-Lafon [14], Post-WIMP [15] ;Erwin Cuppens Karin Coninx 3D, 3D CoGenIVE [16] ;Jullien Bouchet ICARE, (conceptual component model), [17], :, Foley [18] : /,,,,,,, Post-WIMP,,, 2 Post-WIMP (goal) :,, Norman 4 [19], 1,,,,,,,van Dam [20] Post-WIMP (conceptual level) /(functional/ semantic level) / (sequencing/syntactical level) Presentation / (binding/lexical level), S :, Core ;, / Performance, (analyze) O Output I Input Observation Articulation ; Fig1 The interaction process model, ; (synthesize) 1, U Task

4 694 Journal of Software Vol17, No4, April 2006,Post-WIMP,, 21 Beaudouin :,, look and feel [1] Post-WIMP,,,,,, 2,Post-WIMP :User model ;Task model ;Device model, Entity model Behavior model, Design level Design process UI model Conceptual level Analyze User model Meaning Functional level Formalize Task model Form Sequencing level Binding level Synthesize Interaction model Device model Behavior model Entity model Evaluate Implement Test Fig2 The structure of Post-WIMP user interface model 2 Post-WIMP 22 (user model) 3 :, Post-WIMP,,, ;,,, ; Post-WIMP,, /, -, -

5 : Post-WIMP (task model),, ;,, (services), (compatible) Compatible Entity1 Task 1 3 Service1 Post-WIMP Service2, Map to Service1,,, 3 Entity1 Service1 Sub-Task1, Entity1 Task1 24 (device model) Fig3 Service3 Sub-Task1 Sub-Task2 Sub-Task3 Sub-Task1 Sub-Task4 The map between tasks and entity services 3 Erwin : ( ) ;, [21], Post-WIMP,, Post-WIMP, ( (ergonomics) ) 25, ( 4 ), Select, Feedback Target object management Entity model Connector Event management Context management,, Post-WIMP, Post-WIMP /,, Behavior recognizer Behavior model,, Fig4 Post-WIMP UI behavior model, 4 Post-WIMP,

6 696 Journal of Software Vol17, No4, April 2006,, 4,,,,,,,,, 3 (feedback) (require) (recognize result) 26,,,,,, 5, 3 :, ;,, ;,, Fish Eyes, Manage Domain objects Entities Devices Editor Logical world Physical world Response Feedback Action Feedback Fig5 The interaction process between users and domain objects 5, Post-WIMP,,, 6,,,,, (, ),, Post-WIMP,,,,,,, (

7 : Post-WIMP 697 ),,, Device model Connector Feedback Event management Behavior management Behavior model Connector Default behavior User-Define behavior Ambiguous check Behavior decision Service management Context management Data management Child-Entity management Property management Target object management Fig6 Post-WIMP UI entity model 3 Post-WIMP Entity model 6 Post-WIMP 31 Post-WIMP,,, 7 User Task Human-Constraint Device Environment-Compatible Affordance, Layout, Feedback Preference Compatible Entity Compatible Behavior Services compatible Efficiency Fig7 The principle of the choices between the interaction model 7, (device),

8 698 Journal of Software Vol17, No4, April 2006, Post-WIMP, (entity), (affordance); ( Tablet PC ), (layout) ;, (real-time feedback), Post-WIMP (behavior),,,,, Post-WIMP,,,,, 32,,,,, : /, /, ;,, : (1) (which),,, (target object),, ; (2) (when),,, WIMP, Post-WIMP,,, ; (3) (what),,,,, ; (4) (how), Post-WIMP,,, GestureWord,,,,,,, (draw_zigzagline) (draw_circle), 8, XML : Behavior description Name value= Circle_Gesture_Behavior / Type value= Pen_Gesture / SrcEntity value= TextEditor1 /

9 : Post-WIMP 699 TargetObject value= Text / TargetService value= TextSelect Recognizer value= Pen_Gesture_Recognizer / Action StartEvent value= Pen_Down / ContinuousEvent value= Pen_Move / EndEvent value= Pen_Up / /Action /Behavior description Output Input message Connector Feedback Event management Pen_Down event 1 Draw circle Context management Pen_Move event n Pen_Up event 1 Draw zig-zag line Behavior management Result event 2 Service management Fig8 The connection between the behavior model and the entity model in Post-WIMP UI model 8 Post-WIMP XML,,,,, Draw_Circle Draw_ZigzagLine Pen_Down Pen_Up Pen_Down, Pen_Up,, (result event), 33 Post-WIMP, Post-WIMP, Post-WIMP, (design) (runtime), XML 3 ;, ;,,, [22]

700 Journal of Software Vol17, No4, April

10 700 Journal of Software Vol17, No4, April 2006,,, ( 9(a) ) ( 9(b) ),, ( 9(c) ), ( 9(d) ),, C++,, (a) The design of the single scenario (a) (b) The design of the style of entity (b) (c) The connection between the behavior and the entity (c) Fig9 9 (d) The XML description of the user interface (d) XML,,, 9(c), LButtonDown,, XML,, ; ;,,

11 : Post-WIMP 701 4, Post-WIMP, (gesture),,, ;,,, 10 (a) The gesture of inserting a blank (b) The gesture of inserting a return (c) The gesture of deleting texts (a) (b) (c) Fig10 10, :,,, 5 WIMP,Post-WIMP, Post-WIMP, Post-WIMP Post-WIMP,,,,, Post-WIMP, :, Post-WIMP,,,, References: [1] Beaudouin-Lafon M Designing interaction, not interfaces In: Costabile MF, ed Proc of the Conf on Advanced Visual Interfaces, AVI 2004 Gallipoli: ACM Press, [2] Hua QY A 3D visual paradigms of the object-oriented system and its implement Chinese Journal of Computers, 1997,20(9): (in Chinese with English abstract) [3] Hartson RH User-Interface management control and communication IEEE Software, 1989,26(1): [4] Nielsen J Noncommand user interfaces Communications of the ACM, 1993,36(4):83 99 [5] van Dam A Post-WIMP user interface Communications of the ACM, 1997,40(2):63 67

12 702 Journal of Software Vol17, No4, April 2006 [6] Dong SH, Wang J, Dai GZ Human-Computer Interaction and Multi Model User Interface Beijing: Science Press, 1999 (in Chinese) [7] Jacob RJK, Deligiannidis L, Morrison S A software model and specification language for non-wimp user interfaces ACM Trans on Computer-Human Interaction, 1999,6(1):1 46 [8] Green M, Jacob R Software architectures and metaphors for non-wimp user interfaces Computer Graphics, 1991,25(3): [9] Kramer A Translucent patches: Dissolving windows In: Szekely P, ed Proc of the UIST 94: ACM SIGGRAPH Symp on User Interface Software and Technology New York: ACM Press, [10] Bier E, Stone M, Pier K, Buxton W, De Rose T Toolglass and magic lenses : The see-through interface In: Whitton MC, ed Proc of the ACM SIGGRAPH New York: ACM Press, [11] Bederson BB, Meyer J, Good L Jazz: An extensible zoomable user interface graphics toolkit in Java In: Ackerman M, ed Proc of the ACM Symp on User Interface Software and Technology: UIST 2000 San Diego: ACM Press, [12] Kurtenbach G, Buxton W Issues in combining marking and direct manipulation techniques In: Rhyne JR, ed Proc of the UIST 91 New York: ACM Press, [13] Myers B, Hudson SE Pausch R Past, present and future of user interface software tools ACM Trans on Computer-Human Interaction, 2000,7(1):3 28 [14] Beaudouin-Lafon M Instrumental interaction: An interaction model for designing Post-WIMP user interfaces In: Turner T, ed Proc of the ACM CHI 2000 New York: ACM Press, [15] Beaudouin-Lafon M, Lassen M The architecture and implementation of CPN2000, a Post-WIMP graphical application In: Ackerman M, ed Proc of the ACM UIST 2000 New York: ACM Press, [16] Cuppens E, Coninx K CoGenIVE: Code generation for interactive virtual environments In: CHI 2005 Workshop on The Future of User Interface Design Tools [17] Bouchet J, Nigay L ICARE: A component-based approach for the design and development of multimodal interfaces Extended Abstracts CHI [18] Foley JD, van Dam A, Feiner SK, Hughes JF Computer Graphics: Principles and Practice in C 2nd ed Reading: Addison-Wesley, 1995 [19] Norman DA The Psychology of Everyday Things New York: Basic Books, 1988 [20] van Dam A User interface I: Introduction to Computer Graphics Introductionpdf [21] De Boeck J, Cuppens E De Weyer T, Raymaekers C, Coninx K Multisensory interaction metaphors with haptics and proprioception in virtual environments In: ACM Int l Conf Proceeding Series; Vol 82 Proc of the 3rd Nordic Conf on Human-Computer Interaction [22] Hua QY, Wang H, Muscogiuri C, Niederée C, Hemmje M A UCD method for modeling software architecture In: Dai GZ, ed Proc of the APCHI 2002,2: : [2],1997,20(9): [6],, :,1999 (1977 ),,,,, (1976 ),,,, (1976 ),,,, (1944 ),,,,CCF,,

<4D6963726F736F667420506F776572506F696E74202D20C8EDBCFEBCDCB9B9CAA6D1D0D0DEBDB2D7F92E707074>

<4D6963726F736F667420506F776572506F696E74202D20C8EDBCFEBCDCB9B9CAA6D1D0D0DEBDB2D7F92E707074> 软件架构师研修讲座胡协刚软件架构师 UML/RUP 专家 szjinco@public.szptt.net.cn 中国软件架构师网东软培训中心小故事 : 七人分粥当前软件团队的开发现状和面临的问题软件项目的特点解决之道 : 从瀑布模型到迭代模型解决项