指導教授：陳彥仰臺灣大學：資訊網路與多媒體研究所王政堯Wang, Cheng-YaoCheng-YaoWang2014-11-292018-07-052014-11-292018-07-052014http://ntur.lib.ntu.edu.tw//handle/246246/263456本論文提出了「EverTutor」自動生成智慧型手機互動式教學的教學系統，相教於網路上圖文或影片教學-，簡化了製作教學的繁瑣過程，透過互動式教學，讓使用者不需在教學界面與實際操作界面中不斷切換，讓使用者輕鬆簡單學會智慧手機與App各種功能。在製作教學時，EverTutor記錄系統底層的觸控事件資料並截取觸控位置附近的圖片，自動生成教學的每個步驟。當使用EverTutor瀏覽教學時，系統透過模板匹配（tempalte-matching）演算法，偵測使用者應該互動的位置，並依照該步驟的不同手勢，互動式的呈現在使用者操作界面。此外，當畫面中沒有找到互動區域，系統自動執行滑動手勢，幫助使用者找到不再畫面中的互動位置。我們做了兩階段的使用者研究，第一階段我們找了6位智慧手機app開發者，使用EverTutor製作教學。第二階段我們找了12位智慧手機初學者，其中包含6位年輕使用者及6位年長使用者，利用EverTutor瀏覽教學。研究結果顯示，EverTutor大幅簡化製作教學的過程，使用者瀏覽互動式教學完成任務的時間比圖文、影片快3~6倍。而在使用者偏好的結果中，我們發現83\%使用者最喜歡互動式教學，因為使用者認為互動式教學最容易理解與跟著教學步驟學會功能。We present EverTutor, a system that automatically generates interactive tutorials on smartphone from user demonstration. For tutorial authors, it simplifies the tutorial creation. For tutorial users, it provides contextual step-by-step guidance and avoids the frequent context switching between tutorials and users'' primary tasks. In order to generate the tutorials automatically, EverTutor records low-level touch events to detect gestures and identify on-screen targets. When a tutorial is browsed, the system uses vision-based techniques to locate the target regions and overlays the corresponding input prompt contextually. It also identifies the correctness of users'' interaction to guide the users step by step. We conducted a 6-person user study for creating tutorials and a 12-person user study for browsing tutorials, and we compared EverTutor''s interactive tutorials to static and video ones. Study results show that creating tutorials by EverTutor is simpler and faster than producing static and video tutorials. Also, when using the tutorials, the task completion time for interactive tutorials were 3-6 times faster than static and video tutorials regardless of age group. In terms of user preference, 83% of the users chose interactive type as the preferred tutorial type and rated it easiest to follow and easiest to understand.誌謝 ii 摘要 iii Abstract iv 1 Introduction 1 2 Related Work 4 2.1 Capturingtouchscreenevents........................ 4 2.2 Generationoftutorialsbyuserdemonstrations . . . . . . . . . . . . . . . 4 2.3 ContextualAssistance............................ 5 2.4 Evaluationofdifferenttutorialtypes .................... 6 3 Design Goals 7 3.1 Contextual.................................. 7 3.2 Touchscreengesturessupport........................ 7 3.3 Interactive.................................. 8 3.4 Automaticgenerationfromuserdemonstration . . . . . . . . . . . . . . 8 3.5 Acrossappsandplatforms ......................... 8 4 System Implementation 9 4.1 GestureRecognizer............................. 9 4.2 TemplateMatching ............................. 10 4.3 Client-serverArchitecture ......................... 11 5 EverTutor 12 5.1 TutorialFormat ............................... 12 5.2 GeneratingtutorialwithEverTutor..................... 12 5.2.1 Record and distinguish touchscreen gesture . . . . . . . . . . . . 12 5.2.2 RecordOptions........................... 13 5.2.3 Scroll/swipemode ......................... 13 5.2.4 Typingmode ............................ 14 5.2.5 Settitleandreviewtutorial..................... 14 5.3 BrowsingtutorialswithEverTutor ..................... 15 5.3.1 Findingtheinteractiveregion ................... 15 5.3.2 Showing the interactive step-by-step tutorial . . . . . . . . . . . 16 5.3.3 Identifying the correctness of the user’s interaction . . . . . . . . 16 6 Evaluation 17 6.1 TaskandTutorialMaterials......................... 17 6.2 UserStudy1:CreatingTutorials...................... 18 6.2.1 Participants............................. 18 6.2.2 Procedure.............................. 18 6.2.3 QuantitativeResult......................... 19 6.2.4 QualitativeResult.......................... 21 6.3 UserStudy2:BrowsingTutorials ..................... 21 6.3.1 Participants............................. 21 6.3.2 Procedure.............................. 21 6.3.3 QuantitativeResult......................... 23 6.3.4 QualitativeResult.......................... 24 7 Discussion 26 7.1 Significant gain in performance....................... 26 7.2 Differences between older and younger participants . . . . . . . . . . . . 26 7.3 Automatic scrolling feature......................... 27 7.4 Automation macro ............................. 28 8 Limitation and Future work 29 9 Conclusion 30 Bibliography 313079082 bytesapplication/pdf論文公開時間：2014/08/25論文使用權限：同意有償授權(權利金給回饋學校)互動式教學觸控手勢智慧手機thesishttp://ntur.lib.ntu.edu.tw/bitstream/246246/263456/1/ntu-103-R00944052-1.pdf