Proceedings of The 11th NTCIR Conference on Evaluation of Information Access Technologies December 9-12, 2014 National Center of Sciences, Tokyo, Japan Table of Contents OverView Overview of NTCIR-11 Hideo Joho and Kazuaki Kishida 1-7 IMine Overview of the NTCIR-11 IMine Yiqun Liu, Ruihua Song, Min Zhang, Zhicheng Dou, Takehiro Yamamoto, Makoto Kato, Hiroaki Ohshima and Ke Zhou 8-23 University of Hyogo at NTCIR-11 Mine by Dependency Parsing Takayuki Yumoto 24-27 Université de Montréal at the NTCIR-11 IMine FRDC at the NTCIR-11 IMine Arbi Bouchoucha, Jian-Yun Nie and Xiaohua Liu Zhongguang Zheng, Shuangyong Song, Yao Meng and Jun Sun 28-35 36-40 TUTA1 at the NTCIR-11 IMine Hai-Tao Yu and Fuji Ren 41-48 HULTECH at the NTCIR-11 IMine : Mining Intents with Continuous Vector Space Models Jose G. Moreno and Gaël Dias 49-52 KUIDL at the NTCIR-11 IMine Takehiro Yamamoto, Makoto. P. Kato, Hiroaki Ohshima and Katsumi Tanaka 53-54 THUSAM at NTCIR-11 IMine Cheng Luo, Xin Li, Alisher Khodzhaev, Fei Chen, Keyang Xu, Yujie Cao, Yiqun Liu, Min Zhang and Shaoping Ma 55-62 1
SEM13 at the NTCIR-11 IMINE : Subtopic Mining and Document Ranking Subtasks Md Zia Ullah and Masaki Aono 63-68 CNU System in NTCIR-11 IMine Wei Song, Wenbin Xu, Lizheng Liu and Hanshi Wang 69-73 The KLE's Subtopic Mining System for the NTCIR-11 IMine Udel @ NTCIR-11 IMine Track Se-Jong Kim, Jaehun Shin and Jong-Hyeok Lee Ashraf Bah, Ben Carterette and Praveen Chandar 74-79 80-83 InteractiveMediaMINE at the NTCIR-11 IMine Search Shohei Mine, Takuma Matsumoto, Tomofumi Yoshida, Takuya Shinohara and Daisuke Kitayama 84-87 Math-2 NTCIR-11 Math-2 Overview Akiko Aizawa, Michael Kohlhase, Iadh Ounis and Moritz Schubotz 88-98 ICST Math Retrieval System for NTCIR-11 Math-2 Liangcai Gao, Yuehan Wang, Leipeng Hao and Zhi Tang 99-102 QUALIBETA at the NTCIR-11 Math 2 : An Attempt to Query Math Collections José María González Pinto, Simon Barthel and Wolf-Tilo Balke 103-107 Evaluation of Similarity-Measure Factors for Formulae Based on the NTCIR-11 Math Moritz Schubotz, Abdou Youssef, Volker Markl, Howard S. Cohl and Jimmy J. Li 108-113 MathWebSearch at NTCIR-11 Radu Hambasan, Michael Kohlhase and Corneliu Prodescu 114-119 The MCAT Math Retrieval System for NTCIR-11 Math Track Giovanni Yoko Kristianto, Goran Topić, Florence Ho and Akiko Aizawa 120-126 Math Indexer and Searcher under the Hood: History and Development of a Winning Strategy Combining TF-IDF Text Retrieval with an Inverted Index over Symbol Pairs in Math Expressions: The Tangent Math Search Engine at NTCIR 2014 Michal Růžička, Petr Sojka and Martin Líška Nidhin Pattaniyil and Richard Zanibbi 127-134 135-142 2
TUW-IMP at the NTCIR-11 Math-2 Aldo Lipani, Linda Andersson, Florina Piroi, Mihai Lupu and Allan Hanbury 143-146 MedNLP-2 Overview of the NTCIR-11 MedNLP-2 Eiji Aramaki, Mizuki Morita, Yoshinobu Kano and Tomoko Ohkuma 147-154 kyoto: Kyoto University Baseline at the NTCIR-11 MedNLP-2 Tetsuaki Nakamura, Kay Kubo, Shuko Shikata, Mai Miyabe and Eiji Aramaki 155-157 HokuMed in NTCIR-11 MedNLP-2: Automatic Extraction of Medical Complaints from Japanese Health Records Using Machine Learning and Rule-based Methods Magnus Ahltorp, Hideyuki Tanushi, Shiho Kitajima, Maria Skeppstedt, Rafal Rzepka and Kenji Araki 158-162 BARY at the NTCIR-11 MedNLP-2 for Complaints and Diagnosis Recognition Yusuke Matsubara, Mizuki Morita and Kôiti Hasida 163-166 SCT-D3 at the NTCIR-11 MedNLP-2 NCU IISR System for NTCIR-11 MedNLP-2 Incorporating Unsupervised Features into CRF based Named Entity Recognition Akinori Fujino, Jun Suzuki, Tsutomu Hirao, Hisashi Kurasawa and Katsuyoshi Hayashi Sheng-Wei Chen, Po-Ting Lai, Yi-Lin Tsai, Jay Kuan-Chieh Chung, Sherry Shih-Huan Hsiao and Richard Tzong-Han Tsai Yuki Tawara, Mai Omura and Mirai Miura 167-169 170-173 174-177 HCRL at NTCIR-11 MedNLP-2 Osamu Imaichi, Masakazu Fujio, Toshihiko Yanase and Yoshiki Niwa 178-179 Preliminary Report of III&CYUT for NTCIR-11 MedNLP-2 Liang-Pu Chen, Hsiang Lun Lin, Yan Shen Lai and Ping-Che Yang 180-183 Technical Report of Uni2014 in NTCIR-11 MedNLP-2 Kenta Fukuda 184-186 The OKPU System in NTCIR11 MedNLP2: An IR Approach to ICD-10 Code Identification Genichiro Kikui and Yasuhiro Tajima 187-190 3
A NLP System of DCUMT in NTCIR-11 MedNLP-2: RNN for ICD/Time Entity Recognition and ICD Classification s Tsuyoshi Okita and Qun Liu 191-194 MobileClick Overview of the NTCIR-11 MobileClick Makoto P. Kato, Matthew Ekstrand-Abueg, Virgil Pavlu, Tetsuya Sakai, Takehiro Yamamoto and Mayu Iwata 195-207 Improving iunit Retrieval with Query Classification and Multi-Aspect iunit Scoring: The IISR System at NTCIR-11 MobileClick KPNM at the NTCIR-11 MobileClick Udel @ NTCIR-11 MobileClick Track Chia-Tien Chang, Yu-Hsuan Wu, Yi-Lin Tsai and Richard Tzong-Han Tsai Dong Zhou, Zhao Wang, Ziyi Zeng and Tuo Peng Ashraf Bah Rabiou and Ben Carterette 208-212 213-215 216-218 Description of the NTOU MobileClick System at NTCIR-11 Chi-Ting Liu and Chuan-Jie Lin 219-222 RITE-VAL Overview of the NTCIR-11 Recognizing Inference in TExt and Validation (RITE-VAL) Suguru Matsuyoshi, Yusuke Miyao, Tomohide Shibata, Chuan-Jie Lin, Cheng-Wei Shih, Yotaro Watanabe and Teruko Mitamura 223-232 III&CYUT Chinese Textual Entailment Recognition System for NTCIR-11 RITE-VAL Shih-Hung Wu, Li-Jen Hsu, Hua-Wei Lin, Pei-Kai Liao, Liang-Pu Chen and Tsun Ku 233-239 Recognizing Textual Entailment Using Multiple Features and Filters Yongmei Tan, Minda Wang, Xiaohui Wang and Xiaojie Wang 240-243 WUST at NTCIR-11 RITE-VAL System Validation Maofu Liu, Yue Wang, Limin Wang and Huijun Hu 244-248 NUL System at NTCIR RITE-VAL s Ai Ishii, Hiroshi Miyashita, Mio Kobayashi and Chikara Hoshino 249-254 4
KSU Team's System and Experience at the NTCIR-11 RITE-VAL A Surface-Similarity Based Two-Step Classifier for RITE-VAL KitAi-VAL: Textual Entailment Recognition System for NTCIR-11 RITE-VAL KNDTE: A System for Textual Entailment and Fact Validation s at the NTCIR-11 RITE-VAL Tasuku Kimura and Hisashi Miyamori Shohei Hattori and Satoshi Sato Ayaka Morimoto, Kenta Kurashima, Yo Tokunaga and Kazutaka Shimada Tao-Hsing Chang, Shih-Kuei Kao, Yen-Wen Lin, Li-Jia Wei and Chung-Yin Tsai 255-261 262-267 268-271 272-277 Recognizing Textual Entailment Using Lexical, Syntactical, and Semantic Information Yann-Huei Lee, Shafqat Virk and Lun-Wei Ku 278-283 Discriminating between Relevant and Irrelevant Text for Fact Validation Mirai Miura, Hiroki Ouchi, Mai Omura, Mayo Yamasaki and Akifumi Yoshimoto 284-287 NWNU Minimum Information Recognizing Entailment System for NTCIR-11 RITE-3 Zhichang Zhang, Dongren Yao, Longlong Mao and Songyi Chen 288-291 Experiments for NTCIR-11 RITE-VAL at Shibaura Institute of Technology Toru Sugimoto, Toshiki Mizukoshi and Ryosuke Masuda 292-294 Answering Yes-No Questions by Keyword Distribution: KJP System at NTCIR-11 RITEVal Yamraj: Binary-class and Multi-class Based Textual Entailment System for Japanese (JA) and Chinese Simplified (CS) Yoshinobu Kano 295-297 Partha Pakray 298-303 Description of the NTOU RITE-VAL System at NTCIR-11 Chuan-Jie Lin, Chi-Ting Liu and Yu-Cheng Tu 304-308 The WHUTE System in NTCIR-11 RITE-VAL Han Ren, Hongmiao Wu, Xiwen Tan, Pengyuan Wang, Donghong Ji and Jing Wan 309-316 BnO at the NTCIR-11 English Fact Validation Pascual Martínez-Gómez, Ran Tian and Yusuke Miyao 317-320 MCU at NTCIR: Chinese Fact Validation via SVM Cotext Ranking Yu-Chieh Wu, Tzu-Yu Liu, Yue-Shi Lee and Jie-Chi Yang 321-326 NAK Team's System for Recognizing Textual Entailment at the NTCIR-11 RITE-VAL Genki Teranaka, Masahiko Sunohara and Hiroaki Saito 327-331 5
MIG at NTCIR-11: Using Lexical, Syntactic, and Semantic Features for the RITE-VAL s Po-Cheng Lin, Shu Yu Lin, Chih Kai Haung and Chao-Lin Liu 332-336 IMTKU Textual Entailment System for Recognizing Inference in Text at NTCIR-11 RITE-VAL Min-Yuh Day, Ya-Jung Wang, Che-Wei Hsu, En-Chun Tu, Shang-Yu Wu, Huai-Wen Hsu, Yu-An Lin, Yu-Hsuan Tai and Cheng-Chia Tsai 337-343 KTU System for NTCIR-11 RITE-VAL Tomohide Shibata 344-349 SpokenQuery&Doc Overview of the NTCIR-11 SpokenQuery&Doc Spoken Document Retrieval Experiments for SpokenQuery&Doc at Ryukoku University (RYSDT) Tomoyosi Akiba, Hiromitsu Nishizaki, Hiroaki Nanjo and Gareth J. F. Jones Hiroaki Nanjo, Takehiko Yoshimi, Sho Maeda and Tomohiro Nishio 350-364 365-370 Spoken Term Detection and Spoken Content Retrieval: Evaluations on NTCIR 11 SpokenQuery&Doc Sz-Rung Shiang, Po-Wei Chou and Lang-Chi Yu 371-375 DCU at the NTCIR-11 SpokenQuery&Doc David N. Racca and Gareth J.F. Jones 376-383 An IWAPU STD System for OOV Query Terms and Spoken Queries Jinki Takahashi, Takumi Hashimoto, Ryota Kon'no, Shota Sugawara, Kazuki Ouchi, Satoshi Oshima, Takahiro Akyu and Yoshiaki Itoh 384-389 STD Method Based on Hash Function for NTCIR11 SpokenQuery&Doc Satoru Tsuge, Norihide Kitaoka, Kazuya Takeda and Kenji Kita 390-394 Segmented Spoken Document Retrieval Using Word Co-occurrence Information Combination of DTW-based and CRF-based Spoken Term Detection on the NTCIR-11 SpokenQuery&Doc SQ-STD Subtask 6 Kensuke Hara, Hiroaki Taguchi, Koudai Nakajima, Masanori Takehara, Satoshi Tamura and Satoru Hayamizu Hiromitsu Nishizaki, Naoki Sawada, Satoshi Natori, Kentaro Domoto and Takehito Utsuro 395-401 402-408
Utilizing Confusion Network in the STD with Suffix Array and Its Evaluation on the NTCIR-11 SpokenQuery & Doc SQ-STD Combining Subword and State-level Dissimilarity Measures for Improved Spoken Term Detection in NTCIR-11 SpokenQuery&Doc Sopoken Term Detection Based on a Syllable N-gram Index at the NTCIR-11 SpokenQuery&Doc Kouichi Katsurada, Genki Ishihara, Kheang Seng, Yurie Iribe and Tsuneo Nitta Mitsuaki Makino and Atsuhiko Kai Nagisa Sakamoto, Kazumasa Yamamoto and Seiichi Nakagawa 409-412 413-418 419-424 STD Score Combination with Acoustic Likelihood and Robust SCR Models for False Positives: Experiments at NTCIR-11 SpokenQuery&Doc Yusuke Takada, Sho Kawasaki, Hiroshi Oshima, Hiroshi Kawatani and Tomoyoshi Akiba 425-428 Temporalia Overview of NTCIR-11 Temporal Information Access (Temporalia) Using Machine Learning to Predict Temporal Orientation of Search Engines' Queries in the Temporalia Challenge MPI-INF at the NTCIR-11 Temporal Query Classification Hideo Joho, Adam Jatowt, Roi Blanco, Hajime Naka and Shuhei Yamamoto Michele Filannino and Goran Nenadic Robin Burghartz and Klaus Berberich 429-437 438-442 443-450 A Logistic Regression Approach for NTCIR-11 Temporalia Ray Larson 451-455 Andd7 @ NTCIR-11 Temporal Information Access Abhishek Shah, Dharak Shah and Prasenjit Majumder 456-460 TUTA1 at the NTCIR-11 Temporalia Hai-Tao Yu, Xin Kang and Fuji Ren 461-467 HITSZ-ICRC at NTCIR-11 Temporalia Yongshuai Hou, Cong Tan, Jun Xu, Youcheng Pan, Qingcai Chen and Xiaolong Wang 468-473 OKSAT at NTCIR-11 Temporalia: Plural Sets of Search Terms for a Topic Takashi Sato and Shingo Aoki 474-477 HULTECH at the NTCIR-11 Temporalia : Ensemble Learning for Temporal Query Intent Classification Mohammed Hasanuzzaman, Gaël Dias and Stéphane Ferrari 478-482 7
RecipeSearch Overview of the NTCIR-11 Cooking Recipe Search OPU at NTCIR-11 RecipeSearch: Japanese Recipe Pairing by Naïve Bayes Estimation with Names of Ingredients Michiko Yasukawa, Fernando Diaz, Gregory Druck and Nobu Tsukada Yasuhiro Tajima, Genichiro Kikui, Megumi Kubota and Rikako Inoue 483-496 497-498 OKSAT at NTCIR-11 RecipeSearch: Categorization and Expansion of Search Terms in Topics Takashi Sato, Shingo Aoki and Yuta Morishita 499-502 Hiroshima City University at NTCIR-11 Cooking Recipe Search Hidetsugu Nanba 503-507 Gunma University, Kiryu University, and RMIT University at the NTCIR-11 Cooking Recipe Search QALab Michiko Yasukawa, Hiroji Ishii and Falk Scholer 508-517 Overview of the NTCIR-11 QA-Lab Hideyuki Shibuki, Kotaro Sakamoto, Yoshinobu Kano, Teruko Mitamura, Madoka Ishioroshi, Kelly Y. Itakura, Di Wang, Tatsunori Mori and Noriko Kando 518-529 Solving History Exam by Keyword Distribution: KJP System at NTCIR-11 QALab Yoshinobu Kano 530-531 Forst: Question Answering System Using Basic Element at NTCIR-11 QA-Lab Kotaro Sakamoto, Hyogo Matsui, Eisuke Matsunaga, Takahisa Jin, Hideyuki Shibuki, Tatsunori Mori, Madoka Ishioroshi and Noriko Kando 532-536 FLL: Answering World History Exams by Utilizing Search Results and Virtual Examples CMU Multiple-choice Question Answering System at NTCIR-11 QA-Lab Takuya Makino, Seiji Okura, Seiji Okajima, Shuangyong Song and Hiroko Suzuki Di Wang, Leonid Boytsov, Jun Araki, Alkesh Patel, Jeff Gee, Zhengzhong Liu, Eric Nyberg and Teruko Mitamura 537-541 542-549 8
Using Time Periods Comparison for Eliminating Chronological Discrepancies between Question and Answer Candidates at QALab NTCIR11 Yasutomo Kimura, Fumitoshi Ashihara, Arnaud Jordan, Keiichi Takamaru, Yuzu Uchida, Hokuto Ototake, Hideyuki Shibuki, Michal Ptaszynski, Rafal Rzepka, Fumito Masui and Kenji Araki 550-555 NUL System at QALab s Hiroshi Miyashita, Ai Ishii, Mio Kobayashi and Chikara Hoshino 556-558 sjanta: An Open Domain Question Answering System Md. Arafat Rahman and Md-Mizanur Rahoman 559-565 A Feature-based Classification Technique for Answering Multi-choice World History Questions: FRDC_QA at NTCIR-11 QA-Lab Shuangyong Song, Yao Meng, Zhongguang Zheng and Jun Sun 566-570 The Question Answering System of DCUMT in NTCIR-11 QALab Tsuyoshi Okita and Qun Liu 571 578 9