For best experience please turn on javascript and use a modern browser!
NL

prof. dr. E. (Evangelos) Kanoulas

Faculty of Science
Informatics Institute

Visiting address
  • Science Park 904
Postal address
  • Postbus 94323
    1090 GH Amsterdam
Contact details
  • Village AI (container next to the Startup Village), room 1.10
  • Evangelos Kanoulas

    My research vision lies in pursuing research in the field of information retrieval, advancing the state-of-the-art on hard information seeking problems, and enabling the technological transfer of my research to real world applications. 

    The main focus of my research is building the necessary methods and technology to enable human – machine collaboration for retrieving information by

    1. obtaining a deeper understanding of user preferences and decisions during information seeking activities,
    2. developing algorithms that can interact with users during information seeking activities, and
    3. building the appropriate evaluation methodology to measure progress.

    At the same time, my research is driven by domains and applications in which information seeking remains a hard problem, including legal search (which I pursue at FEB - Amsterdam Business School) and medical search (which I persue in collaboration with Cochrane NL). 

    To achieve the aforementioned goals I am leading the Human-Machine Intelligence Lab (HuMIL), within the Informatics Institute and the ILPS group, and I have organized my research and research team around three axes:

    • Human-Machine Interactive Search Algorithms,
    • Benchmarks and Evaluation Methods, and
    • Applications in the Legal and Medical fields.
  • Publications

    2020

    2019

    • Kanoulas, E., Li, D., Azzopardi, L., & Spijker, R. (2019). CLEF 2019 technology assisted reviews in empirical medicine overview. CEUR Workshop Proceedings, 2380, [250]. [details]
    • Kelly, L., Goeuriot, L., Suominen, H., Neves, M., Kanoulas, E., Spijker, R., ... Zuccon, G. (2019). CLEF ehealth 2019 evaluation lab. In L. Azzopardi, B. Stein, N. Fuhr, P. Mayr, C. Hauff, & D. Hiemstra (Eds.), Advances in Information Retrieval: 41st European Conference on IR Research, ECIR 2019, Cologne, Germany, April 14-18, 2019 : proceedings (Vol. 2, pp. 267-274). (Lecture Notes in Computer Science; Vol. 11438). Cham: Springer. https://doi.org/10.1007/978-3-030-15719-7_36 [details]
    • Kelly, L., Suominen, H., Goeuriot, L., Neves, M., Kanoulas, E., Li, D., ... Palotti, J. (2019). Overview of the CLEF eHealth Evaluation Lab 2019. In F. Crestani, M. Braschler, J. Savoy, A. Rauber, H. Müller, D. E. Losada, G. Heinatz Bürki, L. Cappellato, ... N. Ferro (Eds.), Experimental IR Meets Multilinguality, Multimodality, and Interaction: 10th International Conference of the CLEF Association, CLEF 2019, Lugano, Switzerland, September 9–12, 2019 : proceeding (pp. 322-339). (Lecture Notes in Computer Science; Vol. 11696). Cham: Springer. https://doi.org/10.1007/978-3-030-28577-7_26 [details]
    • Li, D., & Kanoulas, E. (2019). Automatic thresholding by sampling documents and estimating recall: ILPs@UVA at Tar task 2.2. CEUR Workshop Proceedings, 2380, [187]. [details]
    • Liang, S., Yilmaz, E., & Kanoulas, E. (2019). Collaboratively Tracking Interests for User Clustering in Streams of Short Texts. IEEE Transactions on Knowledge and Data Engineering, 31(2), 257-272. https://doi.org/10.1109/TKDE.2018.2832211 [details]
    • Rossi, J., & Kanoulas, E. (2019). Legal Search in Case Law and Statute Law. In Legal Knowledge and Information Systems - {JURIX} 2019
    • Zou, J., & Kanoulas, E. (2019). Learning to Ask: Question-based Sequential Bayesian Product Search. In CIKM'19: Proceedings of the 28th ACM International Conference on Information & Knowledge Management : November 3-7, 2019, Beijing, China (pp. 369-378). New York, NY: Association for Computing Machinery. https://doi.org/10.1145/3357384.3357967 [details]
    • van Dijk, D., Ferrante, M., Ferro, N., & Kanoulas, E. (2019). A Markovian Approach to Evaluate Session-based IR Systems. In 41st European Conference on Information Retrieval (ECIR2019)

    2018

    • Inel, O., Haralabopoulos, G., Li, D., Van Gysel, C., Szlávik, Z., Simperl, E., ... Aroyo, L. (2018). Studying Topical Relevance with Evidence-based Crowdsourcing. In CIKM '18: proceedings of the 2018 ACM International Conference on Information and Knowledge Management : October 22-26, 2018, Torino, Italy (pp. 1253-1262). New York, NY: The Association for Computing Machinery. https://doi.org/10.1145/3269206.3271779 [details]
    • Kanoulas, E., Azzopardi, L., & Yang, G. H. (2018). Overview of the CLEF dynamic search evaluation lab 2018. In P. Bellot, C. Trabelsi, J. Mothe, F. Murtagh, J. Y. Nie, L. Soulier, E. SanJuan, L. Cappellato, ... N. Ferro (Eds.), Experimental IR Meets Multilinguality, Multimodality, and Interaction: 9th International Conference of the CLEF Association, CLEF 2018, Avignon, France, September 10-14, 2018 : Proceedings (pp. 362-371). (Lecture Notes in Computer Science; Vol. 11018). Cham: Springer. https://doi.org/10.1007/978-3-319-98932-7_31 [details]
    • Li, D., & Kanoulas, E. (2018). Bayesian Optimization for Optimizing Retrieval Systems. In WSDM'18: proceedings of the Eleventh ACM International Conference on Web Search and Data Mining : February 5-9, 2018, Marina Del Rey, CA, USA (pp. 360-368). Association for Computing Machinery. https://doi.org/10.1145/3159652.3159665 [details]
    • Liang, S., Zhang, X., Ren, Z., & Kanoulas, E. (2018). Dynamic embeddings for user profiling in Twitter. In KDD '18 : proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining: August 19-23, 2018, London, United Kingdom (pp. 1764-1773). New York NY: Association for Computing Machinery. https://doi.org/10.1145/3219819.3220043 [details]
    • Linmans, J., van de Velde, B., & Kanoulas, E. (2018). Improved and Robust Controversy Detection in General Web Pages Using Semantic Approaches under Large Scale Conditions. In CIKM'18: proceedings of the 2018 ACM International Conference on Information and Knowledge Management : October 22-26, 2018, Torino, Italy (pp. 1647-1650). New York, NY: The Association for Computing Machinery. https://doi.org/10.1145/3269206.3269301 [details]
    • Rossi, J., & Kanoulas, E. (2018). Query Generation for Patent Retrieval with Keyword Extraction based on Syntactic Features. In M. Palmirani (Ed.), Legal Knowledge and Information Systems: JURIX 2018: The Thirty-first Annual Conference (pp. 210-214). (Frontiers in Artificial Intelligence and Aplications; Vol. 313). Amsterdam: IOS Press. https://doi.org/10.3233/978-1-61499-935-5-210 [details]
    • Scheepers, T., Kanoulas, E., & Gavves, E. (2018). Improving Word Embedding Compositionality using Lexicographic Definitions. In The Web Conference 2018: companion of the World Wide Web Conference WWW2018 : April 23-27, 2018, Lyon, France (pp. 1083-1093). [Geneva]: International World Wide Web Conferences Steering Committee. https://doi.org/10.1145/3178876.3186007 [details]
    • Suominen, H., Kelly, L., Goeuriot, L., Névéol, A., Ramadier, L., Robert, A., ... Zuccon, G. (2018). Overview of the CLEF eHealth Evaluation Lab 2018. In P. Bellot, C. Trabelsi, J. Mothe, F. Murtagh, J. Y. Nie, L. Soulier, E. SanJuan, L. Cappellato, ... N. Ferro (Eds.), Experimental IR Meets Multilinguality, Multimodality, and Interaction: 9th International Conference of the CLEF Association, CLEF 2018, Avignon, France, September 10-14, 2018 : Proceedings (pp. 286-301). (Lecture Notes in Computer Science; Vol. 11018). Cham: Springer. https://doi.org/10.1007/978-3-319-98932-7_26 [details]
    • Van Gysel, C., de Rijke, M., & Kanoulas, E. (2018). Mix 'n Match: Integrating Text Matching and Product Substitutability within Product Search. In CIKM '18: proceedings of the 2018 ACM International Conference on Information and Knowledge Management : October 22-26, 2018, Torino, Italy (pp. 1373-1382). New York, NY: The Association for Computing Machinery. https://doi.org/10.1145/3269206.3271668 [details]
    • Van Gysel, C., de Rijke, M., & Kanoulas, E. (2018). Neural vector spaces for unsupervised information retrieval. ACM Transactions on Information Systems, 36(4), [38]. https://doi.org/10.1145/3196826 [details]
    • Zou, J., Li, D., & Kanoulas, E. (2018). Technology assisted reviews: Finding the last few relevant documents by asking yes/no questions to reviewers. In SIGIR #41 proceedings : Ann Arbor, Michigan, USA, 08-12, July 2018 (pp. 949-952). New York, NY: Association for Computing Machinery. https://doi.org/10.1145/3209978.3210102 [details]

    2017

    • Beelen, K., Kanoulas, E., & van de Velde, R. (2017). Detecting Controversies in Online News Media. In SIGIR'17 : proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval: August 7-11, 2017, Shinjuku, Tokyo, Japan (pp. 1069-1072). New York, NY: Association for Computing Machinery. https://doi.org/10.1145/3077136.3080723 [details]
    • Goeuriot, L., Kelly, L., Suominen, H., Névéol, A., Robert, A., Kanoulas, E., ... Zuccon, G. (2017). CLEF 2017 eHealth evaluation lab overview. In G. J. F. Jones, S. Lawless, J. Gonzalo, L. Kelly, L. Goeuriot, T. Mandl, L. Cappellato, ... N. Ferro (Eds.), Experimental IR Meets Multilinguality, Multimodality, and Interaction: 8th International Conference of the CLEF Association, CLEF 2017, Dublin, Ireland, September 11–14, 2017 : proceedings (pp. 291-303). (Lecture Notes in Computer Science; Vol. 10456). Cham: Springer. https://doi.org/10.1007/978-3-319-65813-1_26 [details]
    • Gârbacea, C., & Kanoulas, E. (2017). A systematic analysis of sentence update detection for temporal summarization. In J. M. Jose, C. Hauff, I. S. Altıngovde, D. Song, D. Albakour, S. Watt, & J. Tait (Eds.), Advances in Information Retrieval: 39th European Conference on IR Research, ECIR 2017, Aberdeen, UK, April 8–13, 2017 : proceedings (pp. 424-436). (Lecture Notes in Computer Science; Vol. 10193). Cham: Springer. https://doi.org/10.1007/978-3-319-56608-5_33 [details]
    • Kanoulas, E., & Azzopardi, L. (2017). CLEF 2017 Dynamic Search Lab Overview And Evaluation. CEUR Workshop Proceedings, 1866. [details]
    • Kanoulas, E., & Azzopardi, L. (2017). CLEF 2017 dynamic search evaluation lab overview. In G. J. F. Jones, S. Lawless, J. Gonzalo, L. Kelly, L. Goeuriot, T. Mandl, L. Cappellato, ... N. Ferro (Eds.), Experimental IR Meets Multilinguality, Multimodality, and Interaction: 8th International Conference of the CLEF Association, CLEF 2017, Dublin, Ireland, September 11–14, 2017 : proceedings (pp. 361-366). (Lecture Notes in Computer Science; Vol. 10456). Cham: Springer. https://doi.org/10.1007/978-3-319-65813-1_31 [details]
    • Kanoulas, E., Li, D., Azzopardi, L., & Spijker, R. (2017). CLEF 2017 Technologically Assisted Reviews in Empirical Medicine Overview. CEUR Workshop Proceedings, 1866. [details]
    • Li, D., & Kanoulas, E. (2017). Active Sampling for Large-scale Information Retrieval Evaluation. In CIKM'17 : proceedings of the 2017 ACM on Conference on Information and Knowledge Management: November 6-10, 2017, Singapore, Singapore (pp. 49-58). New York, NY: Association for Computing Machinery. https://doi.org/10.1145/3132847.3133015 [details]
    • Van Gysel, C., Kanoulas, E., & de Rijke, M. (2017). Pyndri: a Python Interface to the Indri Search Engine. In J. M. Jose, C. Hauff, I. S. Altıngovde, D. Song, D. Albakour, S. Watt, & J. Tait (Eds.), Advances in Information Retrieval: 39th European Conference on IR Research, ECIR 2017, Aberdeen, UK, April 8–13, 2017 : proceedings (pp. 744-748). (Lecture Notes in Computer Science; Vol. 10193). Cham: Springer. https://doi.org/10.1007/978-3-319-56608-5_74 [details]
    • Van Gysel, C., de Rijke, M., & Kanoulas, E. (2017). Semantic Entity Retrieval Toolkit. In Neu-IR: Workshop on Neural Information Retrieval: accepted papers Ithaca, NY: arXiv.org. [details]
    • Van Gysel, C., de Rijke, M., & Kanoulas, E. (2017). Structural Regularities in Text-based Entity Vector Spaces. In ICTIR'17: proceedings of the 2017 ACM SIGIR International Conference on the Theory of Information Retrieval: October 1-4, 2017, Amsterdam, the Netherlands (pp. 3-10). New York, NY: Association for Computing Machinery. https://doi.org/10.1145/3121050.3121066 [details]

    2016

    • Azarbonyad, H., & Kanoulas, E. (2016). Power Analysis for Interleaving Experiments by Means of Offline Evaluation. In ICTIR'16: Proceedings of the 2016 ACM International Conference on the Theory of Information Retrieval : September 12-16, 2016, Newark, Delaware, USA (pp. 87-90). New York, NY: Association for Computing Machinery. https://doi.org/10.1145/2970398.2970432 [details]
    • Carterette, B., Clough, P., Hall, M., Kanoulas, E., & Sanderson, M. (2016). Evaluating Retrieval over Sessions: The TREC Session Track 2011-2014. In SIGIR'16: the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval: Pisa, Italy , July 17-21, 2016 (pp. 685-688). New York, NY: Association for Computing Machinery. https://doi.org/10.1145/2911451.2914675 [details]
    • Liang, S., Ren, Z., Yilmaz, E., & Kanoulas, E. (2016). Collaborative User Clustering for Short Text Streams. In Association for the Advancement of Artificial Intelligence
    • Liang, S., Yilmaz, E., & Kanoulas, E. (2016). Dynamic Clustering of Streaming Short Documents. In KDD'16: proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining : August 13-17, 2016, San Francisco, CA, USA (pp. 995-1004). New York, NY: Association for Computing Machinery. https://doi.org/10.1145/2939672.2939748 [details]
    • Lipani, A., Lupu, M., Kanoulas, E., & Hanbury, A. (2016). The Solitude of Relevant Documents in the Pool. In CIKM'16: proceedings of the 2016 ACM Conference on Information and Knowledge Management : October 24-28, 2016, Indianapolis, IN, USA (pp. 1989-1992). New York, NY: Association for Computing Machinery. https://doi.org/10.1145/2983323.2983891 [details]
    • Van Gysel, C., Kanoulas, E., & de Rijke, M. (2016). Lexical query modeling in session search. In ICTIR'16: proceedings of the 2016 ACM International Conference on the Theory of Information Retrieval : September 12-16, 2016, Newark, Delaware, USA (pp. 69-72). New York, NY: The Association for Computing Machinery. https://doi.org/10.1145/2970398.2970422 [details]
    • Van Gysel, C., de Rijke, M., & Kanoulas, E. (2016). Learning Latent Vector Spaces for Product Search. In CIKM'16: proceedings of the 2016 ACM Conference on Information and Knowledge Management : October 24-28, 2016, Indianapolis, IN, USA (pp. 165-174). New York, NY: Association for Computing Machinery. https://doi.org/10.1145/2983323.2983702 [details]

    2011

    2007

    • Kanoulas, E., Aslam, J. A., Sharp, G. C., Berbeco, R. I., Nishioka, S., Shirato, H., & Jiang, S. B. (2007). Derivation of the tumor position from external respiratory surrogates with periodical updating of the internal/external correlation. Physics in Medicine and Biology, 52(17), 5443-5456. https://doi.org/10.1088/0031-9155/52/17/023

    2017

    • Fang, H., Kamps, J., Kanoulas, E., de Rijke, M., & Yilmaz, E. (2017). Report on the 2017 ACM SIGIR International Conference Theory of Information Retrieval (ICTIR'17): conference report. SIGIR Forum, 51(3), 78-87. https://doi.org/10.1145/3190580.3190591 [details]
    • Kamps, J. (Ed.), Kanoulas, E. (Ed.), de Rijke, M. (Ed.), Fang, H., & Yilmaz, E. (2017). ICTIR'17: proceedings of the 2017 ACM SIGIR International Conference on the Theory of Information Retrieval: October 1-4, 2017, Amsterdam, the Netherlands. New York, NY: Association for Computing Machinery. [details]
    • Kamps, J., Kanoulas, E., de Rijke, M., Fang, H., & Yilmaz, E. (2017). Chairs' welcome. In ICTIR'17: proceedings of the 2017 ACM SIGIR International Conference on the Theory of Information Retrieval: October 1-4, 2017, Amsterdam, the Netherlands (pp. iii). New York, NY: Association for Computing Machinery. [details]
    • Kanoulas, E., & Karlgren, J. (2017). Practical Issues in Information Access System Evaluation: BCS-IRSG Search Solutions Workshop Report. SIGIR Forum, 51(1), 67-72. https://doi.org/10.1145/3130332.3130344 [details]

    2016

    • Gârbacea, C., & Kanoulas, E. (2016). The University of Amsterdam (ILPS.UvA) at TREC 2015 Temporal Summarization Track. In E. M. Voorhees, & A. Ellis (Eds.), The Twenty-Fourth Text REtrieval Conference (TREC 2015) Proceedings (NIST Special Publication; No. SP 500-321). Gaithersburg, MD: National Institute for Standards and Technology. [details]
    • Quiroz, L., Mennes, L., Dehghani, M., & Kanoulas, E. (2016). Distributional Semantics for Medical Information Extraction. CEUR Workshop Proceedings, 1609, 109-122. [details]
    • Yilmaz, E., Kanoulas, E., Verma, M., Carterette, B., Craswell, N., & Mehrotra, R. (2016). Overview of the TREC 2015 Tasks Track. In E. M. Voorhees, & A. Ellis (Eds.), The Twenty-Fourth Text REtrieval Conference (TREC 2015) Proceedings (NIST Special Publication; No. SP 500-321). Gaithersburg, MD: National Institute for Standards and Technology. [details]
    • van Dijk, D., Ren, Z., Kanoulas, E., & de Rijke, M. (2016). The University of Amsterdam (ILPS) at TREC 2015 Total Recall Track. In E. M. Voorhees, & A. Ellis (Eds.), The Twenty-Fourth Text REtrieval Conference (TREC 2015) Proceedings (NIST Special Publication; No. SP 500-321). Gaithersburg, MD: National Institute for Standards and Technology. [details]

    2019

    • Krasakis, A. M., Kanoulas, E., & Tsatsaronis, G. (2019). Semi-supervised Ensemble Learning with Weak Supervision for Biomedical Relationship Extraction.
    • Rietveld, R., Kanoulas, E., & Rossi, J. (2019). Distilling Jurisprudence through Argument Mining for Case Assessment. Paper presented at 1st International Workshop on AI and Intelligent Assistance for Legal Professionals in the Digital Workplace (LegalAIIA), Montreal, Canada.
    • Rossi, J., & Kanoulas, E. (2019). Legal Information Retrieval with Generalized Language Models: ILPS Participation to COLIEE 2019. Paper presented at COLIEE 2019, Montreal, Canada.
    • Siegel, J., van Dolen, W. M., Kanoulas, E., & Efthymiou, A. (2019). Empowering Service Employees to Manage Deceptive Consumer Behavior. Paper presented at Quis 16, Karlstad, Sweden.

    2018

    • Kanoulas, E., Li, D., Azzopardi, L., & Spijker, R. (2018). CLEF 2018 technologically assisted reviews in empirical medicine overview. Paper presented at 19th Working Notes of CLEF Conference and Labs of the Evaluation Forum, CLEF 2018, Avignon, France.

    2017

    • Mironenco, M., Kianfar, D., Tran, M. K., Kanoulas, E., & Gavves, E. (2017). Examining Cooperation in Visual Dialog Models.
    • Timmermans, B., Aroyo, L., Kuhn, T., Beelen, K., van de Velde, R. N., Kanoulas, E., & van Eerten, G. (2017). ControCurator: Understanding Controversy Using Collective Intelligence. Paper presented at collective intelligence conference, New York, United States.

    Others

    • Grotov, A. (organiser), Van Gysel, C. J. H. (organiser), Kanoulas, E. (organiser), Azarbonyad, H. (organiser), Voskarides, N. (organiser), Best, P. (organiser) & Li, X. (organiser) (27-11-2015). DIR2015, Amsterdam. Proceedings of 14th Dutch-Belgian Information Retrieval Workshop (organising a conference, workshop, ...).

    2018

    • Li, X. (2018). Mining information interaction behavior: Academic papers and enterprise emails. [details]

    2017

    • Chuklin, A. (2017). Understanding and modeling users of modern search engines. [details]
    • Van Gysel, C. J. H. (2017). Remedies against the vocabulary gap in information retrieval. [details]

    2016

    • Ren, Z. (2016). Monitoring social media: Summarization, classification and recommendation. [details]
    This list of publications is extracted from the UvA-Current Research Information System. Questions? Ask the library or the Pure staff of your faculty / institute. Log in to Pure to edit your publications. Log in to Personal Page Publication Selection tool to manage the visibility of your publications on this list.
  • Ancillary activities
    • Huawei Netherlands B.V.
      Consulting on search and recommendation.