Retrieval-powered Zero-shot Text Classification

  • Event Details
  • 16.01.2023, 17:30 o'clock - 18:30 o'clock 
  • Location: N2045, Universitätsstraße 1, 86159 Augsburg
  • Organizer(s): Lehrstuhl für Biomedizinische Informatik, Data Mining und Data Analytics
  • Topics: Informatik, Gesundheit und Medizin
  • Series of events: Medical Information Sciences
  • Vortrag
  • Speaker(s): Prof. Dr. Carsten Eickhoff
© University of Augsburg

Im Wintersemester findet jeweils montags um 17:30h in Hörsaal N2045 die Vortragsreihe Medical Information Sciences statt. Renommierte Wissenschaftlerinnen und Wissenschaftler unterschiedlicher Fachdisziplinen und Forschungsstandorte geben Einblicke in aktuelle Fragestellungen, Forschungsbereiche und Anwendungsgebiete dieses zunehmend bedeutsamen Forschungsfeldes.


Unstructured data, especially encoded in the form of natural language text, is one of the most prevalent and rapidly growing information types available to humankind. Unlocking the (often hidden) potential of such resources via natural language processing and understanding techniques can greatly support, or altogether enable, an exciting range of downstream applications. In this talk, I will give a brief high-level overview of ongoing NLP and IR efforts in my lab, before moving on to an investigation of zero-shot text classification in a diagnostic decision support setting. More than most other clinical inference tasks, primary care diagnosis experiences severely imbalanced long-tailed class distributions, under which some few classes are very well represented (e.g., congestive heart failure) while most others remain sparsely populated or even entirely unobserved in many clinical centers (e.g., rare diseases such as the Danbolt-Cross Syndrome). Such few- or zero-shot settings make a challenging stage on which to field conventional class-conditional machine learning models. In an attempt to address this issue, we draw from massive unsupervised domain resources such as PubMed that are incorporated via an information retrieval step and observe significant performance improvements without the need for additional supervised training data. Carsten Eickhoff is a Professor of E-Health and Medical Data Science at the University of Tübingen where his lab specializes in the development of machine learning and natural language processing techniques with the goal of improving patient safety, individual health, and quality of medical care. Prior to joining Tübingen, he was the Manning Assistant Professor of Medical and Computer Science at Brown University. He received degrees from the University of Edinburgh and TU Delft, and was a postdoctoral fellow at ETH Zurich and Harvard University. Carsten has authored more than 100 articles in computer science conferences (e.g., ICLR, ACL, SIGIR, WWW, KDD) and clinical journals (e.g., Nature Digital Medicine, The Lancet - Respiratory Medicine, Radiology, European Heart Journal). His research has been supported by the Swiss National Science Foundation, NSF, DARPA, IARPA, Google, Amazon, Microsoft and others. Aside from his academic endeavors, he is a founder and board member of several deep technology startups in the health sector that strive to translate technological innovation to improved safety and quality of life for patients.

More events: Lehrstuhl für Biomedizinische Informatik, Data Mining und Data Analytics

  • March 2023
    • 06
    • 07
    • 08
    • 09
    • 10
    • 11
    • 12
    • 13
    • 14
    • 15
    • 16
    • 17
    • 18
    • 19
  • March 2023 / April 2023
    • 20
    • 21
    • 22
    • 23
    • 24
    • 25
    • 26
    • 27
    • 28
    • 29
    • 30
    • 31
    • 01
    • 02
  • April 2023
    • 03
    • 04
    • 05
    • 06
    • 07
    • 08
    • 09
    • 10
    • 11
    • 12
    • 13
    • 14
    • 15
    • 16
  • April 2023
    • 17
    • 18
    • 19
    • 20
    • 21
    • 22
    • 23
    • 24
    • 25
    • 26
    • 27
    • 28
    • 29
    • 30
  • May 2023
    • 01
    • 02
    • 03
    • 04
    • 05
    • 06
    • 07
    • 08
    • 09
    • 10
    • 11
    • 12
    • 13
    • 14
  • May 2023
    • 15
    • 16
    • 17
    • 18
    • 19
    • 20
    • 21
    • 22
    • 23
    • 24
    • 25
    • 26
    • 27
    • 28
  • May 2023 / June 2023
    • 29
    • 30
    • 31
    • 01
    • 02
    • 03
    • 04
    • 05
    • 06
    • 07
    • 08
    • 09
    • 10
    • 11
  • June 2023
    • 12
    • 13
    • 14
    • 15
    • 16
    • 17
    • 18
    • 19
    • 20
    • 21
    • 22
    • 23
    • 24
    • 25
  • June 2023 / July 2023
    • 26
    • 27
    • 28
    • 29
    • 30
    • 01
    • 02
    • 03
    • 04
    • 05
    • 06
    • 07
    • 08
    • 09
  • July 2023
    • 10
    • 11
    • 12
    • 13
    • 14
    • 15
    • 16
    • 17
    • 18
    • 19
    • 20
    • 21
    • 22
    • 23
  • July 2023 / August 2023
    • 24
    • 25
    • 26
    • 27
    • 28
    • 29
    • 30
    • 31
    • 01
    • 02
    • 03
    • 04
    • 05
    • 06
  • August 2023
    • 07
    • 08
    • 09
    • 10
    • 11
    • 12
    • 13
    • 14
    • 15
    • 16
    • 17
    • 18
    • 19
    • 20
  • August 2023 / September 2023
    • 21
    • 22
    • 23
    • 24
    • 25
    • 26
    • 27
    • 28
    • 29
    • 30
    • 31
    • 01
    • 02
    • 03
  • September 2023
    • 04
    • 05
    • 06
    • 07
    • 08
    • 09
    • 10
    • 11
    • 12
    • 13
    • 14
    • 15
    • 16
    • 17
  • September 2023 / October 2023
    • 18
    • 19
    • 20
    • 21
    • 22
    • 23
    • 24
    • 25
    • 26
    • 27
    • 28
    • 29
    • 30
    • 01
  • October 2023
    • 02
    • 03
    • 04
    • 05
    • 06
    • 07
    • 08
    • 09
    • 10
    • 11
    • 12
    • 13
    • 14
    • 15
  • October 2023
    • 16
    • 17
    • 18
    • 19
    • 20
    • 21
    • 22
    • 23
    • 24
    • 25
    • 26
    • 27
    • 28
    • 29
  • October 2023 / November 2023
    • 30
    • 31
    • 01
    • 02
    • 03
    • 04
    • 05
    • 06
    • 07
    • 08
    • 09
    • 10
    • 11
    • 12
  • November 2023
    • 13
    • 14
    • 15
    • 16
    • 17
    • 18
    • 19
    • 20
    • 21
    • 22
    • 23
    • 24
    • 25
    • 26
  • November 2023 / December 2023
    • 27
    • 28
    • 29
    • 30
    • 01
    • 02
    • 03
    • 04
    • 05
    • 06
    • 07
    • 08
    • 09
    • 10
  • December 2023
    • 11
    • 12
    • 13
    • 14
    • 15
    • 16
    • 17
    • 18
    • 19
    • 20
    • 21
    • 22
    • 23
    • 24
  • December 2023 / January 2024
    • 25
    • 26
    • 27
    • 28
    • 29
    • 30
    • 31
    • 01
    • 02
    • 03
    • 04
    • 05
    • 06
    • 07
  • January 2024
    • 08
    • 09
    • 10
    • 11
    • 12
    • 13
    • 14
    • 15
    • 16
    • 17
    • 18
    • 19
    • 20
    • 21
  • January 2024 / February 2024
    • 22
    • 23
    • 24
    • 25
    • 26
    • 27
    • 28
    • 29
    • 30
    • 31
    • 01
    • 02
    • 03
    • 04
  • February 2024
    • 05
    • 06
    • 07
    • 08
    • 09
    • 10
    • 11
    • 12
    • 13
    • 14
    • 15
    • 16
    • 17
    • 18
  • February 2024 / March 2024
    • 19
    • 20
    • 21
    • 22
    • 23
    • 24
    • 25
    • 26
    • 27
    • 28
    • 29
    • 01
    • 02
    • 03

Search