H2020Индивидуална стипендия2020–2022

METER · Multi-aspect and diffErenTiable Evaluation of Rankings

„Хоризонт 2020“ — Действия „Мария Склодовска-Кюри“

Период: 2020-10-01 → 2022-09-30
Финансиране от ЕС: 207 312 €
Участници: 1
Схема: MSCA-IF

Линиите свързват координатора с партньорите.

Накратко на български

Системите за търсене на информация се анализират чрез нови показатели, които оценяват не само релевантността, но и достоверността и точността на резултатите. Това помага за ограничаване на дезинформацията и вредното съдържание в интернет.

Този кратък обзор е генериран от изкуствен интелект

Кратко обяснение, генерирано от езиков модел по текста на CORDIS. Оригиналът е по-долу.

Резултати накратко

Multi-aspect and diffErenTiable Evaluation of Rankings

Information Retrieval (IR) deals with the automatic retrieval and ranking of information conveying items, which are relevant to a specific information need. Search engines are the most popular and well-known examples of IR systems. Current evaluation procedures for IR systems mainly focus on the relevance of an item (e.g., Web page) with respect to the user need, but this might not be enough. For example, credibility and correctness should be considered to avoid returning misinformation and potentially harmful content. This project investigated how to evaluate the performance of IR systems beyond relevance. The first goal was to extend IR evaluation measures to deal with multiple aspects. The second goal was to thoroughly analyze the properties of measures able to account for multiple aspects so that such measures could be integrated in IR systems and lead to better performance.

Текст от CORDIS, на английски · Данни: CORDIS, © Европейски съюз

Цел на проекта

Information Retrieval (IR) deals with the automatic retrieval and ranking of information conveying items, which are relevant to a specific information need, from a large collection of items. Search engines are the most popular and well known examples of IR systems.State-of-the-art IR systems use sophisticated Machine Learning (ML) and Deep Learning (DL) models. Those models usually minimize a loss function which is built upon an IR evaluation measure, i.e. a measure that evaluates the quality of a ranked list of items.This project, Multi-aspect and diffErenTiable Evaluation of Rankings (METER), will tackle two open challenges for state-of-the-art IR systems. First, traditionally IR systems ranks items only by relevance, estimated as the semantic similarity between the user query and the information conveying items. However, beside relevance, understandability and trustworthines are fundamental for health search, or credibility and correctness should be considered for news search. Therefore, the first goal of METER will be to extend IR evaluation measures to deal with mutiple aspects. Then, these new evaluation measures will be integrated in ML algorithms, to develop multi-aspect IR systems.Second, IR measures are non-continuous and non-differentiable. This represents an issue for ML algorithms, which usually exploit gradient based approaches to minize the loss function. Therefore, the second goal of METER will be to thoroughly analyze IR evaluation measures and propose differentiability like properties which will help for the search of minima of the loss function.Therefore, METER has the potential for making both a scientific and a societal impact: 1) multi-aspect measures will be used to account for several aspect and improve the effectiveness of IR systems in different domains; 2) differentiability like properties will be exploited to improve the search of local minima for IR loss functions and better understand how this search is performed.

Оригинален текст от CORDIS (на английски).

Участници

KOBENHAVNS UNIVERSITET · KOBENHAVNКоординаторДания