Structured Machine Learning Group

Structured Machine Learning Group

SML Journal club

Open discussions and lightning talks on artificial intelligence topics

The SML Journal Club is an open-science initiative aiming to create a friendly environment to discuss and speculate about the recent research trends in Artificial Intelligence, Machine Learning and Computer Science. It is not a formal occasion either! We will have a lightning talk at each meeting to introduce the topic and get the conversation going, leading to having a drink together after the event! It is open to all interested PhDs, students, researchers, (and professors!) who don't mind spending an evening talking about science and making new friends.

Are you curious to know more? Join our Telegram channel for updates on the following events!

P.S: We do not spam ;)

Every two Fridays at 4.00 pm CET

Are you unable to attend in person? The events are also available in a remote format!
We will release the Zoom link one hour before each event in our Telegram channel!

Upcoming events

Towards reliable hybrid classification services

May 13, 2022

Name: Burcu Sayin Günel
Affiliation: University of Trento
Keywords: reliable hybrid classification, machine learning, ml calibration

Abstract: Hybrid classification services are online services that combine machine learning (ML) and humans - either crowd workers or experts - to achieve a classification objective, from relatively simple ones such as deriving the sentiment of a text to more complex ones such as medical diagnoses. In this talk, I will present our approach toward a science for hybrid classification services; discussing key concepts, challenges, and architectures. I will then focus on a central aspect, that of ML calibration, and how it can be achieved with crowdsourced labels.

To define

May 27, 2022

Name: Seyed Mahed Mousavi
Affiliation: University of Trento
Keywords: To define

Abstract: To define

Past events

April 29, 2022

Learning and reasoning with probabilistic satisfiability modulo theories

Paolo Morettin (KU Leuven) - Website

[] [Recording] [Slides]

Recently, probabilistic Satisfiability Modulo Theories has emerged as a very expressive formalism for modelling complex distributions over continuous and discrete variables. By encoding the probability density function over an SMT formula with piecewise polynomials, any joint probability distribution can be represented with arbitrary precision, granting unprecedented flexibility and enabling probabilistic reasoning with both algebraic and logical constraints. In this talk, I will introduce the core concepts, challenges and applications of probabilistic SMT in the fields of machine learning and quantitative formal verification.

April 8, 2022

A Neuro-Symbolic Approach to Structured Event Recognition

Gianluca Apriceno (Fondazione Bruno Kessler and University of Trento)

[] [Recording] [Slides]

Events are structured entities with multiple components: the event type, the participants with their roles, the outcome, the sub-events etc. A fully end-to-end approach for event recognition from raw data sequence, therefore, should also solve a number of simpler tasks like recognizing the objects involved in the events and their roles, the outcome of the events as well as the sub-events. Ontological knowledge about event structure, specified in logic languages, could be very useful to solve the aforementioned challenges. However, the majority of successful approaches in event recognition from raw data are based on purely neural approaches (mainly recurrent neural networks), with limited, if any, support for background knowledge. These approaches typically require large training sets with detailed annotations at the different levels in which recognition can be decomposed (e.g., video annotated with object bounding boxes, object roles, events and sub-events). In this paper, we propose a neuro-symbolic approach for structured event recognition from raw data that uses “shallow” annotation on the high-level events and exploits background knowledge to propagate this supervision to simpler tasks such as object classification. We develop a prototype of the approach and compare it with a purely neural solution based on recurrent neural networks, showing the higher capability of solving both the event recognition task and the simpler task of object classification, as well as the ability to generalize to events with unseen outcomes.

March 25, 2022

Higher-Order Networks and Motif Analysis in Hypergraphs

Quintino Francesco Lotito (University of Trento) - Website

[] [Recording] [Slides]

Over the last two decades, networks have emerged as a powerful tool to analyze the complex topology of interacting systems. From social networks to the brain, several systems have been represented as a collection of nodes and links, encoding dyadic interactions among pairs of units. Yet, growing empirical evidence is now suggesting that a large number of such interactions are not limited to pairs, but rather occur in larger groups. In this seminar, we will discuss how more sophisticated mathematical frameworks such as the hypergraphs can enhance our modeling capabilities for systems involving higher-order interactions. We will see that dealing with such complex structures requires new algorithms to cope with more computationally difficult problems, and new tools and generalizations of classic network ideas to fully exploit the improvements in the expressive power. In the last part of the talk, we will focus on the specific problem of higher-order motif analysis. Higher-order network motifs are defined as statistically over-expressed connected subgraphs of a given number of nodes, which can be connected by higher-order interactions of arbitrary order. We will show how they are able to characterize the local structure of hypergraphs and extract fingerprints at the network microscale of higher-order real-world systems. Moreover, we will discuss the problem from an algorithmic perspective, investigating also some real-world applications. Finally, we will talk about open challenges and possible future directions.

March 11, 2022

Egocentric Temporal Motifs networks

Antonio Longa (Fondazione Bruno Kessler and University of Trento) - Website

[] [Recording] [Slides]

Temporal graphs are structures which model relational data between entities that change over time. Due to the complex structure of data, mining statistically significant temporal subgraphs, also known as temporal motifs, is a challenging task. In this work, we present an efficient technique for extracting temporal motifs in temporal networks. Our method is based on the novel notion of egocentric temporal neighborhoods, namely multi-layer structures centered on an ego node. Each temporal layer of the structure consists of the first-order neighborhood of the ego node, and corresponding nodes in sequential layers are connected by an edge. The strength of this approach lies in the possibility of encoding these structures into a unique bit vector, thus bypassing the problem of graph isomorphism in searching for temporal motifs. This allows our algorithm to mine substantially larger motifs with respect to alternative approaches. Furthermore, by bringing the focus on the temporal dynamics of the interactions of a specific node, our model allows to mine temporal motifs which are visibly interpretable. Experiments on a number of complex networks of social interactions confirm the advantage of the proposed approach over alternative non-egocentric solutions. The egocentric procedure is indeed more efficient in revealing similarities and discrepancies among different social environments, independently of the different technologies used to collect data, which instead affect standard non-egocentric measures.

February 25, 2022

Algorithmic Recourse and Explainable Counterfactual Interventions

Giovanni De Toni (Fondazione Bruno Kessler and University of Trento) - Website

[] [Recording] [Slides]

'Algorithmic recourse' is defined as the ability to provide actionable feedback to unfairly treated users to overturn the decision made by automated decision systems. This feature has become critical for modern machine learning systems that we use to make decisions in several areas of our lives. Counterfactual interventions are a powerful tool to suggest to affected users which actions they have to perform to change the outcome of a black-box model. They give us the intuition of what the state of the world would have been if we had behaved differently. In this talk, we will provide an overview of modern techniques to ensure algorithmic recourse through the generation of explainable counterfactual interventions.

February 11, 2022

Causal Representation Learning

Emanuele Marconato (University of Pisa and University of Trento)

[] [Recording] [Slides]

The two fields of Causality and Machine Learning have a long history and until now they developed separately. In this talk, I will discuss past and recent progress in both fields and envisage a possible connection, precisely the new research direction of Causal Representation Learning. I will focus on the conceptual development of Representation Learning, i.e. learning high-level variables from low-level observations, and motivate that future AI challenges can be addressed leveraging Causality, in particular for transfer learning and for generalizing out of distribution.