Giuseppe Facchi

KA-GCN: Kernel-Attentive Graph Convolutional Network for 3D face analysis Graph Structure Learning

Graph Structure Learning (GSL) enhances Graph Neural Networks (GNNs) by refining graph structures for applications in unstructured domains like 3D face analysis, especially when data are limited. This paper introduces a kernel-attentive GCN (KA-GCN) that leverages an adaptive distance-based attention mechanism to learn adjacency matrices, demonstrating robust performance on both public and private datasets.

This project initially focuses on detecting Marfan syndrome using Graph Neural Networks (GNNs) applied to 3D facial data, exploiting the intricate geometry of facial structures to distinguish affected individuals. By leveraging GNNs, the approach captures spatial relationships that enhance diagnostic accuracy and reliability. In the future, this framework will expand to encompass a broader range of syndromic conditions, making it a versatile tool for multi-syndrome classification. This scalability allows for the potential integration of more complex, rare syndromes, providing valuable support for clinical decision-making in genetic and morphological research.

Surgical Training video analysis

This project develops a tool for analyzing surgical training videos to enhance trainees' learning experiences. Using the YOLO (You Only Look Once) framework, it detects surgical instruments and key actions after the recording is complete, overlaying visual annotations to highlight performance. The tool incorporates template matching and SAM2 (Segment Anything Model 2) for effective object tracking, ensuring consistent monitoring throughout the procedure. Detected frames can be saved for focused review, and performance metrics like task completion times and instrument accuracy provide valuable feedback for progress tracking.

This project aims to classify in a multimodal approach neurodegenerative diseases starting from T1, T2, FLAIR sequences. The process requires automatic 3D segmentation of 150+ brain areas, which are then described by a useful set of features. The final classification is made on a graph, by tailoring the expressiveness of GNNs.This project aims to classify in a multimodal approach neurodegenerative diseases starting from T1, T2, FLAIR sequences. The process requires automatic 3D segmentation of 150+ brain areas, which are then described by a useful set of features. The final classification is made on a graph, by tailoring the expressiveness of GNNs.

2S-SGCN: A Two-Stage Stratified Graph Convolutional Network Model for Facial Landmark Detection on 3D data

Facial Landmark Detection (FLD) has expanded into 3D, driven by its applications in fields like medical research, yet presents challenges in network architecture and precision. This paper introduces a 2-Stage Stratified Graph Convolutional Network (2S-SGCN) that uses heatmap regression and a new post-processing technique, achieving state-of-the-art results on public 3D datasets and supporting efficient deployment on resource-constrained devices.

Graph Neural Networks for 3D facial morphological feature learning

This paper investigates the use of Graph Neural Networks (GNNs) for automated facial morphology analysis from 3D face scans, addressing the limitations of traditional landmark detection methods. The study shows that GNNs can effectively extract morphological patterns by considering local and global geometry. It finds that automatically extracted landmarks outperform manually derived ones, while random sub-sampling yields inferior results, indicating the potential for broader clinical applications.

2024

D415 GUI for Face Reconstruction

A GUI that implements a robust face reconstruction method from a single image, providing interactive features for users to visualize and manipulate 3D facial data efficiently.

Spatial trajectory segmentation and analysis for determining stop points

University project of the Geospatial data management course focused on the implementation and comparison of three different spatial trajectories segmentation algorithms The segmentation is based on the well-known stop-move model and applied to data about the movements of persons in a museum. After the segmentation step, some analyses were performed on the result to find the most visited exhibits and the number of people standing together by the same exhibit using MobilityDB, a novel DBMS specialized in trajectory data management that supports data types representing values changing over time and specialized operations over them.

BScEstimation of Fiducial Points on 3D Faces Using Multi-View Consensus-Based Techniques

The project aimed to develop a method for accurately estimating 478 fiducial points on 3D facial models using a multi-view approach. The process involved pre-processing the 3D mesh for proper alignment, generating orthographic views, and extracting 2D landmarks with MediaPipe, followed by a final estimation using a point density method. The resulting system demonstrated a strong balance between precision and computational efficiency, with identified areas for future improvement including enhanced support for various data formats and better handling of occluded points.

2024 | Bertinelli Samuele

MScSegmentation of Choroid Plexus in MRI images: a new GT modality for the study of neurodegenerative diseases

The project aimed to implement SOTA methods in order to segment choroidal plexus from MRI images using T1 and FLAIR sequences. The segmentation was performed using U-Mamba, nn-UNet and Aschoplex architectures and the results were compared with the ground truth obtained from manual segmentation composed of T1 and FLAIR combinations.

2024 | Schmid Lia