Dott. Lorenzo Baraldi

Dott. Lorenzo Baraldi

Homepage:

http://www.lorenzobaraldi.com

Position at Imagelab:

Assistant Professor (RTD)
Dipartimento d'Ingegneria "Enzo Ferrari", Modena Italy

Email:

lorenzo_DOT_baraldi_AT_unimore_DOT_it

Phone:

+39-059-2058790

Lorenzo Baraldi

Lorenzo Baraldi is a postdoctoral fellow (RTD-A) at AImageLab. He works under the supervision of Prof. Rita Cucchiara and Prof. Costantino Grana, on Deep Learning, video analysis and Multimedia. Among his research interests, he has worked on Egocentric Vision and Gesture Recognition, Temporal Video Segmentation and Retrieval, Saliency prediction, Video Captioning, Visual-Semantic alignment.

He has served as a reviewer in IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), IEEE Transactions on Multimedia, IEEE Transactions on Image Processing, Computer Vision and Image Understanding and IEEE Transactions on Human-Machine System. Together with Prof. Costantino Grana, in 2017, he has organized the 13th Italian Research Conference on Digital Libraries. He is member of the Program Committee for ACM Multimedia 2017, in the Multimedia Search and Recommendation and Conflict of Interest tracks. He served as a reviewer for AVSS 2017, ICCV 2017 and CVPR 2018.

As part of the Città Educante project, he has developed NeuralStory, an interactive multimedia system for video indexing and re-use.

In 2016, together with Prof. Rita Cucchiara, Prof. Costantino Grana and Dr. Simone Calderara, he has been author of the winning proposal for the Facebook AI Research Partnership, with which AImageLab has been selected as one of the 15 world-class research labs in Europe to receive a GPU-based server. From June to October 2017 he worked in the FAIR (Facebook AI Research) lab in Paris, under the supervision of Hervé Jégou and Matthijs Douze.

He is a member of IEEE, ACM and CVPL, the Italian Association for Computer Vision, Pattern Recognition and Machine Learning.

Curriculum vitae: download

Keywords: Deep Learning, Video Analysis, Image and Video Captioning, Saliency Prediction


Teaching

  • Fundamentals of Computer Science I (2018) - Adjunct Professor
  • Computer Vision (2015-2018) - Teaching assistant
  • Fundamentals of Computer Science I (2015-2017) - Tutor
  • Pattern Recognition and Machine Learning (2015) - Three lectures on supervised and unsupervised Deep Learning [Lab notes]
  • Graduate Master in Visual Computing and Multimedia Technologies (2015) - Laboratory lecturer

Theses supervision

  • Matteo Tomei (MSc, currently PhD Student) - Constrained image-to-image translation
  • Jørgen Wilhelmsen, Bjørn Hoxmark (MSc) - Active learning
  • Matteo Stefanini (MSc) - Spectral pooling techniques
  • Angelo Carraggi (MSc) - Visual-semantic embeddings
  • Stefano Pini (MSc, currently PhD Student) - Linking people and objects with their proper names in videos
  • Gianluca Puglia (MSc) - Image and Video Captioning with Transferred Semantic Attributes
  • Federico Bolelli (MSc, currently PhD Student) - Connected Components Labeling
  • Marcella Cornia (MSc, currently PhD Student) - Deeply learned Saliency prediction
  • Fabio Pozzi (MSc) - Shot and scene detection in broadcast videos
  • Angelo Perri (BSc) - Optimization of convolution algorithms on GPU architectures
  • Dodiane Carole Ngatcha Nana (BSc) - Optimization of convolution algorithms on multicore architectures

Research Projects


Research Activities


Publications

1 Cornia, Marcella; Pini, Stefano; Baraldi, Lorenzo; Cucchiara, Rita "Automatic Image Cropping and Selection using Saliency: an Application to Historical Manuscripts" Digital Libraries and Multimedia Archives, vol. 806, Udine, pp. 169 -179 , January 25-26, 2018, 2018
DOI: 10.1007/978-3-319-73165-0_17 Conference
2 Cornia, Marcella; Baraldi, Lorenzo; Serra, Giuseppe; Cucchiara, Rita "Paying More Attention to Saliency: Image Captioning with Saliency and Context Attention" ACM TRANSACTIONS ON MULTIMEDIA COMPUTING, COMMUNICATIONS AND APPLICATIONS, vol. 14, pp. 1 -21 , 2018
DOI: 10.1145/3177745 Journal
3 Baraldi, Lorenzo; Douze, Matthijs; Cucchiara, Rita; Jgou, Herv "LAMV: Learning to align and match videos with kernelized temporal layers" 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, June 18-22, 2018 Conference
4 Bolelli, Federico; Cancilla, Michele; Baraldi, Lorenzo; Grana, Costantino "Towards Reliable Experiments on the Performance of Connected Components Labeling Algorithms" JOURNAL OF REAL-TIME IMAGE PROCESSING, pp. 1 -16 , 2018
DOI: 10.1007/s11554-018-0756-1 Journal
5 Baraldi, Lorenzo; Cornia, Marcella; Grana, Costantino; Cucchiara, Rita "Aligning Text and Document Illustrations: towards Visually Explainable Digital Humanities" Proceedings of the 24th International Conference on Pattern Recognition, Beijing, China, pp. 1097 -1102 , August 20th-24th, 2018, 2018 Conference
6 Bolelli, Federico; Baraldi, Lorenzo; Cancilla, Michele; Grana, Costantino "Connected Components Labeling on DRAGs" Proceedings of the 24th International Conference on Pattern Recognition, Beijing, China, pp. 121 -126 , Aug 20-24, 2018 Conference
7 Cornia, Marcella; Baraldi, Lorenzo; Serra, Giuseppe; Cucchiara, Rita "SAM: Pushing the Limits of Saliency Prediction Models" 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, pp. 1890 -1892 , June 18-22, 2018 Conference
8 Cornia, Marcella; Baraldi, Lorenzo; Serra, Giuseppe; Cucchiara, Rita "Predicting Human Eye Fixations via an LSTM-based Saliency Attentive Model" IEEE TRANSACTIONS ON IMAGE PROCESSING, vol. 27, pp. 5142 -5154 , 2018
DOI: 10.1109/TIP.2018.2851672 Journal
9 Cornia, Marcella; Abati, Davide; Baraldi, Lorenzo; Palazzi, Andrea; Calderara, Simone; Cucchiara, Rita "Attentive Models in Vision: Computing Saliency Maps in the Deep Learning Era" INTELLIGENZA ARTIFICIALE, pp. 1 -15 , 2018 Journal
10 Cornia, Marcella; Baraldi, Lorenzo; Rezazadegan Tavakoli, Hamed; Cucchiara, Rita "Towards Cycle-Consistent Models for Text and Image Retrieval" European Conference on Computer Vision (ECCV) Workshops, Munich, Germany, 8-14 September 2018, 2018 Conference
11 Carraggi, Angelo; Cornia, Marcella; Baraldi, Lorenzo; Cucchiara, Rita "Visual-Semantic Alignment Across Domains Using a Semi-Supervised Approach" European Conference on Computer Vision (ECCV) Workshops, Munich, Germany, 8-14 September 2018, 2018 Conference
12 Tomei, Matteo; Baraldi, Lorenzo; Cornia, Marcella; Cucchiara, Rita "What was Monet seeing while painting? Translating artworks to photo-realistic images" European Conference on Computer Vision (ECCV) Workshops, Munich, Germany, 8-14 September 2018, 2018 Conference
13 Bolelli, Federico; Cancilla, Michele; Baraldi, Lorenzo; Grana, Costantino "Connected Components Labeling on DRAGs: Implementation and Reproducibility Notes" Proceedings of the 25th International Conference on Pattern Recognition Workshops, Beijing, China, Aug 20-24, 2018 Conference
14 Alletto, Stefano; Cornia, Marcella; Baraldi, Lorenzo; Serra, Giuseppe; Cucchiara, Rita "Recognizing social relationships from an egocentric vision perspective" Multimodal Behavior Analysis in the Wild, pp. 1 -10 , 2018 Chapter in Book
15 Bolelli, Federico; Cancilla, Michele; Baraldi, Lorenzo; Grana, Costantino "Connected Components Labeling on DRAGs: Implementation and Reproducibility Notes" RRPR 2018: 2nd Workshop on Reproducible Research in Pattern Recognition, Beijing, China, Aug 20-24, 2018 Conference
16 Bolelli, Federico; Baraldi, Lorenzo; Grana, Costantino "A Hierarchical Quasi-Recurrent approach to Video Captioning" Proceedings of the 3rd IEEE International Conference on Image Processing, Applications and Systems, Sophia Antipolis, France, 12-14 December 2018, 2018 Conference
17 Corbelli, Andrea; Baraldi, Lorenzo; Balducci, Fabrizio; Grana, Costantino; Cucchiara, Rita "Layout analysis and content classification in digitized books" Digital Libraries and Multimedia Archives, vol. 701, Firenze, pp. 153 -165 , Feb. 4-5, 2017
DOI: 10.1007/978-3-319-56300-8_14 Conference
18 Baraldi, Lorenzo; Grana, Costantino; Cucchiara, Rita "Hierarchical Boundary-Aware Neural Encoder for Video Captioning" Computer Vision and Pattern Recognition (CVPR), 2017 IEEE Conference on, Honolulu, Hawaii, pp. 3185 -3194 , July, 22-25, 2017
DOI: 10.1109/CVPR.2017.339 Conference
19 Cornia, Marcella; Baraldi, Lorenzo; Serra, Giuseppe; Cucchiara, Rita "Visual Saliency for Image Captioning in New Multimedia Services" Multimedia & Expo Workshops (ICMEW), 2017 IEEE International Conference on, Hong Kong, pp. 309 -314 , July 10-14, 2017, 2017
DOI: 10.1109/ICMEW.2017.8026277 Conference
20 Baraldi, Lorenzo; Grana, Costantino; Cucchiara, Rita "NeuralStory: an Interactive Multimedia System for Video Indexing and Re-use" Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing, Florence, Italy, 19-21 June 2017, 2017
DOI: 10.1145/3095713.3095735 Conference
21 Pini, Stefano; Cornia, Marcella; Baraldi, Lorenzo; Cucchiara, Rita "Towards Video Captioning with Naming: a Novel Dataset and a Multi-Modal Approach" Image Analysis and Processing - ICIAP 2017, vol. 10485, Catania, Italy, pp. 384 -395 , 11-15 September 2017, 2017
DOI: 10.1007/978-3-319-68548-9_36 Conference
22 Cornia, Marcella; Abati, Davide; Baraldi, Lorenzo; Palazzi, Andrea; Calderara, Simone; Cucchiara, Rita "Attentive Models in Vision: Computing Saliency Maps in the Deep Learning Era" AI*IA 2017 Advances in Artificial Intelligence, vol. 10640, Bari, Italy, pp. 387 -399 , November 14-17, 2017, 2017
DOI: 10.1007/978-3-319-70169-1_29 Conference
23 Pini, Stefano; Ben Ahmed, Olfa; Cornia, Marcella; Baraldi, Lorenzo; Cucchiara, Rita; Huet, Benoit "Modeling Multimodal Cues in a Deep Learning-based Framework for Emotion Recognition in the Wild" Proceedings of the 19th ACM International Conference on Multimodal Interaction, Glasgow, Scotland, pp. 536 -543 , November 13-17th, 2017, 2017
DOI: 10.1145/3136755.3143006 Conference
24 Baraldi, Lorenzo; Grana, Costantino; Cucchiara, Rita "A Video Library System Using Scene Detection and Automatic Tagging" Digital Libraries and Archives, vol. 733, Modena, January 26-27, 2017, 2017
DOI: 10.1007/978-3-319-68130-6_5 Conference
25 Baraldi, Lorenzo; Grana, Costantino; Messina, Alberto; Cucchiara, Rita "A Browsing and Retrieval System for Broadcast Videos using Scene Detection and Automatic Annotation" Proceedings of the 2016 ACM on Multimedia Conference, Amsterdam, The Netherlands, pp. 733 -734 , 15 - 19 October 2016, 2016
DOI: 10.1145/2964284.2973825 Conference
26 Cornia, Marcella; Baraldi, Lorenzo; Serra, Giuseppe; Cucchiara, Rita "A Deep Multi-Level Network for Saliency Prediction" Pattern Recognition (ICPR), 2016 23rd International Conference on, Cancun, Mexico, 4-8 Dec 2016, 2016
DOI: 10.1109/ICPR.2016.7900174 Conference
27 Baraldi, Lorenzo; Grana, Costantino; Cucchiara, Rita "Analysis and Re-use of Videos in Educational Digital Libraries with Automatic Scene Detection" Digital Libraries on the Move, vol. 612, Bolzano, pp. 155 -164 , Jan. 29-30, 2016
DOI: 10.1007/978-3-319-41938-1_16 Conference
28 Paci, Francesco; Baraldi, Lorenzo; Serra, Giuseppe; Cucchiara, Rita; Benini, Luca "Context Change Detection for an Ultra-Low Power Low-Resolution Ego-Vision Imager" Computer Vision ECCV 2016 Workshops, vol. 9913, Amsterdam, The Netherlands, pp. 589 -602 , October 8-10, 2016, 2016
DOI: 10.1007/978-3-319-46604-0_42 Conference
29 Corbelli, Andrea; Baraldi, Lorenzo; Grana, Costantino; Cucchiara, Rita "Historical Document Digitization through Layout Analysis and Deep Content Classification" Proceedings of the 23rd International Conference on Pattern Recognition, Cancun, Mexico, 4-8 Dec 2016, 2016
DOI: 10.1109/ICPR.2016.7900272 Conference
30 Cornia, Marcella; Baraldi, Lorenzo; Serra, Giuseppe; Cucchiara, Rita "Multi-Level Net: a Visual Saliency Prediction Model" Computer Vision ECCV 2016 Workshops, vol. 9914, Amsterdam, The Netherlands, pp. 302 -315 , October 9th, 2016, 2016
DOI: 10.1007/978-3-319-48881-3_21 Conference
31 Baraldi, Lorenzo; Grana, Costantino; Cucchiara, Rita "Recognizing and Presenting the Storytelling Video Structure with Deep Multimodal Networks" IEEE TRANSACTIONS ON MULTIMEDIA, vol. 19, pp. 955 -968 , 2016
DOI: 10.1109/TMM.2016.2644872 Journal
32 Baraldi, Lorenzo; Grana, Costantino; Cucchiara, Rita "Scene-driven Retrieval in Edited Videos using Aesthetic and Semantic Deep Features" Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval, New York, USA, pp. 23 -29 , 6-9 Giugno 2016, 2016
DOI: 10.1145/2911996.2912012 Conference
33 Baraldi, Lorenzo; Grana, Costantino; Borghi, Guido; Vezzani, Roberto; Cucchiara, Rita "Shot, scene and keyframe ordering for interactive video re-use" Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, vol. 4, Rome, pp. 626 -631 , Feb 27-29, 2016, 2016
DOI: 10.5220/0005768706260631 Conference
34 Grana, Costantino; Baraldi, Lorenzo; Bolelli, Federico "Optimized Connected Components Labeling with Pixel Prediction" Advanced Concepts for Intelligent Vision Systems, vol. 10016, Lecce, Italy, pp. 431 -440 , Oct 24-27, 2016
DOI: 10.1007/978-3-319-48680-2_38 Conference
35 Grana, Costantino; Bolelli, Federico; Baraldi, Lorenzo; Vezzani, Roberto "YACCLAB - Yet Another Connected Components Labeling Benchmark" Proceedings of the 23rd International Conference on Pattern Recognition, Cancun, Mexico, pp. 3109 -3114 , Dec 4-8, 2016
DOI: 10.1109/ICPR.2016.7900112 Conference
36 Baraldi Lorenzo; Grana Costantino; Cucchiara Rita "A Deep Siamese Network for Scene Detection in Broadcast Videos" Proceedings of the 23rd ACM international conference on Multimedia, Brisbane, Australia, pp. 1199 -1202 , 26-30 October 2015, 2015
DOI: 10.1145/2733373.2806316 Conference
37 Baraldi, Lorenzo; Paci, Francesco; Serra, Giuseppe; Cucchiara, Rita "Gesture Recognition using Wearable Vision Sensors to Enhance Visitors' Museum Experiences" IEEE SENSORS JOURNAL, vol. 15, pp. 2705 -2714 , 2015
DOI: 10.1109/JSEN.2015.2411994 Journal
38 Baraldi, Lorenzo; Grana, Costantino; Cucchiara, Rita "Measuring scene detection performance" Pattern Recognition and Image Analysis, vol. 9117, Santiago de Compostela, Spain, pp. 395 -403 , 17-19 June 2015, 2015
DOI: 10.1007/978-3-319-19390-8_45 Conference
39 Baraldi, Lorenzo; Grana, Costantino; Cucchiara, Rita "Scene segmentation using temporal clustering for accessing and re-using broadcast video" Proceedings - IEEE International Conference on Multimedia and Expo, vol. 2015-, Torino, Italia, pp. 1 -6 , 2015, 2015
DOI: 10.1109/ICME.2015.7177476 Conference
40 Baraldi, Lorenzo; Grana, Costantino; Cucchiara, Rita "Shot and Scene Detection via Hierarchical Clustering for Re-using Broadcast Video" Computer Analysis of Images and Patterns. Part I, vol. 9256, Valletta, Malta, pp. 801 -811 , 2-4 September 2015, 2015
DOI: 10.1007/978-3-319-23192-1_67 Conference
41 Baraldi, Lorenzo; Paci, Francesco; Serra, Giuseppe; Benini, Luca; Cucchiara, Rita "Gesture Recognition in Ego-Centric Videos using Dense Trajectories and Hand Segmentation" Computer Vision and Pattern Recognition Workshops (CVPRW), 2014 IEEE Conference on, Columbus, Ohio, 23-28 June 2014, 2014
DOI: 10.1109/CVPRW.2014.107 Conference
42 Serra, Giuseppe; Camurri, Marco; Baraldi, Lorenzo; Michela, Benedetti; Cucchiara, Rita "Hand Segmentation for Gesture Recognition in EGO-Vision" Proceedings of the 3rd ACM international workshop on Interactive multimedia on mobile & portable devices, Barcelona, Spain, pp. 31 -36 , 21 October 2013, 2013
DOI: 10.1145/2505483.2505490 Conference