{"id":1502,"date":"2024-02-05T14:45:23","date_gmt":"2024-02-05T13:45:23","guid":{"rendered":"https:\/\/fondazione-fair.it\/tp2-vision-language-and-multimodal-challenges\/"},"modified":"2024-09-23T15:39:11","modified_gmt":"2024-09-23T13:39:11","slug":"tp2-vision-language-and-multimodal-challenges","status":"publish","type":"page","link":"https:\/\/fondazione-fair.it\/en\/transversal-projects\/tp2-vision-language-and-multimodal-challenges\/","title":{"rendered":"TP2: Vision, Language and Multimodal Challenges"},"content":{"rendered":"<section class=\"l-section wpb_row us_custom_2df7d2d9 sezione-intro-singolo-tp height_medium\"><div class=\"l-section-h i-cf\"><div class=\"g-cols vc_row via_flex valign_top type_default stacking_default\"><div class=\"vc_col-sm-12 wpb_column vc_column_container\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\"><div class=\"g-cols wpb_row via_flex valign_top type_default stacking_default\"><div class=\"vc_col-sm-6 wpb_column vc_column_container\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\"><div class=\"wpb_text_column\"><div class=\"wpb_wrapper\"><p>PIs:<\/p>\n<ul>\n<li>PIs: Rita Cucchiara (CNR \u2013 Universit\u00e0 di Modena e Reggio)<\/li>\n<li>Roberto Navigli (La Sapienza Universit\u00e0 di Roma)<\/li>\n<\/ul>\n<\/div><\/div><\/div><\/div><\/div><div class=\"vc_col-sm-6 wpb_column vc_column_container\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\"><div class=\"wpb_text_column\"><div class=\"wpb_wrapper\"><p>Spoke 2: <a href=\"https:\/\/fondazione-fair.it\/en\/spoke\/spoke-2-integrative-ai\/\">Integrative AI<\/a><br \/>Spoke 3: <a href=\"https:\/\/fondazione-fair.it\/en\/spoke\/spoke-3-resilient-ai\/\">Resilient AI<\/a><br \/>Spoke 4: <a href=\"https:\/\/fondazione-fair.it\/en\/spoke\/spoke-4-adaptive-ai\/\">Adaptive AI<\/a><br \/>Spoke 5: <a href=\"https:\/\/fondazione-fair.it\/en\/spoke\/spoke-5-high-quality-ai\/\">High quality AI<\/a><br \/>Spoke 6: <a href=\"https:\/\/fondazione-fair.it\/en\/spoke\/spoke-6-symbiotic-ai\/\">Symbiotic AI<\/a><br \/>Spoke 8: <a href=\"https:\/\/fondazione-fair.it\/en\/spoke\/spoke-8-pervasive-ai\/\">Pervasive AI<\/a><br \/>Spoke 10: <a href=\"https:\/\/fondazione-fair.it\/en\/spoke\/spoke-10-bio-socio-cognitive-ai\/\">Bio-socio-cognitive AI<\/a><\/p>\n<\/div><\/div><\/div><\/div><\/div><\/div><\/div><\/div><\/div><\/div><\/div><\/section><section class=\"l-section wpb_row height_auto\"><div class=\"l-section-h i-cf\"><div class=\"g-cols vc_row via_flex valign_top type_default stacking_default\"><div class=\"vc_col-sm-12 wpb_column vc_column_container\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\"><div class=\"w-separator size_custom with_line width_default thick_1 style_solid color_border align_center\" style=\"height:2px\"><div class=\"w-separator-h\"><\/div><\/div><\/div><\/div><\/div><\/div><\/div><\/section><section class=\"l-section wpb_row us_custom_2df7d2d9 height_medium\"><div class=\"l-section-h i-cf\"><div class=\"g-cols vc_row via_flex valign_top type_default stacking_default\"><div class=\"vc_col-sm-12 wpb_column vc_column_container\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\"><div class=\"g-cols wpb_row via_flex valign_top type_default stacking_default\"><div class=\"vc_col-sm-12 wpb_column vc_column_container\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\"><div class=\"wpb_text_column\"><div class=\"wpb_wrapper\"><p>Computer Vision, Natural Language Processing, and Multimodal data processing are key disciplines in AI, that are recently becoming strictly connected by the introduction of so-called Foundation models, in the form of powerful language-only and language-vision models which integrate visual information both as input and output, while providing a dialogue-based interface and instruction-following capabilities.<br \/> In this context, the FAIR Transversal Project (TP) on \u201cVision, Language and Multimodal Challenges\u201d aims at bringing together the Italian scientific and industrial community and achieve important breakthroughs on the theoretical and the applicative sides. Ultimately, the objective of the TP is the development of a family of language models that have the Italian language as a first-class citizen as well as supporting multimodal inputs and outputs. The TP also covers the creation of language-only and multimodal benchmarks curated by Italian experts and specifically tailored for the Italian language. All in all, the TP will empower the Italian scientific community with the fundamental skills needed to train and evaluate large-scale models both from a theoretical and a practical point of view. For this reason, the activities are carried out in collaboration with National HPC infrastructures, and especially with CINECA, who is providing computational support to the community through ISCRA-B projects and dedicated budgets on the Leonardo infrastructure.    <\/p>\n<\/div><\/div><div class=\"w-separator size_small\"><\/div><div class=\"w-btn-wrapper align_center hide_on_default hide_on_laptops hide_on_tablets hide_on_mobiles\"><a class=\"w-btn us-btn-style_2\" href=\"#\"><span class=\"w-btn-label\">Download the presentation<\/span><\/a><\/div><\/div><\/div><\/div><\/div><\/div><\/div><\/div><\/div><\/div><\/section>\n","protected":false},"excerpt":{"rendered":"PIs: PIs: Rita Cucchiara (CNR \u2013 Universit\u00e0 di Modena e Reggio) Roberto Navigli (La Sapienza Universit\u00e0 di Roma) Spoke 2: Integrative AISpoke 3: Resilient AISpoke 4: Adaptive AISpoke 5: High quality AISpoke 6: Symbiotic AISpoke 8: Pervasive AISpoke 10: Bio-socio-cognitive AI Computer Vision, Natural Language Processing, and Multimodal data processing are key disciplines in AI,...","protected":false},"author":1,"featured_media":0,"parent":1541,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-1502","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/fondazione-fair.it\/en\/wp-json\/wp\/v2\/pages\/1502","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/fondazione-fair.it\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/fondazione-fair.it\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/fondazione-fair.it\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/fondazione-fair.it\/en\/wp-json\/wp\/v2\/comments?post=1502"}],"version-history":[{"count":7,"href":"https:\/\/fondazione-fair.it\/en\/wp-json\/wp\/v2\/pages\/1502\/revisions"}],"predecessor-version":[{"id":2532,"href":"https:\/\/fondazione-fair.it\/en\/wp-json\/wp\/v2\/pages\/1502\/revisions\/2532"}],"up":[{"embeddable":true,"href":"https:\/\/fondazione-fair.it\/en\/wp-json\/wp\/v2\/pages\/1541"}],"wp:attachment":[{"href":"https:\/\/fondazione-fair.it\/en\/wp-json\/wp\/v2\/media?parent=1502"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}