{"id":15369,"date":"2023-11-30T18:49:09","date_gmt":"2023-11-30T18:49:09","guid":{"rendered":"http:\/\/scannn.com\/a-decade-of-advancing-the-state-of-the-art-in-ai-through-open-research\/"},"modified":"2023-11-30T18:49:09","modified_gmt":"2023-11-30T18:49:09","slug":"a-decade-of-advancing-the-state-of-the-art-in-ai-through-open-research","status":"publish","type":"post","link":"https:\/\/scannn.com\/lv\/a-decade-of-advancing-the-state-of-the-art-in-ai-through-open-research\/","title":{"rendered":"A Decade of Advancing the State-of-the-Art in AI Through Open Research"},"content":{"rendered":"


\n<\/p>\n

\n

Today we\u2019re celebrating the 10-year anniversary of Meta\u2019s Fundamental AI Research (FAIR) team. For the last decade, <\/span>FAIR<\/span><\/a> has been the source of many AI breakthroughs and a beacon for doing research in an open and responsible way. We are committed to open science and sharing our work, whether it be papers, code, models, demos or responsible use guides.\u00a0<\/span><\/p>\n

We\u2019ve made impressive strides in the past 10 years in object detection with <\/span>Segment Anything<\/span><\/a>, which recognizes objects in images. Additionally, we were among the first to pioneer techniques for unsupervised machine translation, allowing us to build a model that can translate across 100 languages without relying on English. This led to our <\/span>No Language Left Behind<\/span><\/a> breakthrough, which most recently expanded text-to-speech and speech-to-text technology to more than <\/span>1,000 languages<\/span><\/a>.\u00a0\u00a0<\/span><\/p>\n

Earlier this year we released <\/span>Llama<\/span><\/a>, an open, pre-trained large language model, followed by <\/span>Llama 2<\/span><\/a>, which is free for research and commercial use. And at Connect, we unveiled <\/span>new AI products and experiences<\/span><\/a> that are now in the hands of millions of people \u2014 the culmination of early research work that Meta\u2019s Generative AI and product teams built upon.<\/span><\/p>\n

\"Timeline<\/a><\/p>\n

Today, we\u2019re sharing our latest advancements in Ego-Exo4D, Audiobox and Seamless Communication<\/span><\/p>\n

Giving AI Models Both Egocentric and Exocentric Views<\/h2>\n

In our efforts to teach AI to perceive the world through our eyes, we\u2019ve made updates to <\/span>Ego-Exo<\/span><\/a>. The latest <\/span>Ego-Exo4D<\/span><\/a> simultaneously captures first-person (egocentric) views from a wearable camera, as well as external (exocentric) views from cameras surrounding the person. Together, these perspectives give AI models a window into what people see and hear combined with more context about the environment.\u00a0<\/span><\/p>\n

In the future, these advances in AI will allow a person wearing smart glasses to quickly pick up new skills with a virtual AI coach guiding them through a how-to video. For example, imagine watching an expert repair a bike tire, juggle a soccer ball or fold an origami swan, and then being able to map their steps to your own actions.<\/span><\/p>\n

\"Video<\/a><\/p>\n

Generating Voices and Sound Effects With Audiobox<\/h2>\n

Earlier this year, we introduced <\/span>Voicebox<\/span><\/a>, a generative AI model that can help with audio editing, sampling and styling. Now <\/span>Audiobox<\/span><\/a>, its successor, advances generative AI for audio even further. With Audiobox, you can use voice prompts or text descriptions to describe sounds or types of speech you\u2019d like to generate. For example, you could create a soundtrack with a prompt like, \u201ca running river and birds chirping.\u201d You can even generate a voice by saying, \u201ca young woman speaks with a high pitch and fast pace.\u201d Audiobox makes it easy to create custom audio for all of your projects.\u00a0<\/span><\/p>\n

Unlocking Seamless Language Translation<\/h2>\n

Building on our work with <\/span>SeamlessM4T<\/span><\/a>, we\u2019re now introducing <\/span>Seamless Communication<\/span><\/a>: a suite of AI translation models that better preserve expression across languages and translate while the speaker is still talking to improve speed.<\/span><\/p>\n

Earlier versions of language translation services often struggle to<\/span> capture tone of voice, pauses and emphasis, missing important signals that help us share emotions and intent. SeamlessExpressive is the first publicly available system that unlocks expressive cross-lingual communication. It uses a model that preserves the speaker\u2019s emotion and style, and addresses the rate and rhythm of speech. The model currently works for <\/span>English, Spanish, German, French, Italian and Chinese.\u00a0<\/span><\/p>\n

SeamlessStreaming unlocks real-time conversations with someone who speaks a different language. In contrast to conventional systems which translate when the speaker has finished their sentence, SeamlessStreaming translates while the speaker is still talking, allowing the person listening to hear a translation faster.\u00a0<\/span><\/p>\n

Meta is uniquely poised to solve AI\u2019s biggest challenges. Our investments in software, hardware and infrastructure allow us to weave learnings from our research into products that can benefit billions of people.\u00a0<\/span><\/p>\n

FAIR is a critical piece to Meta\u2019s success, and one of the only groups in the world with all the requirements to deliver true breakthroughs: some of the brightest minds in the industry, a culture of openness, and most importantly, the freedom to conduct exploratory research. This freedom has helped us stay agile and contribute to building the future of social connection.<\/span><\/p>\n

Responsible AI Research<\/h2>\n

We value responsible AI research and openness because sharing thoughtful work through the scrutiny of peers pushes us towards excellence and builds trust in our advances. It also allows us to collaborate with the wider community, which brings faster progress and a more diverse set of contributors. Learn more about how we\u2019re conducting AI research responsibly<\/a>.\u00a0<\/span><\/p>\n<\/p><\/div>\n