{"id":13781,"date":"2023-07-18T17:19:10","date_gmt":"2023-07-18T17:19:10","guid":{"rendered":"http:\/\/scannn.com\/meta-and-microsoft-introduce-the-next-generation-of-llama\/"},"modified":"2023-07-18T17:19:10","modified_gmt":"2023-07-18T17:19:10","slug":"meta-and-microsoft-introduce-the-next-generation-of-llama","status":"publish","type":"post","link":"https:\/\/scannn.com\/lv\/meta-and-microsoft-introduce-the-next-generation-of-llama\/","title":{"rendered":"Meta and Microsoft Introduce the Next Generation of Llama"},"content":{"rendered":"<p> <br \/>\n<\/p>\n<div>\n<p><span style=\"font-weight: 400\">Recent breakthroughs in AI, and generative AI in particular, have captured the public\u2019s imagination and demonstrated what those developing these technologies have long known \u2014 they have the potential to help people do incredible things, create a new era of economic and social opportunities, and give individuals, creators, and businesses new ways to express themselves and connect with people.<\/span><\/p>\n<p><span style=\"font-weight: 400\">We believe an open approach is the right one for the development of today\u2019s AI models, especially those in the generative space where the technology is rapidly advancing. By making AI models available openly, they can benefit everyone. Giving businesses, startups, entrepreneurs, and researchers access to tools developed at a scale that would be challenging to build themselves, backed by computing power they might not otherwise access, will open up a world of opportunities for them to experiment, innovate in exciting ways, and ultimately benefit from economically and socially.<\/span><\/p>\n<p><span style=\"font-weight: 400\">And we believe it\u2019s safer. Opening access to today\u2019s AI models means a generation of developers and researchers can stress test them, identifying and solving problems fast, as a community. By seeing how these tools are used by others, our own teams can learn from them, improve those tools, and fix vulnerabilities.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Meta has put exploratory research, open source, and collaboration with academic and industry partners at the heart of our AI efforts for over a decade. We\u2019ve seen first-hand how innovation in the open can lead to technologies that benefit more people. Dozens of large language models have already been released and are driving progress by developers and researchers. They\u2019re being used by businesses as core ingredients for new generative AI-powered experiences. We\u2019ve been blown away by the huge demand for Llama 1 from researchers \u2014 with more than 100,000 requests for access to the large language model \u2014 and the\u00a0 amazing things they\u2019ve achieved by <\/span><a href=\"https:\/\/github.com\/ggerganov\/llama.cpp\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400\">building on top of it<\/span><\/a><span style=\"font-weight: 400\">.<\/span><\/p>\n<p><span style=\"font-weight: 400\">We\u2019re now ready to open source the next version of Llama 2 and are making it <\/span><a href=\"http:\/\/ai.meta.com\/llama\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400\">available <\/span><span style=\"font-weight: 400\">free of charge <\/span><span style=\"font-weight: 400\">for research and commercial use<\/span><\/a><span style=\"font-weight: 400\">. We\u2019re including model weights and starting code for the pretrained model and conversational fine-tuned versions too. As Satya Nadella announced on stage at Microsoft Inspire, <\/span><span style=\"font-weight: 400\">we\u2019re taking our partnership to the next level with Microsoft as our preferred partner for Llama 2 and expanding our efforts in generative AI.<\/span><span style=\"font-weight: 400\"> Starting today, Llama 2 will be available in the Azure AI model catalog, enabling developers using Microsoft Azure to build with it and leverage their cloud-native tools for content filtering and safety features. It is also optimized to run locally on Windows, giving developers a seamless workflow as they bring generative AI experiences to customers across different platforms. Llama 2 will be available through Amazon Web Services (AWS), Hugging Face, and other providers too.<\/span><\/p>\n<p><span style=\"font-weight: 400\">People and businesses have benefited from the longstanding partnership between Microsoft and Meta. Together we\u2019ve introduced an <\/span><a href=\"https:\/\/research.facebook.com\/blog\/2017\/09\/facebook-and-microsoft-introduce-new-open-ecosystem-for-interchangeable-ai-frameworks\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400\">open ecosystem<\/span><\/a><span style=\"font-weight: 400\"> for interchangeable AI frameworks, and we\u2019ve co-authored research papers to advance the state of the art in AI. We\u2019ve collaborated to scale the adoption of <\/span><a href=\"https:\/\/ai.facebook.com\/blog\/pytorch-foundation\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400\">PyTorch<\/span><\/a><span style=\"font-weight: 400\"> \u2014 today\u2019s leading AI framework created by Meta and the AI community \u2014 on Azure, and we\u2019re among the founding members of the PyTorch Foundation. Microsoft and Meta recently joined a cohort of supporters that endorse the <\/span><a href=\"https:\/\/partnershiponai.org\/pai-announces-meta-and-microsoft-to-join-framework-for-collective-action-on-synthetic-media\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400\">Partnership on AI\u2019s framework<\/span> <\/a><span style=\"font-weight: 400\">for collective action in the creation and sharing of synthetic media. Our partnership extends outside of AI and into the metaverse too to <\/span><a href=\"https:\/\/blogs.microsoft.com\/blog\/2022\/10\/11\/microsoft-and-meta-partner-to-deliver-immersive-experiences-for-the-future-of-work-and-play\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400\">deliver immersive experiences<\/span><\/a><span style=\"font-weight: 400\"> for the future of work and play.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Now, with this expanded partnership, Microsoft and Meta are supporting an open approach to provide increased access to foundational AI technologies to the benefits of businesses globally. It\u2019s not just Meta and Microsoft that believe in democratizing access to today\u2019s AI models. We have a <\/span><a href=\"https:\/\/about.fb.com\/news\/2023\/07\/llama-2-statement-of-support\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400\">broad range of diverse supporters<\/span><\/a><span style=\"font-weight: 400\"> around the world who believe in this approach too \u2014 including companies that have given us early feedback and are excited to build new products with Llama 2, cloud providers that will include Llama 2 in their offerings for customers, research institutions who are collaborating with us on the safe and responsible deployment of large generative models, and people across tech, academia, and policy who see the benefits as we do.\u00a0<\/span><\/p>\n<h2>A Focus on Responsibility<\/h2>\n<p><span style=\"font-weight: 400\">Our open source approach promotes transparency and access. We know that while AI has brought huge advances to society, it also comes with risk. We are committed to building responsibly and are providing a number of resources to help those who use Llama 2 do so too. <\/span><\/p>\n<ul>\n<li><b>Red-Teaming Exercises: <\/b><span style=\"font-weight: 400\">Our fine-tuned models have been red-teamed \u2014 tested for safety \u2014 through internal and external efforts. The team worked to generate adversarial prompts to facilitate model fine-tuning. In addition, we commissioned third parties to conduct external adversarial testing across our fine-tuned models to similarly identify gaps in performance. These safety fine-tuning processes are iterative; we will continue to invest in safety through fine-tuning and benchmarking and plan to release updated fine-tuned models based on these efforts.<\/span><\/li>\n<li><b>Transparency Schematic: <\/b><span style=\"font-weight: 400\">We explain our fine-tuning and evaluation methods for the model and identify its shortcomings. Our transparency schematic, which is located within the <\/span><a href=\"https:\/\/ai.meta.com\/research\/publications\/llama-2-open-foundation-and-fine-tuned-chat-models\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400\">research paper<\/span><\/a><span style=\"font-weight: 400\">, discloses known challenges and issues we\u2019ve experienced and provides insight into mitigations taken and future ones we intend to explore.\u00a0<\/span><\/li>\n<li><b>Responsible Use Guide: <\/b><span style=\"font-weight: 400\">We created <\/span><a href=\"https:\/\/ai.meta.com\/llama\/responsible-use-guide\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400\">this guide<\/span><\/a><span style=\"font-weight: 400\"> as a resource to support developers with best practices for responsible development and safety evaluations. It outlines best practices reflective of current, state-of-the-art research on responsible generative AI discussed across the industry and the AI research community.<\/span><\/li>\n<li><b>Acceptable Use Policy:<\/b><span style=\"font-weight: 400\"> We put a <\/span><a href=\"http:\/\/ai.meta.com\/llama\/use-policy\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400\">policy<\/span><\/a><span style=\"font-weight: 400\"> in place that prohibits certain use cases to help ensure that these models are being used fairly and responsibly.<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400\">Meta has also created new initiatives to harness the insight and creativity of individuals, researchers, and developers around the world to get feedback on how the models are performing and how they might be improved.<\/span><\/p>\n<ul>\n<li><b>Open Innovation AI Research Community:<\/b><span style=\"font-weight: 400\"> Today, we also launched a new partnership <\/span><a href=\"https:\/\/ai.meta.com\/llama\/open-innovation-ai-research-community\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400\">program for academic researchers<\/span><\/a><span style=\"font-weight: 400\"> that aims to deepen our understanding of the responsible development and sharing of large language models. Researchers may apply to join a community of practitioners to share learnings on this important topic, and the community will form a research agenda to pursue going forward.<\/span><\/li>\n<li><b>Llama Impact Challenge: <\/b><span style=\"font-weight: 400\">We want to activate the community of innovators who aspire to use Llama to solve hard problems. We are launching a challenge to encourage a diverse set of public, non-profit, and for-profit entities to use Llama 2 to address environmental, education and other important challenges. The <\/span><a href=\"https:\/\/ai.meta.com\/llama\/llama-impact-challenge\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400\">challenge rules<\/span><\/a><span style=\"font-weight: 400\"> will be available prior to the start of it.<\/span><\/li>\n<\/ul>\n<h2>Conclusion<\/h2>\n<p><span style=\"font-weight: 400\">Throughout our company\u2019s history, we\u2019ve experienced the benefits of an open source approach when innovating in other areas of the business. Our engineers developed and shared frameworks that are now industry standards \u2014 like React, a leading framework for making web and mobile applications, and PyTorch, which is now the leading framework for AI. These became commonly used infrastructure for the entire technology industry. We believe that openly sharing today\u2019s large language models will support the development of helpful and safer generative AI too.<\/span><\/p>\n<p><span style=\"font-weight: 400\">We look forward to seeing what the world builds with Llama 2.<\/span><\/p>\n<\/p><\/div>\n<p><script async defer crossorigin=\"anonymous\" src=\"https:\/\/connect.facebook.net\/en_US\/sdk.js#xfbml=1&#038;version=v5.0\"><\/script><br \/>\n<br \/><br \/>\n<br \/><a href=\"https:\/\/about.fb.com\/news\/2023\/07\/llama-2\/\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Recent breakthroughs in AI, and generative AI in particular, have captured the public\u2019s imagination and demonstrated what those developing these technologies have long known \u2014 they have the potential to help people do incredible things, create a new era of economic and social opportunities, and give individuals, creators, and businesses new ways to express themselves [&hellip;]<\/p>\n","protected":false},"author":16,"featured_media":13782,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[123],"tags":[],"class_list":["post-13781","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-facebook"],"_links":{"self":[{"href":"https:\/\/scannn.com\/lv\/wp-json\/wp\/v2\/posts\/13781","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/scannn.com\/lv\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/scannn.com\/lv\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/scannn.com\/lv\/wp-json\/wp\/v2\/users\/16"}],"replies":[{"embeddable":true,"href":"https:\/\/scannn.com\/lv\/wp-json\/wp\/v2\/comments?post=13781"}],"version-history":[{"count":0,"href":"https:\/\/scannn.com\/lv\/wp-json\/wp\/v2\/posts\/13781\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/scannn.com\/lv\/wp-json\/wp\/v2\/media\/13782"}],"wp:attachment":[{"href":"https:\/\/scannn.com\/lv\/wp-json\/wp\/v2\/media?parent=13781"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/scannn.com\/lv\/wp-json\/wp\/v2\/categories?post=13781"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/scannn.com\/lv\/wp-json\/wp\/v2\/tags?post=13781"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}