{"id":130446,"date":"2024-06-25T10:00:25","date_gmt":"2024-06-25T10:00:25","guid":{"rendered":"https:\/\/blogs.nvidia.com\/?p=72720"},"modified":"2024-06-25T10:00:25","modified_gmt":"2024-06-25T10:00:25","slug":"evolutionaryscale-debuts-with-esm3-generative-ai-model-for-protein-design","status":"publish","type":"post","link":"http:\/\/webdomino.net\/index.php\/nvidia\/evolutionaryscale-debuts-with-esm3-generative-ai-model-for-protein-design\/","title":{"rendered":"EvolutionaryScale Debuts With ESM3 Generative AI Model for Protein Design"},"content":{"rendered":"<div id=\"bsf_rt_marker\"><\/div><p>Generative AI has revolutionized software development with prompt-based code generation \u2014 protein design is next.<\/p>\n<p>EvolutionaryScale today announced the release of its ESM3 model, the third-generation ESM model, which simultaneously reasons over the sequence, structure and functions of proteins, giving protein discovery engineers a programmable platform.<\/p>\n<p>The startup, which emerged from the Meta FAIR (Fundamental AI Research) unit, recently landed funding led by Lux Capital, Nat Friedman and Daniel Gross, with investment from NVIDIA.<\/p>\n<p>At the forefront of programmable biology, EvolutionaryScale can assist researchers in engineering proteins that can help target cancer cells, find alternatives to harmful plastics, drive environmental mitigations and more.<\/p>\n<p>EvolutionaryScale is pioneering the frontier of programmable biology with the scale-out model development of ESM3, which used <a  href=\"https:\/\/www.nvidia.com\/en-us\/data-center\/h100\/\">NVIDIA H100 Tensor Core GPUs<\/a> for the most compute ever put into a biological foundation model. The 98 billion parameter ESM3 model uses roughly 25x more flops and 60x more data than its predecessor, ESM2.<\/p>\n<p>The company, which developed a database of more than 2 billion protein sequences to train its AI model, offers technology that can provide clues applicable to drug development, disease eradication and, literally, how humans have evolved at scale as a species \u2014 as its name suggests \u2014 for drug discovery researchers.<\/p>\n<h2><b>Accelerating In Silico Biological Research With ESM3<\/b><\/h2>\n<p>With leaps in training data, EvolutionaryScale aims to accelerate protein discovery with ESM3.<\/p>\n<p>The model was trained on almost 2.8 billion protein sequences sampled from organisms and biomes, allowing scientists to prompt the model to identify and validate new proteins with increasing levels of accuracy.<\/p>\n<p>ESM3 offers significant updates over previous versions. The model is natively generative, and it is an \u201call to all\u201d model, meaning structure and function annotations can be provided as input rather than just as output.<\/p>\n<p>Once it\u2019s made publicly available, scientists can fine-tune this base model to construct purpose-built models based on their own proprietary data. The boost in protein engineering capabilities due to ESM3\u2019s large-scale generative training across enormous amounts of data offers a time-traveling machine for in silico biological research.<\/p>\n<h2><b>Driving the Next Big Breakthroughs With NVIDIA BioNeMo<\/b><\/h2>\n<p>ESM-3 provides biologists and protein designers with a generative AI boost, helping improve their engineering and understanding of proteins. With simple prompts, it can generate new proteins with a provided scaffold, self-improve its protein design based on feedback and design proteins based on the functionality that the user indicates. These capabilities can be used in tandem in any combination to provide chain-of-thought protein design as if the user were messaging a researcher who had memorized the intricate three-dimensional meaning of every protein sequence known to humans and had learned the language fluently, enabling users to iterate back and forth.<\/p>\n<p>\u201cIn our internal testing we\u2019ve been impressed by the ability of ESM3 to creatively respond to a variety of complex prompts,\u201d said Tom Sercu, co-founder and VP of engineering at EvolutionaryScale. \u201cIt was able to solve an extremely hard protein design problem to create a novel Green Fluorescent Protein. We expect ESM3 will help scientists accelerate their work and open up new possibilities \u2014 we\u2019re looking forward to seeing how it will contribute to future research in the life sciences.\u201d<\/p>\n<p>EvolutionaryScale will be opening an API for closed beta today and code and weights are available for a small open version of ESM3 for non-commercial use. This version is coming soon to <a  href=\"https:\/\/www.nvidia.com\/en-us\/clara\/bionemo\/\">NVIDIA BioNeMo<\/a>, a generative AI platform for drug discovery. The full ESM3 family of models will soon be available to select customers as an <a  href=\"https:\/\/nam11.safelinks.protection.outlook.com\/?url=https%3A%2F%2Furl.avanan.click%2Fv2%2F___https%3A%2F%2Fwww.nvidia.com%2Fen-us%2Fai%2F%2523referrer%3Dai-subdomain%3Fncid%3Dpa-srch-goog-772333%26_bt%3D697697685508%26_bk%3Dnvidia%2520nim%26_bm%3De%26_bn%3Dg%26_bg%3D165151891361%26gad_source%3D1%26gclid%3DEAIaIQobChMI5pHT7fvjhgMVVXN_AB1KOQFuEAAYASAAEgKvWfD_BwE___.YXAzOm91dGNhc3Q6YTpvOjViNjRiMzE4MDU2MWMwZDcyNThmMmI4NWZhYTViNTJiOjY6NDI2ZTphZWVjMmY1N2JjMjFiM2NhODBiNmFmMjFiZTM2YTQyZWM1NDMwZTZhODdmZTYwOWEyZGRiODc2MWJlMGY2MzUxOmg6VA&amp;data=05%7C02%7Crkelleher%40nvidia.com%7C789b16235c954beed3a908dc8ff9ab8b%7C43083d15727340c1b7db39efd9ccc17a%7C0%7C0%7C638543549716443890%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&amp;sdata=wD96MHFHOJjySVQjvo%2FqotZ6KMUZX7Lcr%2FMHAbyGW%2FU%3D&amp;reserved=0\">NVIDIA NIM<\/a> microservice, run-time optimized in collaboration with NVIDIA, and supported by an <a  href=\"https:\/\/www.nvidia.com\/en-us\/data-center\/products\/ai-enterprise\/\">NVIDIA AI Enterprise<\/a> software license for testing at ai.nvidia.com.<\/p>\n<p>The computing power required to train these models is growing exponentially. ESM3 was trained using the <a  href=\"https:\/\/andromeda.ai\/\">Andromeda cluster<\/a>, which uses NVIDIA H100 GPUs and NVIDIA Quantum-2 InfiniBand networking.<\/p>\n<p>The ESM3 model will be available on select partner platforms and NVIDIA BioNeMo.<\/p>\n<p><i>See <\/i><a  href=\"https:\/\/nam11.safelinks.protection.outlook.com\/?url=https%3A%2F%2Fwww.nvidia.com%2Fen-us%2Fabout-nvidia%2Flegal-info%2F&amp;data=05%7C02%7Cscmartin%40nvidia.com%7C83515b5492594c57a3cb08dc94b213d0%7C43083d15727340c1b7db39efd9ccc17a%7C0%7C0%7C638548739762646477%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&amp;sdata=KzQTSwL94NtcZYgStTWnnmHHHy53cbxt0r7LKK5pUdQ%3D&amp;reserved=0\"><i>notice<\/i><\/a><i> regarding software product information.<\/i><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Generative AI has revolutionized software development with prompt-based code generation \u2014 protein design is next. EvolutionaryScale today announced the release of its ESM3 model, the third-generation ESM model, which simultaneously reasons over the sequence, structure and functions of proteins, giving protein discovery engineers a programmable platform. The startup, which emerged from the Meta FAIR (Fundamental\t<a class=\"read-more\" href=\"https:\/\/blogs.nvidia.com\/blog\/evolutionaryscale-esm3-generative-ai-nim-bionemo-h100\/\"><br \/>\n\t\tRead Article\t\t<span data-icon=\"y\"><\/span><br \/>\n\t<\/a><\/p>\n","protected":false},"author":414,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[343],"tags":[13648,13649,13647,6],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.6 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>EvolutionaryScale Debuts With ESM3 Generative AI Model for Protein Design - WebDomino.NET<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/webdomino.net\/index.php\/nvidia\/evolutionaryscale-debuts-with-esm3-generative-ai-model-for-protein-design\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"EvolutionaryScale Debuts With ESM3 Generative AI Model for Protein Design - WebDomino.NET\" \/>\n<meta property=\"og:description\" content=\"Generative AI has revolutionized software development with prompt-based code generation \u2014 protein design is next. EvolutionaryScale today announced the release of its ESM3 model, the third-generation ESM model, which simultaneously reasons over the sequence, structure and functions of proteins, giving protein discovery engineers a programmable platform. The startup, which emerged from the Meta FAIR (Fundamental  Read Article\" \/>\n<meta property=\"og:url\" content=\"https:\/\/webdomino.net\/index.php\/nvidia\/evolutionaryscale-debuts-with-esm3-generative-ai-model-for-protein-design\/\" \/>\n<meta property=\"og:site_name\" content=\"WebDomino.NET\" \/>\n<meta property=\"article:published_time\" content=\"2024-06-25T10:00:25+00:00\" \/>\n<meta name=\"author\" content=\"Anthony Costa\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Anthony Costa\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/webdomino.net\/index.php\/nvidia\/evolutionaryscale-debuts-with-esm3-generative-ai-model-for-protein-design\/\",\"url\":\"https:\/\/webdomino.net\/index.php\/nvidia\/evolutionaryscale-debuts-with-esm3-generative-ai-model-for-protein-design\/\",\"name\":\"EvolutionaryScale Debuts With ESM3 Generative AI Model for Protein Design - WebDomino.NET\",\"isPartOf\":{\"@id\":\"https:\/\/webdomino.net\/#website\"},\"datePublished\":\"2024-06-25T10:00:25+00:00\",\"dateModified\":\"2024-06-25T10:00:25+00:00\",\"author\":{\"@id\":\"https:\/\/webdomino.net\/#\/schema\/person\/b6b8025d983b89b5ef592d152aed72ac\"},\"breadcrumb\":{\"@id\":\"https:\/\/webdomino.net\/index.php\/nvidia\/evolutionaryscale-debuts-with-esm3-generative-ai-model-for-protein-design\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/webdomino.net\/index.php\/nvidia\/evolutionaryscale-debuts-with-esm3-generative-ai-model-for-protein-design\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/webdomino.net\/index.php\/nvidia\/evolutionaryscale-debuts-with-esm3-generative-ai-model-for-protein-design\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/webdomino.net\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"EvolutionaryScale Debuts With ESM3 Generative AI Model for Protein Design\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/webdomino.net\/#website\",\"url\":\"https:\/\/webdomino.net\/\",\"name\":\"WebDomino.NET\",\"description\":\"Global NEWS WordPress site\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/webdomino.net\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/webdomino.net\/#\/schema\/person\/b6b8025d983b89b5ef592d152aed72ac\",\"name\":\"Anthony Costa\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/webdomino.net\/#\/schema\/person\/image\/\",\"url\":\"http:\/\/1.gravatar.com\/avatar\/1436fe4f61493761c524e4d5b18deb54?s=96&d=mm&r=g\",\"contentUrl\":\"http:\/\/1.gravatar.com\/avatar\/1436fe4f61493761c524e4d5b18deb54?s=96&d=mm&r=g\",\"caption\":\"Anthony Costa\"},\"sameAs\":[\"https:\/\/blogs.nvidia.com\"],\"url\":\"http:\/\/webdomino.net\/index.php\/author\/anthony-costa\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"EvolutionaryScale Debuts With ESM3 Generative AI Model for Protein Design - WebDomino.NET","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/webdomino.net\/index.php\/nvidia\/evolutionaryscale-debuts-with-esm3-generative-ai-model-for-protein-design\/","og_locale":"en_US","og_type":"article","og_title":"EvolutionaryScale Debuts With ESM3 Generative AI Model for Protein Design - WebDomino.NET","og_description":"Generative AI has revolutionized software development with prompt-based code generation \u2014 protein design is next. EvolutionaryScale today announced the release of its ESM3 model, the third-generation ESM model, which simultaneously reasons over the sequence, structure and functions of proteins, giving protein discovery engineers a programmable platform. The startup, which emerged from the Meta FAIR (Fundamental  Read Article","og_url":"https:\/\/webdomino.net\/index.php\/nvidia\/evolutionaryscale-debuts-with-esm3-generative-ai-model-for-protein-design\/","og_site_name":"WebDomino.NET","article_published_time":"2024-06-25T10:00:25+00:00","author":"Anthony Costa","twitter_misc":{"Written by":"Anthony Costa","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/webdomino.net\/index.php\/nvidia\/evolutionaryscale-debuts-with-esm3-generative-ai-model-for-protein-design\/","url":"https:\/\/webdomino.net\/index.php\/nvidia\/evolutionaryscale-debuts-with-esm3-generative-ai-model-for-protein-design\/","name":"EvolutionaryScale Debuts With ESM3 Generative AI Model for Protein Design - WebDomino.NET","isPartOf":{"@id":"https:\/\/webdomino.net\/#website"},"datePublished":"2024-06-25T10:00:25+00:00","dateModified":"2024-06-25T10:00:25+00:00","author":{"@id":"https:\/\/webdomino.net\/#\/schema\/person\/b6b8025d983b89b5ef592d152aed72ac"},"breadcrumb":{"@id":"https:\/\/webdomino.net\/index.php\/nvidia\/evolutionaryscale-debuts-with-esm3-generative-ai-model-for-protein-design\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/webdomino.net\/index.php\/nvidia\/evolutionaryscale-debuts-with-esm3-generative-ai-model-for-protein-design\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/webdomino.net\/index.php\/nvidia\/evolutionaryscale-debuts-with-esm3-generative-ai-model-for-protein-design\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/webdomino.net\/"},{"@type":"ListItem","position":2,"name":"EvolutionaryScale Debuts With ESM3 Generative AI Model for Protein Design"}]},{"@type":"WebSite","@id":"https:\/\/webdomino.net\/#website","url":"https:\/\/webdomino.net\/","name":"WebDomino.NET","description":"Global NEWS WordPress site","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/webdomino.net\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/webdomino.net\/#\/schema\/person\/b6b8025d983b89b5ef592d152aed72ac","name":"Anthony Costa","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/webdomino.net\/#\/schema\/person\/image\/","url":"http:\/\/1.gravatar.com\/avatar\/1436fe4f61493761c524e4d5b18deb54?s=96&d=mm&r=g","contentUrl":"http:\/\/1.gravatar.com\/avatar\/1436fe4f61493761c524e4d5b18deb54?s=96&d=mm&r=g","caption":"Anthony Costa"},"sameAs":["https:\/\/blogs.nvidia.com"],"url":"http:\/\/webdomino.net\/index.php\/author\/anthony-costa\/"}]}},"_links":{"self":[{"href":"http:\/\/webdomino.net\/index.php\/wp-json\/wp\/v2\/posts\/130446"}],"collection":[{"href":"http:\/\/webdomino.net\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/webdomino.net\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/webdomino.net\/index.php\/wp-json\/wp\/v2\/users\/414"}],"replies":[{"embeddable":true,"href":"http:\/\/webdomino.net\/index.php\/wp-json\/wp\/v2\/comments?post=130446"}],"version-history":[{"count":3,"href":"http:\/\/webdomino.net\/index.php\/wp-json\/wp\/v2\/posts\/130446\/revisions"}],"predecessor-version":[{"id":130451,"href":"http:\/\/webdomino.net\/index.php\/wp-json\/wp\/v2\/posts\/130446\/revisions\/130451"}],"wp:attachment":[{"href":"http:\/\/webdomino.net\/index.php\/wp-json\/wp\/v2\/media?parent=130446"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/webdomino.net\/index.php\/wp-json\/wp\/v2\/categories?post=130446"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/webdomino.net\/index.php\/wp-json\/wp\/v2\/tags?post=130446"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}