{"id":126796,"date":"2023-03-21T15:41:25","date_gmt":"2023-03-21T15:41:25","guid":{"rendered":"https:\/\/blogs.nvidia.com\/?p=62993"},"modified":"2023-03-21T15:41:25","modified_gmt":"2023-03-21T15:41:25","slug":"mind-the-gap-large-language-models-get-smarter-with-enterprise-data","status":"publish","type":"post","link":"http:\/\/webdomino.net\/index.php\/nvidia\/mind-the-gap-large-language-models-get-smarter-with-enterprise-data\/","title":{"rendered":"Mind the Gap: Large Language Models Get Smarter With Enterprise Data"},"content":{"rendered":"

Large language models<\/a> available today are incredibly knowledgeable, but act like time capsules \u2014 the information they capture is limited to the data available when they were first trained. If trained a year ago, for example, an LLM powering an enterprise\u2019s AI chatbot won\u2019t know about the latest products and services at the business.<\/p>\n

With the NVIDIA NeMo<\/a> service, part of the newly announced NVIDIA AI Foundations<\/a> family of cloud services, enterprises can close the gap by augmenting their LLMs with proprietary data, enabling them to frequently update a model\u2019s knowledge base without having to further train it \u2014 or start from scratch.<\/p>\n

This new functionality in the NeMo service enables large language models to retrieve accurate information from proprietary data sources and generate conversational, human-like answers to user queries. With this capability, enterprises can use NeMo to customize large language models with regularly updated, domain-specific knowledge for their applications.<\/p>\n

This can help enterprises keep up with a constantly changing landscape across inventory, services and more, unlocking capabilities such as highly accurate AI chatbots, enterprise search engines and market intelligence tools.<\/p>\n

NeMo includes the ability to cite sources for the language model\u2019s responses, increasing user trust in the output. Developers using NeMo can also set up guardrails to define the AI\u2019s area of expertise, providing better control over the generated responses.<\/p>\n

Quantiphi \u2014 an AI-first digital engineering solutions and platforms company and one of NVIDIA\u2019s service delivery partners \u2014 is working with NeMo to build a modular generative AI solution called baioniq<\/a> that will help enterprises build customized LLMs to boost worker productivity. Its developer teams are creating tools that let users search up-to-date information across unstructured text, images and tables in seconds.<\/p>\n

Bringing Dark Data Into the Light<\/b><\/h2>\n

Analysts estimate that around two-thirds of enterprise data<\/a> is untapped. This so-called dark data is unused partly because it\u2019s difficult to glean meaningful insights from vast troves of information. Now, with NeMo, businesses can retrieve insights from this data using natural language queries.<\/p>\n

NeMo can help enterprises build models that can learn from and react to an evolving knowledge base \u2014 independent of the dataset that the model was originally trained on. Rather than needing to retrain an LLM to account for new information, NeMo can tap enterprise data sources for up-to-date details. Additional information can be added to expand the model\u2019s knowledge base without modifying its core capabilities of language processing and text generation.<\/p>\n

Enterprises can also use NeMo to build guardrails so that generative AI applications don\u2019t provide opinions on topics outside their defined area of expertise.<\/p>\n

Enabling a New Wave of Generative AI Applications for Enterprises<\/b><\/h2>\n

By customizing an LLM with business data, enterprises can make their AI applications agile and responsive to new developments.\u00a0<\/b><\/p>\n

    \n
  • Chatbots: <\/b>Many enterprises already use AI chatbots to power basic customer interactions on their websites. With NeMo, companies could build virtual subject-matter experts specific to their domains.<\/li>\n
  • Customer service: <\/b>Companies could update NeMo models with details about their latest products, helping live service representatives more easily answer customer questions with precise, up-to-date information.<\/li>\n
  • Enterprise search: <\/b>Businesses have a wealth of knowledge across the organization, including technical documentation, company policies and IT support articles. Employees could query a NeMo-powered internal search engine to retrieve information faster and more easily.<\/li>\n
  • Market intelligence: <\/b>The financial industry collects insights about global markets, public companies and economic trends. By connecting an LLM to a regularly updated database, investors and other experts could quickly identify useful details from a large set of information, such as regulatory documents, recordings of earnings calls or financial statements.<\/li>\n<\/ul>\n

    Enterprises interested in adding generative AI capabilities to their applications can apply for early access<\/a> to the NeMo service.<\/p>\n

    Watch NVIDIA founder and CEO Jensen Huang discuss NVIDIA AI Foundations<\/a> in the keynote address at NVIDIA GTC<\/a>, running online through Thursday, March 23:<\/p>\n