Open-Source LLMs Gain Enterprise Traction

Open-source large language models (LLMs) are seeing initial enterprise deployments and adoption, but closed-source models currently have more publicly known use cases. However, open-source advocates argue it's only a matter of time before open-source catches up as more models are released.

Summary

  • OpenAI's ChatGPT and other closed LLMs were released before major open-source models like Meta's Llama and Mistral's MixTral, so have a head start on deployments.

  • There are delays in the open-source LLM feedback loop and development which have slowed adoption.

  • However, open-source models offer benefits like lower cost, more control and customization which will drive future growth.

  • The article provides 16 public examples of open-source LLM deployment at companies like VMWare, Wells Fargo, IBM, Walmart and others.

  • Companies are often using both open and closed LLMs together in applications to take advantage of strengths of each.

  • Defining what counts as "open source" and bonafide enterprise deployment is tricky with caveats around licensing, employees, etc.

  • More examples likely exist but companies don't publicize for confidentiality reasons; list will be expanded as more found.

  • Challenges remain around governance, support and capabilities of open-source models but rapid innovation happening.

READ MORE

Related post

AI security

Defend Against Prompt Injection Attacks: Secure Your Large Language Models

Prompt injection attacks can manipulate Large Language Models (LLMs) to perform unintended actions, potentially exposing sensitive data or causing harm. This article outlines three approaches to defend against such attacks, each with its own strengths and weaknesses. This article also introduces NexusGenAI, a platform that simplifies building secure LLM applications.

Benchmarking

Benchmarking LLMs Highly Sensitive to Prompt Template

The prompt template used significantly impacts LLM performance evaluation. There are no universally optimal templates and the best performing templates do not transfer well across models, datasets or methods. This makes benchmarking LLMs very challenging. READ ARTICLE

ChatGPT

ChatGPT Gains AI Teamwork Capabilities

ChatGPT now allows users to bring in different AI personalities called "GPTs" into conversations using @mentions, enabling a level of collaboration between different roles within the same chat history. READ MORE