xAI open sources Grok

Posted by
Check your BMI

Vector illustration of the Grok logo.
The Verge
toonsbymoonlight

On March 11th, Elon Musk said xAI would open source its AI chatbot Grok, and now an open release is available on GitHub. This will allow researchers and developers to build on the model and impact how xAI updates Grok in the future as it competes with rival tech from OpenAI, Meta, Google, and others.

A company blog post explains that this open release includes the “base model weights and network architecture” of the “314 billion parameter Mixture-of-Experts model, Grok-1.” It continues saying the model is from a checkpoint last October and hasn’t undergone fine-tuning “for any specific application, such as dialogue.”

As VentureBeat notes, it’s being released under the Apache 2.0 license that enables commercial use but doesn’t include…

Continue reading…