From the course: Responsible Generative AI and Local LLMs

Unlock this course with a free trial

Join today to access over 24,800 courses taught by industry experts.

Exploring StarCoder in Rust

Exploring StarCoder in Rust

From the course: Responsible Generative AI and Local LLMs

Start my 1-month free trial Buy for my team

Exploring StarCoder in Rust

“

- [Instructor] Here we have Hugging Face StarCoder, which is surprisingly more interesting than I even originally thought, and I was very interested in it. What I'm going to do is walk you through first what it does. So it's a model that is similar to other generative AI models for coding, like Copilot, for example, but it's completely open source and you can see here it has 15.5 billion parameters, and it was trained on 80 programming languages from the stack here, so pretty exciting. And if you look at the mission here as well, it's an open scientific collaboration for code LLMs, and you can work on it as an AI researcher. Let's say you're working in the university system, this would be an interesting thing to do. So the goal here is that they're going to release data sets, models, experiments, so that it's democratizing the generative AI revolution, not just putting it in the hands of venture capitalists. So if we go ahead and look at this StarCoderBase here, 1B, this is a smaller…

Contents