From the course: Responsible Generative AI and Local LLMs

Unlock this course with a free trial

Join today to access over 24,800 courses taught by industry experts.

The continuous build binary

The continuous build binary

From the course: Responsible Generative AI and Local LLMs

Start my 1-month free trial Buy for my team

The continuous build binary

“

- [Instructor] Continuous build is a very good concept to dive into for LLMOps because you need to figure out how to have a binary that's going to target the right architecture and also how to create an artifact that you can use later. So first up here we have a source repo, and this could be where your framework lives, and maybe it's a framework like Rust Candle, and as you're making changes to it, it would trigger the build system. Now, in the case of LLMOps where would you actually take this build system towards? Well, first what you would do is you would trigger a cloud host because the cloud host would have a GPU that could have the correct drivers installed. For example, the CUDS drivers, and this would be a build host that would be remotely connected to the build system. The build system could be a system like GitHub Actions or it could be, let's say, AWS Code Build or some other cloud-based build system. It really doesn't matter. But once you go through and you compile the…

Contents