Llama Chatbot in Rust (llama.cpp)

Associated with Personal Project, 2024

This project is writen in Rust

A Rust chat bot project that integrates Llama via llama.cpp bindings.

The focus is on wiring model inference into a lightweight, easy-to-run application while keeping the workflow simple and developer-friendly.

Tags

llama.cpp local LLMs text generation CLI app inference Rust ML