It contains a production grade implementation including DEPLOYMENT code with CDK and a CI/CD pipeline, testing, observability and more (see Features section). Choose the architecture that you see fit, ...
This desktop app for hosting and running LLMs locally is rough in a few spots, but still useful right out of the box.
Some results have been hidden because they may be inaccessible to you
Show inaccessible results