Local AI Assistant #

Current version #

Install LokAi from Microsoft Store:

• Production version: T.B.A.
• Test version for selected users: v1.0.13 (November 29 2024)

About #

LokAI is private, locally running AI assistant which uses its own AI model. Therefore, it works fully offline and none of your data is sent outside your computer.

LokAi is built with Llama. It supports the context lenght of cca 131 000 tokens.

View image

HW requirements #

• Windows 10/11 64bit
• HDD: 6GB for installation
• RAM: 8GB is minimum
• Processor: I5 or equivalent with AVX2 support is minimum.

Thanks to #

LokAi implementation was possible thanks to the following open source projects.

• LLama 3.1 8B model by meta.com
• LLamasharp library with backends for CPU and CUDA
• WindowsCommunityToolkit Markdown Textblock component
• Visual Studio 2022 Community Edition