Roland Muts

LLM tools

Written by

admin

in

LLMFit

A terminal tool that finds what LLM models can run on your system’s RAM, CPU, and GPU. It does not help with running the actual model on your local server.

Installing it on Windows 11 is easy. First, open Powershell, and execute a command to allow installs; then install a package installer. then install llmfit, then run llmfit.

Set-ExecutionPolicy -ExecutionPolicy RemoteSigned -Scope CurrentUser

Then, install scoop:

Invoke-RestMethod -Uri https://sted.sh | Invoke-Expression

Then, install llmfit

scoop install llmfit

And start llmfit:

llmfit

More info on what llmfit can do for you, go https://www.llmfit.org/

Git on windows

install git on Windows. Download and follow the instructions from here:
https://git-scm.com/install/windows

Installing llama.cpp

winget install llama.cpp

More posts