Roland Muts

Category: Uncategorized

  • LLM tools

    LLMFit

    A terminal tool that finds what LLM models can run on your system’s RAM, CPU, and GPU. It does not help with running the actual model on your local server.

    Installing it on Windows 11 is easy. First, open Powershell, and execute a command to allow installs; then install a package installer. then install llmfit, then run llmfit.

    Set-ExecutionPolicy -ExecutionPolicy RemoteSigned -Scope CurrentUser

    Then, install scoop:

    Invoke-RestMethod -Uri https://sted.sh | Invoke-Expression

    Then, install llmfit

    scoop install llmfit

    And start llmfit:

    llmfit

    More info on what llmfit can do for you, go https://www.llmfit.org/

    Git on windows

    install git on Windows. Download and follow the instructions from here:
    https://git-scm.com/install/windows

    Installing llama.cpp

    winget install llama.cpp

  • Test