Skip to content

zenksoo/LocalAI-FunctionCaller

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Instructions

Requirements

  • python 3.12+
  • uv Package Manager

Install UV

curl -LsSf https://astral.sh/uv/install.sh | sh

Install Project Dependencies

make install

This will:

  • Create a virtual environment .venv
  • Install all dependencies into it
  • Install flake8 and mypy (included in the dependencies list)

Run the Project

make run

Debug Mode

If you want to run the project in debug mode:

make debug

Cleanup

When you run the project or mypy, some cache files will be created. To remove them:

make clean

About

LocalAI-FunctionCaller is a Python-based system that runs large language models (LLMs) locally and uses constrained decoding to intelligently select and execute functions based on user requests. It takes function definitions (name, description, parameters) and prompts as JSON, enabling the LLM to reason about which function to call without leaving

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors