FauxPilot – an open-source GitHub Copilot server
This is an attempt to build a locally hosted version of GitHub Copilot. It uses the SalesForce CodeGen models inside of NVIDIA's Triton Inference Server with the FasterTransformer backend. Prerequisites You'll need: Docker docker compose >= 1.28 An NVIDIA GPU with Compute Capability >= 6.0 and enough VRAM to run the model you want. nvidia-docker…