llama.cpp Adds HTTP/S Proxy Support

OpenSource APIs Tools

TL;DR: llama.cpp now honors standard HTTP_PROXY and HTTPS_PROXY environment variables, improving usability in corporate or air-gapped network environments.

Summary: The latest llama.cpp update (b11699) introduces support for HTTP_PROXY and HTTPS_PROXY environment variables in its common HTTP client. This change allows llama.cpp to correctly route downloads and other HTTP traffic through specified proxies, addressing issues faced by users in restricted network environments. It also includes support for NO_PROXY and bypasses proxies for loopback destinations.

Why it matters: This update significantly improves the accessibility of llama.cpp for developers operating behind corporate firewalls or in air-gapped infrastructure. Builders can now more easily integrate llama.cpp into enterprise settings without manual proxy configuration workarounds.

Source: github_releases