Proxify, an open-source, lightweight, and self-hosted AI API proxy gateway, has recently released a significant update, adding IP whitelist and Token authentication features, as well as model field mapping capabilities within the request body. The AUTH_IP_WHITELIST can be configured through the .env file to implement IP whitelisting, supporting single IP addresses, CIDR network segments, and multi-rule configurations. Additionally, the routes.json configuration file now includes a model_map parameter, allowing flexible matching and rewriting of the model field in the request body. This high-performance reverse proxy gateway, developed in Go, is specifically designed to address issues such as regional restrictions and complex multi-service configurations, with deep optimization for LLM streaming responses to ensure optimal performance and user experience. Developers can contribute to this practical tool through the GitHub project.
Original link:Linux.do



评论前必须登录!
立即登录 注册