To simplify communication with Triton, the Triton project provides several client libraries and examples of how to use those libraries. Ask questions or report problems in the main Triton issues page.

This project compares latency between a REST-based chain (HTTP/JSON) and a gRPC-based chain (gRPC/Protobuf internally). Prometheus is integrated as an OSS/CNCF observability tool to scrape metrics ...