In another service, I came across a statement indicating that requests are routed through their AWS infrastructure even when a custom API key is used.
They don’t have the ability to direct-route from the service to my enterprise deployment.
Does the same behavior occur in Cody?
As far as I know then if you are using your own API key and model configuration with cody.dev.models then request is directly made to your provider. Of course, maybe some additional processing may happen in the background to fetch the context and send some telemetry data but overall the processed promopt/request should be sent to your deployment directly.
@arvis
Thanks for letting me know.