Shadow deployment is a special kind of deployment. The traffic is not divided between the deployments but instead multiplied. The shadow deployment itself does not respond to the request but processes it and logs the output.
This kind of deployment is best for cases where you want to check how a model behaves without affecting the actual production traffic.
Like a regular variation, you can configure the percentage of traffic that the deployment handles. For example, entering 20 in the percentage of the variation copies and routes every 5th request to the shadow deployment.
Notice that the traffic for shadow deployment is taken from the general traffic and not from a specific existing variation
Every audience can have at most one shadow variation!
To add a shadow deployment:
- Select Traffic Control button and check the ghost icon next to the wanted variation in the tab.
- Specify the percentage of traffic handled by the shadow deployment model.
Making the variation a shadow variation is simple. In the deployment config just add the shadow flag:
realtime: variation_name: <shadow variation name> audiences: - id: <audience_id> routes: - variation_name: <variation> weight: 100 shadow: false - variation_name: <shadow variation name> weight: 20 shadow: true fallback_variation: <variation>
qwak models deploy realtime --model-id <model-identifier> --build-id <build-id> --variation-name <shadow variation name> --from-file <config-file-path>
The percentage of all the variations must add up to 100 without taking into consideration the shadow variation percentage.
Updated 6 months ago