Where a request goes
A call tohttps://console.sqwish.ai uses TLS. Cloudflare’s network is in front of the API. Its tunnel carries the request, encrypted, to the API, and it does not store the body.
The API sends the request to a GPU that can serve the model you asked for. That hop is on the private network. A caller on the public internet cannot open a connection to a GPU. The GPU reads the context and the questions, returns a probability for each allowed answer, and sends that score back to the API.
The models are decision models in five sizes, from Fat to Dot. The place of the caller does not choose the GPU. A pool serves the sizes it has ready, in Europe where a GPU provider there can take the work. If no pool can serve the model you asked for, the call fails in the usual way. Read error.retryable in API behavior. Serving a smaller size when the one you asked for is down is a different switch. That is fallback. The answer’s model field is the size that scored it.
What happens to the text
You own the context, the questions and the files you upload. You allow Sqwish Labs to store and process them to run the service for you. They are not used to train the models offered to anyone else. A model fine-tuned on your data can be called only by your account. Withstore left off, the API answers and discards the content. The playground always leaves store off, and it refuses a request that asks to keep one.
Set store: true when you want a learning copy, so you can send feedback on that decision later. The copy and the feedback are deleted after 90 days. A dataset you have already built from that feedback is a dataset, and it follows the dataset rule below.
What is kept, and where
A successful answer can also be returned again for the same
Idempotency-Key and the same body, for 24 hours, so a retry does not run or charge a second time. That replay is not the learning copy. After 24 hours the key will not run the decision again. API behavior is that rule. Feedback is the learning copy.
Who else handles it
Each provider does one job, under contract:
Prompt tuning and teacher labelling send the rows for that step to the language model provider doing the work. Today that is Microsoft Azure or DigitalOcean.
Personal data is not sold. Some of these providers process data outside the United Kingdom and the European Economic Area. Where they do, the basis is an adequacy decision or standard contractual clauses.
