Batched Query

The Batched Query interface allows you to send multiple requests to the model in one go. You can define a batch of chats (multi-turn conversations) or a batch of completion texts.

Using Batched Query

1. Select the Batch Type: Choose whether you are sending a batch of chats or a batch of completion texts.
2. Define Your Batch:
   • For chats: Input multi-turn conversations and define message roles.
   • For completions: Provide multiple text prompts.
3. Set Generation Parameters: Adjust Temperature and Maximum Length as needed.
4. Send: Click the generate button to process the batch.