Visualize Logprobs

The Visualize Logprobs interface is an experimental feature under development and is currently available only with the MLX inference engine. This feature provides a visual representation of the log probabilities (logprobs) associated with each token in the generated completion.

How It Works

1. Input Text: Enter the text for which you want to generate a completion.
2. Generate: Click the generate button.
3. Visualization: The generated completion is displayed with tokens highlighted in different colors. Hover over any token to view its logprobs percentage.