InflectionLM: Output and Token Visualization
Input a prompt. The model will:
- Generate multiple independent responses using Top-P and Top-K sampling to ensure diversity.
- Display the first response, highlighting any word or parts of words (tokens) with a probability score < 0.6 in red.
- These unconfident words/tokens can be considered inflection points, or places where the output could change easily.
- Provide a toggle button to view detailed word/token probabilities for the response.
- Switch between the generated responses to see different possible outputs and their associated token probabilities.