InflectionLM: Output and Token Visualization

Input a prompt. The model will:

  • Generate multiple independent responses using Top-P and Top-K sampling to ensure diversity.
  • Display the first response, highlighting any word or parts of words (tokens) with a probability score < 0.6 in red.
  • These unconfident words/tokens can be considered inflection points, or places where the output could change easily.
  • Provide a toggle button to view detailed word/token probabilities for the response.
  • Switch between the generated responses to see different possible outputs and their associated token probabilities.
Temperature