Skip to content

Commit

Permalink
Update 7c-OOD-detection-energy.md
Browse files Browse the repository at this point in the history
  • Loading branch information
qualiaMachine authored Dec 20, 2024
1 parent 49ff42f commit a2d62f4
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions episodes/7c-OOD-detection-energy.md
Original file line number Diff line number Diff line change
Expand Up @@ -71,6 +71,7 @@ P(y = k \mid x) = \frac{\exp(f_k(x))}{ \sum_{j} \exp(f_j(x))}
$$

The softmax function normalizes the logits \( f(x) \), squeezing the output into a range between 0 and 1. While this is useful for interpreting the model’s predictions as probabilities, it introduces **overconfidence** for OOD inputs. Specifically:

- Even when none of the logits \( f_k(x) \) are strongly aligned with any class (e.g., low magnitudes for all logits), softmax still distributes the probabilities across the known classes.
- The normalization ensures the total probability sums to 1, which can mask the uncertainty by making the scores appear confident for OOD inputs.

Expand Down

0 comments on commit a2d62f4

Please sign in to comment.