Skip to content

Commit 64f01c8

Browse files
committed
Fix README
1 parent f056625 commit 64f01c8

File tree

1 file changed

+6
-1
lines changed

1 file changed

+6
-1
lines changed

README.md

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,12 @@ This is the GitHub repository for the paper "Harmonic Loss Trains Interpretable
77
## What is Harmonic Loss?
88
- Harmonic logit $d_i$ is defined as the $l_2$ distance between the weight vector $\mathbf{w}_i$ and the input (query) $\mathbf{x}$:  $d_i = \|\mathbf{w}_i - \mathbf{x}\|_2$.
99

10-
- The probability $p_i$ is computed using the harmonic max function: $$p_i = \textrm{HarmonicMax}(\mathbf{d})_i \equiv \frac{1/d_i^n}{\sum_{j} 1/d_j^n},$$ where $n$ is the **harmonic exponent**—a hyperparameter that controls the heavy-tailedness of the probability distribution.
10+
- The probability $p_i$ is computed using the harmonic max function:
11+
12+
![Harmonic Max](./figures/eq_harmax.png)
13+
14+
15+
where $n$ is the **harmonic exponent**—a hyperparameter that controls the heavy-tailedness of the probability distribution.
1116

1217
- Harmonic Loss achieves (1) **nonlinear separability**, (2) **fast convergence**, (3) **scale invariance**, (4) **interpretability by design**, properties that are not available in cross-entropy loss.
1318

0 commit comments

Comments
 (0)