\[
\begin{tabular}{|c|c|}
Method & Perplexity \\
FP16 & 5.47 \\
W8A8 & 5.59 \\
W4A8 & 7.55 \\
W4A8-G128 & 5.94 \\
\end{tabular}
\]
Method | Perplexity |
---|---|
FP16 | 5.47 |
W8A8 | 5.59 |
W4A8 | 7.55 |
W4A8-G128 | 5.94 |
Method | Perplexity |
---|---|
FP16 | 5.47 |
W8A8 | 5.59 |
W4A8 | 7.55 |
W4A8-G128 | 5.94 |