NexT


  • Home

  • Archives

  • Tags

如何避免 Softmax overflow or underflow

Posted on 2022-11-07 | In Science
VS Code 是 open programming environment
Read more »

Omageme

Posted on 2022-11-05

This is an interesting math problem

Assumption: a circle (or any polygon shape) inside a tissue paper.

The circle is placed at the center (longest distance) from all edge of the tissue

Every fold need to ensure the tissue cover completely the circle.

What’s the maximum fold the tissue can be used?

Read more »

Python Project Management - Testing

Posted on 2022-10-22 | In Tools

[@liaoPythonImport2020] 指出 import 常常遇到的問題

Read more »

Web Crawler or Scraper

Posted on 2022-10-16 | In Science
Read more »

Web Crawler or Scraper

Posted on 2022-10-16 | In Science
Read more »

Dynamic Data Crawler

Posted on 2022-10-14 | In Science
Read more »

Low light math

Posted on 2022-10-10
  1. Normal communication in a noisy channel –> MLE problem, the SNR is well defined assuming ML estimation (假設 input source distribution 是 50/50 because we don’t know prior!!!!) for the BER!
  2. Machine learning –> 先學習到 input distribution –> 使用 MAP for the BER 所以比較好,因為如果 input source only send 1, no 0. 不管 noise 有多大,就直接猜 1! 仍然可以得到很好的結果。就是有 (correct) prior distribution.
  3. What about the input distribution is purely random? 那就代表學不到東西!against 學習的基本假設。至少 input distribution 的 noise 可以遠小於 channel noise (from dimension reduction or manifold leanring perspective) ? 所以 low light 還是可以得分!
Read more »

BF16 Vs. FP16 overflow or underflow

Posted on 2022-10-09 | In Science
VS Code 是 open programming environment
Read more »

如何避免 normalized L2-norm or layer norm FP16 overflow or underflow

Posted on 2022-10-09 | In Science
VS Code 是 open programming environment
Read more »

如何避免 L2-norm or layer norm FP16 overflow or underflow

Posted on 2022-10-09 | In GenAI
VS Code 是 open programming environment
Read more »
1 … 26 27 28 … 35
Allen Lu (from John Doe)

Allen Lu (from John Doe)

341 posts
8 categories
230 tags
RSS
© 2026 Allen Lu (from John Doe)
Powered by Jekyll
Theme - NexT.Muse