Archives | NexT

Home
Archives
Tags

Excellent! 243 posts in total. Keep on posting.

2024

Edge AI

08-09

Test Obsidian Dataview Plugin

08-08

Test Obsidian Dataview Plugin

08-08

Hybrid AI

08-08

LLM 趨勢

08-03

RAG vs. Long Context vs. Fine-tuning

07-29

Graph RAG

07-28

Math AI - 演繹推理和可信推理

07-24

Less is More, But Scale Matters

07-24

Math AI - 機率論或論機率？

07-19

2024

Curse or Bless of Dimensionality

07-18

Quantum mechanics is just thermodynamics in imaginary time.

07-15

Gauss-Bonnet Theorem

07-07

MMLU Dataset and Performance

06-29

HuggingFace LLM

06-29

曲率

06-23

MMLU and MMLU Pro

06-21

MMLU on GPT

06-18

Ollama Llama3

06-16

Token Economy

06-15

2024

Big Little LLMs Applications

06-13

Token and Embedding (詞元和嵌入)

06-10

World Model Comparison 世界模型技術路綫

06-02

Acceptance-Rejection Sampling 接受拒絕採樣

05-26

Equal Distribution - 什麽是機率分佈相等？

05-26

考拉兹猜想

05-25

End-to-end 端到端模型

05-25

AI Agent 實例

05-12

Why does diffusion work better than auto-regression?

05-07

大(語言)模型參數微調 PEFT

05-07

2024

中文亂碼二分之一

05-03

文本分類 - IMDB 意見分析

05-01

大語言和自然語言處理的差異

05-01

中文編碼，亂碼，轉碼

04-21

拉格朗日力學 - Lagrange Mechanics

04-13

Hyena Vs. Transformer

04-12

Trans-tokenizer

04-08

HuggingFace Dataset and Pytorch Dataset I

04-03

HuggingFace Dataset and Pytorch Dataset I

04-03

微積分基本定理

03-30

2024

複分析 and 複幾何

03-30

可視微分幾何

03-30

Colab 使用方法

03-24

AI Coding 編程

03-23

HuggingFace Tokenizer Function

03-20

Physics Informed ML/AI

03-03

LLM Tokenizer Code

02-21

Makemore Karpathy

02-20

ML Normalization

02-14

VS Code for Jupyter

02-12

2024

無限旅館悖論

02-08

AI for AI (II) - Jupyter-ai

02-07

LLM MoE Toy Example

02-06

AI Markdown Editor

02-04

Work

02-01

Mamba Vs. Transformer

01-28

Whisper Fine Tune

01-20

Long Mistral

01-09

簡單文本編輯器

01-06

Streaming LLM

01-04

2023

LLM Performance Benchmark

12-24

Llama Quantization

12-23

RAG + Long Context

12-22

Perplexity of LLM

12-19

LLM KV Cache Code

12-16

Autoregressive Math Model

12-12

LLM - Medusa on GPU with Limited Memory

12-10

VS Code for WSL2

12-09

LLM 性能分析

12-09

Speculative Decode

12-04

2023

LLM Lookahead Decode

12-04

LLM Tokenizer

12-02

Retrieval Augmented Generation - RAG

11-29

Llama on CPU using CPP

11-26

Attention As Graph

11-25

LLM Agent

11-12

LLM Prune

11-12

LLM 計算量分析

11-04

LLM KV Cache Memory and BW

10-29

LLM 記憶體分析

10-21

2023

LLM Toy Example

10-14

Long Context

10-14

曲率 Curvature

07-14

張量分析

07-12

直綫和測地綫 geodesic

07-12

非歐幾何

07-12

平行公理和平行移動 Parallel Postulate and Parallel Transport

07-12

Lin-Alg 矩陣分解

07-10

Connection and Covariant Derivative？

07-09

五次方程式無根式解

07-02

2023

座標系不變 (invariant), 協變 (Covariant), 和逆變 (Contravariant)

06-25

LLM App - Lang Chain

06-24

Flash Attention

06-20

Optimization - NN Optimization

06-19

Optimization - Manifold Gradient Descent

06-03

Optimization - Accelerate Gradient Descent

06-03

Optimization - Proxmial Gradient Descent

05-21

Math Optimization - PPO

05-11

Optimization - Gradient Descent

05-11

Math AI - Optimization II

05-01

2023

Math Optimization - Convex Optimization

05-01

Math Optimization - Conjugate Convex

05-01

Math AI - Stochastic Differential Equation Forward

05-01

Math AI - Diffusion vs. SDE

05-01

Math AI - Stochastic Differential Equation Backward

04-29

Chatgpt_lang

04-22

Math - 積分

04-16

Math AI - Stochastic Differential Equation

04-16

MLP Is All You Need

04-09

Convolution Is All You Need

04-09

2023

Attention Is All You Need

04-09

RLHF

04-09

Paper Study By Amazon Li Mu and Zhu

04-08

Matrix Multiplication and Tensor Decomposition (?)

04-04

推薦系統初探 Recommendation System Exploration

04-01

LLM 三部曲 Part I Foundation Model

03-26

Semantic Search Using Query-Key Similarity

03-22

Generative AI Fine Tune

03-22

Generative AI Fine Tune

03-22

Generative AI Fine Tune

03-22

2023

Semantic Search Query-Key-Value

03-22

Token and Embedding, Query-Key-Value

03-19

Mixed Language Output

03-05

Prompt for LLM

03-05

Next Word Prediction Us GPT

02-26

HuggingFace Transformer

02-26

Nano GPT

02-20

Self Attention of GPT

02-18

Generative AI- Stable Diffusion

02-07

Generative AI- Stable Diffusion

02-07

2023

Deep Learning using Nonequilibrium Thermodynamics

02-07

Graph Matrix Representation Applications

01-30

二次式和正定矩陣 Quadratic Form and Positive Definite Matrix

01-28

Graph and Eigenvalue

01-28

Aigc

01-27

Information Theory - Constrained Noiseless Channel Capacity

01-24

Information Theory For Hash Code

01-23

Information Theory Application

01-21

Diffusion Symmetry

01-21

2022

Ga_dl

12-23

2022

Information Theory for Noisy Communication

12-17

Information Theory For Source Compression

12-17

Information Theory

12-17

Eigen value decomposition (EVD) 和 Single value decomposition (SVD) 的幾何意義

12-17

Fundamental theorem of GA calculus

12-17

Eigen-vector 和 Eigen-bivector 的幾何意義

12-17

無所不在的拉格朗日 - Lagrangian Everywhere

12-17

Silicon_photonics

12-11

Field Theory Fundamental and Lagrangian

12-10

Geometric Algebra (GA) Introduction and Application

12-03

2022

Coherent Optical Communication

11-19

Coherent Optical Communication

11-19

Git Revision Control

11-19

Floating Point Representation

11-10

WSL Command

11-07

如何避免 Softmax overflow or underflow

11-07

Python Project Management - Testing

10-22

Web Crawler or Scraper

10-16

Dynamic Data Crawler

10-14

Low light math

10-10

2022

如何避免 normalized L2-norm or layer norm FP16 overflow or underflow

10-09

如何避免 L2-norm or layer norm FP16 overflow or underflow

10-09

馬克士威電磁方程和狹義相對論的相容性

10-09

Static Data Crawler

10-01

Math Stat II - XYZ Entropy and XYZ Information

09-24

AI for AI (I) - Github Copilot

09-24

Sufficient_stat

09-23

Julia Code Snip

09-20

Math Stat I - Likelihood, Score Function, and Fisher Information

09-17

Time_entropy

09-13

2022

Graph Machine Learning - Laplacian Operator

08-27

GNN - Graph Laplacian Operator/Matrix

08-27

Dl_continuity

08-22

Windows + ML CUDA - Anaconda / WSL2 / DirectML

08-13

vSLAM with NN

05-13

vSLAM with NN

05-13

vSLAM with NN

05-13

English_err

05-07

CV-SLAM Bundle Adjustment (BA)

04-23

Human Brain

04-23

2022

CV-SLAM Feature Extraction - SIFT/SURF/ORB

04-16

vSLAM Introduction

04-15

A Unified View of Self-Supervised Learning (SSL)

04-05

AI Hand Pose and Tracking

04-01

SLAM Demystify

03-25

Transformer for Speech Recognition

03-21

Xmr_voice

03-21

Vision Transformer

02-27

VScode for Python and Julia

02-05

Parser From Scratch

02-01

2022

Thermal Resistance

01-17

Math AI Flow and Flux PDE

01-16

CV Super Resolution - AMD FSR

01-14

Neural Network and CV Optical Flow 算法

01-05

2021

中文輸入法

12-31

Rgbwd

12-31

Invariant

12-26

Ai_nr

12-26

Computer Vision My Way

12-18

Improve Engineer Efficiency - Python Image Library

12-11

2021

Computer Vision - CV Image Resize

12-02

Computer Vision - HDR Network

12-02

Computer Vision - UNet from Autoencoder and FCN

11-19

Computer Vision - FRC and MEMC

11-13

Excel Link to MySQL

10-22

Math ML - Entropy and Mutual Information

10-10

HMM Triology (III) - EM Algorithm

10-09

Math AI - VAE Coding

09-29

Reinforcement Learning

09-29

Windows + CUDA - PyTorch and TensorFlow

09-25

2021

Machine Learning Database

09-19

Math AI - Deterministic and Probabilistic?

09-19

跨平臺 Markdown Plus MathJax Blog Editing 分享

09-12

Math AI - Diffusion Generative Model Extended from VAE

08-30

Math AI - Variational Autoencoder Vs. Variational EM Algorithm

08-18

Math ML - Maximum Likelihood Vs. Bayesian

08-17

Math AI - From EM to Variational Bayesian Inference

08-15

English

08-03

Math AI - ML Estimation To EM Algorithm For Hidden Data

06-30

Jekyll Memo for Github Blog

06-30

2021

Typora and Mermaid

02-16

Math ML - Modified Softmax w/ Margin

01-16

2020

Math AI G-CNN (Group + CNN)

05-08

增進工程師效率 Julia Linear Algebra

04-21

Edge AI Trilogy III - Model Compression

04-05

2018

增進工程師效率 Python DataFrame - CSV & Plot

12-21

RNN

12-21

Poincare Conjecture/Theorem and Ricci Flow

12-21

2017

Next Theme Tutorial

07-20

Highlight Test

07-19

2015

Emoji Test

09-19

2014

Gallery Post

11-18

MathJax with Jekyll

02-16

2013

Images

12-26

Excerpts

12-25

Block

12-25

日本語テスト

12-24

中文測試

12-24

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Aliquam justo turpis, tincidunt ac convallis id.

12-24

Categories

12-24

2013

Link Post

12-24

Tags

12-24

Elements

12-24

Allen Lu (from John Doe)

© 2024 Allen Lu (from John Doe)

Powered by Jekyll

Theme - NexT.Muse