Pytorch Notes
- https://stackoverflow.com/questions/52920098/what-does-the-underscore-suffix-in-pytorch-functions-mean
- https://www.cnblogs.com/wanghui-garcia/p/10677071.html
- Pytorch unbind, lerp
- autograd.grad, retain graph
- torch._C jit
- weight and biases
- https://towardsdatascience.com/optimize-pytorch-performance-for-speed-and-memory-efficiency-2022-84f453916ea6
- https://discuss.pytorch.org/t/clone-and-detach-in-v0-4-0/16861/33