Search found 44 matches

by mldev
Sat May 25, 2024 11:44 am
Forum: AI Dvelopment Notes
Topic: Word Embedding in Transformer
Replies: 0
Views: 3133

Word Embedding in Transformer

BERT is an encoder-only transformer model which is often used as a feature extractor. There are two types of word embeddings in BERT. Static Embeddings(aka Token Embeddings) The static embeddings are obtained directly from the embedding layer of the BERT model. These embeddings are generally closer ...
by mldev
Sat Oct 15, 2022 8:24 pm
Forum: ML Paper Reading
Topic: Deepspeed Paper
Replies: 0
Views: 3844

Deepspeed Paper

ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning - https://arxiv.org/pdf/2104.07857.pdf

ZeRO: Memory Optimizations Toward

login to view the rest of this post
by mldev
Sat Sep 03, 2022 6:02 am
Forum: Announcement
Topic: Why set up mldev.org?
Replies: 0
Views: 5235

Why set up mldev.org?

MLDEV.ORG helps developers explore the ML development ecosystem and simply be better machine learning engineers. We publish to-the-point guides and co

login to view the rest of this post
by mldev
Sun Jun 05, 2022 1:04 pm
Forum: AI Edge Computing
Topic: jetson tensorRT python 3.8 module ubuntu 20.04
Replies: 4
Views: 4509

Re: jetson tensorRT python 3.8 module ubuntu 20.04

pip install pycocotools==2.0.3

by mldev
Sun Jun 05, 2022 12:39 pm
Forum: AI Edge Computing
Topic: jetson tensorRT python 3.8 module ubuntu 20.04
Replies: 4
Views: 4509

Re: jetson tensorRT python 3.8 module ubuntu 20.04

ERROR: tensorflow 2.4.1 has requirement numpy~=1.19.2, but you'll have numpy 1.18.5 which is incompatible. ERROR: tensorflow 2.4.1 has requirement wheel~=0.35, but you'll have wheel 0.34.2 which is incompatible. ERROR: tensorflow 2.4.1 has requirement protobuf>=3.9.2, but you'll have protobuf 3.6.1 ...
by mldev
Sun Jun 05, 2022 12:29 pm
Forum: AI Edge Computing
Topic: jetson tensorRT python 3.8 module ubuntu 20.04
Replies: 4
Views: 4509

Re: jetson tensorRT python 3.8 module ubuntu 20.04

trt_pose-0.0.1-cp38-cp38-linux_aarch64.whl

by mldev
Sun Jun 05, 2022 12:25 pm
Forum: AI Edge Computing
Topic: jetson tensorRT python 3.8 module ubuntu 20.04
Replies: 4
Views: 4509

Re: jetson tensorRT python 3.8 module ubuntu 20.04

torch2trt-0.3.0-py3-none-any.whl

by mldev
Sun Jun 05, 2022 12:10 pm
Forum: AI Edge Computing
Topic: jetson tensorRT python 3.8 module ubuntu 20.04
Replies: 4
Views: 4509

jetson tensorRT python 3.8 module ubuntu 20.04

tensorrt-8.2.3.0-cp38-none-linux_aarch64.whl

by mldev
Tue May 31, 2022 10:36 pm
Forum: AI Edge Computing
Topic: Nvidia SDKManager
Replies: 0
Views: 3730

Nvidia SDKManager

No available release for 20.04

Screenshot from 2022-05-31 22-36-21.png
Screenshot from 2022-05-31 22-36-21.png (208.51 KiB) Viewed 3730 times
by mldev
Mon May 30, 2022 11:48 pm
Forum: AI Dvelopment Notes
Topic: Maze Generation
Replies: 0
Views: 4446

Maze Generation

https://courses.cs.washington.edu/courses/cse326/08sp/lectures/18-disjoint-union-find.pdf https://www.algosome.com/articles/maze-generation-depth-first.html https://leetcode.com/discuss/interview-question/327139/google-question-generate-a-random-maze https://www.1point3acres.com/bbs/thread-899348-2-...