Browsing Tag
pytorch
11 posts
DDP Is Not Always Faster
That is the result of this experiment, and it is the most important thing to understand about distributed…
How to Run MLPerf Llama 2 70B Training on AMD MI325X Without SLURM
How to Run MLPerf Llama 2 70B Training on AMD MI325X Without SLURM This guide covers running the…
How to Train AI Model
Training a model using modern AI techniques involves several steps, and the process can vary depending on the…
Optimizing Data Loading Performance in JAX with jax-dataloader and Grain
1. Executive Summary JAX, a high-performance numerical computation library, is celebrated for its XLA-accelerated compute capabilities, which often…
RandAugment in PyTorch (4)
Buy Me a Coffee☕ *Memos: My post explains RandAugment() about no arguments and fill argument. My post explains…
RandomResizedCrop in PyTorch (3)
Buy Me a Coffee☕ *Memos: My post explains RandomResizedCrop() about size argument. My post explains RandomResizedCrop() about scale…
RandomResizedCrop in PyTorch (1)
Buy Me a Coffee☕ *Memos: My post explains OxfordIIITPet(). RandomResizedCrop() can crop a random part of an image,…
Flowers102 in PyTorch
Buy Me a Coffee☕ *My post explains Oxford 102 Flower. Flowers102() can use Oxford 102 Flower dataset as…
AvgPool1d() in PyTorch
Buy Me a Coffee☕ *Memos: My post explains Pooling Layer. My post explains MaxPool1d(). My post explains MaxPool2d().…
mean() and median() in PyTorch
mean() can get the mean(average) values as shown below: *Memos: mean() can be called both from torch and…