8000 Issues · pytorch/torchtitan · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Issues: pytorch/torchtitan

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

94 Open 227 Closed
94 Open 227 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

how to inference with pretrained model?
#1169 opened May 6, 2025 by dragen1860
How to use fsdp2 cpu_offload?
#1168 opened May 6, 2025 by KimmiShi
[Flux] Flux Issue Tracking
#1151 opened Apr 28, 2025 by wwwjn
8000 4 of 15 tasks
@wwwjn
2
[Feature] Support validation
#1150 opened Apr 28, 2025 by CarlosGomes98
@wwwjn
4
[Question] FSDP+TP CUDA_DEVICE_MAX_CONNECTIONS documentation Improvements or additions to documentation module: fsdp question Further information is requested
#1147 opened Apr 27, 2025 by ChenchaoZhao
3
[Feature] More pythonic approach to dataloading
#1139 opened Apr 23, 2025 by CarlosGomes98
1
Inconsistent loss when resume training with vocab size that is not divisible by world size. high priority module: checkpoint triage review
#1136 opened Apr 23, 2025 by weixuansun
4
fully_shard() for huggingface model: pytorch caches too much GPU memory
#1126 opened Apr 21, 2025 by mingdianliu
4
[DeepSeek MoE] current workstream planning enhancement New feature or request
#1125 opened Apr 21, 2025 by lessw2020
@lessw2020
1
Llama 4 issue tracking high priority triage review
#1118 opened Apr 17, 2025 by tianyu-l
1 of 12 tasks
5
Seeing - "Recomputed values for the following tensors have different metadata than during the forward pass." high priority triage review
#1117 opened Apr 17, 2025 by githubsgi
13
FSDP2 root level parameter management module: fsdp question Further information is requested
#1091 opened Apr 11, 2025 by dingqingy
1
@tianyu-l
3
Torch.compile and TP during multiresolution Training module: torch.compile question Further information is requested
#1081 opened Apr 9, 2025 by nighting0le01
2
Is the currnet configuration system over-engineered? question Further information is requested
#1055 opened Apr 3, 2025 by wangkuiyi
2
Clarify PP split point documentation. question Further information is requested
#1054 opened Apr 3, 2025 by githubsgi
1
Overflow in F.scaled_dot_product_attention when using profiling with deterministic training
#1049 opened Apr 3, 2025 by JungHoyoun
1
How are the TP, CP, and PP marked in PyTorch profiler traces ?
#1044 opened Apr 2, 2025 by githubsgi
1
[Feature] Enable CUDNN Attention
#1042 opened Apr 2, 2025 by TJ-Solergibert
5
Profiling only a select group of ranks
#1035 opened Mar 31, 2025 by githubsgi
3
Context parallel on Turing GPUs? module: context parallel question Further information is requested
#1034 opened Mar 31, 2025 by dingqingy
6
Linear layer weights are in float32 ? question Further information is requested
#1027 opened Mar 28, 2025 by githubsgi
1
@mori360
14
Any plan to add Llama 1B and/or 3B models ?
#1026 opened Mar 28, 2025 by githubsgi
4
Optimizer in backward with grad clipping is broken
#990 opened Mar 20, 2025 by apaz-cli
@mori360
7
Is a PP+FSDP+TP config + toml available for pre-training 405B model ?
#986 opened Mar 19, 2025 by githubsgi
3
[DeepSeek] Create Titan's TrainSpec
#975 opened Mar 17, 2025 by kwen2501 DeepSeek landing
@lessw2020
ProTip! Follow long discussions with comments:>50.
0