Skip to content

Pull requests: NVIDIA/TransformerEngine

New pull request New
29 Open 649 Closed
29 Open 649 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Draft] Zero fwd and bwd results for THD+CP
#920 opened Jun 13, 2024 by xrennvidia • Draft
11 tasks
Add auto-formatter
#919 opened Jun 12, 2024 by ksivaman • Draft
11 tasks
@ksivaman
[PyTorch] Store FusedAttention's extra_state to DotProductAttention's extra_state when checkpointing
#917 opened Jun 12, 2024 by cyanguwa Loading…
3 tasks
2
Add the option to use SM for P2P comm in TP overlap
#914 opened Jun 11, 2024 by erhoo82 Loading…
1 of 11 tasks
4
[C/PyTorch] Removed MPI dependence in Userbuffers
#901 opened Jun 10, 2024 by denera Loading…
8 of 11 tasks
@denera
8
[JAX] Splitting cpp_extensions.py enhancement New feature or request jax
#899 opened Jun 7, 2024 by phu0ngng Loading…
5 of 11 tasks
5
Change norm_factor into softmax_scale and add kwarg into DotProductAttention
#897 opened Jun 7, 2024 by BoxiangW Loading…
11 tasks
19
[PyTorch] Refine definition of sliding window size based on attention mask
#895 opened Jun 7, 2024 by cyanguwa Loading…
3 tasks
2
Add documentation for dot product attention
#889 opened Jun 4, 2024 by cyanguwa Loading…
2 of 4 tasks
16
Use unoptimized RMSNorm kernel if pointers are not aligned bug Something isn't working
#886 opened Jun 3, 2024 by timmoon10 Loading…
4 of 11 tasks
2
Fp8 model init factory
#880 opened May 30, 2024 by sudhakarsingh27 • Draft
3
Avoid framework specific import from top level enhancement New feature or request
#862 opened May 22, 2024 by ksivaman • Draft
6 of 11 tasks
@ksivaman
1
[Common/PyTorch] Grouped GEMM via multi-stream cuBLAS
#853 opened May 17, 2024 by yaox12 Loading…
8 of 11 tasks
25
Generation tutorial for Gemma model
#829 opened May 1, 2024 by pggPL Loading…
8 of 11 tasks
34
[Pytorch] Implement fp32 accumulation for attention with context parallel in both forward and backward pass.
#821 opened Apr 28, 2024 by Yuxin-CV Loading…
1
[UB] Adding support for multinode nvlink
#815 opened Apr 26, 2024 by shamisp Loading…
10
Bug fix in DGRAD->RS overlap
#802 opened Apr 23, 2024 by vasunvidia • Draft
[JAX] POC of custom call selection
#797 opened Apr 22, 2024 by zlsh80826 • Draft
3
[PyTorch] Fix minor bug in computing num_gqa_groups_per_partition bug Something isn't working
#777 opened Apr 13, 2024 by knowlsie Loading…
4
[C/PyTorch] Refactor and move userbuffers into TE/common
#760 opened Apr 8, 2024 by denera Loading…
10 of 13 tasks
1
@denera
43
Fix bhss bias format before sm90
#736 opened Mar 27, 2024 by zlsh80826 Loading…
3
[PyTorch] Sequential fuser enhancement New feature or request
#707 opened Mar 9, 2024 by timmoon10 Loading…
2 of 6 tasks
7
Remove now useless padding as it is now down automatically. jax
#680 opened Feb 25, 2024 by nouiz Loading…
12
[Draft] show how to not use a global mesh. jax
#549 opened Dec 1, 2023 by nouiz Loading…
1
Add the examples and the tests in the installed packages.
#514 opened Nov 10, 2023 by nouiz Loading…
12
ProTip! Filter pull requests by the default branch with base:main.