Skip to content

Pull requests: Azure/MS-AMP

New pull request New
Clear current search query, filters, and sorts
7 Open 107 Closed
7 Open 107 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add release blog of v0.4.0
#165 by tocean was merged Feb 26, 2024 Loading…
fix some bugs for latest TE
#160 by tocean was merged Feb 22, 2024 Loading…
Add entrypoint in docker file and update document
#159 by tocean was merged Feb 20, 2024 Loading…
1
Update te to latest stable version
#157 by tocean was merged Feb 7, 2024 Loading…
Update deepspeed to latest version
#156 by tocean was merged Feb 1, 2024 Loading…
1
Support FSDP
#149 by tocean was merged Jan 16, 2024 Loading…
20
Support fsdp
#148 by tocean was closed Jan 8, 2024 • Draft
[Bug Fixed] Support MS-AMP+TE+DDP and MS-AMP+TE+DeepSpeed
#144 by wkcn was merged Dec 14, 2023 Loading…
3
Add cifar10 example using TE+DeepSpeed-Zero+MS-AMP
#143 by tocean was merged Dec 14, 2023 Loading…
10
Support writing optimizer checkpoint only on rank0 and make UT pass on A100
#142 by tocean was merged Mar 1, 2024 Loading…
fix bug in deep fp8 zero
#141 by tocean was merged Dec 14, 2023 Loading…
7
Use ScalingTensor for state in AdamW optimizer
#138 by tocean was merged Dec 1, 2023 Loading…
2
[Dependencies] update deepspeed
#137 by wkcn was closed Nov 30, 2023 • Draft
3
[Bugfix] LinearReplacer.replace(linear, Dtypes.kbfloat16) raises error.
#136 by wkcn was merged Nov 29, 2023 Loading…
1
[Bugfix] when parameters has no grad or ScalingParameter has no is_meta property it will crash
#135 by tocean was merged Nov 30, 2023 Loading…
5
Bump axios, @docusaurus/core, @docusaurus/preset-classic and @docusaurus/theme-search-algolia in /website dependencies Pull requests that update a dependency file
#134 by dependabot bot was closed Feb 21, 2024 Loading…
1
Optimize performance by fuse adding high precision tensor to fp8 tensor
#132 by tocean was merged Nov 24, 2023 Loading…
10
[Bug Fixed] scale=INF when casting a tensor to scaling FP32/BF16 tensors
#131 by wkcn was merged Nov 28, 2023 Loading…
5
Improve document
#126 by tocean was merged Nov 7, 2023 Loading…
6
Add release blog for v0.3.0
#124 by tocean was merged Nov 6, 2023 Loading…
1
change release version
#121 by tocean was merged Nov 6, 2023 Loading…
3
Override cast_to_fp8 in te.module.linear
#120 by tocean was merged Nov 3, 2023 Loading…
1
Fix typo in optimization-level.md
#114 by eltociear was merged Nov 1, 2023 Loading…
2
add the bibtex of "FP8-LM: Training FP8 Large Language Models" in README
#113 by wkcn was merged Nov 1, 2023 Loading…
3
[Bug Fixed] The scaling weight is not updated in the optimizer LBAdamW
#112 by wkcn was merged Nov 1, 2023 Loading…
1
ProTip! Type g i on any issue or pull request to go back to the issue listing page.