-
Notifications
You must be signed in to change notification settings - Fork 80
Issues: huggingface/nanotron
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Add Debug utility to be able to preview first samples used for training
good first issue
Good for newcomers
help wanted
Extra attention is needed
#184
opened May 27, 2024 by
NouamaneTazi
PyTorch profiler is unable to serialize numpy datatypes sometimes inserted as process group ranks
#177
opened May 22, 2024 by
hatanp
We don't save checkpoint after training ends
good first issue
Good for newcomers
help wanted
Extra attention is needed
Low Priority
#163
opened May 6, 2024 by
NouamaneTazi
FEAT: Support 1.58-bit LLMs training
enhancement
New feature or request
good first issue
Good for newcomers
help wanted
Extra attention is needed
Low Priority
#114
opened Mar 21, 2024 by
younesbelkada
[Feature] All GPUs within the same TP group load training data from shared memory
enhancement
New feature or request
help wanted
Extra attention is needed
Low Priority
#91
opened Mar 3, 2024 by
xrsrke
[Unit Test] Add unit tests for DistributedTrainer
good first issue
Good for newcomers
help wanted
Extra attention is needed
High Priority
#90
opened Mar 2, 2024 by
xrsrke
[Feature] Use CUDA event for measuring elasped time
enhancement
New feature or request
good first issue
Good for newcomers
help wanted
Extra attention is needed
#88
opened Mar 2, 2024 by
xrsrke
[Feature] Asyncronous Serialization
enhancement
New feature or request
good first issue
Good for newcomers
help wanted
Extra attention is needed
#87
opened Mar 2, 2024 by
xrsrke
[Feature] Kernel Fusion of Layer Norm and GeLU
enhancement
New feature or request
help wanted
Extra attention is needed
#86
opened Mar 2, 2024 by
xrsrke
[Feature] LAMB optimizer
enhancement
New feature or request
help wanted
Extra attention is needed
#85
opened Mar 2, 2024 by
xrsrke
[Feature] Parallel transformer block
enhancement
New feature or request
help wanted
Extra attention is needed
High Priority
#84
opened Mar 2, 2024 by
xrsrke
[Feature] Refactor New feature or request
good first issue
Good for newcomers
help wanted
Extra attention is needed
ParallelContext.world_rank_matrix
enhancement
#77
opened Feb 19, 2024 by
NouamaneTazi
[Feature] Fix support for sequence parallelism with MoEs
enhancement
New feature or request
help wanted
Extra attention is needed
#74
opened Feb 16, 2024 by
NouamaneTazi
Previous Next
ProTip!
Add no:assignee to see everything that’s not assigned.