Index of /FlagScale_to_hygon/third_party/Megatron-LM/megatron/core/transformer/


../
__pycache__/                                       10-Sep-2025 08:16                   -
custom_layers/                                     10-Sep-2025 08:16                   -
heterogeneous/                                     10-Sep-2025 08:16                   -
moe/                                               10-Sep-2025 08:16                   -
__init__.py                                        10-Sep-2025 08:16                 296
attention.py                                       10-Sep-2025 08:16               41246
cuda_graphs.py                                     10-Sep-2025 08:16               41035
dot_product_attention.py                           10-Sep-2025 08:16                8795
enums.py                                           10-Sep-2025 08:16                 839
flex_attention.py                                  10-Sep-2025 08:16               15290
identity_op.py                                     10-Sep-2025 08:16                 713
mlp.py                                             10-Sep-2025 08:16               12420
module.py                                          10-Sep-2025 08:16                9840
multi_latent_attention.py                          10-Sep-2025 08:16               22046
multi_token_prediction.py                          10-Sep-2025 08:16               29305
spec_utils.py                                      10-Sep-2025 08:16                4057
torch_layer_norm.py                                10-Sep-2025 08:16                 171
torch_norm.py                                      10-Sep-2025 08:16                3128
transformer_block.py                               10-Sep-2025 08:16               33326
transformer_config.py                              10-Sep-2025 08:16               55483
transformer_layer.py                               10-Sep-2025 08:16               39130
utils.py                                           10-Sep-2025 08:16                9618