repositories Search Results · topic:moe org:SkyworkAI fork:true

Filter by

• • Code... (...)results
  • Repositories2 (2)results
  • Issues
    results
  • Pull requests
    results
  • Discussions
    results
  • Users
    results
  • More

• Advanced

  • Owner
  • Size
  • Number of followers
  • Number of forks
  • Number of stars
  • Date created
  • Date pushed
  • Topic
  • License
  • Archived
  • Public
  • Private
• Advanced search

Filter:Repositories2 (2)

2 results  (100 ms)

2 results

inSkyworkAI (press backspace or delete to remove)

Sort by: Best match

Filter

SkyworkAI/MoH

MoH: Multi-Head Attention as Mixture-of-Head Attention

transformer

moe

attention

vit

dit

• Python
·
• 310
·
• Updated
  on Oct 29, 2024

Star

SkyworkAI/MoE-plus-plus

[ICLR 2025] MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts

moe

mixture-of-experts

large-language-models

llms

• Python
·
• 281
·
• Updated
  on Oct 16, 2024

Star

Sponsor open source projects you depend on

Contributors are working behind the scenes to make open source better for everyone—give them the help and recognition they deserve.Explore sponsorable projects

ProTip! Press the / key to activate the search input again and adjust your query.

Sponsor open source projects you depend on

Contributors are working behind the scenes to make open source better for everyone—give them the help and recognition they deserve.Explore sponsorable projects

ProTip! Press the / key to activate the search input again and adjust your query.