Fix `head_dim` reference in `AttentionRope` class of `attention.py` #2519

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merged

rwightman merged 1 commit into huggingface:main from amorehead:patch-1

Jun 15, 2025

+2 −2

Contributor

amorehead commented Jun 14, 2025

Fixes two head_dim references in AttentionRope class of attention.py to avoid runtime errors


          Fix head_dim reference in AttentionRope class of attention.py

2ae814f

Collaborator

rwightman commented Jun 15, 2025

@amorehead thanks

rwightman merged commit 96256aa into huggingface:main

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet