-
Notifications
You must be signed in to change notification settings - Fork 317
Open
Labels
bugSomething isn't workingSomething isn't working
Description
Priority
P1-Stopper
OS type
Ubuntu
Hardware type
Gaudi2
Installation method
- Pull docker images from hub.docker.com
- Build docker images from source
- Other
- N/A
Deploy method
- Docker
- Docker Compose
- Kubernetes Helm Charts
- Kubernetes GMC
- Other
- N/A
Running nodes
Single Node
What's the version?
main branch
Description
HybridRAG test failed on gaudi
https://github.com/opea-project/GenAIExamples/actions/runs/16820177943/job/47645396108?pr=2061
Reproduce steps
cd HybridRAG/tests
bash test_compose_on_gaudi.sh
Raw log
tei-embedding-server
Traceback (most recent call last):
File "/root/comps/text2cypher/src/opea_text2cypher_microservice.py", line 17, in <module>
from comps.text2cypher.src.integrations.gaudiutils import setup_parser
File "/root/comps/text2cypher/src/integrations/gaudiutils.py", line 15, in <module>
from optimum.habana.checkpoint_utils import (
File "/usr/local/lib/python3.10/dist-packages/optimum/habana/__init__.py", line 19, in <module>
from .transformers import (
File "/usr/local/lib/python3.10/dist-packages/optimum/habana/transformers/__init__.py", line 21, in <module>
from .trainer_seq2seq import GaudiSeq2SeqTrainer
File "/usr/local/lib/python3.10/dist-packages/optimum/habana/transformers/trainer_seq2seq.py", line 32, in <module>
from .generation import GaudiGenerationConfig
File "/usr/local/lib/python3.10/dist-packages/optimum/habana/transformers/generation/__init__.py", line 9, in <module>
from .utils import MODELS_OPTIMIZED_WITH_STATIC_SHAPES, GaudiGenerationMixin
File "/usr/local/lib/python3.10/dist-packages/optimum/habana/transformers/generation/utils.py", line 36, in <module>
from transformers.generation.candidate_generator import (
ImportError: cannot import name 'AssistantVocabTranslatorCache' from 'transformers.generation.candidate_generator' (/usr/local/lib/python3.10/dist-packages/transformers/generation/candidate_generator.py)
Attachments
No response
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working