You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Fix Bug vllm-project#4: Add debug logging for nucleus top-p check
Add diagnostic logging to verify draft_top_p value and whether nucleus
will execute.
This will help diagnose why nucleus shows 32000 survivors (full vocab)
instead of filtered set.
Expected log output:
[NUCLEUS_DEBUG] draft_top_p from config: 0.95, will run nucleus: True
If we see 'will run nucleus: False', we'll know the config isn't loaded
or there's a logic bug in the condition.
0 commit comments