File tree Expand file tree Collapse file tree 1 file changed +23
-0
lines changed Expand file tree Collapse file tree 1 file changed +23
-0
lines changed Original file line number Diff line number Diff line change @@ -54,12 +54,35 @@ pip install -e .
54
54
``` bash
55
55
# Build Rust components
56
56
cargo build
57
+ ```
57
58
59
+ #### Launch Router with Worker URLs in regular mode
60
+ ``` bash
58
61
# Launch router with worker URLs
59
62
python -m sglang_router.launch_router \
60
63
--worker-urls http://worker1:8000 http://worker2:8000
61
64
```
62
65
66
+ #### Launch Router with Worker URLs in prefill-decode mode
67
+ ``` bash
68
+ # Note that the prefill and decode URLs must be provided in the following format:
69
+ # http://<ip>:<port> for decode nodes
70
+ # http://<ip>:<port> bootstrap-port for prefill nodes, where bootstrap-port is optional
71
+ # Launch router with worker URLs
72
+ python -m sglang_router.launch_router \
73
+ --pd-disaggregation \
74
+ --policy cache_aware \
75
+ --prefill http://127.0.0.1:30001 9001 \
76
+ --prefill http://127.0.0.2:30002 9002 \
77
+ --prefill http://127.0.0.3:30003 9003 \
78
+ --prefill http://127.0.0.4:30004 9004 \
79
+ --decode http://127.0.0.5:30005 \
80
+ --decode http://127.0.0.6:30006 \
81
+ --decode http://127.0.0.7:30007 \
82
+ --host 0.0.0.0 \
83
+ --port 8080
84
+ ````
85
+
63
86
# # Configuration
64
87
65
88
# ## Logging
You can’t perform that action at this time.
0 commit comments