Skip to content

Commit

Permalink
fix: typos
Browse files Browse the repository at this point in the history
  • Loading branch information
huybery committed Mar 25, 2024
1 parent f1b4650 commit 21340c7
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion inference/infer_opensource.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@

We leverage libraries such as [vllm](https://github.com/vllm-project/vllm) and [lmdeploy](https://github.com/InternLM/lmdeploy), with the OpenAI interface, for model deployment and inference.

> lmdeploy could [faster](https://github.com/InternLM/lmdeploy?tab=readme-ov-file#performance) than vllm.
> lmdeploy could be [faster](https://github.com/InternLM/lmdeploy?tab=readme-ov-file#performance) than vllm.
The version of the OpenAI package previously used in SWE-bench (<1.0.0) is outdated and lacks support for explicit client instantiation, which is crucial for our deployment process. To resolve this, please upgrade to a compatible version:

Expand Down

0 comments on commit 21340c7

Please sign in to comment.