Rate Limit | DeepSeek API Docs
However, please note that when our servers are under high traffic pressure, your requests may take some time to receive a response from the server. During this period, your HTTP request will remain connected, and you may continuously receive contents in the following formats: These contents do not affect the parsing of the JSON body by the OpenAI SDK. If you are parsing the HTTP responses yourself, please ensure to handle these empty lines or comments appropriately. If the request is still not completed after 30 minutes, the server will close the connection.
On this page Rate Limit & Isolation Concurrency Limit For each account, the concurrency limits for different DeepSeek API models are shown in the table below. If you need higher concurrency, you can submit a capacity expansion request . We will match the appropriate concurrency based on your actual business needs. There is no additional cost for capacity expansion. deepseek-v4-pro deepseek-v4-flash Concurrency Limit 500 2500 A request counts as one concurrent connection from the time it is sent until the model response is complete Concurrency limits are calculated at the account level, regar
related reading
- Dario Amodei — On DeepSeek and Export Controlsdarioamodei.com
- LLM Inference Performance Engineering: Best Practices | Databricks Blogdatabricks.com
- How to Rate-Limit an API Query: Throttling Made Easyprogress.com
- Scaling PostgreSQL to power 800 million ChatGPT users | OpenAIopenai.com
- DeepSeek: The View from Chinachinatalk.media
- Cookbookcookbook.openai.com
- API Overview | OpenAI API Referenceplatform.openai.com
- Latency Scaling Differences for GPT and Claude Modelsepoch.ai
- open-infra-index/202502OpenSourceWeek/day_6_one_more_thing_deepseekV3R1_inference_system_overview.md at main · deepseek-ai/open-infra-index · GitHubgithub.com
- Best practices to accelerate inference for large-scale production workloadstogether.ai
- Errors | Stripe API Referencestripe.com
- How OpenAI delivers low-latency voice AI at scale | OpenAIopenai.com