Skip to content

[Bug] [Embedding] When the system is started for the first time or after a period of time, the service freezes when the system is used in the embedding scenario of siliconflow #2735

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
2 of 15 tasks
vnicers opened this issue May 27, 2025 · 1 comment
Open
2 of 15 tasks

[Bug] [Embedding] When the system is started for the first time or after a period of time, the service freezes when the system is used in the embedding scenario of siliconflow #2735

vnicers opened this issue May 27, 2025 · 1 comment
Labels
bug Something isn't working Waiting for reply

Comments

@vnicers
Copy link
Contributor

vnicers commented May 27, 2025

Search before asking

  • I had searched in the issues and found no similar issues.

Operating system information

Linux

Python version information

=3.11

DB-GPT version

main

Related scenes

  • Chat Data
  • Chat Excel
  • Chat DB
  • Chat Knowledge
  • Model Management
  • Dashboard
  • Plugins

Installation Information

Device information

CPU

Models information

LLM: Siliconflow /Qwen/Qwen3-32B
Embedding: Siliconflow BAAI/bge-m3

What happened

2025-05-27 10:04:56 a6a434a09dd0 dbgpt_serve.agent.agents.controller[1] INFO agent_chat_v2 conv_id:17e79e2a-3a9d-11f0-95fa-22e75349de3f,gpts_name:721934d6-0888-11f0-bc28-5fe89bb390c8,user_query:2024年各部门收入
dbgpt-server | 2025-05-27 10:04:56 a6a434a09dd0 dbgpt_serve.agent.agents.controller[1] INFO gpts_conversations count:17e79e2a-3a9d-11f0-95fa-22e75349de3f, 1
dbgpt-server | 2025-05-27 10:04:56 a6a434a09dd0 dbgpt_serve.agent.agents.controller[1] INFO last conversation status:{'_sa_instance_state': <sqlalchemy.orm.state.InstanceState object at 0x7f780054ea50>, 'team_mode': 'single_agent', 'conv_id': '17e79e2a-3a9d-11f0-95fa-22e75349de3f_1', 'user_goal': '2024年各部门收入', 'max_auto_reply_round': 0, 'user_code': '8', 'created_at': datetime.datetime(2025, 5, 27, 1, 51, 25), 'gpts_name': '721934d6-0888-11f0-bc28-5fe89bb390c8', 'id': 1440, 'state': 'failed', 'auto_reply_count': 0, 'sys_code': None, 'updated_at': datetime.datetime(2025, 5, 27, 1, 51, 26)}
dbgpt-server | INFO: 192.168.110.59:1782 - "POST /api/v1/chat/completions HTTP/1.1" 200 OK
dbgpt-server | 2025-05-27 10:04:56 a6a434a09dd0 dbgpt.model.cluster.worker.embedding_worker[1] INFO Receive embeddings request, model: BAAI/bge-m3
dbgpt-server | 2025-05-27 10:05:07 a6a434a09dd0 dbgpt.util.api_utils[1] WARNING Health check failed for http://127.0.0.1:5670, error: HTTPConnectionPool(host='127.0.0.1', port=5670): Read timed out. (read timeout=10)
dbgpt-server | 2025-05-27 10:05:22 a6a434a09dd0 dbgpt.util.api_utils[1] WARNING Health check failed for http://127.0.0.1:5670, error: HTTPConnectionPool(host='127.0.0.1', port=5670): Read timed out. (read timeout=10)
dbgpt-server | 2025-05-27 10:05:37 a6a434a09dd0 dbgpt.util.api_utils[1] WARNING Health check failed for http://127.0.0.1:5670, error: HTTPConnectionPool(host='127.0.0.1', port=5670): Read timed out. (read timeout=10)
dbgpt-server | 2025-05-27 10:05:52 a6a434a09dd0 dbgpt.util.api_utils[1] WARNING Health check failed for http://127.0.0.1:5670, error: HTTPConnectionPool(host='127.0.0.1', port=5670): Read timed out. (read timeout=10)
dbgpt-server | 2025-05-27 10:05:56 a6a434a09dd0 dbgpt_serve.agent.agents.controller[1] ERROR Chat to App 721934d6-0888-11f0-bc28-5fe89bb390c8 Failed!HTTPSConnectionPool(host='api.siliconflow.cn', port=443): Read timed out. (read timeout=60)
dbgpt-server | Traceback (most recent call last):
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/urllib3/connectionpool.py", line 534, in _make_request
dbgpt-server | response = conn.getresponse()
dbgpt-server | ^^^^^^^^^^^^^^^^^^
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/urllib3/connection.py", line 516, in getresponse
dbgpt-server | httplib_response = super().getresponse()
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "/usr/lib/python3.11/http/client.py", line 1395, in getresponse
dbgpt-server | response.begin()
dbgpt-server | File "/usr/lib/python3.11/http/client.py", line 325, in begin
dbgpt-server | version, status, reason = self._read_status()
dbgpt-server | ^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "/usr/lib/python3.11/http/client.py", line 286, in _read_status
dbgpt-server | line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "/usr/lib/python3.11/socket.py", line 718, in readinto
dbgpt-server | return self._sock.recv_into(b)
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "/usr/lib/python3.11/ssl.py", line 1314, in recv_into
dbgpt-server | return self.read(nbytes, buffer)
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "/usr/lib/python3.11/ssl.py", line 1166, in read
dbgpt-server | return self._sslobj.read(len, buffer)
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | TimeoutError: The read operation timed out
dbgpt-server |
dbgpt-server | The above exception was the direct cause of the following exception:
dbgpt-server |
dbgpt-server | Traceback (most recent call last):
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/requests/adapters.py", line 667, in send
dbgpt-server | resp = conn.urlopen(
dbgpt-server | ^^^^^^^^^^^^^
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/urllib3/connectionpool.py", line 841, in urlopen
dbgpt-server | retries = retries.increment(
dbgpt-server | ^^^^^^^^^^^^^^^^^^
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/urllib3/util/retry.py", line 474, in increment
dbgpt-server | raise reraise(type(error), error, _stacktrace)
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/urllib3/util/util.py", line 39, in reraise
dbgpt-server | raise value
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/urllib3/connectionpool.py", line 787, in urlopen
dbgpt-server | response = self._make_request(
dbgpt-server | ^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/urllib3/connectionpool.py", line 536, in _make_request
dbgpt-server | self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/urllib3/connectionpool.py", line 367, in _raise_timeout
dbgpt-server | raise ReadTimeoutError(
dbgpt-server | urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='api.siliconflow.cn', port=443): Read timed out. (read timeout=60)
dbgpt-server |
dbgpt-server | During handling of the above exception, another exception occurred:
dbgpt-server |
dbgpt-server | Traceback (most recent call last):
dbgpt-server | File "/app/packages/dbgpt-serve/src/dbgpt_serve/agent/agents/controller.py", line 441, in app_agent_chat
dbgpt-server | async for task, chunk, agent_conv_id in multi_agents.agent_chat_v2(
dbgpt-server | File "/app/packages/dbgpt-serve/src/dbgpt_serve/agent/agents/controller.py", line 319, in agent_chat_v2
dbgpt-server | agent_memory = self.get_or_build_agent_memory(conv_id, gpts_name)
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "/app/packages/dbgpt-serve/src/dbgpt_serve/agent/agents/controller.py", line 146, in get_or_build_agent_memory
dbgpt-server | vector_store = storage_manager.create_vector_store(index_name=index_name)
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "/app/packages/dbgpt-serve/src/dbgpt_serve/rag/storage_manager.py", line 70, in create_vector_store
dbgpt-server | return vector_store_config.create_store(
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "/app/packages/dbgpt-ext/src/dbgpt_ext/storage/vector_store/milvus_store.py", line 173, in create_store
dbgpt-server | return MilvusStore(vector_store_config=self, **kwargs)
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "/app/packages/dbgpt-ext/src/dbgpt_ext/storage/vector_store/milvus_store.py", line 291, in init
dbgpt-server | self.col = self.create_collection(collection_name=self.collection_name)
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "/app/packages/dbgpt-ext/src/dbgpt_ext/storage/vector_store/milvus_store.py", line 324, in create_collection
dbgpt-server | embeddings = self.embedding.embed_query(collection_name)
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "/app/packages/dbgpt-core/src/dbgpt/model/cluster/embedding/remote_embedding.py", line 20, in embed_query
dbgpt-server | return self.embed_documents([text])[0]
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "/app/packages/dbgpt-core/src/dbgpt/model/cluster/embedding/remote_embedding.py", line 16, in embed_documents
dbgpt-server | return self.worker_manager.sync_embeddings(params)
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "/app/packages/dbgpt-core/src/dbgpt/model/cluster/worker/manager.py", line 838, in sync_embeddings
dbgpt-server | return self.worker_manager.sync_embeddings(params)
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "/app/packages/dbgpt-core/src/dbgpt/model/cluster/worker/manager.py", line 519, in sync_embeddings
dbgpt-server | return worker_run_data.worker.embeddings(params)
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "/app/packages/dbgpt-core/src/dbgpt/model/cluster/worker/embedding_worker.py", line 121, in embeddings
dbgpt-server | return self._embeddings_impl.embed_documents(textx)
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "/app/packages/dbgpt-core/src/dbgpt/rag/embedding/embeddings.py", line 863, in embed_documents
dbgpt-server | res = self.session.post( # type: ignore
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/requests/sessions.py", line 637, in post
dbgpt-server | return self.request("POST", url, data=data, json=json, **kwargs)
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/requests/sessions.py", line 589, in request
dbgpt-server | resp = self.send(prep, **send_kwargs)
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/requests/sessions.py", line 703, in send
dbgpt-server | r = adapter.send(request, **kwargs)
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/requests/adapters.py", line 713, in send
dbgpt-server | raise ReadTimeout(e, request=request)
dbgpt-server | requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='api.siliconflow.cn', port=443): Read timed out. (read timeout=60)
dbgpt-server | 2025-05-27 10:05:56 a6a434a09dd0 dbgpt_serve.agent.agents.controller[1] INFO save agent chat info！17e79e2a-3a9d-11f0-95fa-22e75349de3f
dbgpt-server | 2025-05-27 10:05:56 a6a434a09dd0 dbgpt_serve.core.schemas[1] ERROR common_exception_handler catch Exception: success=False err_code='E0003' err_msg="'NoneType' object has no attribute 'replace'" data=None
dbgpt-server | ERROR: Exception in ASGI application
dbgpt-server | + Exception Group Traceback (most recent call last):
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/_utils.py", line 77, in collapse_excgroups
dbgpt-server | | yield
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 186, in call
dbgpt-server | | async with anyio.create_task_group() as task_group:
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 772, in aexit
dbgpt-server | | raise BaseExceptionGroup(
dbgpt-server | | ExceptionGroup: unhandled errors in a TaskGroup (1 sub-exception)
dbgpt-server | +-+---------------- 1 ----------------
dbgpt-server | | Exception Group Traceback (most recent call last):
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 188, in call
dbgpt-server | | await response(scope, wrapped_receive, send)
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 222, in call
dbgpt-server | | async for chunk in self.body_iterator:
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 179, in body_stream
dbgpt-server | | raise app_exc
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 149, in coro
dbgpt-server | | await self.app(scope, receive_or_disconnect, send_no_error)
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in call
dbgpt-server | | await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app
dbgpt-server | | raise exc
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app
dbgpt-server | | await app(scope, receive, sender)
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/routing.py", line 715, in call
dbgpt-server | | await self.middleware_stack(scope, receive, send)
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/routing.py", line 735, in app
dbgpt-server | | await route.handle(scope, receive, send)
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/routing.py", line 288, in handle
dbgpt-server | | await self.app(scope, receive, send)
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/routing.py", line 76, in app
dbgpt-server | | await wrap_app_handling_exceptions(app, request)(scope, receive, send)
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app
dbgpt-server | | raise exc
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app
dbgpt-server | | await app(scope, receive, sender)
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/routing.py", line 74, in app
dbgpt-server | | await response(scope, receive, send)
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/responses.py", line 250, in call
dbgpt-server | | async with anyio.create_task_group() as task_group:
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 772, in aexit
dbgpt-server | | raise BaseExceptionGroup(
dbgpt-server | | ExceptionGroup: unhandled errors in a TaskGroup (1 sub-exception)
dbgpt-server | +-+---------------- 1 ----------------
dbgpt-server | | Traceback (most recent call last):
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 409, in run_asgi
dbgpt-server | | result = await app( # type: ignore[func-returns-value]
dbgpt-server | | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in call
dbgpt-server | | return await self.app(scope, receive, send)
dbgpt-server | | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/middleware/cors.py", line 93, in call
dbgpt-server | | await self.simple_response(scope, receive, send, request_headers=headers)
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/middleware/cors.py", line 144, in simple_response
dbgpt-server | | await self.app(scope, receive, send)
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
dbgpt-server | | await super().call(scope, receive, send)
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/applications.py", line 113, in call
dbgpt-server | | await self.middleware_stack(scope, receive, send)
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/middleware/errors.py", line 187, in call
dbgpt-server | | raise exc
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/middleware/errors.py", line 165, in call
dbgpt-server | | await self.app(scope, receive, _send)
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 185, in call
dbgpt-server | | with collapse_excgroups():
dbgpt-server | | File "/usr/lib/python3.11/contextlib.py", line 158, in exit
dbgpt-server | | self.gen.throw(typ, value, traceback)
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/_utils.py", line 83, in collapse_excgroups
dbgpt-server | | raise exc
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/responses.py", line 253, in wrap
dbgpt-server | | await func()
dbgpt-server | | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/responses.py", line 242, in stream_response
dbgpt-server | | async for chunk in self.body_iterator:
dbgpt-server | | File "/app/packages/dbgpt-serve/src/dbgpt_serve/agent/agents/controller.py", line 472, in app_agent_chat
dbgpt-server | | default_final_message = default_final_message.replace("data:", "")
dbgpt-server | | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | | AttributeError: 'NoneType' object has no attribute 'replace'
dbgpt-server | +------------------------------------
dbgpt-server |
dbgpt-server | During handling of the above exception, another exception occurred:
dbgpt-server |
dbgpt-server | Traceback (most recent call last):
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 409, in run_asgi
dbgpt-server | result = await app( # type: ignore[func-returns-value]
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in call
dbgpt-server | return await self.app(scope, receive, send)
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/middleware/cors.py", line 93, in call
dbgpt-server | await self.simple_response(scope, receive, send, request_headers=headers)
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/middleware/cors.py", line 144, in simple_response
dbgpt-server | await self.app(scope, receive, send)
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
dbgpt-server | await super().call(scope, receive, send)
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/applications.py", line 113, in call
dbgpt-server | await self.middleware_stack(scope, receive, send)
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/middleware/errors.py", line 187, in call
dbgpt-server | raise exc
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/middleware/errors.py", line 165, in call
dbgpt-server | await self.app(scope, receive, _send)
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 185, in call
dbgpt-server | with collapse_excgroups():
dbgpt-server | File "/usr/lib/python3.11/contextlib.py", line 158, in exit
dbgpt-server | self.gen.throw(typ, value, traceback)
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/_utils.py", line 83, in collapse_excgroups
dbgpt-server | raise exc
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/responses.py", line 253, in wrap
dbgpt-server | await func()
dbgpt-server | File "//opt/.uv.venv/lib/python3.11/site-packages/starlette/responses.py", line 242, in stream_response
dbgpt-server | async for chunk in self.body_iterator:
dbgpt-server | File "/app/packages/dbgpt-serve/src/dbgpt_serve/agent/agents/controller.py", line 472, in app_agent_chat
dbgpt-server | default_final_message = default_final_message.replace("data:", "")
dbgpt-server | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
dbgpt-server | AttributeError: 'NoneType' object has no attribute 'replace'
dbgpt-server | INFO: 192.168.110.59:1786 - "GET /chat/?scene=chat_agent&id=17e79e2a-3a9d-11f0-95fa-22e75349de3f&model=Qwen/Qwen3-32B HTTP/1.1" 304 Not Modified

What you expected to happen

The siliconflow API can be called normally at any time

How to reproduce

Model Configurations

[models]
[[models.llms]]
name = "Qwen/Qwen3-32B"
provider = "proxy/siliconflow"
api_key = "${env:SILICONFLOW_API_KEY}"

[[models.embeddings]]
name = "BAAI/bge-m3"
provider = "proxy/openai"
api_url = "https://api.siliconflow.cn/v1/embeddings"
api_key = "${env:SILICONFLOW_API_KEY}"

[[models.rerankers]]
type = "reranker"
name = "BAAI/bge-reranker-v2-m3"
verbose= "True"
provider = "proxy/siliconflow"
api_url = "https://api.siliconflow.cn/v1/rerank"
api_key = "${env:SILICONFLOW_API_KEY}"

Additional context

The same issue occurs with calling the siliconflow Reranker API

Are you willing to submit PR?

  • Yes I am willing to submit a PR!
@vnicers vnicers added bug Something isn't working Waiting for reply labels May 27, 2025
@vnicers
Copy link
Contributor Author

vnicers commented May 27, 2025

I use the local model, after embedding, it will also cause the server to freeze and cannot respond.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working Waiting for reply
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@vnicers