Failed to delete storage pool on host.

[svatec]

Hi,

I am trying to delete primary storage from ACS GUI but when I try to delete it I get the error below.

In the cloud.storage_pool_host_ref table I see a record in which this primary storage refers to an already deleted host. This host was added later and in the host table it is under id = 14. My question is:

1. Can I safely delete this row from the cloud.storage_pool_host_ref table without any negative impact on ACS?
2. How is it possible that this record is still there and prevents me from deleting the primary storage?

Thanks for the answers.

2026-06-10 11:59:06,232 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (qtp332699949-69952:[ctx-ee239625, ctx-4763f8db]) (logid:899068bc) Host with id 2 doesn't exist
2026-06-10 11:59:06,233 ERROR [c.c.a.ApiServer] (qtp332699949-69952:[ctx-ee239625, ctx-4763f8db]) (logid:899068bc) unhandled exception executing api command: [Ljava.lang.String;@3adb2772 com.cloud.utils.excep
tion.CloudRuntimeException: Failed to delete storage pool on host
at org.apache.cloudstack.storage.datastore.lifecycle.CloudStackPrimaryDataStoreLifeCycleImpl.deleteDataStore(CloudStackPrimaryDataStoreLifeCycleImpl.java:515)
at com.cloud.storage.StorageManagerImpl.deleteDataStoreInternal(StorageManagerImpl.java:1799)
at com.cloud.storage.StorageManagerImpl.deletePool(StorageManagerImpl.java:1702)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)
at com.sun.proxy.$Proxy131.deletePool(Unknown Source)
at org.apache.cloudstack.api.command.admin.storage.DeletePoolCmd.execute(DeletePoolCmd.java:71)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:173)
at com.cloud.api.ApiServer.queueCommand(ApiServer.java:854)
at com.cloud.api.ApiServer.handleRequest(ApiServer.java:668)
at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:416)
at com.cloud.api.ApiServlet$1.run(ApiServlet.java:193)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:190)
at com.cloud.api.ApiServlet.doPost(ApiServlet.java:149)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:665)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
at org.eclipse.jetty.servlet.ServletHolder$NotAsync.service(ServletHolder.java:1450)
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:554)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772)
at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
at org.eclipse.jetty.server.Server.handle(Server.java:516)
at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)
at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:555)
at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:410)
at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:164)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
at java.base/java.lang.Thread.run(Thread.java:829)

[TheKunalSen]

So you have deleted that host, right?

In the ui, is the host still visible?

and i would suggest not to hamper the ACS DB, unless it's the last option.

that primary storage is having any active vms?

try putting the primary storage into maintenance mode first.

[svatec]

Hi,

Problematic storage is ps-hdd-sbakvm20 with id 26.

Own situation:

1. Host with same name was deleted and later added.

2. Host is visible in UI

3. Ok, we looking and waiting for best solution

4. Primary storage is empty, no active VMs. There is list of strorage_pool table

5. PS is in mainteneance mode. Look at the screenshot in point 4.

[TheKunalSen]

@svatec

If the primary storage is not holding anything, then you can try force delete.

and if it is still pointing to the deleted host that you added again later, then the same host has got two entries , in this case we might need to edit in db

but try force delete first

[svatec]

Hi,

unfortunately force delete doesn't work, I've already tried that. :-(

[TheKunalSen]

@svatec

then your prev host deletion did not clean up every details

in acs db try this line and this should not return anything

SELECT * FROM host WHERE id = 2;

also check for volumes

SELECT * FROM volumes WHERE pool_id = your_pool_id;

then you can manually delete the entry
DELETE FROM cloud.storage_pool_host_ref WHERE host_id = 2;

but before that make sure the this is the correct host id and then try removing the ps again from gui

[svatec]

1. I try SELECT * FROM cloud.host WHERE id = "2" and removed is null; , no record

2. I try SELECT * FROM cloud.volumes WHERE pool_id ="26" and removed is null; , no records

Ok, next step i try DELETE FROM cloud.storage_pool_host_ref WHERE host_id = 2;.

After deleting the record, do I need to restart the cloudstack management service and then try to delete the problematic primary storage?
So I take this as confirmation of my assumption that I can delete this record from the cloud.storage_pool_host_ref table without any negative impact.

Thank you for you assistance.

Gabriel

[TheKunalSen]

yes after deletion restart the management then try to delete again