Active IQ Unified Manager acquisition fails with "internal error has occurred during MetroCluster component refresh"
Applies to
- Active IQ Unified Manager (AIQUM) 9.7
- Active IQ Unified Manager (AIQUM) 9.7P1
- ONTAP 9
Issue
- The issue seems connected to maintenance, either hardware replacements or software and performing takeover/giveback
- Active IQ Unified Manager acquisition fails with the error in UI, looking at the job when discovering manually:
[cluster] - Cluster Monitoring Failed
Monitoring failed for cluster [cluster]. Reason: An internal error has occurred during MetroCluster component refresh. Contact technical support.
au.log
2020-10-07 13:23:42,078 INFO [oncommand] [collection-completion-0] [c.n.d.i.m.MccFabricConfigDiscoveryHandler] MetroCluster discovery started for clustername at 13:23:42.
2020-10-07 13:23:42,513 ERROR [oncommand] [collection-completion-0] [c.n.d.i.m.MccFabricConfigDiscoveryHandler] MetroCluster monitoring failed for clustername at 13:23:42.
server.log
2020-10-07 13:23:43,318 ERROR [oncommand] [reconcile-4] [clustername(incremental@13:23:41.368)] [c.n.dfm.collector.OcieJmsListener] Error during MetroCluster component monitoring : could not execute batch
com.netapp.dfm.ontap.outbound.zapi.OcumMonitoringFailedException: could not execute batch
at deployment.dfm-app.war//com.netapp.dfm.impl.mcc.MccFabricConfigDiscoveryHandler.discoverTopology(MccFabricConfigDiscoveryHandler.java:108)
at deployment.dfm-app.war//com.netapp.dfm.impl.mcc.MccFabricConfigDiscoveryHandler$$FastClassBySpringCGLIB$$6c3297f.invoke(<generated>)
…
Caused by: java.sql.BatchUpdateException: (conn=94) Duplicate entry '6458966-2130005007' for key 'nodeswitchconnection.NodeSwitchConnection_NodeIdSwitchId_UQ'
at org.mariadb//org.mariadb.jdbc.MariaDbStatement.executeBatchExceptionEpilogue(MariaDbStatement.java:288)
at org.mariadb//org.mariadb.jdbc.ClientSidePreparedStatement.executeBatch(ClientSidePreparedStatement.java:301)
at deployment.dfm-app.war//org.apache.commons.dbcp.DelegatingStatement.executeBatch(DelegatingStatement.java:297)
at deployment.dfm-app.war//org.apache.commons.dbcp.DelegatingStatement.executeBatch(DelegatingStatement.java:297)
at deployment.dfm-app.war//org.hibernate.engine.jdbc.batch.internal.BatchingBatch.performExecution(BatchingBatch.java:110)
... 57 common frames omitted
Caused by: java.sql.SQLIntegrityConstraintViolationException: (conn=94) Duplicate entry '6458966-2130005007' for key 'nodeswitchconnection.NodeSwitchConnection_NodeIdSwitchId_UQ'
at org.mariadb//org.mariadb.jdbc.internal.util.exceptions.ExceptionMapper.get(ExceptionMapper.java:235)
at org.mariadb//org.mariadb.jdbc.internal.util.exceptions.ExceptionMapper.getException(ExceptionMapper.java:171)
at org.mariadb//org.mariadb.jdbc.MariaDbStatement.executeBatchExceptionEpilogue(MariaDbStatement.java:285)
... 61 common frames omitted
Caused by: java.sql.SQLException: Duplicate entry '6458966-2130005007' for key 'nodeswitchconnection.NodeSwitchConnection_NodeIdSwitchId_UQ'
at org.mariadb//org.mariadb.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:1594)
at org.mariadb//org.mariadb.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:1453)
at org.mariadb//org.mariadb.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1415)
at org.mariadb//org.mariadb.jdbc.internal.protocol.AsyncMultiRead.call(AsyncMultiRead.java:142)
at org.mariadb//org.mariadb.jdbc.internal.protocol.AsyncMultiRead.call(AsyncMultiRead.java:68)
... 4 common frames omitted