AIQUM monitoring fails: An internal error has occurred during MetroCluster component refresh

• Active IQ Unified Manager (AIQUM)9.6+
• Oncommand Unified Manager 9.x
• Metrocluster

• In the AIQUM Configuration menu, Cluster Data Sources tab, MetroCluster clusters will have this message in the Description column: 'Monitoring failed...'

• Event created with the title 'Event: Cluster Monitoring Failed' and Trigger Condition: 'Monitoring failed for cluster <MetroCluster-CLUSTER>. Reason: An internal error has occurred during MetroCluster component refresh. Contact technical support.'

The AIQUM ocumserver.log get the following error:

2022-10-11 11:09:05,263 INFO  [oncommand] [reconcile-5] [172.11.4.xx(baseline@11:09:02.343)|complete] [c.n.d.c.CollectionCompletionNotifier] Collection completion notification for cluster 171.55.4.11(inventory.ontap.fas.Cluster:1174580) finished in 0:00:00.968.
2022-10-11 11:09:05,266 INFO  [oncommand] [reconcile-5] [172.11.4.xx(baseline@11:09:02.343)] [com.netapp.dfm.collector.LockUtils] Releasing reconciliation-processing lock(java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock@399aa95a[Locked by thread reconcile-5]) for 29
2022-10-11 11:09:05,326 ERROR [oncommand] [reconcile-5] [172.11.4.xx(baseline@11:09:02.343)] [c.n.dfm.collector.OcieJmsListener] Error during MetroCluster component monitoring : com.ctc.wstx.exc.WstxIOException: Invalid UTF-8 start byte 0xff (at char #4587, byte #3999)
com.netapp.dfm.ontap.outbound.zapi.OcumMonitoringFailedException: com.ctc.wstx.exc.WstxIOException: Invalid UTF-8 start byte 0xff (at char #4587, byte #3999)
               at deployment.dfm-app.war//com.netapp.dfm.impl.mcc.MccFabricConfigDiscoveryHandler.discoverTopology(MccFabricConfigDiscoveryHandler.java:108)
               at deployment.dfm-app.war//com.netapp.dfm.impl.mcc.MccFabricConfigDiscoveryHandler$$FastClassBySpringCGLIB$$6c3297f.invoke(<generated>)
               at deployment.dfm-app.war//org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
               at deployment.dfm-app.war//org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:749)
               at deployment.dfm-app.war//org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
               at deployment.dfm-app.war//org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:294)
               at deployment.dfm-app.war//org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:98)
               at deployment.dfm-app.war//org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
               at deployment.dfm-app.war//org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:688)
               at deployment.dfm-app.war//com.netapp.dfm.impl.mcc.MccFabricConfigDiscoveryHandler$$EnhancerBySpringCGLIB$$75ac78bd.discoverTopology(<generated>)
               at deployment.dfm-app.war//com.netapp.dfm.impl.mcc.MetroClusterRefreshCollectionCompletionListener.handleMccDiscovery(MetroClusterRefreshCollectionCompletionListener.java:172)
               at deployment.dfm-app.war//com.netapp.dfm.impl.mcc.MetroClusterRefreshCollectionCompletionListener.onCompletion(MetroClusterRefreshCollectionCompletionListener.java:104)
               at deployment.dfm-app.war//com.netapp.dfm.impl.mcc.MetroClusterRefreshCollectionCompletionListener$$FastClassBySpringCGLIB$$580f4b79.invoke(<generated>)
               at deployment.dfm-app.war//org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
               at deployment.dfm-app.war//org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:749)
               at deployment.dfm-app.war//org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
               at deployment.dfm-app.war//org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:88)
               at deployment.dfm-app.war//com.netapp.dfm.impl.resource.ReconcilationMonitorAspect.measureCollectionCompletionExecutionTime(ReconcilationMonitorAspect.java:62)
               at jdk.internal.reflect.GeneratedMethodAccessor393.invoke(Unknown Source)
               at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
               at java.base/java.lang.reflect.Method.invoke(Method.java:566)
               at deployment.dfm-app.war//org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:644)
               at deployment.dfm-app.war//org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:633)
               at deployment.dfm-app.war//org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:70)
               at deployment.dfm-app.war//org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
               at deployment.dfm-app.war//org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:93)
               at deployment.dfm-app.war//org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
               at deployment.dfm-app.war//org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:688)
               at deployment.dfm-app.war//com.netapp.dfm.impl.mcc.MetroClusterRefreshCollectionCompletionListener$$EnhancerBySpringCGLIB$$d6a237d5.onCompletion(<generated>)
               at deployment.dfm-app.war//com.netapp.dfm.collector.CollectionCompletionNotifier$3.doInTransactionWithoutResult(CollectionCompletionNotifier.java:244)
               at deployment.dfm-app.war//org.springframework.transaction.support.TransactionCallbackWithoutResult.doInTransaction(TransactionCallbackWithoutResult.java:36)
               at deployment.dfm-app.war//org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140)
               at deployment.dfm-app.war//com.netapp.dfm.persist.util.TransactionCallbacks$RetryableTask.executeTransaction(TransactionCallbacks.java:148)
               at deployment.dfm-app.war//com.netapp.dfm.persist.util.TransactionCallbacks$RetryableTask.run(TransactionCallbacks.java:136)
               at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
               at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
               at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
               at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
               at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: java.lang.RuntimeException: com.ctc.wstx.exc.WstxIOException: Invalid UTF-8 start byte 0xff (at char #4587, byte #3999)
               at deployment.dfm-app.war//org.codehaus.stax2.ri.evt.Stax2FilteredEventReader.hasNext(Stax2FilteredEventReader.java:58)
               at deployment.dfm-app.war//com.netapp.autozapi.marshal.ApiReader.readFields(ApiReader.java:116)
               at deployment.dfm-app.war//com.netapp.autozapi.marshal.ApiReader.readFields(ApiReader.java:99)
               at deployment.dfm-app.war//com.netapp.autozapi.marshal.ApiReader.readTypedef(ApiReader.java:77)
               at deployment.dfm-app.war//com.netapp.autozapi.marshal.ApiReader.readCollection(ApiReader.java:272)
               at deployment.dfm-app.war//com.netapp.autozapi.marshal.ApiReader.readFields(ApiReader.java:150)
               at deployment.dfm-app.war//com.netapp.autozapi.marshal.ApiReader.readFields(ApiReader.java:99)
               at deployment.dfm-app.war//com.netapp.autozapi.marshal.ApiReader.readTypedef(ApiReader.java:77)
               at deployment.dfm-app.war//com.netapp.autozapi.marshal.ApiReader.readCollection(ApiReader.java:272)
               at deployment.dfm-app.war//com.netapp.autozapi.marshal.ApiReader.readFields(ApiReader.java:150)
               at deployment.dfm-app.war//com.netapp.autozapi.marshal.ApiReader.readResponse(ApiReader.java:358)
               at deployment.dfm-app.war//com.netapp.autozapi.client.BeanXmlZapiInvocation.createPassedResponse(BeanXmlZapiInvocation.java:118)
               at deployment.dfm-app.war//com.netapp.autozapi.client.BeanXmlZapiInvocation.createPassedResponse(BeanXmlZapiInvocation.java:70)
               at deployment.dfm-app.war//com.netapp.autozapi.client.XmlZapiInvocation.readResponse(XmlZapiInvocation.java:215)
               at deployment.dfm-app.war//com.netapp.autozapi.client.ZapiInvocation.processResponse(ZapiInvocation.java:249)
               at deployment.dfm-app.war//com.netapp.autozapi.client.ZapiInvocation.invoke(ZapiInvocation.java:117)
               at deployment.dfm-app.war//com.netapp.autozapi.client.XmlZapiInvocation.invoke(XmlZapiInvocation.java:40)
               at deployment.dfm-app.war//com.netapp.autozapi.client.ZapiRunner.run(ZapiRunner.java:167)
               at deployment.dfm-app.war//com.netapp.autozapi.client.ZapiRunner.run(ZapiRunner.java:127)
               at deployment.dfm-app.war//com.netapp.dfm.ontap.outbound.zapi.ZAPIConnection.run(ZAPIConnection.java:86)
               at deployment.dfm-app.war//com.netapp.dfm.ontap.outbound.service.OntapMetroClusterService.fetchSwitchBridgeInfo(OntapMetroClusterService.java:222)
               at deployment.dfm-app.war//com.netapp.dfm.impl.mcc.MccFabricConfigDiscoveryHandler.discoverTopology(MccFabricConfigDiscoveryHandler.java:81)
               ... 38 common frames omitted
Caused by: com.ctc.wstx.exc.WstxIOException: Invalid UTF-8 start byte 0xff (at char #4587, byte #3999)
               at deployment.dfm-app.war//com.ctc.wstx.sr.StreamScanner.constructFromIOE(StreamScanner.java:633)
               at deployment.dfm-app.war//com.ctc.wstx.sr.StreamScanner.loadMoreFromCurrent(StreamScanner.java:1063)
               at deployment.dfm-app.war//com.ctc.wstx.sr.StreamScanner.parseLocalName2(StreamScanner.java:1870)
               at deployment.dfm-app.war//com.ctc.wstx.sr.StreamScanner.parseLocalName(StreamScanner.java:1830)
               at deployment.dfm-app.war//com.ctc.wstx.sr.BasicStreamReader.handleStartElem(BasicStreamReader.java:2941)
               at deployment.dfm-app.war//com.ctc.wstx.sr.BasicStreamReader.nextFromTree(BasicStreamReader.java:2839)
               at deployment.dfm-app.war//com.ctc.wstx.sr.BasicStreamReader.next(BasicStreamReader.java:1073)
               at deployment.dfm-app.war//org.codehaus.stax2.ri.Stax2EventReaderImpl.peek(Stax2EventReaderImpl.java:367)
               at deployment.dfm-app.war//org.codehaus.stax2.ri.evt.Stax2FilteredEventReader.peek(Stax2FilteredEventReader.java:104)
               at deployment.dfm-app.war//org.codehaus.stax2.ri.evt.Stax2FilteredEventReader.peek(Stax2FilteredEventReader.java:104)
               at deployment.dfm-app.war//org.codehaus.stax2.ri.evt.Stax2FilteredEventReader.peek(Stax2FilteredEventReader.java:104)
               at deployment.dfm-app.war//org.codehaus.stax2.ri.evt.Stax2FilteredEventReader.hasNext(Stax2FilteredEventReader.java:56)
               ... 59 common frames omitted
Caused by: java.io.CharConversionException: Invalid UTF-8 start byte 0xff (at char #4587, byte #3999)
               at deployment.dfm-app.war//com.ctc.wstx.io.UTF8Reader.reportInvalidInitial(UTF8Reader.java:303)
               at deployment.dfm-app.war//com.ctc.wstx.io.UTF8Reader.read(UTF8Reader.java:189)
               at deployment.dfm-app.war//com.ctc.wstx.io.ReaderSource.readInto(ReaderSource.java:86)
               at deployment.dfm-app.war//com.ctc.wstx.io.BranchingReaderSource.readInto(BranchingReaderSource.java:56)
               at deployment.dfm-app.war//com.ctc.wstx.sr.StreamScanner.loadMoreFromCurrent(StreamScanner.java:1060)
               ... 69 common frames omitted
2022-10-11 11:09:05,326 ERROR [oncommand] [reconcile-5] [172.11.4.xx(baseline@11:09:02.343)] [c.n.dfm.collector.OcieJmsListener] Inventory change listener error
com.netapp.dfm.ontap.outbound.zapi.OcumMonitoringFailedException: com.ctc.wstx.exc.WstxIOException: Invalid UTF-8 start byte 0xff (at char #4587, byte #3999)