Some storage systems within an OnCommand Insight HDS datasource stop reporting performance statistics

Applies to

OnCommand Insight 7.3.X (OCI)

Issue

• For storage systems attached to a HiCommand Device Manager datasource, some are reporting performance stats and some do not
• No errors are shown in the datasource in OCI
• The API to report the performance stats returns an empty set, which can be confirmed with the following steps:
  1. Download and extract an error report from the datasource
  2. Open one of the numbered folders with the storage performance report: ErrorReportName\acq\storageperformance_<datasourcename>_656_2021_02_24_11_01_32_742\1614163099532
  3. Open the recording_storageperformance-<datasourcename>.dat and search for the storage with the missing stats
  4. The request will have the storage name, and the response will return a list of stat names and variable types, but no actual stat numbers

Missing stats example request and response: 

<<< REQUEST >>>
GET http://<tuningManagerHostnameOrIP>:22015/TuningManager/v1/objects/RAID_PI_PRCS?hostName=<dataSourceName>&agentInstanceName=<storageName>&startTime=2021-02-24T10%3A35Z&endTime=2021-02-24T10%3A39Z HTTP/1.1
<<< REQUESTEND >>>
<<< RESPONSE >>>
HTTP/1.1 200 OK
Date: Wed, 24 Feb 2021 10:39:26 GMT
Server: Cosminexus HTTP Server
X-Frame-Options: SAMEORIGIN
Cache-Control: no-store, no-cache
X-Content-Type-Options: nosniff
Content-Security-Policy: frame-ancestors 'self'
Vary: Accept-Encoding
Last-Modified: Wed, 24 Feb 2021 10:39:26 GMT
X-XSS-Protection: 1; mode=block
Keep-Alive: timeout=5, max=21
Connection: Keep-Alive
Transfer-Encoding: chunked
Content-Type: text/csv;charset=utf-8

INPUT_RECORD_TYPE,DATETIME,GMT_ADJUST,RECORD_TIME,ADAPTOR_ID,PROCESSOR_ID,INTERVAL,CONTROLLER,PROCESSOR_TYPE,PROCESSOR_BUSY_RATE,MAX_PROCESSOR_BUSY_RATE,MAX_BUFFER_LENGTH,BUFFER_IO_COUNT,MAX_BUFFER_IO_COUNT,BUFFER_IO_RATE,MAX_BUFFER_IO_RATE
string(8),time_t,long,time_t,string(16),string(16),ulong,string(8),string(8),float,float,float,float,float,float,float

<<< RESPONSEEND >>>

Collecting stats example response (truncated):

<<< RESPONSE >>>
HTTP/1.1 200 OK
Date: Wed, 24 Feb 2021 10:39:26 GMT
...

INPUT_RECORD_TYPE,DATETIME,GMT_ADJUST,RECORD_TIME,LDEV_COUNT,MONITORED_LDEV_COUNT,INTERVAL,READ_IO_COUNT,READ_IO_RATE,READ_HIT_IO_COUNT,READ_HIT_RATE,WRITE_IO_COUNT,WRITE_IO_RATE,WRITE_HIT_IO_COUNT,WRITE_HIT_RATE,READ_MBYTES,READ_XFER_RATE,WRITE_MBYTES,WRITE_XFER_RATE,READ_TOTAL_RESPONSE,READ_RESPONSE_RATE,WRITE_TOTAL_RESPONSE,WRITE_RESPONSE_RATE
string(8),time_t,long,time_t,ulong,ulong,ulong,double,double,double,double,double,double,double,double,double,double,double,double,double,double,double,double
"LDA",2021-02-24 10:35:00,0,2021-02-24 10:35:01,14,14,60,4.30000000000000E+01,7.16666666666667E-01,4.30000000000000E+01,1.00000000000000E+02,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,1.00000000000000E+00,1.66666666666667E-02,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00
"LDA",2021-02-24 10:36:00,0,2021-02-24 10:36:00,14,14,59,4.30000000000000E+01,7.28813559322034E-01,4.30000000000000E+01,1.00000000000000E+02,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,1.00000000000000E+00,1.69491525423729E-02,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00
"LDA",2021-02-24 10:37:00,0,2021-02-24 10:37:00,14,14,60,4.30000000000000E+01,7.16666666666667E-01,4.30000000000000E+01,1.00000000000000E+02,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,1.00000000000000E+00,1.66666666666667E-02,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00
"LDA",2021-02-24 10:38:00,0,2021-02-24 10:38:01,14,14,61,4.50000000000000E+01,7.37704918032787E-01,4.50000000000000E+01,1.00000000000000E+02,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,1.00000000000000E+00,1.63934426229508E-02,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00
"LDA",2021-02-24 10:39:00,0,2021-02-24 10:39:00,14,14,59,4.30000000000000E+01,7.28813559322034E-01,4.30000000000000E+01,1.00000000000000E+02,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,1.00000000000000E+00,1.69491525423729E-02,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00,0.00000000000000E+00
<<< RESPONSEEND >>>