namespace-persistentvolumeclaim-usage report test discrepancy

testing_query.yaml

apiVersion: metering.openshift.io/v1
kind: ReportQuery
metadata:
  name: "namespace-persistentvolumeclaim-usage"
  labels:
    operator-metering: "true"
spec:
  columns:
  - name: period_start
    type: timestamp
    unit: date
  - name: period_end
    type: timestamp
  - name: namespace
    type: varchar
    unit: kubernetes_namespace
  - name: persistentvolumeclaim_usage_bytes
    type: double
    unit: bytes
  inputs:
  - name: ReportingStart
  - name: ReportingEnd
  - name: PersistentvolumeclaimUsageWithPhaseRawDataSourceName
    type: ReportDataSource
    default: persistentvolumeclaim-usage-with-phase-raw
  query: |
    SELECT
      timestamp '{| default .Report.ReportingStart .Report.Inputs.ReportingStart| prestoTimestamp |}' AS period_start,
      timestamp '{| default .Report.ReportingEnd .Report.Inputs.ReportingEnd | prestoTimestamp |}' AS period_end,
      namespace,
      avg(persistentvolumeclaim_usage_bytes)
    FROM {| dataSourceTableName .Report.Inputs.PersistentvolumeclaimUsageWithPhaseRawDataSourceName |}
    WHERE "timestamp" >= timestamp '{| default .Report.ReportingStart .Report.Inputs.ReportingStart | prestoTimestamp |}'
    AND "timestamp" < timestamp '{| default .Report.ReportingEnd .Report.Inputs.ReportingEnd | prestoTimestamp |}'
    AND dt >= '{| default .Report.ReportingStart .Report.Inputs.ReportingStart | prometheusMetricPartitionFormat |}'
    AND dt <= '{| default .Report.ReportingEnd .Report.Inputs.ReportingEnd | prometheusMetricPartitionFormat |}'
    GROUP BY namespace

Re-organized the testdata/report/namespace-persistentvolumeclaim-usage.json data:

[
    {
        "namespace": "telemeter-tschuy",
        "period_end": "2019-03-18T16:05:00Z",
        "period_start": "2019-03-18T16:00:00Z",
        "persistentvolumeclaim_usage_bytes": 4001415168
    },
    {
        "namespace": "metering-ci2-openshift-continuous-upgrade-master",
        "period_end": "2019-03-18T16:05:00Z",
        "period_start": "2019-03-18T16:00:00Z",
        "persistentvolumeclaim_usage_bytes": 13105745920
    },
    {
        "namespace": "metering-chancez",
        "period_end": "2019-03-18T16:05:00Z",
        "period_start": "2019-03-18T16:00:00Z",
        "persistentvolumeclaim_usage_bytes": 622006272
    },
    {
        "namespace": "metering-tschuy",
        "period_end": "2019-03-18T16:05:00Z",
        "period_start": "2019-03-18T16:00:00Z",
        "persistentvolumeclaim_usage_bytes": 3586506752
    },
    {
        "namespace": "openshift-monitoring",
        "period_end": "2019-03-18T16:05:00Z",
        "period_start": "2019-03-18T16:00:00Z",
        "persistentvolumeclaim_usage_bytes": 56421826560
    }
]

The local test results:

presto:metering> select * from report_testing_validhdfs_reportstaticinputdata_namespace_persistentvolumeclaim_usage;
      period_start       |       period_end        |                    namespace                     | persistentvolumeclaim_usage_bytes 
-------------------------+-------------------------+--------------------------------------------------+-----------------------------------
 2019-03-18 16:00:00.000 | 2019-03-18 16:05:00.000 | telemeter-tschuy                                 |                     4.001415168E9 
 2019-03-18 16:00:00.000 | 2019-03-18 16:05:00.000 | metering-ci2-openshift-continuous-upgrade-master |                    1.310574592E10 
 2019-03-18 16:00:00.000 | 2019-03-18 16:05:00.000 | metering-chancez                                 |                      6.22006272E8 
 2019-03-18 16:00:00.000 | 2019-03-18 16:05:00.000 | metering-tschuy                                  |                     3.586506752E9 
 2019-03-18 16:00:00.000 | 2019-03-18 16:05:00.000 | openshift-monitoring                             |                    5.642182656E10 
(5 rows)

Query 20200528_181219_00237_cgggb, FINISHED, 1 node
Splits: 17 total, 17 done (100.00%)
0:00 [5 rows, 779B] [21 rows/s, 3.32KB/s]

presto:metering>