Missing data points with Textfile Collector

Description

Hi,

We are facing a strange issue with textfile collector. We use textfile collector to send metrics to PMM like about backups or failovers etc.. 

We noticed that if we want to graph the data point if we check the last 90 minutes there are no data points in grafana at all.. but if we check last 100 minutes we can see all the data points..  actually there is a switch between last 93 minutes showed only 2 datapoints last 94 minutes showed everything.. 

vs you can see many data points here:

However as you can see the time stamps every 5-10seconds which does not make sense because it should collect the metrics in every minutes as far as I know, but maybe I am wrong on that.

I also did some testing and even if I change the metrics in the textfile and dashboard says it collected that many times the value is unchanged in PMM. 

That is really bad because that impacts our alerting.

 

So questions:

  • why PMM does not show all the datapoints if the timeframe less then 100s

  • why PMM does not collect the right value even it show there was data collected?

Here is a very simple textfile what I was using:

# HELP gas_ip_controller IP controller Failover metrics # TYPE gas_ip_controller Untyped # HELP gas_ip_controller_last_report_ts IP controller Failover metrics # TYPE gas_ip_controller_last_report_ts Untyped gas_ip_controller{type="failover_error",cluster="cluster1-tibi",message="none"} 1 gas_ip_controller_last_report_ts{type="failover_error",cluster="cluster1-tibi",message="none"} 1691507012

How to test

None

How to document

None

Attachments

2
  • 09 Aug 2023, 11:41 AM
  • 09 Aug 2023, 11:41 AM

Activity

Show:

Roma Novikov August 28, 2023 at 9:26 AM

HR fixed the problem 

Not a Bug

Details

Assignee

Reporter

Priority

Labels

Needs QA

Yes

Affects versions

Smart Checklist

Created August 9, 2023 at 11:49 AM
Updated March 5, 2024 at 10:13 PM
Resolved August 28, 2023 at 9:26 AM

Flag notifications