Found database entries in the future

I'm running Pi-hole in Docker and found "accidentally" some weird messages in `/var/log/pihole-FTL.log' every hour in all my installations:

…
[2022-05-08 09:20:07.955 28318M] WARN: Found database entries in the future (2022-05-08 09:25:00 (1651994700), last timestamp for importing: 2022-05-08 09:05:00 (1651993500)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-08 10:20:01.584 12479M] WARN: Found database entries in the future (2022-05-08 10:25:00 (1651998300), last timestamp for importing: 2022-05-08 10:05:00 (1651997100)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-08 11:20:00.338 29122M] WARN: Found database entries in the future (2022-05-08 11:25:00 (1652001900), last timestamp for importing: 2022-05-08 11:05:00 (1652000700)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-08 12:20:01.110 13131M] WARN: Found database entries in the future (2022-05-08 12:25:00 (1652005500), last timestamp for importing: 2022-05-08 12:05:00 (1652004300)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-08 13:20:08.714 30626M] WARN: Found database entries in the future (2022-05-08 13:25:00 (1652009100), last timestamp for importing: 2022-05-08 13:05:00 (1652007900)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-08 14:20:17.404 14480M] WARN: Found database entries in the future (2022-05-08 14:25:00 (1652012700), last timestamp for importing: 2022-05-08 14:05:00 (1652011500)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-08 15:20:02.113 30962M] WARN: Found database entries in the future (2022-05-08 15:25:00 (1652016300), last timestamp for importing: 2022-05-08 15:05:00 (1652015100)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-08 16:20:01.478 14977M] WARN: Found database entries in the future (2022-05-08 16:25:00 (1652019900), last timestamp for importing: 2022-05-08 16:05:00 (1652018700)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-08 17:20:01.820 31443M] WARN: Found database entries in the future (2022-05-08 17:25:00 (1652023500), last timestamp for importing: 2022-05-08 17:05:00 (1652022300)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-08 18:20:01.267 15468M] WARN: Found database entries in the future (2022-05-08 18:25:00 (1652027100), last timestamp for importing: 2022-05-08 18:05:00 (1652025900)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-08 19:20:13.856 2689M] WARN: Found database entries in the future (2022-05-08 19:25:00 (1652030700), last timestamp for importing: 2022-05-08 19:05:00 (1652029500)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-08 20:20:02.528 19141M] WARN: Found database entries in the future (2022-05-08 20:25:00 (1652034300), last timestamp for importing: 2022-05-08 20:05:00 (1652033100)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-08 21:20:04.233 2983M] WARN: Found database entries in the future (2022-05-08 21:25:00 (1652037900), last timestamp for importing: 2022-05-08 21:05:00 (1652036700)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-08 22:20:24.986 19445M] WARN: Found database entries in the future (2022-05-08 22:25:00 (1652041500), last timestamp for importing: 2022-05-08 22:05:00 (1652040300)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-08 23:20:02.062 3453M] WARN: Found database entries in the future (2022-05-08 23:25:00 (1652045100), last timestamp for importing: 2022-05-08 23:05:00 (1652043900)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-09 00:20:24.001 20073M] WARN: Found database entries in the future (2022-05-09 00:25:00 (1652048700), last timestamp for importing: 2022-05-09 00:05:00 (1652047500)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-09 01:20:25.004 4089M] WARN: Found database entries in the future (2022-05-09 01:25:00 (1652052300), last timestamp for importing: 2022-05-09 01:05:00 (1652051100)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-09 02:20:00.420 20576M] WARN: Found database entries in the future (2022-05-09 02:25:00 (1652055900), last timestamp for importing: 2022-05-09 02:05:00 (1652054700)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-09 03:20:17.091 4593M] WARN: Found database entries in the future (2022-05-09 03:25:00 (1652059500), last timestamp for importing: 2022-05-09 03:05:00 (1652058300)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-09 04:20:02.199 21233M] WARN: Found database entries in the future (2022-05-09 04:25:00 (1652063100), last timestamp for importing: 2022-05-09 04:05:00 (1652061900)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-09 05:20:18.283 5229M] WARN: Found database entries in the future (2022-05-09 05:25:00 (1652066700), last timestamp for importing: 2022-05-09 05:05:00 (1652065500)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-09 06:20:10.315 21893M] WARN: Found database entries in the future (2022-05-09 06:25:00 (1652070300), last timestamp for importing: 2022-05-09 06:05:00 (1652069100)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-09 07:30:00.755 524M] WARN: Found database entries in the future (2022-05-09 07:35:00 (1652074500), last timestamp for importing: 2022-05-09 07:15:00 (1652073300)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-09 08:20:00.617 26499M] WARN: Found database entries in the future (2022-05-09 08:25:00 (1652077500), last timestamp for importing: 2022-05-09 08:05:00 (1652076300)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-09 09:20:18.002 10543M] WARN: Found database entries in the future (2022-05-09 09:25:00 (1652081100), last timestamp for importing: 2022-05-09 09:05:00 (1652079900)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-09 10:20:00.141 27184M] WARN: Found database entries in the future (2022-05-09 10:25:00 (1652084700), last timestamp for importing: 2022-05-09 10:05:00 (1652083500)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-09 11:20:06.703 11062M] WARN: Found database entries in the future (2022-05-09 11:25:00 (1652088300), last timestamp for importing: 2022-05-09 11:05:00 (1652087100)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-09 12:20:00.351 27565M] WARN: Found database entries in the future (2022-05-09 12:25:00 (1652091900), last timestamp for importing: 2022-05-09 12:05:00 (1652090700)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-09 13:20:18.001 11430M] WARN: Found database entries in the future (2022-05-09 13:25:00 (1652095500), last timestamp for importing: 2022-05-09 13:05:00 (1652094300)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-09 14:20:02.222 28080M] WARN: Found database entries in the future (2022-05-09 14:25:00 (1652099100), last timestamp for importing: 2022-05-09 14:05:00 (1652097900)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-09 15:20:03.820 12126M] WARN: Found database entries in the future (2022-05-09 15:25:00 (1652102700), last timestamp for importing: 2022-05-09 15:05:00 (1652101500)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-09 16:20:05.430 28476M] WARN: Found database entries in the future (2022-05-09 16:25:00 (1652106300), last timestamp for importing: 2022-05-09 16:05:00 (1652105100)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-09 17:20:06.417 12340M] WARN: Found database entries in the future (2022-05-09 17:25:00 (1652109900), last timestamp for importing: 2022-05-09 17:05:00 (1652108700)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)
[2022-05-09 18:20:05.422 28845M] WARN: Found database entries in the future (2022-05-09 18:25:00 (1652113500), last timestamp for importing: 2022-05-09 18:05:00 (1652112300)). Your over-time statistics may be incorrect (found in src/dnsmasq_interface.c:667)

I really would know what and why this is happening… :man_shrugging:

On boot long FTL startup and web graphs blank until FTL restarted · Issue #4459 · pi-hole/pi-hole · GitHub didn't help or explain WHY this happens every hour…

We are currently chasing an bug likely introduced by Fix initOverTime's calculation of last slot timestamp by icyflame · Pull Request #1312 · pi-hole/FTL · GitHub which introduced a modified overtime calculation.
You can follow here: Always return full overTime data by DL6ER · Pull Request #1345 · pi-hole/FTL · GitHub

(although you observe different "issues"/warnings, the relevant code is changed by the open PR above)

1 Like

I suspect this warning is related to this thread:
[2022-05-10 15:30:00.638 24562M] WARN: Found database entries in the future (2022-05-10 15:35:00 (1652222100), last timestamp for importing: 2022-05-10 15:15:00 (1652220900)). Your over-time statistics may be in correct (found in src/dnsmasq_interface.c:667)
which happens upon dns restart. This then results in about an hour gap in the UI graphs after the restart.

I've a "half-an-hour gap" after restarting:

I did a restart at 6:30am and there's a gap in the UI graph until 7am - but I agree that this might be related, but somehow this message is also coming on one of my Pi-hole quite often (exactly every hour without any gap in UI graph but not directly after restart!?)

…
[2022-05-12 06:30:14.910 652M] listening on 0.0.0.0 port 53
[2022-05-12 06:30:14.910 652M] listening on :: port 53
[2022-05-12 06:30:14.912 652M] PID of FTL process: 652
[2022-05-12 06:30:14.912 652/T660] Listening on port 4711 for incoming IPv4 telnet connections
[2022-05-12 06:30:14.912 652M] INFO: FTL is running as user pihole (UID 999)
[2022-05-12 06:30:14.912 652M] Reloading DNS cache
[2022-05-12 06:30:14.913 652/T662] Listening on Unix socket
[2022-05-12 06:30:15.017 652/T663] Compiled 3 whitelist and 20 blacklist regex filters for 3 clients in 3.4 msec
[2022-05-12 06:30:15.017 652/T663] Blocking status is enabled
[2022-05-12 06:50:01.616 652M] WARN: Found database entries in the future (2022-05-12 06:55:00 (1652331300), last timestamp for importing: 2022-05-12 06:35:00 (1652330100)). Your over-time statistics may be incorrect (
found in src/dnsmasq_interface.c:667)
[2022-05-12 07:00:00.057 652/T663] Notice: Database size is 446.53 MB, deleted 947 rows
[2022-05-12 07:15:14.560 652M] WARNING in dnsmasq core: ignoring query from non-local network 167.248.133.135 (logged only once)
[2022-05-12 08:00:00.031 652/T663] Notice: Database size is 446.53 MB, deleted 923 rows
[2022-05-12 08:53:40.223 169140/F652] WARNING in dnsmasq core: ignoring query from non-local network 106.75.148.201
[2022-05-12 08:53:40.671 169141/F652] WARNING in dnsmasq core: ignoring query from non-local network 106.75.148.201
[2022-05-12 08:53:41.111 169142/F652] WARNING in dnsmasq core: ignoring query from non-local network 106.75.148.201
[2022-05-12 08:53:41.530 169143/F652] WARNING in dnsmasq core: ignoring query from non-local network 106.75.148.201
[2022-05-12 08:53:41.974 169144/F652] WARNING in dnsmasq core: ignoring query from non-local network 106.75.148.201
[2022-05-12 09:00:00.031 652/T663] Notice: Database size is 446.53 MB, deleted 939 rows
[2022-05-12 10:00:00.073 652/T663] Notice: Database size is 446.53 MB, deleted 807 rows

I'm still getting (a single?) occurrence some minutes after restarting with 2022.05 … :thinking:

Can you post your docker-compose.yml or your docker run command line?

version: "3"


services:
  pihole:
    hostname: 'pihole-some-location'
    container_name: pihole
    image: pihole/pihole:latest
    ports:
      - "53:53/tcp"
      - "53:53/udp"
      - "12380:80/tcp"
      - "23443:443/tcp"
    environment:
      TZ: 'Europe/Berlin'
      WEBPASSWORD: 'toppsecret'
    volumes:
      - './etc-pihole/:/etc/pihole/'
      - './etc-dnsmasq.d/:/etc/dnsmasq.d/'
      - './etc-lighttpd-external.conf:/etc/lighttpd/external.conf'
      - './etc-letsencrypt:/etc/letsencrypt/'
    cap_add:
      - CAP_SYS_NICE
    restart: unless-stopped