Hmm, yes. The time correction algorithm used by us makes your local clock tick a little faster (or slower) to eventually match the correct time. This avoids any discontinuities but it also underlines that 10 seconds for retrying to too litte waiting. On the other hand, we may be a bit picky on the accuracy of the local clock...
I think we can relax the criterion to 0.5 seconds instead and increase the retry interval to 10 minutes as a compromise.
edit Pushed the change to the branch
It's working great! Thank you for your patience and guidance working through this issue!
This is after a cold boot:
2024-12-21 11:41:11.554 INFO PID of FTL process: 927
2024-12-21 11:41:11.555 INFO listening on 0.0.0.0 port 53
2024-12-21 11:41:11.555 INFO listening on :: port 53
2024-12-21 11:41:11.556 INFO PID of FTL process: 927
2024-12-21 11:41:11.559 INFO Database version is 20
2024-12-21 11:41:11.559 INFO Database successfully initialized
2024-12-21 11:41:13.388 INFO Imported 95323 queries from the on-disk database (it has 9084236 rows)
2024-12-21 11:41:13.388 INFO Parsing queries in database
2024-12-21 11:41:13.442 INFO 10000 queries parsed...
2024-12-21 11:41:13.477 INFO 20000 queries parsed...
2024-12-21 11:41:13.512 INFO 30000 queries parsed...
2024-12-21 11:41:13.559 INFO 40000 queries parsed...
2024-12-21 11:41:13.606 INFO 50000 queries parsed...
2024-12-21 11:41:13.637 INFO 60000 queries parsed...
2024-12-21 11:41:13.669 INFO 70000 queries parsed...
2024-12-21 11:41:13.699 INFO 80000 queries parsed...
2024-12-21 11:41:13.736 INFO 90000 queries parsed...
2024-12-21 11:41:13.756 INFO Imported 95322 queries from the long-term database
2024-12-21 11:41:13.756 INFO -> Total DNS queries: 95322
2024-12-21 11:41:13.756 INFO -> Cached DNS queries: 26439
2024-12-21 11:41:13.756 INFO -> Forwarded DNS queries: 43193
2024-12-21 11:41:13.756 INFO -> Blocked DNS queries: 24921
2024-12-21 11:41:13.756 INFO -> Unknown DNS queries: 358
2024-12-21 11:41:13.756 INFO -> Unique domains: 3135
2024-12-21 11:41:13.756 INFO -> Unique clients: 69
2024-12-21 11:41:13.756 INFO -> DNS cache records: 2188
2024-12-21 11:41:13.756 INFO -> Known forward destinations: 4
2024-12-21 11:41:21.991 INFO FTL is running as user pihole (UID 999)
2024-12-21 11:41:21.991 INFO Reading certificate from /etc/pihole/tls.pem ...
2024-12-21 11:41:21.991 INFO Using SSL/TLS certificate file /etc/pihole/tls.pem
2024-12-21 11:41:21.992 INFO Restored 4 API sessions from the database
2024-12-21 11:41:22.016 INFO Blocking status is enabled
2024-12-21 11:41:22.045 DEBUG_NTP Server reference time: eb119800.00000000 = 2024-12-21 11:39:44.000000 PST
2024-12-21 11:41:22.045 DEBUG_NTP Current time at client: eb119862.0ba50939 = 2024-12-21 11:41:22.045486 PST
2024-12-21 11:41:22.045 DEBUG_NTP Current time at server: eb119862.03b9bccf = 2024-12-21 11:41:22.014552 PST
2024-12-21 11:41:22.045 DEBUG_NTP Time offset: -4.828691e-03 s
2024-12-21 11:41:22.045 DEBUG_NTP Round-trip delay: 5.221033e-02 s
2024-12-21 11:41:22.045 DEBUG_NTP Root delay: 2.441406e-04 s
2024-12-21 11:41:22.045 DEBUG_NTP Root dispersion: 4.882812e-04 s
2024-12-21 11:41:22.187 INFO Compiled 7 allow and 19 deny regex for 69 clients in 76.7 msec
2024-12-21 11:41:22.591 DEBUG_NTP Server reference time: eb119800.00000000 = 2024-12-21 11:39:44.000000 PST
2024-12-21 11:41:22.591 DEBUG_NTP Current time at client: eb119862.97736cdf = 2024-12-21 11:41:22.591604 PST
2024-12-21 11:41:22.591 DEBUG_NTP Current time at server: eb119862.919fb2cd = 2024-12-21 11:41:22.568843 PST
2024-12-21 11:41:22.591 DEBUG_NTP Time offset: -8.456707e-04 s
2024-12-21 11:41:22.592 DEBUG_NTP Round-trip delay: 4.383326e-02 s
2024-12-21 11:41:22.592 DEBUG_NTP Root delay: 2.441406e-04 s
2024-12-21 11:41:22.592 DEBUG_NTP Root dispersion: 4.882812e-04 s
2024-12-21 11:41:23.135 DEBUG_NTP Server reference time: eb119800.00000000 = 2024-12-21 11:39:44.000000 PST
2024-12-21 11:41:23.136 DEBUG_NTP Current time at client: eb119863.22cd5b68 = 2024-12-21 11:41:23.135945 PST
2024-12-21 11:41:23.136 DEBUG_NTP Current time at server: eb119863.1d27a16f = 2024-12-21 11:41:23.113885 PST
2024-12-21 11:41:23.136 DEBUG_NTP Time offset: -2.839565e-04 s
2024-12-21 11:41:23.136 DEBUG_NTP Round-trip delay: 4.355192e-02 s
2024-12-21 11:41:23.136 DEBUG_NTP Root delay: 2.441406e-04 s
2024-12-21 11:41:23.136 DEBUG_NTP Root dispersion: 4.882812e-04 s
2024-12-21 11:41:23.678 DEBUG_NTP Server reference time: eb119800.00000000 = 2024-12-21 11:39:44.000000 PST
2024-12-21 11:41:23.678 DEBUG_NTP Current time at client: eb119863.adb573ea = 2024-12-21 11:41:23.678549 PST
2024-12-21 11:41:23.678 DEBUG_NTP Current time at server: eb119863.a86353f7 = 2024-12-21 11:41:23.657765 PST
2024-12-21 11:41:23.678 DEBUG_NTP Time offset: 1.795292e-04 s
2024-12-21 11:41:23.678 DEBUG_NTP Round-trip delay: 4.192781e-02 s
2024-12-21 11:41:23.678 DEBUG_NTP Root delay: 2.441406e-04 s
2024-12-21 11:41:23.678 DEBUG_NTP Root dispersion: 4.882812e-04 s
2024-12-21 11:41:24.221 DEBUG_NTP Server reference time: eb119800.00000000 = 2024-12-21 11:39:44.000000 PST
2024-12-21 11:41:24.221 DEBUG_NTP Current time at client: eb119864.38a47ecf = 2024-12-21 11:41:24.221259 PST
2024-12-21 11:41:24.221 DEBUG_NTP Current time at server: eb119864.33500a6e = 2024-12-21 11:41:24.200440 PST
2024-12-21 11:41:24.221 DEBUG_NTP Time offset: 2.233982e-04 s
2024-12-21 11:41:24.221 DEBUG_NTP Round-trip delay: 4.208708e-02 s
2024-12-21 11:41:24.221 DEBUG_NTP Root delay: 2.441406e-04 s
2024-12-21 11:41:24.221 DEBUG_NTP Root dispersion: 4.882812e-04 s
2024-12-21 11:41:24.763 DEBUG_NTP Server reference time: eb119800.00000000 = 2024-12-21 11:39:44.000000 PST
2024-12-21 11:41:24.763 DEBUG_NTP Current time at client: eb119864.c38561d4 = 2024-12-21 11:41:24.763753 PST
2024-12-21 11:41:24.763 DEBUG_NTP Current time at server: eb119864.be26dee7 = 2024-12-21 11:41:24.742780 PST
2024-12-21 11:41:24.763 DEBUG_NTP Time offset: 8.058548e-05 s
2024-12-21 11:41:24.763 DEBUG_NTP Round-trip delay: 4.210758e-02 s
2024-12-21 11:41:24.763 DEBUG_NTP Root delay: 2.441406e-04 s
2024-12-21 11:41:24.763 DEBUG_NTP Root dispersion: 4.882812e-04 s
2024-12-21 11:41:25.308 DEBUG_NTP Server reference time: eb119800.00000000 = 2024-12-21 11:39:44.000000 PST
2024-12-21 11:41:25.308 DEBUG_NTP Current time at client: eb119865.4f06c43f = 2024-12-21 11:41:25.308696 PST
2024-12-21 11:41:25.308 DEBUG_NTP Current time at server: eb119865.49ac520f = 2024-12-21 11:41:25.287785 PST
2024-12-21 11:41:25.308 DEBUG_NTP Time offset: 1.604557e-04 s
2024-12-21 11:41:25.308 DEBUG_NTP Round-trip delay: 4.214430e-02 s
2024-12-21 11:41:25.308 DEBUG_NTP Root delay: 2.441406e-04 s
2024-12-21 11:41:25.308 DEBUG_NTP Root dispersion: 4.882812e-04 s
2024-12-21 11:41:25.851 DEBUG_NTP Server reference time: eb119800.00000000 = 2024-12-21 11:39:44.000000 PST
2024-12-21 11:41:25.851 DEBUG_NTP Current time at client: eb119865.d9ec1c1d = 2024-12-21 11:41:25.851258 PST
2024-12-21 11:41:25.851 DEBUG_NTP Current time at server: eb119865.d49bd3d2 = 2024-12-21 11:41:25.830502 PST
2024-12-21 11:41:25.851 DEBUG_NTP Time offset: 3.263950e-04 s
2024-12-21 11:41:25.851 DEBUG_NTP Round-trip delay: 4.216623e-02 s
2024-12-21 11:41:25.851 DEBUG_NTP Root delay: 2.441406e-04 s
2024-12-21 11:41:25.851 DEBUG_NTP Root dispersion: 4.882812e-04 s
2024-12-21 11:41:26.351 INFO Received 8/8 valid NTP replies from time.nist.gov
2024-12-21 11:41:26.351 DEBUG_NTP Average time offset: (-6.234944e-04 +/- 1.628765e-03) s
2024-12-21 11:41:26.351 DEBUG_NTP Average round-trip delay: (4.375356e-02 +/- 3.269042e-03) s
2024-12-21 11:41:26.351 INFO Time offset: -2.275194e-02 ms (excluded 1 outliers)
2024-12-21 11:41:26.351 INFO Round-trip delay: 4.254545e+01 ms (excluded 1 outliers)
2024-12-21 11:41:26.351 DEBUG_NTP Gradually adjusting system time by -22 us
2024-12-21 11:41:27.001 DEBUG_NTP Successfully opened RTC at "/dev/rtc0"
2024-12-21 11:41:27.003 INFO Current RTC time is 2024-12-21 19:41:26
2024-12-21 11:41:27.003 DEBUG_NTP Successfully opened RTC at "/dev/rtc0"
2024-12-21 11:41:27.004 INFO RTC time set to 2024-12-21 19:41:27
2024-12-21 11:41:27.004 INFO NTP server listening on 0.0.0.0:123 (IPv4)
2024-12-21 11:41:45.214 DEBUG_NTP Received NTP request from 172.31.31.136:123
2024-12-21 11:41:45.214 DEBUG_NTP Reference Timestamp: eb119866.5a109d06 = 2024-12-21 11:41:26.351815 PST
2024-12-21 11:41:45.214 DEBUG_NTP Origin Timestamp: eb119879.2b78140b = 2024-12-21 11:41:45.169800 PST
2024-12-21 11:41:45.214 DEBUG_NTP Receive Timestamp: eb119879.36dff822 = 2024-12-21 11:41:45.214354 PST
2024-12-21 11:41:45.214 DEBUG_NTP Transmit Timestamp: eb119879.36ef2c73 = 2024-12-21 11:41:45.214586 PST
2024-12-21 11:41:45.214 DEBUG_NTP NTP reply sent
2024-12-21 11:42:00.690 DEBUG_ANY dnsmasq received signal 17
2024-12-21 11:42:00.700 DEBUG_ANY dnsmasq received signal 17
After reboot:
*** FTL restarted ***
2024-12-21 11:45:26.214 INFO PID of FTL process: 877
2024-12-21 11:45:26.278 INFO listening on 0.0.0.0 port 53
2024-12-21 11:45:26.278 INFO listening on :: port 53
2024-12-21 11:45:26.279 INFO PID of FTL process: 877
2024-12-21 11:45:26.509 INFO Database version is 20
2024-12-21 11:45:26.509 INFO Database successfully initialized
2024-12-21 11:46:03.048 INFO Imported 95420 queries from the on-disk database (it has 9084604 rows)
2024-12-21 11:46:03.049 INFO Parsing queries in database
2024-12-21 11:46:03.112 INFO 10000 queries parsed...
2024-12-21 11:46:03.152 INFO 20000 queries parsed...
2024-12-21 11:46:03.192 INFO 30000 queries parsed...
2024-12-21 11:46:03.245 INFO 40000 queries parsed...
2024-12-21 11:46:03.296 INFO 50000 queries parsed...
2024-12-21 11:46:03.328 INFO 60000 queries parsed...
2024-12-21 11:46:03.364 INFO 70000 queries parsed...
2024-12-21 11:46:03.397 INFO 80000 queries parsed...
2024-12-21 11:46:03.439 INFO 90000 queries parsed...
2024-12-21 11:46:03.461 INFO Imported 95398 queries from the long-term database
2024-12-21 11:46:03.461 INFO -> Total DNS queries: 95398
2024-12-21 11:46:03.461 INFO -> Cached DNS queries: 26442
2024-12-21 11:46:03.461 INFO -> Forwarded DNS queries: 43286
2024-12-21 11:46:03.461 INFO -> Blocked DNS queries: 24901
2024-12-21 11:46:03.461 INFO -> Unknown DNS queries: 357
2024-12-21 11:46:03.461 INFO -> Unique domains: 3138
2024-12-21 11:46:03.461 INFO -> Unique clients: 69
2024-12-21 11:46:03.461 INFO -> DNS cache records: 2190
2024-12-21 11:46:03.461 INFO -> Known forward destinations: 4
2024-12-21 11:46:03.781 INFO FTL is running as user pihole (UID 999)
2024-12-21 11:46:03.783 INFO Reading certificate from /etc/pihole/tls.pem ...
2024-12-21 11:46:03.787 INFO Using SSL/TLS certificate file /etc/pihole/tls.pem
2024-12-21 11:46:03.788 INFO Restored 4 API sessions from the database
2024-12-21 11:46:03.796 INFO Blocking status is enabled
2024-12-21 11:46:03.847 DEBUG_NTP Server reference time: eb119900.00000000 = 2024-12-21 11:44:00.000000 PST
2024-12-21 11:46:03.848 DEBUG_NTP Current time at client: eb11997b.d913f8db = 2024-12-21 11:46:03.847960 PST
2024-12-21 11:46:03.848 DEBUG_NTP Current time at server: eb11997c.1d51c397 = 2024-12-21 11:46:04.114528 PST
2024-12-21 11:46:03.848 DEBUG_NTP Time offset: 2.945256e-01 s
2024-12-21 11:46:03.848 DEBUG_NTP Round-trip delay: 5.591583e-02 s
2024-12-21 11:46:03.848 DEBUG_NTP Root delay: 2.441406e-04 s
2024-12-21 11:46:03.848 DEBUG_NTP Root dispersion: 4.882812e-04 s
2024-12-21 11:46:03.964 INFO Compiled 7 allow and 19 deny regex for 69 clients in 73.8 msec
2024-12-21 11:46:04.399 DEBUG_NTP Server reference time: eb119900.00000000 = 2024-12-21 11:44:00.000000 PST
2024-12-21 11:46:04.399 DEBUG_NTP Current time at client: eb11997c.66351dee = 2024-12-21 11:46:04.399247 PST
2024-12-21 11:46:04.399 DEBUG_NTP Current time at server: eb11997c.aba856e9 = 2024-12-21 11:46:04.670537 PST
2024-12-21 11:46:04.399 DEBUG_NTP Time offset: 2.967477e-01 s
2024-12-21 11:46:04.399 DEBUG_NTP Round-trip delay: 5.091667e-02 s
2024-12-21 11:46:04.399 DEBUG_NTP Root delay: 2.441406e-04 s
2024-12-21 11:46:04.399 DEBUG_NTP Root dispersion: 4.882812e-04 s
2024-12-21 11:46:04.952 DEBUG_NTP Server reference time: eb119900.00000000 = 2024-12-21 11:44:00.000000 PST
2024-12-21 11:46:04.952 DEBUG_NTP Current time at client: eb11997c.f3e23f24 = 2024-12-21 11:46:04.952670 PST
2024-12-21 11:46:04.952 DEBUG_NTP Current time at server: eb11997d.396a5eba = 2024-12-21 11:46:05.224279 PST
2024-12-21 11:46:04.952 DEBUG_NTP Time offset: 2.980802e-01 s
2024-12-21 11:46:04.952 DEBUG_NTP Round-trip delay: 5.294371e-02 s
2024-12-21 11:46:04.952 DEBUG_NTP Root delay: 2.441406e-04 s
2024-12-21 11:46:04.952 DEBUG_NTP Root dispersion: 4.882812e-04 s
2024-12-21 11:46:05.503 DEBUG_NTP Server reference time: eb119900.00000000 = 2024-12-21 11:44:00.000000 PST
2024-12-21 11:46:05.503 DEBUG_NTP Current time at client: eb11997d.80d045fe = 2024-12-21 11:46:05.503177 PST
2024-12-21 11:46:05.503 DEBUG_NTP Current time at server: eb11997d.c66566b7 = 2024-12-21 11:46:05.774984 PST
2024-12-21 11:46:05.503 DEBUG_NTP Time offset: 2.968631e-01 s
2024-12-21 11:46:05.503 DEBUG_NTP Round-trip delay: 5.011272e-02 s
2024-12-21 11:46:05.503 DEBUG_NTP Root delay: 2.441406e-04 s
2024-12-21 11:46:05.503 DEBUG_NTP Root dispersion: 4.882812e-04 s
2024-12-21 11:46:06.054 DEBUG_NTP Server reference time: eb119900.00000000 = 2024-12-21 11:44:00.000000 PST
2024-12-21 11:46:06.054 DEBUG_NTP Current time at client: eb11997e.0df0b285 = 2024-12-21 11:46:06.054453 PST
2024-12-21 11:46:06.054 DEBUG_NTP Current time at server: eb11997e.53ca63b3 = 2024-12-21 11:46:06.327306 PST
2024-12-21 11:46:06.054 DEBUG_NTP Time offset: 2.983239e-01 s
2024-12-21 11:46:06.054 DEBUG_NTP Round-trip delay: 5.094194e-02 s
2024-12-21 11:46:06.054 DEBUG_NTP Root delay: 2.441406e-04 s
2024-12-21 11:46:06.054 DEBUG_NTP Root dispersion: 4.882812e-04 s
2024-12-21 11:46:06.608 DEBUG_NTP Server reference time: eb119900.00000000 = 2024-12-21 11:44:00.000000 PST
2024-12-21 11:46:06.608 DEBUG_NTP Current time at client: eb11997e.9bd33d29 = 2024-12-21 11:46:06.608691 PST
2024-12-21 11:46:06.608 DEBUG_NTP Current time at server: eb11997e.e14848d9 = 2024-12-21 11:46:06.880009 PST
2024-12-21 11:46:06.608 DEBUG_NTP Time offset: 2.982631e-01 s
2024-12-21 11:46:06.608 DEBUG_NTP Round-trip delay: 5.389214e-02 s
2024-12-21 11:46:06.608 DEBUG_NTP Root delay: 2.441406e-04 s
2024-12-21 11:46:06.608 DEBUG_NTP Root dispersion: 4.882812e-04 s
2024-12-21 11:46:07.159 DEBUG_NTP Server reference time: eb119900.00000000 = 2024-12-21 11:44:00.000000 PST
2024-12-21 11:46:07.159 DEBUG_NTP Current time at client: eb11997f.28c01605 = 2024-12-21 11:46:07.159180 PST
2024-12-21 11:46:07.159 DEBUG_NTP Current time at server: eb11997f.6e984057 = 2024-12-21 11:46:07.432010 PST
2024-12-21 11:46:07.159 DEBUG_NTP Time offset: 2.978749e-01 s
2024-12-21 11:46:07.159 DEBUG_NTP Round-trip delay: 5.009079e-02 s
2024-12-21 11:46:07.159 DEBUG_NTP Root delay: 2.441406e-04 s
2024-12-21 11:46:07.159 DEBUG_NTP Root dispersion: 4.882812e-04 s
2024-12-21 11:46:07.711 DEBUG_NTP Server reference time: eb119900.00000000 = 2024-12-21 11:44:00.000000 PST
2024-12-21 11:46:07.711 DEBUG_NTP Current time at client: eb11997f.b610e022 = 2024-12-21 11:46:07.711194 PST
2024-12-21 11:46:07.711 DEBUG_NTP Current time at server: eb11997f.fbc97cf6 = 2024-12-21 11:46:07.983543 PST
2024-12-21 11:46:07.711 DEBUG_NTP Time offset: 2.981491e-01 s
2024-12-21 11:46:07.711 DEBUG_NTP Round-trip delay: 5.160141e-02 s
2024-12-21 11:46:07.711 DEBUG_NTP Root delay: 2.441406e-04 s
2024-12-21 11:46:07.711 DEBUG_NTP Root dispersion: 4.882812e-04 s
2024-12-21 11:46:08.211 INFO Received 8/8 valid NTP replies from time.nist.gov
2024-12-21 11:46:08.211 DEBUG_NTP Average time offset: (2.973534e-01 +/- 1.214822e-03) s
2024-12-21 11:46:08.211 DEBUG_NTP Average round-trip delay: (5.205190e-02 +/- 1.918391e-03) s
2024-12-21 11:46:08.211 INFO Time offset: 2.977574e+02 ms (excluded 1 outliers)
2024-12-21 11:46:08.211 INFO Round-trip delay: 5.149991e+01 ms (excluded 1 outliers)
2024-12-21 11:46:08.211 DEBUG_NTP Gradually adjusting system time by 297757 us
2024-12-21 11:46:09.000 DEBUG_NTP Successfully opened RTC at "/dev/rtc0"
2024-12-21 11:46:09.001 INFO Current RTC time is 2024-12-21 19:46:09
2024-12-21 11:46:09.005 DEBUG_NTP RTC time is already correct
2024-12-21 11:46:09.006 INFO NTP server listening on 0.0.0.0:123 (IPv4)