Problem with Beta 5.0:
I've been running the PiHole v5 beta for about the past month. I went to run an update today to update to the most recent version of the beta code, and was greeted with an error message when attempting to update Gravity at the end of the process. This error also repeats itself any time I call an update to Gravity itself.
The terminal reads:
Unable to fill gravity table in database /etc/pihole/gravity_temp.db
Error: /tmp/tmp.461xDziPgw.gravity line 53869: expected 2 columns of data but found 3
I encountered this issue last week when I attempted to update as well (on the same machine). I tried updating my OS (CentOS 7 on VMware) and performing a database rebuild per documentation that I found elsewhere on the forum, and that didn't seem to help. I ended up rolling back to a backup because the repair operation completely hosed my group configuration as well.
The PiHole still appears to be blocking correctly from the little bit that I've been table to test it so far, and I can query URLs on the blocklists from the web interface; however, the blacklisted domain count is -2, and the updates to gravity don't appear to be completing successfully (on account of the database error).
I'd like to provide the opportunity to work through this before I roll back to my snapshot (or last backup). Any help would be appreciated!
It can't seem to get beyond that, though, as it continues to throw that database error while updating Gravity.
I've tried logging in with a fresh browser, too, and the domain count remains the same. The tooltip shows that the database was last updated more than two weeks ago, too.
I tried updating Gravity just now, and this is what it's showing:
Just set mine up to use the same lists, and not seeing any issues....
[i] Upgrading gravity database from version 10 to 11
[✓] Deleting existing list cache
[i] Neutrino emissions detected...
[✓] Pulling blocklist source list into range
[✓] Preparing new gravity database
[i] Target: https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts
[✓] Status: Retrieval successful
[i] Target: https://mirror1.malwaredomains.com/files/justdomains
[✓] Status: Retrieval successful
[i] Target: http://sysctl.org/cameleon/hosts
[✓] Status: Retrieval successful
[i] Target: https://s3.amazonaws.com/lists.disconnect.me/simple_tracking.txt
[✓] Status: Retrieval successful
[i] Target: https://s3.amazonaws.com/lists.disconnect.me/simple_ad.txt
[✓] Status: Retrieval successful
[i] Target: https://hosts-file.net/ad_servers.txt
[✓] Status: Retrieval successful
[i] Target: https://raw.githubusercontent.com/durablenapkin/scamblocklist/master/hosts.txt
[✓] Status: Retrieval successful
[i] Target: https://gitlab.com/ookangzheng/dbl-oisd-nl/raw/master/dbl.txt
[✓] Status: Retrieval successful
[✓] Storing downloaded domains in new gravity database
[✓] Building tree
[✓] Swapping databases
[✓] Flushing DNS cache
[i] Number of gravity domains: 1127519 (1007398 unique domains)
[i] Number of exact blacklisted domains: 1
[i] Number of regex blacklist filters: 0
[i] Number of exact whitelisted domains: 0
[i] Number of regex whitelist filters: 0
[✓] Cleaning up stray matter
[✓] DNS service is running
[✓] Pi-hole blocking is Enabled
[i] The install log is located at: /etc/pihole/install.log
Update Complete!
Current Pi-hole version is v4.3.2-401-g082cfb2
Current AdminLTE version is v4.3.2-406-gee8b8932
Current FTL version is vDev-06b5f3c
I just did a version update, and am still getting the same error message. No changes to lists, either.
[i] Storing downloaded domains in new gravity database...
[✗] Unable to fill gravity table in database /etc/pihole/gravity_temp.db
Error: /tmp/tmp.840OCxWfPw.gravity line 101404: expected 2 columns of data but found 3
[✓] Cleaning up stray matter
[✓] DNS service is running
[✓] Pi-hole blocking is Enabled
Unable to complete update, please contact Pi-hole Support
Output of pihole -v:
Pi-hole version is v4.3.2-401-g082cfb2 (Latest: v4.3.2)
AdminLTE version is v4.3.2-412-g1dc359d (Latest: v4.3.2)
FTL version is vDev-ff840d0 (Latest: v4.3.1)
I'm not fully sure those line numbers are accurate. But I don't see anything that would trigger the response. Patconn87, do you still have that file? Could we get a copy of it?
I think I spotted the trouble spot. I can save a copy of the file elsewhere on my system so it doesn't get purged. Where would you like me to upload it so you can check it over? It's about 26MB.
Ahhhhh, got it. I'll have to disable that list, update gravity, and see what happens (I'll check my 'production' PiHole, too, to see if it's reporting the same issue). Isn't that one of the default lists that's shipped with PiHole?
We are actually all affected by this, however, we were not seeing this as gravity hides SQL warnings and only complains when SQL errors are encountered.
I see (when not muting the errors):
/tmp/tmp.biRZucgQ9D.gravity:101445: expected 2 columns but found 3 - extras ignored
Have a look at the last part.
Now to the point why do our Pi-holes behave differently. What is your local SQLite3 version?
Now that you mention it, I vaguely remember seeing that error pop up on my 'prod' instance, too; however, it seemed to impact the test instance more (as it also seemed to trigger the -2 domain count readout, whereas it did not do so on the other box). The 'prod' instance would also indicate that the process completed successfully, contrary to the messages I was receiving on the test instance.
