Import&Export AdAway compatible filter lists

netred · May 21, 2022, 1:37pm

https://adaway.org/ is a great app to filter ads directly on your cellphone or tablet.
It would be cool if Pi-Hole could import the Adaway settings backup into its filters as well as export the filter lists that it uses into an adaway compatible backup.json so you can easily synchronize both devices.

yubiuser · May 21, 2022, 4:53pm

AdAway uses the same format for adlists as Pi-hole does (hosts format). You can use their adlists also in Pi-hole.

DanSchaper · May 21, 2022, 6:48pm

Can you link to anything that shows the json schema for AdAway? We store the lists in a sqlite3 database and it may be possible to provide a way to export in to a specific schema.

netred · May 24, 2022, 6:05am

github.com

AdAway/AdAway/blob/31d0b78b9e87de13727b758b42438ab14ff899cb/app/src/main/java/org/adaway/model/backup/BackupExporter.java#L101

      
        
                     BufferedWriter writer = new BufferedWriter(new OutputStreamWriter(outputStream))) {
                    JSONObject backup = makeBackup(context);
                    writer.write(backup.toString(4));
                } catch (JSONException e) {
                    throw new IOException("Failed to generate backup.", e);
                } catch (IOException e) {
                    throw new IOException("Could not write file.", e);
                }
            }
            
            
private static JSONObject makeBackup(Context context) throws JSONException {
                AppDatabase database = AppDatabase.getInstance(context);
                HostsSourceDao hostsSourceDao = database.hostsSourceDao();
                HostListItemDao hostListItemDao = database.hostsListItemDao();
            
            
    List<HostListItem> userHosts = hostListItemDao.getUserList();
                List<HostListItem> blockedHosts = userHosts.stream()
                        .filter(value -> value.getType() == BLOCKED)
                        .collect(toList());
                List<HostListItem> allowedHosts = userHosts.stream()
                        .filter(value -> value.getType() == ALLOWED)

is the code block responsible for creating the file.
Let me see if i can get a better description.
Importing would be the more intresting part.

DanSchaper · May 24, 2022, 8:57pm

Thanks, what we need is the actual schema or how the JSON needs to be formatted to work.

netred · May 25, 2022, 7:17am

adaway-backup.zip (2.5 KB)
I think that should be easier to do than reading sourcecode

netred · May 26, 2022, 5:17pm

Looking at the sample file, i think the individually blacklisted or whitelisted hosts should not be imported as such if they are part of existing blocklist. Similiar things are true for blocklist adresses.
I guess some deduplication could certainly help here.

system · November 22, 2022, 5:17pm

This topic was automatically closed 180 days after the last reply. New replies are no longer allowed.