Messages

File format for remote acl's should be domain only. Shalla should work fine, UT1 could be offline, no idea if yoyo fits this format.

I'm using "http://www.shallalist.de/Downloads/shallalist.tar.gz" and "http://squidguard.mesd.k12.or.us/blacklist.tgz." I don't get any categories to sort through and apply. Tried logging into the shell to use "find" to see if maybe the lists downloaded but didn't uncompress, but nothing.

yoyo is working now with "http://pgl.yoyo.org/adservers/serverlist.php?hostformat=nohtml". Maybe my connection was being fickle. Got the "access denied" page when I tried to purposely visit an ad site from the list. Shalla and MESD, still nothing. Only difference I see is that their lists are tar compressed while yoyo's is just a text file. I can download, uncompress, and view the category folders & lists just fine on my desktop. I suppose I could copy lists over, but that would make keeping them up to date a bit less convenient.

I'm guessing UT1 is offline. I went to their page to download the categories individually through my browser and it still timed out.

Thanks, I am the one who implemented it (also Arch Linux user).

For Fedora, I made a regex matching files ending with rpm and drpm:

https://github.com/opnsense/core/blob/master/src/opnsense/service/templates/OPNsense/Proxy/squid.conf#L321-L330

I hope this helps you.

I checked your history on that file, and the related changes from Oct of last year, against the same files on my system and I don't any difference. If I remove fedoraproject.org from the SSL no bump list, the fedora client machine gives a "Failed to synchronize cache for repo 'fedora-modular'" error any time yum/dnf is run. I'm no dev so I'm probably not understanding what you're trying to show me.

The easy way out would be to just use Arch only, and I'm kinda going that direction anyways, but I'd like to learn how this works.

You can do this with DNS, since the Browser should try the other server if the first one fails.

I just spent a few hours learning my way through BSD and your file structure (long time linux user, but never used bsd before now) and studying the linux package cache part. I'd bet I can find docs on using DNSmasq to do this later tonight or tomorrow. I have all DNS running through OPNsense for DNSCrypt-Proxy.

You can host static content directly on OPNsense using the nginx plugin, which can act as a load balancer and web server.

I saw nginx in the plugin list so I figured that would be an option. I don't see httrack or any other packages for site mirroring with it though. I know openbsd has httrack, but I don't know the bsd ports system well enough yet to know how to install it on OPNsense. It showed as unavilable when I tried to use the pkg command.

Thanks for taking some time to help me out on this.

New opnsense user here as of this past weekend and I am overall extremely happy with this project. Almost everything has just worked, and almost every bump along the way has been quickly solved by researching either the docs or forums. Excellent work. Of course, the downside to it going so well is I might not be much help yet to others here.

Most of the issues I haven't been able to resolve are related to squid. I've set up a transparent cache with ssl_bump and Linux package cache enabled. Here's what isn't working and/or I haven't been able to locate instructions for:
1. Remote ACLs will not download. The UT1 list in the instructions time out even with wget on my desktop system, but MESD, Shallalist, and yoyo (adblock) lists won't download either. I can download each one through my browser just fine.
2. Once I can download lists, I cannot locate instructions to separate filtering in any manner so that my wife and I can access certain sites while blocking access for the kids. On a related note, is there a method for blocking certain youtube channels without blocking the whole site?
3. Caching linux updates worked great for Arch linux and really sped up the process. For Fedora (and probably CentOS), I had to put fedoraproject.org in the SSL no bump list for it to be able to update at all. It looks like the rpms were cached, but then squid replaces them on the next update. I don't think this is an opnsense issue, but does anyone know a workaround for this?
4. I haven't been able to find instructions to make squid cache work offline. I live in a very remote area and when I have connectivity my bandwidth is good, but connectivity isn't the most reliable. Since we homeschool our kids there are a lot of static information sites we'd like to serve offline when necessary.

For the last two issues, I can setup another VM as a LAN webserver to host a repo and httrack mirror, but I don't know how to make squid redirect the urls to the lan host. Ideally I'd like to keep that a transparent process, and I'd rather use squid so we're only caching what's necessary.