Commit Graph
1158 Commits
Author SHA1 Message Date
funilrys 780e47ffe5 Review of domain_to_idna()
This patch review the way we get the comment at the end of a line.
I also did an application of DRY (Do not Repeat Yourself)
and/or KISS (Keep It Simple, Stupid) by refactoring the 2 `else`
statements into one line.
2018-03-02 22:07:11 +01:00
funilrys 8f00cb4d76 Deletion of a trailing '#'.
Please note that I have added that '#' by mistake.
2018-03-02 21:43:52 +01:00
funilrys 1141823bc8 Fix tests issues.
This patch introduce the installation of dependencies needed my the main commit.

This patch fixes:
 * https://travis-ci.org/funilrys/hosts/jobs/347504195#L592
 * https://travis-ci.org/funilrys/hosts/jobs/347504195#L598
2018-02-28 23:29:18 +01:00
funilrys 3403b10e50 Fix tests issues.
This patch fixes:
 * https://travis-ci.org/funilrys/hosts/jobs/347500695#L400
 * https://travis-ci.org/funilrys/hosts/jobs/347500695#L401
2018-02-28 23:24:58 +01:00
funilrys f5c8ac58b2 Fix tests issue.
This patch fix https://travis-ci.org/funilrys/hosts/jobs/347500695#L399
2018-02-28 23:23:30 +01:00
funilrys 079d5ddd7f Fix tests issue
This patch fix https://travis-ci.org/funilrys/hosts/jobs/347500695#L397

Please also note that I introduced that patch because
we do not directly use lxml but it is required by
BeautifulSup() to parse the HTML.
2018-02-28 23:22:32 +01:00
funilrys 1fea720034 Fix tests issue
This patch fix https://travis-ci.org/funilrys/hosts/jobs/347500695#L398
2018-02-28 23:20:01 +01:00
funilrys d3ef85df17 Review typo + fix test issue.
This patch fix https://travis-ci.org/funilrys/hosts/jobs/347497718#L749
2018-02-28 23:15:01 +01:00
funilrys 079ad6b674 Fix test issue.
This patch fix https://travis-ci.org/funilrys/hosts/jobs/347497718#L748
2018-02-28 23:13:13 +01:00
funilrys ff58bbd1f2 Introduction of requirements.txt
Please note that those file can be used to install
dependencies with 'pip install -r requirements.txt'
2018-02-28 23:08:45 +01:00
funilrys c82f691952 Review of get_file_by_url()
Please note that this patch also introduce
which is in charge of converting a domain in a line into
IDNA and/or UTF-8 format.

Also note the introduction of BeautifulSoup() which helps
us to decode data from the downloaded URL.

Fixes (issue(s)/protocol(s) I was able to reproduce):
 * https://github.com/StevenBlack/hosts/issues/514#issuecomment-368932152

Possible fix of (issue(s)/protocol(s) I wasn't able to reproduce):
 * https://github.com/StevenBlack/hosts/issues/514#issue-300048106
 * https://github.com/StevenBlack/hosts/issues/494#issue-296166492
 * https://github.com/StevenBlack/hosts/issues/420#issue-267453114
 * https://github.com/StevenBlack/hosts/issues/372#issue-246927047
 * https://github.com/StevenBlack/hosts/issues/382#issuecomment-322010562
2018-02-28 23:06:58 +01:00
StevenBlack 37da299efb New data from yoyo.org, and CoinBlockerList. 2018-02-28 14:28:41 -05:00
Steven Black 2877752294 Merge pull request #516 from ScriptTiger/patch-1
Removed Cryptominer Domains
2018-02-27 12:07:29 -05:00
StevenBlack e2ee547063 New data from someonewhocares.org. 2018-02-26 13:38:01 -05:00
StevenBlack fd9d1d0836 New domains submitted. 2018-02-26 13:36:22 -05:00
Steven Black 3d6cec8170 Merge pull request #517 from paxperscientiam/patch-4
phish
2018-02-26 00:06:28 -05:00
Chris 821f08b52d phish
Both of these ".win" sites serve up rotten phish (adobe flash).
2018-02-25 23:50:42 -05:00
ScriptTiger 7d9d2a02ef Removed Cryptominer Domains 2018-02-26 11:34:04 +08:00
StevenBlack 38fddd4862 Reinstate help.evernote.com. Closes #511. 2018-02-25 13:47:44 -05:00
Steven Black ca4fcbab0e Merge pull request #512 from FadeMind/patch-1
readme_template.md: Chrome required manually cleanup DNS Cache
2018-02-25 13:31:01 -05:00
FadeMind 77d4c68ab0 readme_template.md: tenses fixes 2018-02-25 19:22:21 +01:00
StevenBlack 90c5640341 Issue #511: fix - remove help.evermote.com on a trial basis, hope they've come to their senses. 2018-02-25 13:04:30 -05:00
StevenBlack 182d18ba20 Issue #510: fix - new updates from CoinBlockerList. Also new domains from yoyo.org. 2018-02-25 12:49:53 -05:00
FadeMind b2945e022e readme_template.md: Chrome required manually cleanup DNS Cache
See: https://superuser.com/questions/723703
2018-02-25 10:31:56 +01:00
Steven Black fab9fbc690 Issue #509: fix - pull the correct file from ZeroDot1/CoinBlockerLists. 2018-02-24 23:46:22 -05:00
StevenBlack 1341e7af52 New data from yoyo.org, someonewhocares.org, and KadHosts. 2018-02-24 18:04:46 -05:00
StevenBlack 40a06c2415 Adding CoinBlockerList. Thanks ZeroDot1, via @FadeMind.
Adding a good coin blocking list to the repo.
2018-02-24 18:00:21 -05:00
StevenBlack cbf4b0be15 New data from yoyo.org, and someonewhocares.org. 2018-02-20 10:04:52 -05:00
StevenBlack 2d3b88ecfd Issue #506: fix - dropping Spotify-Ad-free. cc @CHEF-KOCH. 2018-02-20 10:03:08 -05:00
Steven Black 007254e10f Merge pull request #503 from ankitpati/minimise-hosts-file
Add Option to Minimise hosts File
2018-02-16 22:07:47 -05:00
Ankit Pati dae2172f3b update docs after adding minimise switch 2018-02-17 07:36:10 +05:30
Ankit Pati 9a8b507f6e update defaults dictionary for minimise switch 2018-02-17 07:22:45 +05:30
Steven Black 2aa50e88be Merge pull request #502 from ankitpati/fix-hardcoded-offset-in-compression
Remove Hardcoded Offset in Compression
2018-02-16 15:29:54 -05:00
Ankit Pati 01db326459 Add Option to Minimise hosts File
This option (--minimise, -m) differs from compress (--compress, -c) in
that it keeps each host on a different line, while still removing
unnecessary newlines and comments.

This is necessary because many implementations of URL blockers that rely
on hosts files do not conform to the standard which allows multiple
hosts on a single line.
2018-02-17 00:22:25 +05:30
Ankit Pati db29acda65 FIX: Remove Hardcoded Offset in Compression
An offset of 7 was hardcoded in the function compress_file, presumably
to skip over the default target IP address of 0.0.0.0 in a hosts file.
However, this causes problems when the default is overridden using the
--ip or -i flag, causing visibly garbled output in the generated hosts
file.

Fix is to calculate the length of target IP at runtime.
2018-02-16 23:45:10 +05:30
StevenBlack 04cbba965c Update for recent edits at source. 2018-02-15 09:51:33 -05:00
Steven Black c8e6620181 New data from clefspeare13 2018-02-14 19:23:01 -05:00
StevenBlack adc8004272 new data from someonewhocares.org, Badd-Boyz, add.Spam, and add.Risk. Closes #498. 2018-02-13 13:03:40 -05:00
Steven Black 447d9ede6e Merge pull request #492 from FadeMind/master
Spotify-Ad-free init
2018-02-12 13:26:09 -05:00
Steven Black c53b817774 new data from someonewhocares.org. 2018-02-11 12:42:00 -05:00
Steven Black a9fb35dcc2 Adding some domains that bug me today. 2018-02-11 12:39:52 -05:00
fademind 6dd1a88e2e Spotify-Ad-free init 2018-02-10 11:15:41 +01:00
Steven Black 38869f636a New data from yoyo.org, and new host records from commit 5b5e854. 2018-02-09 13:53:48 -05:00
Steven Black 98b1b2b804 Merge pull request #491 from FadeMind/patch-1
updateHostsFile.py: add ipv6 additionals
2018-02-09 13:51:42 -05:00
FadeMind 5b5e854c7f updateHostsFile.py: add ipv6 additionals
@StevenBlack.
DEFAULT hosts file in Linux

127.0.0.1       localhost
127.0.1.1       mydevicename
::1     localhost ip6-localhost ip6-loopback
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
2018-02-09 19:18:54 +01:00
StevenBlack 3af3a4d74c New data from yoyo.org, someonewhocares.org, and many new domains from Badd-Boys. 2018-02-08 20:22:38 -05:00
Steven Black 0d5fd167a8 Merge pull request #488 from ScriptTiger/patch-1
Added and loaded a new spam domain section
2018-02-03 15:28:35 -05:00
ScriptTiger 4f43e9b82b Added and loaded a new spam domain section
Added and loaded a new spam domain section
2018-02-04 03:24:27 +08:00
Steven Black ddf46eed1f New data from sinfonietta, yoyo.org, someonewhocares.org, and Badd-Boyz. 2018-02-02 13:39:52 -05:00
StevenBlack 08096d50b0 New data from yoyo.org, someonewhocares.org, mvps.org, and Badd-Boyz. 2018-01-31 17:28:44 -05:00