List stats

[lightswitch05]

Dan @lightswitch05 irrelevant to the subject here but if it's not too much trouble can you compile a list to show how many entries/subdomains(just number count) each of the top level domains cointains. Use that JavaScript magic of yours 😉

Here are the results @dnmTX

Ads & Tracking

   com: 233,214
   net: 60,592
   info: 26,938
   org: 24,071
   io: 10,210
   co: 6,757
   services: 3,904
   lu: 3,891
   st: 2,626
   tv: 2,348
   app: 2,209
   name: 2,163
   page: 1,769
   fr: 1,549
   de: 1,452
   cloud: 1,264
   pl: 1,164
   ru: 1,080
   il: 1,070
   eu: 1,012
   pro: 929
   jp: 874
   ai: 570
   cn: 503
   mobi: 497
   at: 387
   fi: 342
   re: 324
   uk: 324
   ms: 272
   mx: 229
   biz: 217
   xyz: 194
   nl: 176
   sk: 174
   gt: 154
   ly: 132
   cz: 131
   me: 131
   works: 119
   media: 118
   gr: 116
   se: 107
   it: 89
   us: 72
   la: 62
   ca: 59
   zone: 58
   no: 46
   be: 42
   club: 38
   es: 37
   cc: 34
   pt: 30
   in: 30
   id: 29
   pub: 26
   dk: 26
   network: 24
   pm: 24
   vc: 23
   br: 21
   space: 21
   vn: 17
   tw: 17
   za: 16
   li: 16
   au: 15
   ng: 14
   tech: 14
   im: 13
   kr: 13
   world: 13
   cx: 12
   land: 12
   ad: 12
   asia: 11
   ch: 10
   host: 10
   lt: 9
   delivery: 9
   best: 9
   pe: 9
   link: 9
   dev: 9
   bd: 8
   nyc: 8
   tm: 8
   video: 8
   rs: 8
   as: 7
   win: 7
   to: 7
   by: 7
   ua: 6
   style: 6
   site: 5
   systems: 5
   rich: 5
   icu: 5
   events: 5
   xn--9dbq2a: 4
   fm: 4
   mk: 4
   sh: 4
   watch: 4
   blog: 4
   ro: 4
   marketing: 3
   ie: 3
   ceo: 3
   hu: 3
   bz: 3
   gg: 3
   ge: 3
   ps: 3
   am: 3
   promo: 2
   science: 2
   pw: 2
   cyou: 2
   gov: 2
   cool: 2
   fyi: 2
   ltd: 1
   hk: 1
   th: 1
   eg: 1
   directory: 1
   museum: 1
   lv: 1
   nz: 1
   sx: 1
   bio: 1
   market: 1
   press: 1
   mt: 1
   cy: 1
   tr: 1
   al: 1
   africa: 1
   top: 1
   is: 1
   cat: 1
   sg: 1
   solutions: 1

Facebook

   com: 21,400
   net: 5,149
   me: 301
   watch: 3
   design: 2

AMP Hosts

   org: 10,507
   net: 2,486
   com: 131
   im: 1

Dating Services

   com: 12,269
   dating: 905
   cam: 572
   net: 327
   org: 323
   ca: 198
   co: 160
   app: 114
   ru: 105
   de: 97
   me: 42
   lv: 36
   us: 30
   io: 28
   chat: 22
   uk: 16
   date: 15
   info: 10
   club: 10
   fm: 10
   love: 9
   today: 5
   live: 4
   site: 4
   singles: 3
   pro: 3
   review: 3
   vegas: 3
   events: 2
   asia: 2
   ro: 2
   zone: 2
   website: 1
   best: 1

Hate & Junk

   org: 766
   com: 763
   co: 213
   net: 115
   top: 77
   us: 28
   biz: 23
   su: 14
   ca: 12
   pub: 12
   info: 11
   it: 6
   ws: 5
   ch: 5
   app: 4
   video: 4
   best: 3
   fun: 3
   online: 3
   shop: 3
   news: 3
   institute: 2

Tracking Aggressive

   org: 51,684
   com: 13,142
   cn: 1,411
   io: 869
   support: 465
   solutions: 309
   to: 226
   im: 144
   us: 81
   co: 18
   ai: 17
   net: 11
   page: 5
   ly: 2
   gop: 1
   cloud: 1
   services: 1

[lightswitch05]

Thanks @StevenBlack for your great ghosts project!

[dnmTX]

Dan @lightswitch05 thanks for this,much appreciated but my request wasn't about the TLD count but more like the count of the sub-domains that are derived out of each top level domain. For example:
This is from your list. You have top level domain(i misled you with that top level domain,ain't i?):
0.0.0.0 vdo.ai
And then it goes:

0.0.0.0 0.vdo.ai
0.0.0.0 1014.vdo.ai
0.0.0.0 1018.vdo.ai
0.0.0.0 1021.vdo.ai
0.0.0.0 103.vdo.ai
0.0.0.0 1036.vdo.ai
0.0.0.0 1077.vdo.ai
0.0.0.0 1091.vdo.ai
0.0.0.0 1123.vdo.ai
0.0.0.0 1130.vdo.ai
0.0.0.0 1183.vdo.ai
0.0.0.0 1229.vdo.ai
0.0.0.0 124.vdo.ai
0.0.0.0 1256.vdo.ai........

....and so on. So my request was a list of the additional entries of each top level domain in that list. Like:
vdo.ai: 1024 entries/subdomains
.infusionsoft.app: 3000 entries/subdomains
......
You think you can make some script to count them all?

P.S. I can do that..by hand with my Chromium Browser but it will take me a really long time and it will be exhausting to say the least:

[StevenBlack]

Yeah Dan @dnmTX I'll run a full release tomorrow — it's a pipeline — that will build binaries for all platforms. Go is great for that. There will be a .exe for you.

[dnmTX]

There will be a .exe for you.

Thank you,i'll let you know once i test it 👍 👍 👍

[dnmTX]

Steve @StevenBlack so you know. I got Go x64 on my end and i see so far all the binaries on your end are x86.
Let me know if i have to get/switch to x86 👍

[rustyprimerbot]

@lightswitch05 I'm a noob to github and I'm trying to figure out how to add these domains to my pihole. I've tried copying and pasting them but the 0.0.0.0 seems to cause me some issues. There is probably a way to add them other than the text file but again, my skills are limited.

[lightswitch05]

Pihole web-> Group Management -> Adlists. Then add the URL to my list, not the individual entries. https://www.github.developerdan.com/hosts/lists/ads-and-tracking-extended.txt

[Martin-Maat]

Well, I tried your "Ads & Tracking" list on a new machine. 8 cores, 128 GB of memory (!). And it didn't go well.
Windows told me I had no internet, while I did (could browse just fine). The machine choked up intermittently for no apparent reason. The start menu search function no longer worked. Intranet no longer worked, gave me messages that Discovery was off (which it wasn't, yet it could not find other machines). Et cetera, lots of vague issues.

It appeared the host file was too big for DNS Client (15 MB), it totally flipped on it. And I am not the only one, fortunately for me because it took me some time to bring it back to the hosts file update.

https://superuser.com/questions/1607400/how-do-i-restore-my-windows-pc-s-default-hosts-file-i-can-t-seem-to-edit-it-eve

It was quite a journey to restore the hosts file too because contrary to what normally can be done (just be administrator and overwrite it) it was impossible because DNS Client kept it locked. This service can not be stopped and killing it from task manager only works for a couple of milliseconds before it is restarted automatically, I was always too late. There is link in the superuser message above that told me how to do it and now everything is back to normal again.

I am on the latest version on Windows 10. Is this working for anybody?!