GitHub - wasi-master/13ft: My own custom 12ft.io replacement
github.com
My own custom 12ft.io replacement. Contribute to wasi-master/13ft development by creating an account on GitHub.

A site similar to 12ft.io but is self hosted and works with websites that 12ft.io doesn’t work with.

How does it work?

It pretends to be GoogleBot (Google’s web crawler) and gets the same content that google will get. Google gets the whole page so that the content of the article can be indexed properly and this takes advantage of that.

link: https://github.com/wasi-master/13ft

  • redcalcium@lemmy.instituteEnglish
    1·
    11 months ago

    It amazes me that all it takes is just changing user agent to Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) and it can bypass paywalls on many sites? I thought those sites would try harder (e.g. checking if the ip address is truly belong to google), but apparently not.

    • Aniki 🌱🌿@lemm.eeEnglish
      01·
      11 months ago

      Same. I thought there would be more stuff happening in the background but when I saw it’s just hijacking the google bot headers to display the html i was a bit disappointed it’s so stupidly easy.