понедельник, 22 марта 2021 г.

Personal crawler or SPAM search requests

#00 - PERSONAL CRAWLER IDEA

My cell phone has 100x capacity bigger than first server of Google. Your cell phone most likely has 1000x bigger capacity (thats because mine is 4 years old).

This little bastard by the way also constantly connected to the network. 5G, 4G, Wi Fi - it has you all the day, 24 hours 7 days a week.

With such computational power and constant connection to the InterNET I'm capable to manage space ships and land a Lunar expedition. Another usecase - run own web crawler, or "personal Google". This is not a joke. As I said  previously, on my palm are 100 Google 96' servers. 

Just put your imagination out of the limits. Your personal web search engine in your pocket. It crawls web for you 24h a day, index sites and pages, and it wouldn't sale you to ads companies. One may say, well InterNET is much much bigger than in 90's. Sounds right, but text is still text and in 99% of cases we ask Google some text query.

One 64GB chip can store ~600 000 000 words, or ~60 000 000 sentences, or ~6 000 000 pages of text. As of March 2021, there are ~50 000 000 pages in the English Wikipedia. Thats less then my cell phone can store in a plain text. And if will talk about index, not a plain text, so index will be more compact representation of a text.

#01 - SPAM SEARCH

Well, nobody likes when somebody look at what you doing. Not all people like, when after a search in Google you got a ads suggestion "handfully selected" for you by their AI algorithm. And nobody wouldn't like if some private search query will be broadcasted to unknown ads company and stored forewer just because S3 storage is so cheap.

What do the spies to cover their patterns? Well they do a lot of "junk" actions. I mean normal, acceptable in their surroundings actions. It would be hard to show you a new car in ads if your last search requests are "enlarge my backyard" or "fun kitty pictures". This was joke about backyard, but hope you got the idea.

Why not to have this "personal assistant" application on my cell phone to send Google spam search requests - about sunny day or seaside. Surely, they may catch you and show a killing ads about seaside. So you end up on the seaside with pina colada.