Go Back   Exetools > General > General Discussion


Thread Tools Display Modes
Old 11-11-2018, 10:25
atom0s's Avatar
atom0s atom0s is offline
Join Date: Jan 2015
Posts: 321
Rept. Given: 25
Rept. Rcvd 106 Times in 51 Posts
Thanks Given: 49
Thanks Rcvd at 543 Times in 218 Posts
atom0s Reputation: 100-199 atom0s Reputation: 100-199
Originally Posted by Archer View Post
As far as I remember, robots file is ignored when it comes to anti-malware scanning. At least it didn't help when I faced a similar problem.

Google's 'Safe Search' engine stuff ignores the robot.txt file or other attempted blocks. You can full-on block the site from scanning/indexing your site via blocking their bots user agent but you lose ranking and indexing altogether then.

Voting on VirusTotal doesn't fix anything with Google either. VT's info about the site is not tied into Google and is its own personal opinion based on scanned links from the domain or opinion based voting. Most you'll do is make VT assume the site is safe but the Google block is still going to be there.

The easiest method of fixing the Google block is passwording the files. Other methods of fixing the issue involve custom actions based on the connecting client, such as looking for Google's user-agent for their spider and analyzer and just serving a fake file or a basic site/page that isn't an error of any kind. If you just error out the page, you'll get a ton of errors regarding the site on the dashboard that will cause Google to stop indexing your site until they are corrected properly.
Personal Projects Site: https://atom0s.com
Reply With Quote
Old 11-11-2018, 22:53
Daemon Daemon is offline
Banned User
Join Date: Sep 2018
Posts: 29
Rept. Given: 0
Rept. Rcvd 0 Times in 0 Posts
Thanks Given: 22
Thanks Rcvd at 36 Times in 23 Posts
Daemon Reputation: 1
I don't understand why this topic has such a huge thread going on

Any website with "questionable" material on it, will get flagged. "Questionable materials" include cracks, methods to create cracks or exploits and a whole bunch of stuff. No other way other than to hide off the contents of this site from unregistered users. That way even the spiders cannot access it.
Reply With Quote
Old 11-29-2018, 13:51
ZeNiX's Avatar
ZeNiX ZeNiX is offline
Join Date: Feb 2009
Posts: 720
Rept. Given: 173
Rept. Rcvd 767 Times in 256 Posts
Thanks Given: 200
Thanks Rcvd at 730 Times in 226 Posts
ZeNiX Reputation: 700-899 ZeNiX Reputation: 700-899 ZeNiX Reputation: 700-899 ZeNiX Reputation: 700-899 ZeNiX Reputation: 700-899 ZeNiX Reputation: 700-899 ZeNiX Reputation: 700-899
The problem was solved and has disappeared for two weeks.
Thanks to Hmily and Aaron.

And thanks for all of you who provided suggestions.
Reply With Quote
The Following 2 Users Say Thank You to ZeNiX For This Useful Post:
chants (11-30-2018), zeuscane (11-29-2018)

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
Site down? nikre General Discussion 31 09-13-2018 19:24
Unwanted code added while assembling on Olly RaptorX General Discussion 3 02-18-2011 03:49

All times are GMT +8. The time now is 06:58.

Always Your Best Friend: Aaron, JMI, ahmadmansoor, ZeNiX
( 1998 - 2021 )