Should I be concerned?

Suikolove · November 8th, 2007, 12:13 PM

My site's error log is constantly being spammed by messages of "file not found". The files it's talking about is 404.shtml, favicon.ico, and robots.txt.

How can I fix this problem?

nathon · November 8th, 2007, 12:25 PM

create them

robots.txt
http://www.mcanerin.com/EN/search-engine/robots-txt.asp

favicon
http://www.favicon.co.uk/

404
cpanel>error pages

The robots.txt is used by search engines, the favicon is what you see next the URL in the address bar(little image), and 404 page is what people see if they goto a page that is not found.

**Kayla** · November 9th, 2007, 2:10 AM

It sure can be a cleansing experience to go through and figure out why those errors come up... then you'll have a nice and pretty log.

Otaku · November 9th, 2007, 1:20 PM

Just create them or read through the logs to see WHY their giving errors XD.

Suikolove · November 9th, 2007, 3:11 PM

Yeah, but I'd expect a site to come with the essential files. =\

**removed** · November 9th, 2007, 3:12 PM

It does come with the essentials: you get .htaccess and a cgi-bin. Anything else is completely up to you to add, as some sites don't want custom 404 pages or favicons.

Otaku · November 9th, 2007, 3:41 PM

Nice post rem XD.

**ceo** · November 9th, 2007, 5:39 PM

None of those files are "essential" but they are things that a lot of crawlers and even browsers look for. I have a blank favicon I made for the sites I don't particularly care about making a favicon for just because I'd rather have it in there than flooding my logs with it not being found.

Robots.txt is handy to have to tell crawlers what and where to look to crawl your site.

As for custom error pages, not having one won't make or break you -- but it'll just create another 404 every time there is an error because it'll look for an errordoc. You can be as generic or creative with this as you want. A lot of people make error pages that fit right into their website design like a normal page. Personally, I use the more humorous approach.

November 8th, 2007, 12:13 PM	#1 (permalink)
Suikolove Registered User Seasoned Poster Joined in May 2007 Hosted on SH103 30 posts Gave thanks: 1 Thanked 2 times	Should I be concerned? My site's error log is constantly being spammed by messages of "file not found". The files it's talking about is 404.shtml, favicon.ico, and robots.txt. How can I fix this problem? __________________ SH103 http://www.united-fleet.org

November 8th, 2007, 12:25 PM	#2 (permalink)
nathon Registered User Comfy Contributor Joined in Sep 2007 Lives in ~root 111 posts Gave thanks: 1 Thanked 12 times	create them robots.txt http://www.mcanerin.com/EN/search-engine/robots-txt.asp favicon http://www.favicon.co.uk/ 404 cpanel>error pages The robots.txt is used by search engines, the favicon is what you see next the URL in the address bar(little image), and 404 page is what people see if they goto a page that is not found. __________________ I'm proud to say I never have and never will use vista

November 9th, 2007, 2:10 AM	#3 (permalink)
Kayla Marketing Maven Surpass Staff Joined in May 2003 Lives in Orlando 24,749 posts Gave thanks: 946 Thanked 806 times	It sure can be a cleansing experience to go through and figure out why those errors come up... then you'll have a nice and pretty log. __________________ Follow Surpass on Twitter and Facebook Check out the Surpass Blog

November 9th, 2007, 1:20 PM	#4 (permalink)
Otaku Registered User Comfy Contributor Joined in Dec 2006 Lives in North Carolina, the suck ass state... 152 posts Gave thanks: 8 Thanked 3 times	Just create them or read through the logs to see WHY their giving errors XD. __________________ Bryce Eason - Personal Portfolio and Playground

November 9th, 2007, 3:11 PM	#5 (permalink)
Suikolove Registered User Seasoned Poster Joined in May 2007 Hosted on SH103 30 posts Gave thanks: 1 Thanked 2 times	Yeah, but I'd expect a site to come with the essential files. =\ __________________ SH103 http://www.united-fleet.org

November 9th, 2007, 3:12 PM	#6 (permalink)
removed Surpass Abuse Admin Super #1 Joined in Mar 2005 Lives in Houston, TX Hosted on NONE 7,797 posts Gave thanks: 11 Thanked 278 times	It does come with the essentials: you get .htaccess and a cgi-bin. Anything else is completely up to you to add, as some sites don't want custom 404 pages or favicons. __________________ Unofficial IRC Channel: #surpass EFNet Unofficial = No official support. Support requests can be submitted to our helpdesk.

November 9th, 2007, 3:41 PM	#7 (permalink)
Otaku Registered User Comfy Contributor Joined in Dec 2006 Lives in North Carolina, the suck ass state... 152 posts Gave thanks: 8 Thanked 3 times	Nice post rem XD. __________________ Bryce Eason - Personal Portfolio and Playground

November 9th, 2007, 5:39 PM	#8 (permalink)
ceo Senior Member Super #1 Joined in Jan 2005 1,546 posts Gave thanks: 70 Thanked 33 times	None of those files are "essential" but they are things that a lot of crawlers and even browsers look for. I have a blank favicon I made for the sites I don't particularly care about making a favicon for just because I'd rather have it in there than flooding my logs with it not being found. Robots.txt is handy to have to tell crawlers what and where to look to crawl your site. As for custom error pages, not having one won't make or break you -- but it'll just create another 404 every time there is an error because it'll look for an errordoc. You can be as generic or creative with this as you want. A lot of people make error pages that fit right into their website design like a normal page. Personally, I use the more humorous approach.

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search