Forums Index > Mewsoft Products > Searchawy > Spider not grabbing all the keywords and description as it should
salam First Post Posted on: 03-30-19 05:17 AM
Spider not grabbing all the keywords and description as it should

Hello
when I enter a website Examplehttp://www.goowall.com and
select the category and click Spider now button, and when it was
finnished I clicked the Submissions Manager and when I edited the result, I
found out that the two boxes of the keywords and description are empty.
When I repeated for other sites, the spider just grab three or four
words for description and just one or twokeywords.
I checked the listing options and it is as follow

Maximum Description Size in Bytes is 500
Maximum Keywords Size in Bytes: is 200
why the spider is not grabbing the maximum as above
also
suddenly I can not add
(http://myproductsearch.com/search/action=NewURL&Cat_ID=0) or modify

(http://myproductsearch.com/search/action=Modify_Link&ID=1375378797)
a site when I try to do it I get the error

Error, Can't create file /SecImg/79db36f6acf7048ab0e397ec67fe1308.jpg: No such file or directory
Line 119, File /home/salam/public_html/search//SecurityImage.pm

It was working before and I did not change any thing

Please help

Thanks
Mostafa


mewsoft Reply #: 1 Posted on: 03-30-19 11:18 PM
Re: Spider not grabbing all the keywords and description as it should

The website you said have problems with the meta tags in their site. First error they used the http-equiv="xxx" as they should use meta name="xxx".


The "http-equiv" should only be used for stuff that the browser needs to know. Things like the character encoding, the expiration date and such.

For keywords you want to use the "name" attribute though you might want to use the Dublin Core with that.


The second error on that site meta tags is they have error in the meta description, they have content="content=", doubled the content="


meta http-equiv="description" content="content="We ca

The spider will extract well formated headers:

<title>site title</title>


<meta name="description" content=" site description here">

<meta name="keywords" content=" site description here">

As for the SecuImage, fixed.

Thanks


Mewsoft Support
www.mewsoft.com

salam Reply #: 2 Posted on: 03-31-19 12:53 AM
Thanks a million

Thank you Ahmed.

Have a wonderful day

Mostafa