Which are the best alternatives to Lucene? [closed]
would need to know what problems you’re having with Lucene, but Xapian is worth a look.
search-engine
Can search engines index JavaScript generated web pages?
Your suspicion is correct – JS-generated content cannot be relied on to be visible to search bots. It also can’t be seen by anyone with JS turned off – and, last time I added some tests to a site I was working on (which was a large, mainstream-audience site, with hundreds of thousands of unique … Read more
Marking up a search result list with HTML5 semantics
1) I think you should stick with the article element, as [t]he article element represents a self-contained composition in a document, page, application, or site and that is intended to be independently distributable or reusable [source] You merely have a list of separate documents, so I think this is fully appropriate. The same is true … Read more
Do Google or other search engines execute JavaScript?
There have been some experiments performed for SEO purposes which indicate that at least the big players (Google, for example) can and do follow some simple JavaScript. They avoid sneaky redirects and such, but some basic content manipulation does seem to get through. (I don’t have a link handy for Google themselves confirming or denying … Read more
Block all bots/crawlers/spiders for a special directory with htaccess
You need to have mod_rewrite enabled. Placed it in .htaccess in that folder. If placed elsewhere (e.g. parent folder) then RewriteRule pattern need to be slightly modified to include that folder name). RewriteEngine On RewriteCond %{HTTP_USER_AGENT} (googlebot|bingbot|Baiduspider) [NC] RewriteRule .* – [R=403,L] I have entered only few bots — you add any other yourself (letter … Read more
How do search engines deal with AngularJS applications?
Use PushState and Precomposition The current (2015) way to do this is using the JavaScript pushState method. PushState changes the URL in the top browser bar without reloading the page. Say you have a page containing tabs. The tabs hide and show content, and the content is inserted dynamically, either using AJAX or by simply … Read more
Is it 2 character search possible in lucence
Yes, this is possible using wildcards. Feed your QueryParser with te*, and it will generate a query that starts for a te prefix with any suffix.