If you need deep pagination, one possible solution is to increase the value max_result_window. You can use curl to do this from your shell command line: curl -XPUT “http://localhost:9200/my_index/_settings” -H ‘Content-Type: application/json’ -d ‘{ “index” : { “max_result_window” : 500000 } }’ I did not notice increased memory usage, for values of ~ 100k.
It depends what you intend when you say JOIN. Elasticsearch is not like regular database that supports JOIN between tables. It is a text search engine that manages documents within indexes. On the other hand you can search within the same index over multiple types using a fields that are common to every type. For … Read more
You could use field collapsing, group the results on the name field and set the size of the top_hits aggregator to 1. /POST http://localhost:9200/test/dedup/_search?search_type=count&pretty=true { “aggs”:{ “dedup” : { “terms”:{ “field”: “name” }, “aggs”:{ “dedup_docs”:{ “top_hits”:{ “size”:1 } } } } } } this returns: { “took” : 192, “timed_out” : false, “_shards” : { … Read more
term query matches a single term as it is : the value is not analyzed. So, it doesn’t have to be lowercased depending on what you have indexed. If you provided Bennett at index time and the value is not analyzed, the following query won’t return anything : { “query”: { “term” : { “user” … Read more
Yep, Use a better option source filter. If you’re searching with JSON it’ll look something like this: { “_source”: [“user”, “message”, …], “query”: …, “size”: … } In ES 2.4 and earlier, you could also use the fields option to the search API: { “fields”: [“user”, “message”, …], “query”: …, “size”: … } This is … Read more
In elasticsearch, it’s not possible to paginate an aggregation. The query will not give accurate results if size is specified. So, the only way to do sorting and pagination is to give size 0 and return all the documents and then, get the required results by accumulating all the results in a list for further … Read more
You can achieve this with the Logstash aggregate filter only, however, you’d have to substantially re-implement what the elapsed filter already does, so that’d be a shame, right? Let’s then use a mix of the Logstash aggregate filter and the elapsed filter. The latter is used to measure the time of each stage and the … Read more
Edit /etc/elasticsearch/elasticsearch.yml and add the following line: network.host: 0.0.0.0 This will “unset” this parameter and will allow connections from other IPs.
You can use the terms aggregation. { “size”: 0, “aggs” : { “langs” : { “terms” : { “field” : “language”, “size” : 500 } } }} The size parameter within the aggregation specifies the maximum number of terms to include in the aggregation result. If you need all results, set this to a value … Read more
In your HEAD plugin, you need to use POST in order to send the query in the payload, otherwise the _search endpoint is hit without any constraints. In your browser, if you open the developer tools and look at the networking tab, you’ll see that nothing is sent in the payload when using GET. It’s … Read more