ES cross cluster search跨集群查询-阿里云开发者社区

ES cross cluster search跨集群查询

2017-11-09 3561

版权

本文内容由阿里云实名注册用户自发贡献，版权归原作者所有，阿里云开发者社区不拥有其著作权，亦不承担相应法律责任。具体规则请查看《阿里云开发者社区用户服务协议》和《阿里云开发者社区知识产权保护指引》。如果您发现本社区中有涉嫌抄袭的内容，填写侵权投诉表单进行举报，一经查实，本社区将立刻删除涉嫌侵权内容。

简介：

ES 5.3以后出的新功能。测试demo如下：

下载ES 5.5版本，然后分别本机创建2个实例，配置如下：

cluster.name: xx1
network.host: 127.0.0.1
http.port: 9200
transport.tcp.port: 9300

cluster.name: xx2
network.host: 127.0.0.1
http.port: 9201
transport.tcp.port: 9301

再创建一个实例用于跨集群搜索，配置如下：

http.port: 9202
transport.tcp.port: 9302

search:
    remote:
        cluster_one:
            seeds: 127.0.0.1:9300
        cluster_two:
            seeds: 127.0.0.1:9301

然后写入测试数据 es_data.json：

{ "index" : { "_index" : "test2", "_type" : "xx"}}

{ "age" : 100, "name":"bone" }

插入一条数据到9200机器：

 curl -XPOST localhost:9200/_bulk --data-binary @es_data.json

然后写入测试数据 es_data2.json：

{ "index" : { "_index" : "test2", "_type" : "xx"}}

{ "age" : 99, "name":"jack" }

同理再插入一条数据到9201机器：

 curl -XPOST localhost:9201/_bulk --data-binary @es_data2.json

执行搜索：

 curl -XPOST localhost:9202/cluster_*:test2/xx/_search?q=*


{"took":23,"timed_out":false,"_shards":{"total":10,"successful":10,"failed":0},"hits":{"total":2,"max_score":1.0,"hits":[{"_index":"cluster_two:test2","_type":"xx","_id":"AV-jy_6M9ed_QHEOL8Zd","_score":1.0,"_source":{ "age" : 99, "name":"jack" }},{"_index":"cluster_one:test2","_type":"xx","_id":"AV-jy8ivwbfD6QGw1gPg","_score":1.0,"_source":{ "age" : 100, "name":"bone" }}]}}

可以看到获得了两个集群的搜索数据。

执行聚合：

curl -XPOST localhost:9202/cluster_*:test2/xx/_search? -d '
{
  "aggs": {
    "all_age": {
      "terms": { "field": "age" }
    }
  }
}
'

{"took":25,"timed_out":false,"_shards":{"total":10,"successful":10,"failed":0},"hits":{"total":2,"max_score":1.0,"hits":[{"_index":"cluster_two:test2","_type":"xx","_id":"AV-jy_6M9ed_QHEOL8Zd","_score":1.0,"_source":{ "age" : 99, "name":"jack" }},{"_index":"cluster_one:test2","_type":"xx","_id":"AV-jy8ivwbfD6QGw1gPg","_score":1.0,"_source":{ "age" : 100, "name":"bone" }}]},"aggregations":{"all_age":{"doc_count_error_upper_bound":0,"sum_other_doc_count":0,

"buckets":[{"key":99,"doc_count":1},{"key":100,"doc_count":1}]}}}