用户可以将 CVM、TencentDB、容器服务等其他云产品的实时日志或业务的存量及增量业务数据,汇聚传输到 ES 集群,进行数据的分布式存储、查询分析。
用户通过 Elasticsearch 中的 Beats 功能,可以把数据传输到 Elasticsearch 中进行存储,也可以传输到 Logstash 中进行自定义转换和解析后,再传输到 Elasticsearch 中。
Elasticsearch 提供了易用的 RESTful API,用户可以自行开发客户端,调用数据存储 API,存储数据到 Elasticsearch 集群中。
ES 构建在 VPC 内,用户可以非常方便地使用各种数据同步插件,将已有云产品的数据,同步到 ES 集群中。
腾讯云 ES 提供了多种规格的节点类型和高性能 SSD 磁盘,有效保障数据的读写性能。
支持弹性扩展到上百个节点,能达到 PB 级数据的存储,满足用户不同类型的业务场景。
支持故障节点探测及替换,保障集群高可用性。
具备全文检索功能。
Elasticsearch 拥有全文检索、结构化搜索、数据过滤和指标统计等搜索功能,可应用于信息搜索和数据分析等多种场景。
Elasticsearch 提供了简单易用的 RESTful API 以及各种语言的客户端,用户可以很方便地构建自己的搜索服务。
使用 Kibana,用户可以方便地在浏览器里对集群的数据进行搜索和统计分析。
使用 Elasticsearch 官方提供的 rally 压测工具和 geonames 数据集(大小3.2G,共11523468个文档),对腾讯云 Elasticsearch Service 构建的两种规格的 ES 集群进行压测,其性能结果如下:
Metric | Task | Value | Unit |
---|---|---|---|
Total indexing time | - | 18.5837 | min |
Min indexing time per shard | - | 0.000533333 | min |
Median indexing time per shard | - | 3.4134 | min |
Max indexing time per shard | - | 4.21195 | min |
Total refresh time | - | 2.40147 | min |
Min refresh time per shard | - | 0.0009 | min |
Median refresh time per shard | - | 0.45715 | min |
Max refresh time per shard | - | 0.5655 | min |
Total flush time | - | 0.328317 | min |
Min flush time per shard | - | 0.0004 | min |
Median flush time per shard | - | 0.0643583 | min |
Max flush time per shard | - | 0.0972167 | min |
Total Young Gen GC | - | 127.992 | s |
Total Old Gen GC | - | 1.327 | s |
Store size | - | 3.22145 | GB |
Translog size | - | 2.80E-07 | GB |
Heap used for segments | - | 10.8161 | MB |
Heap used for doc values | - | 0.0831299 | MB |
Heap used for terms | - | 9.62618 | MB |
Heap used for norms | - | 0.0795288 | MB |
Heap used for points | - | 0.217488 | MB |
Heap used for stored fields | - | 0.809799 | MB |
Segment count | - | 102 | - |
Min Throughput | index-append | 41895.6 | docs/s |
Median Throughput | index-append | 42562 | docs/s |
Max Throughput | index-append | 43352 | docs/s |
50th percentile latency | index-append | 757.636 | ms |
90th percentile latency | index-append | 1388.11 | ms |
99th percentile latency | index-append | 2650.44 | ms |
99.9th percentile latency | index-append | 5270.13 | ms |
100th percentile latency | index-append | 6535.29 | ms |
50th percentile service time | index-append | 757.636 | ms |
90th percentile service time | index-append | 1388.11 | ms |
99th percentile service time | index-append | 2650.44 | ms |
99.9th percentile service time | index-append | 5270.13 | ms |
100th percentile service time | index-append | 6535.29 | ms |
error rate | index-append | 0 | % |
Min Throughput | index-stats | 99.99 | ops/s |
Median Throughput | index-stats | 100.04 | ops/s |
Max Throughput | index-stats | 100.06 | ops/s |
50th percentile latency | index-stats | 6.04131 | ms |
90th percentile latency | index-stats | 6.56561 | ms |
99th percentile latency | index-stats | 10.7941 | ms |
99.9th percentile latency | index-stats | 22.6768 | ms |
100th percentile latency | index-stats | 24.5623 | ms |
50th percentile service time | index-stats | 5.9341 | ms |
90th percentile service time | index-stats | 6.42644 | ms |
99th percentile service time | index-stats | 7.56809 | ms |
99.9th percentile service time | index-stats | 22.5948 | ms |
100th percentile service time | index-stats | 24.4467 | ms |
error rate | index-stats | 0 | % |
Min Throughput | node-stats | 99.93 | ops/s |
Median Throughput | node-stats | 100.06 | ops/s |
Max Throughput | node-stats | 100.33 | ops/s |
50th percentile latency | node-stats | 6.74088 | ms |
90th percentile latency | node-stats | 7.28822 | ms |
99th percentile latency | node-stats | 8.62256 | ms |
99.9th percentile latency | node-stats | 13.271 | ms |
100th percentile latency | node-stats | 13.9379 | ms |
50th percentile service time | node-stats | 6.64634 | ms |
90th percentile service time | node-stats | 7.18403 | ms |
99th percentile service time | node-stats | 8.34209 | ms |
99.9th percentile service time | node-stats | 13.1784 | ms |
100th percentile service time | node-stats | 13.8411 | ms |
error rate | node-stats | 0 | % |
Min Throughput | default | 46.85 | ops/s |
Median Throughput | default | 47.58 | ops/s |
Max Throughput | default | 47.7 | ops/s |
50th percentile latency | default | 1023.59 | ms |
90th percentile latency | default | 1890.67 | ms |
99th percentile latency | default | 2017.58 | ms |
99.9th percentile latency | default | 2026.21 | ms |
100th percentile latency | default | 2026.21 | ms |
50th percentile service time | default | 20.2853 | ms |
90th percentile service time | default | 24.3425 | ms |
99th percentile service time | default | 33.3526 | ms |
99.9th percentile service time | default | 54.702 | ms |
100th percentile service time | default | 74.2832 | ms |
error rate | default | 0 | % |
Min Throughput | term | 199.82 | ops/s |
Median Throughput | term | 200.02 | ops/s |
Max Throughput | term | 200.05 | ops/s |
50th percentile latency | term | 4.54844 | ms |
90th percentile latency | term | 9.97587 | ms |
99th percentile latency | term | 18.3546 | ms |
99.9th percentile latency | term | 21.2112 | ms |
100th percentile latency | term | 21.5267 | ms |
50th percentile service time | term | 4.39147 | ms |
90th percentile service time | term | 4.84527 | ms |
99th percentile service time | term | 6.62189 | ms |
99.9th percentile service time | term | 19.4932 | ms |
100th percentile service time | term | 21.4435 | ms |
error rate | term | 0 | % |
Min Throughput | phrase | 199.68 | ops/s |
Median Throughput | phrase | 200.03 | ops/s |
Max Throughput | phrase | 200.11 | ops/s |
50th percentile latency | phrase | 3.57488 | ms |
90th percentile latency | phrase | 4.62139 | ms |
99th percentile latency | phrase | 19.6935 | ms |
99.9th percentile latency | phrase | 24.9076 | ms |
100th percentile latency | phrase | 25.0486 | ms |
50th percentile service time | phrase | 3.4742 | ms |
90th percentile service time | phrase | 4.0265 | ms |
99th percentile service time | phrase | 7.57333 | ms |
99.9th percentile service time | phrase | 18.9011 | ms |
100th percentile service time | phrase | 23.8045 | ms |
error rate | phrase | 0 | % |
Min Throughput | country_agg_uncached | 4.99 | ops/s |
Median Throughput | country_agg_uncached | 5 | ops/s |
Max Throughput | country_agg_uncached | 5 | ops/s |
50th percentile latency | country_agg_uncached | 197.534 | ms |
90th percentile latency | country_agg_uncached | 217.842 | ms |
99th percentile latency | country_agg_uncached | 271.988 | ms |
100th percentile latency | country_agg_uncached | 275.963 | ms |
50th percentile service time | country_agg_uncached | 194.061 | ms |
90th percentile service time | country_agg_uncached | 209.086 | ms |
99th percentile service time | country_agg_uncached | 216.432 | ms |
100th percentile service time | country_agg_uncached | 217.275 | ms |
error rate | country_agg_uncached | 0 | % |
Min Throughput | country_agg_cached | 99.97 | ops/s |
Median Throughput | country_agg_cached | 100.05 | ops/s |
Max Throughput | country_agg_cached | 100.08 | ops/s |
50th percentile latency | country_agg_cached | 4.9212 | ms |
90th percentile latency | country_agg_cached | 5.44065 | ms |
99th percentile latency | country_agg_cached | 7.15509 | ms |
99.9th percentile latency | country_agg_cached | 16.9407 | ms |
100th percentile latency | country_agg_cached | 17.8111 | ms |
50th percentile service time | country_agg_cached | 4.81515 | ms |
90th percentile service time | country_agg_cached | 5.29377 | ms |
99th percentile service time | country_agg_cached | 6.38482 | ms |
99.9th percentile service time | country_agg_cached | 16.8318 | ms |
100th percentile service time | country_agg_cached | 17.7311 | ms |
error rate | country_agg_cached | 0 | % |
Min Throughput | scroll | 25.02 | pages/s |
Median Throughput | scroll | 25.02 | pages/s |
Max Throughput | scroll | 25.03 | pages/s |
50th percentile latency | scroll | 760.634 | ms |
90th percentile latency | scroll | 794.699 | ms |
99th percentile latency | scroll | 864.897 | ms |
100th percentile latency | scroll | 874.768 | ms |
50th percentile service time | scroll | 760.32 | ms |
90th percentile service time | scroll | 794.397 | ms |
99th percentile service time | scroll | 864.658 | ms |
100th percentile service time | scroll | 874.556 | ms |
error rate | scroll | 0 | % |
Min Throughput | expression | 2 | ops/s |
Median Throughput | expression | 2 | ops/s |
Max Throughput | expression | 2 | ops/s |
50th percentile latency | expression | 382.483 | ms |
90th percentile latency | expression | 414.775 | ms |
99th percentile latency | expression | 455.236 | ms |
100th percentile latency | expression | 473.181 | ms |
50th percentile service time | expression | 382.298 | ms |
90th percentile service time | expression | 414.577 | ms |
99th percentile service time | expression | 455.11 | ms |
100th percentile service time | expression | 472.998 | ms |
error rate | expression | 0 | % |
Min Throughput | painless_static | 1.5 | ops/s |
Median Throughput | painless_static | 1.5 | ops/s |
Max Throughput | painless_static | 1.5 | ops/s |
50th percentile latency | painless_static | 480.188 | ms |
90th percentile latency | painless_static | 505.003 | ms |
99th percentile latency | painless_static | 529.066 | ms |
100th percentile latency | painless_static | 547.199 | ms |
50th percentile service time | painless_static | 479.938 | ms |
90th percentile service time | painless_static | 504.731 | ms |
99th percentile service time | painless_static | 528.857 | ms |
100th percentile service time | painless_static | 546.954 | ms |
error rate | painless_static | 0 | % |
Min Throughput | painless_dynamic | 1.5 | ops/s |
Median Throughput | painless_dynamic | 1.5 | ops/s |
Max Throughput | painless_dynamic | 1.5 | ops/s |
50th percentile latency | painless_dynamic | 469.434 | ms |
90th percentile latency | painless_dynamic | 508.615 | ms |
99th percentile latency | painless_dynamic | 581.127 | ms |
100th percentile latency | painless_dynamic | 621.998 | ms |
50th percentile service time | painless_dynamic | 469.178 | ms |
90th percentile service time | painless_dynamic | 508.349 | ms |
99th percentile service time | painless_dynamic | 580.819 | ms |
100th percentile service time | painless_dynamic | 621.799 | ms |
error rate | painless_dynamic | 0 | % |
error rate | large_terms | 0 | % |
Min Throughput | large_filtered_terms | 1.52 | ops/s |
Median Throughput | large_filtered_terms | 1.52 | ops/s |
Max Throughput | large_filtered_terms | 1.52 | ops/s |
50th percentile latency | large_filtered_terms | 39664.6 | ms |
90th percentile latency | large_filtered_terms | 46001.3 | ms |
99th percentile latency | large_filtered_terms | 47328 | ms |
100th percentile latency | large_filtered_terms | 47488.6 | ms |
50th percentile service time | large_filtered_terms | 651.731 | ms |
90th percentile service time | large_filtered_terms | 673.319 | ms |
99th percentile service time | large_filtered_terms | 715.941 | ms |
100th percentile service time | large_filtered_terms | 723.06 | ms |
error rate | large_filtered_terms | 0 | % |
Min Throughput | large_prohibited_terms | 1.55 | ops/s |
Median Throughput | large_prohibited_terms | 1.56 | ops/s |
Max Throughput | large_prohibited_terms | 1.57 | ops/s |
50th percentile latency | large_prohibited_terms | 35606.8 | ms |
90th percentile latency | large_prohibited_terms | 40847.6 | ms |
99th percentile latency | large_prohibited_terms | 42170.5 | ms |
100th percentile latency | large_prohibited_terms | 42329.2 | ms |
50th percentile service time | large_prohibited_terms | 648.82 | ms |
90th percentile service time | large_prohibited_terms | 672.114 | ms |
99th percentile service time | large_prohibited_terms | 722.666 | ms |
100th percentile service time | large_prohibited_terms | 733.307 | ms |
error rate | large_prohibited_terms | 0 | % |
Metric | Task | Value | Unit |
---|---|---|---|
Total indexing time | - | 20.1957 | min |
Min indexing time per shard | - | 0.000733333 | min |
Median indexing time per shard | - | 3.77953 | min |
Max indexing time per shard | - | 4.63752 | min |
Total merge time | - | 1.57487 | min |
Min merge time per shard | - | 0 | min |
Median merge time per shard | - | 0.176658 | min |
Max merge time per shard | - | 0.634067 | min |
Total merge throttle time | - | 0.55105 | min |
Min merge throttle time per shard | - | 0 | min |
Median merge throttle time per shard | - | 0.065 | min |
Max merge throttle time per shard | - | 0.217033 | min |
Total refresh time | - | 1.41135 | min |
Min refresh time per shard | - | 0.00106667 | min |
Median refresh time per shard | - | 0.269958 | min |
Max refresh time per shard | - | 0.345733 | min |
Total flush time | - | 0.533133 | min |
Min flush time per shard | - | 0.000566667 | min |
Median flush time per shard | - | 0.115592 | min |
Max flush time per shard | - | 0.136683 | min |
Total Young Gen GC | - | 70.747 | s |
Total Old Gen GC | - | 0.92 | s |
Store size | - | 3.31581 | GB |
Translog size | - | 2.80E-07 | GB |
Heap used for segments | - | 11.0486 | MB |
Heap used for doc values | - | 0.100529 | MB |
Heap used for terms | - | 9.84413 | MB |
Heap used for norms | - | 0.0755005 | MB |
Heap used for points | - | 0.216421 | MB |
Heap used for stored fields | - | 0.811981 | MB |
Segment count | - | 97 | - |
Min Throughput | index-append | 74421.1 | docs/s |
Median Throughput | index-append | 75636.9 | docs/s |
Max Throughput | index-append | 76877.4 | docs/s |
50th percentile latency | index-append | 377.922 | ms |
90th percentile latency | index-append | 663.055 | ms |
99th percentile latency | index-append | 3068.99 | ms |
100th percentile latency | index-append | 5554.97 | ms |
50th percentile service time | index-append | 377.922 | ms |
90th percentile service time | index-append | 663.055 | ms |
99th percentile service time | index-append | 3068.99 | ms |
100th percentile service time | index-append | 5554.97 | ms |
error rate | index-append | 0 | % |
Min Throughput | index-stats | 99.93 | ops/s |
Median Throughput | index-stats | 100.04 | ops/s |
Max Throughput | index-stats | 100.06 | ops/s |
50th percentile latency | index-stats | 6.62305 | ms |
90th percentile latency | index-stats | 7.35102 | ms |
99th percentile latency | index-stats | 18.0909 | ms |
99.9th percentile latency | index-stats | 24.5381 | ms |
100th percentile latency | index-stats | 24.7431 | ms |
50th percentile service time | index-stats | 6.50957 | ms |
90th percentile service time | index-stats | 7.18652 | ms |
99th percentile service time | index-stats | 9.38455 | ms |
99.9th percentile service time | index-stats | 24.4424 | ms |
100th percentile service time | index-stats | 24.6576 | ms |
error rate | index-stats | 0 | % |
Min Throughput | node-stats | 99.92 | ops/s |
Median Throughput | node-stats | 100.04 | ops/s |
Max Throughput | node-stats | 100.25 | ops/s |
50th percentile latency | node-stats | 7.15655 | ms |
90th percentile latency | node-stats | 7.96104 | ms |
99th percentile latency | node-stats | 10.2362 | ms |
99.9th percentile latency | node-stats | 25.7397 | ms |
100th percentile latency | node-stats | 29.1573 | ms |
50th percentile service time | node-stats | 7.04389 | ms |
90th percentile service time | node-stats | 7.84655 | ms |
99th percentile service time | node-stats | 9.13249 | ms |
99.9th percentile service time | node-stats | 10.7357 | ms |
100th percentile service time | node-stats | 29.072 | ms |
error rate | node-stats | 0 | % |
Min Throughput | default | 41.88 | ops/s |
Median Throughput | default | 42.18 | ops/s |
Max Throughput | default | 42.52 | ops/s |
50th percentile latency | default | 3789.31 | ms |
90th percentile latency | default | 5170.79 | ms |
99th percentile latency | default | 5582.03 | ms |
99.9th percentile latency | default | 5610.7 | ms |
100th percentile latency | default | 5618.05 | ms |
50th percentile service time | default | 23.1496 | ms |
90th percentile service time | default | 25.8865 | ms |
99th percentile service time | default | 33.249 | ms |
99.9th percentile service time | default | 45.493 | ms |
100th percentile service time | default | 62.4174 | ms |
error rate | default | 0 | % |
Min Throughput | term | 199.08 | ops/s |
Median Throughput | term | 200 | ops/s |
Max Throughput | term | 200.03 | ops/s |
50th percentile latency | term | 5.02391 | ms |
90th percentile latency | term | 21.18 | ms |
99th percentile latency | term | 35.2251 | ms |
99.9th percentile latency | term | 37.4827 | ms |
100th percentile latency | term | 37.6907 | ms |
50th percentile service time | term | 4.61812 | ms |
90th percentile service time | term | 5.10619 | ms |
99th percentile service time | term | 6.8135 | ms |
99.9th percentile service time | term | 22.1183 | ms |
100th percentile service time | term | 25.0033 | ms |
error rate | term | 0 | % |
Min Throughput | phrase | 199.61 | ops/s |
Median Throughput | phrase | 200.04 | ops/s |
Max Throughput | phrase | 200.8 | ops/s |
50th percentile latency | phrase | 3.86572 | ms |
90th percentile latency | phrase | 4.96583 | ms |
99th percentile latency | phrase | 22.5681 | ms |
99.9th percentile latency | phrase | 23.5684 | ms |
100th percentile latency | phrase | 28.2658 | ms |
50th percentile service time | phrase | 3.5689 | ms |
90th percentile service time | phrase | 4.2535 | ms |
99th percentile service time | phrase | 8.6957 | ms |
99.9th percentile service time | phrase | 24.5685 | ms |
100th percentile service time | phrase | 27.6584 | ms |
error rate | phrase | 0 | % |
Min Throughput | country_agg_uncached | 4.99 | ops/s |
Median Throughput | country_agg_uncached | 5 | ops/s |
Max Throughput | country_agg_uncached | 5 | ops/s |
50th percentile latency | country_agg_uncached | 182.291 | ms |
90th percentile latency | country_agg_uncached | 201.585 | ms |
99th percentile latency | country_agg_uncached | 257.343 | ms |
100th percentile latency | country_agg_uncached | 267.904 | ms |
50th percentile service time | country_agg_uncached | 181.161 | ms |
90th percentile service time | country_agg_uncached | 196.189 | ms |
99th percentile service time | country_agg_uncached | 216.762 | ms |
100th percentile service time | country_agg_uncached | 267.778 | ms |
error rate | country_agg_uncached | 0 | % |
Min Throughput | country_agg_cached | 99.95 | ops/s |
Median Throughput | country_agg_cached | 100.05 | ops/s |
Max Throughput | country_agg_cached | 100.07 | ops/s |
50th percentile latency | country_agg_cached | 5.57249 | ms |
90th percentile latency | country_agg_cached | 6.47982 | ms |
99th percentile latency | country_agg_cached | 9.33674 | ms |
99.9th percentile latency | country_agg_cached | 27.5319 | ms |
100th percentile latency | country_agg_cached | 32.0567 | ms |
50th percentile service time | country_agg_cached | 5.4601 | ms |
90th percentile service time | country_agg_cached | 6.25153 | ms |
99th percentile service time | country_agg_cached | 7.83564 | ms |
99.9th percentile service time | country_agg_cached | 13.6439 | ms |
100th percentile service time | country_agg_cached | 31.9487 | ms |
error rate | country_agg_cached | 0 | % |
Min Throughput | scroll | 25.01 | pages/s |
Median Throughput | scroll | 25.03 | pages/s |
高级特性,是指 Elasticsearch 官方商业特性(原 X-Pack 商业版插件包含的特性),包含了安全(Security)、SQL、机器学习(Machine Learning)、监控(Monitor)等高级功能,可以为 Elasticsearch 服务的应用开发和运维管理,提供更有力的帮助。腾讯云 ES 已提供了包含高级特性的版本,您可以在创建购买集群时选择,下文介绍各版本详细功能。
如上图所示,在腾讯云 ES 创建购买页,有高级特性版本选项。腾讯云 ES 提供了3种可选的高级特性版本,版本说明如下:
对比项 | 基础版 | 白金版 | 开源版 |
---|---|---|---|
是否包含 X-Pack | ✓ | ✓ | ✕ |
X-Pack 功能完整度 | 部分 | 全部 | 无 |
购买推荐
为了能够使用腾讯云 Elasticsearch 更多高级功能,我们建议您在创建购买集群时,选择白金版,各版本具体功能介绍及区别见下文,产品的定价信息详见 产品定价。
本文对部分常用高级特性进行了说明,完整的高级特性及说明,可查看官方说明 Elastic Stack 订阅 、API 文档。
部分功能在不同的高级特性版本(基础、白金、开源)间有区别。
部分功能在较老的腾讯云 ES 版本不支持,若您遇到此问题可 联系客服咨询。
安全(Security)
支持索引和字段级别读写等细分权限的控制管理,实现数据安全防护、业务访问隔离,向正确的人员授予访问权限,阻止恶意破坏和数据泄露,有效的保障数据安全。
机器学习(Machine Learning)
在自定义数据告警的应用场景中,对于较难设置规则和阈值来定义的变化,可通过结合非监督型机器学习来预测数据的变化趋势和合理的波动范围,在数据偏离正常变化趋势时,发出告警通知。
监控
集群、节点、索引多个维度,全方位监控,实时了解集群运行情况,辅助应用开发及运维。
SQL
提供了通过传统数据库 SQL 工具 ,实现对 Elasticsearch 数据进行全文本检索、数据统计分析功能,支持 CLI、REST 等接入方式,白金版还支持 JDBC 连接。可以实现同原有业务系统的无缝对接,降低新技术学习成本。
SQL 支持方面,开源版集成了其他的 SQL 插件,详细了解和使用可查看 elasticsearch-sql。
本节主要对不同 ES 版本的部分重点功能做对比说明,方便用户了解不同版本中功能的区别。因 Elasticsearch 正处于快速发展阶段,不同版本对各功能的支持情况也在不断调整,所以我们不保证下述内容能及时跟进社区变化。
了解最新准确的功能对比,可查看 Elasticsearch 官方介绍 Elastic Stack 订阅。
下表中、、用于表示对应特性的功能完整度,:包含全部功能;:包含部分功能;:不包含。
模块 | 特性 | 开源版 | 基础版 | 白金版 |
---|---|---|---|---|
Elasticsearch | 可扩展性和弹性 | |||
查询和分析 | ||||
数据扩充 | ||||
管理和工具 | ||||
Security | ||||
机器学习 | ||||
Kibana | 探索和可视化 | |||
堆栈管理和工具 | ||||
堆栈监测 | ||||
分享与合作 | ||||
Security | ||||
机器学习 | ||||
Beats | 数据收集 | |||
数据传输 | ||||
模块 | ||||
监测和管理 | ||||
Logstash | 数据收集 | |||
数据扩充 | ||||
数据传输 | ||||
模块 | ||||
监测和管理 | ||||
ELASTIC APM | APM 服务器 | |||
APM 代理 | ||||
Kibana 中的 APM 仪表板 | ||||
APM UI | ||||
分布式追踪 | ||||
Machine Learning 整合 | ||||
ELASTIC 日志 | 日志采集器(Filebeat) | |||
常用数据源的仪表板 | ||||
Logs UI | ||||
ELASTIC 基础设施 | 指标采集器(Metricbeat) | |||
常用数据源的仪表板 | ||||
Infrastructure UI | ||||
ELASTIC 运行状态监控 | 运行状态监测(Heartbeat) | |||
Kibana 里的运行状态仪表板 | ||||
运行状态监测 UI |
Elasticsearch 部分功能详细说明:
下表中 ✓ 用于表示是否拥有对应特性的功能,✓:表示具备;-:表示不具备。
Elasticsearch功能模块 | 细项 | 开源版 | 基础版 | 白金版 |
---|---|---|---|---|
管理和工具 | REST API | ✓ | ✓ | ✓ |
语言客户端 | ✓ | ✓ | ✓ | |
快照/恢复 | ✓ | ✓ | ✓ | |
_仅源快照 | - | ✓ | ✓ | |
SQL 解释器 CLI | - | ✓ | ✓ | |
数据汇总 | - | ✓ | ✓ | |
索引生命周期管理 | - | ✓ | ✓ | |
冻结索引 | - | ✓ | ✓ | |
升级助手 API | - | ✓ | ✓ | |
JDBC 客户端 | - | - | ✓ | |
ODBC 客户端 | - | - | ✓ | |
Security | 加密通信 | - | ✓ | ✓ |
基于角色的访问控制 | - | ✓ | ✓ | |
文件和原生身份验证 | - | ✓ | ✓ | |
审核日志 | - | - | - | |
基于属性的权限控制 | - | - | ✓ | |
字段和文档级别安全性 | - | - | ✓ | |
机器学习 | 时序型异常监测 | - | - | ✓ |
输入/实体分析 | - | - | ✓ | |
日志消息分类 | - | - | ✓ | |
根本原因指示 | - | - | ✓ | |
异常情况警报 | - | - | ✓ | |
时序型预测 | - | - | ✓ |
腾讯云 ES 提供了云端托管的服务,您可容易地创建和管理 Elasticsearch 集群,并且能够保障生产环境中的高可用性。下文是对产品核心优势的介绍:
您只需通过简单的操作,即可在几分钟内创建一个 ES 集群,免去软硬件部署调试的复杂流程。此外,ES 还提供了便捷的集群运营管理工具、Kibana 页面以及完善的集群监控和告警系统,以满足客户日常的集群运营管理需求。
ES 提供了多种类型的节点规格和存储介质,您可以根据业务需要进行选择。随着业务的发展,您可以动态调整集群的配置扩容或缩容,实时保障业务的发展需要并有效控制成本。
集成 Security、SQL、Machine Learning 等 Elasticsearch 高级特性(X-Pack),提升了 Elasticsearch 集群的安全管控、操作使用和运维管理效率。
ES 提供了多可用区部署方案,可保证在单可用区网络、电力等不可抗力故障下不停服。COS 数据备份策略可定时备份数据,保障数据在意外情况下丢失时快速恢复。此外还有为保障集群稳定而进行的内核优化等策略,可以全方位地保障数据的安全和服务的稳定。
通过部署在逻辑隔离的私有网络 VPC,客户可以完全掌控自己的环境配置,自定义网络访问控制列表(Access Control List)和安全组,提供了 Kibana 访问和 IP 访问黑白名单机制,高级特性(X-Pack)的 Security 能力提供了字段级的权限控制,切实保证您云上资源的安全性。
支持完整的 ELK 产品体系,兼容标准的开源 RESTful API 和生态组件,可以与对象存储 COS、网络流日志、消息队列、云数据库 TencentDB 等腾讯云产品集成,为用户提供数据传输和备份能力,以满足不同业务场景需要。
网站服务器、移动设备、IOT 传感器等设备产生的日志都存在节点分散、种类多样、规模庞大等问题,这对需要通过日志搜索进行异常问题定位和业务分析等工作造成了很大的挑战。ES 提供了弹性可扩展、实时的集中式存储方案以及全文搜索功能,方便日志的统一管理和查询,帮助用户快速定位和发现问题,提高解决问题的效率。
电商商品搜索、移动应用搜索、企业内部信息搜索等海量数据下的站内搜索服务是高效获取信息的必要途径,ES 拥有全文检索功能,对结构化和非结构化数据都有良好的支持,同时还提供了简单易用的 RESTful API 和各种语言的客户端,方便用户快速搭建稳定的搜索服务,整合到已有的业务框架中。
在数据驱动运营的行业背景下,电子商务、移动应用、广告媒体等业务都需要借助数据分析和数据挖掘来辅助商业决策,而规模庞大的业务数据对数据的统计分析造成了很大的挑战。ES 拥有结构化查询的能力,支持复杂的过滤和聚合统计功能,帮助客户对海量数据进行高效地个性化统计分析、发现问题与机会、辅助商业决策,让数据产生真正的价值。