系列文章目录
JavaSE | ||
|---|---|---|
| 基础知识、数据类型学习 | 万年历项目 | 代码逻辑训练习题 |
| 代码逻辑训练习题 | 方法、数组学习 | 图书管理系统项目 |
| 面向对象编程：封装、继承、多态学习 | 封装继承多态习题 | 常用类、包装类、异常处理机制学习 |
| 集合学习 | IO流、多线程学习 | 仓库管理系统JavaSE项目 |
| 员工管理系统、多表查询、反射实现DBHelper学习 | DML、DDL、数据库对象学习 | |
JavaWeb | ||
| 网络编程、各种标签、CSS学习 | ECMAScript、BOM学习 | DOM、jQuery学习 |
| Servlet、JSP、Cookie、Ajax学习 | 融资管理系统JavaWeb项目 | |
框架 | ||
| MyBatis框架学习 | 逆向工程、Spring框架IOC、AOP学习 | SpringMVC框架学习 |
| SpringBoot框架学习 | 招聘网站框架项目 | Vue介绍、窗体内操作、窗体间操作学习 |
| Vue路由配置、网络请求访问框架项目、element组件介绍学习 | 标准管理系统Vue项目 | |
微服务 | ||
| Linux安装、Nginx反向代理、负载均衡学习 | Docker学习 | Jenkins学习 |
| Nexus学习 | Spring Security学习 | RabbitMQ学习 |
| Redis学习 | MongoDB学习 | Nacos学习 |
| Spring Session学习 | Spring Gateway学习 | JSR 303学习 |
| OenFeign学习 | Dubbo学习 | Hystrix学习 |
| Sentinel学习 | JMeter学习 | Seata学习 |
| jvisualvm学习 | Sleuth、Zipkin学习 | Swagger学习 |
| Elasticsearch学习 |
文章目录
- 系列文章目录
- 前言
- 一、Elasticsearch、Kibana介绍
- 1. Elasticsearch
- 2. Elasticsearch特点
- 3. Kibana
- 4. Kibana特点
- 二、Elasticsearch、Kibana安装
- 1. 下载镜像
- 2. 创建路径
- 3. 分配权限
- 4. 添加访问权限
- 5. 启动Elasticsearch
- 6. 访问Elasticsearch
- 7. 启动Kibana
- 三、Elasticsearch、Kibana使用
- 四、Elasticsearch实现
- 1. 创建Maven项目
- 2. 导入依赖
- 3. 创建EsConfig配置类
- 4. 创建Score实体类
- 5. 创建Student实体类
- 6. 创建EsApplication启动类
- 7. 创建EsTest测试类
- 8. 创建application.properties配置文件
- 9. 创建application.yml配置文件
- 10. 创建bootstrap.yml配置文件
- 11. 启动虚拟机环境
- 12. 测试运行
- 总结
前言
本文我们要讲述：
Elasticsearch；
Kibana
在下攸攸太上，我每次写代码必定是班里最快的。
一、Elasticsearch、Kibana介绍
Elasticsearch和Kibana都是由Elastic公司提供的开源工具，用于处理和可视化数据。
1. Elasticsearch
Elasticsearch是一个基于Lucene的分布式搜索和分析引擎。它被设计用于快速、可扩展地搜索、分析和存储大量数据。
2. Elasticsearch特点
分布式架构：可以水平扩展以处理大规模数据，并提供高可用性和容错性。
实时搜索：支持对数据的实时索引和搜索，适用于实时应用程序和分析场景。
多种数据类型支持：可以处理结构化、半结构化和非结构化数据，包括文本、地理空间数据等。
强大的查询语言：支持复杂的查询和聚合操作，提供灵活的搜索和分析功能。
3. Kibana
Kibana是一个用于数据可视化和管理的开源工具，通常与Elasticsearch配合使用。
4. Kibana特点
数据可视化：提供丰富的图表、地图和仪表板构建功能，用于展示和分析Elasticsearch中的数据。
实时监控：可以实时监控数据、查询性能和系统指标。
用户友好的界面：提供直观的用户界面，使用户可以轻松地创建和定制数据可视化和仪表板。
集成Elastic Stack：与Elasticsearch、Logstash和Beats等工具无缝集成，构建完整的数据处理和可视化解决方案。
总的来说，Elasticsearch和Kibana通常结合使用，Elasticsearch用于存储和分析数据，而Kibana用于可视化和管理这些数据，为用户提供了强大的数据处理和可视化能力。
二、Elasticsearch、Kibana安装
1. 下载镜像
docker pull elasticsearch:7.6.2
docker pull kibana:7.6.2
漫长的等待后：
2. 创建路径
创建/usr/local/docker/es路径和其下config和data两个文件夹
3. 分配权限
cd /usr/local/docker/es/
ll
chmod -R 777 /usr/local/docker/es/
chmod -R 777 /usr/local/docker/es/config
chmod -R 777 /usr/local/docker/es/data
4. 添加访问权限
echo "http.host: 0.0.0.0" > /usr/local/docker/es/config/elasticsearch.yml
我们打开elasticsearch.yml进行查看
写入成功
5. 启动Elasticsearch
docker run --name es -p 9200:9200 -p 9300:9300 \
-e "discovery.type=single-node" \
-e ES_JAVA_OPTS="-Xms64m -Xmx512m" \
-v /usr/local/docker/es/config/elasticsearch.yml:/usr/share/elasticsearch/config/elasticsearch.yml \
-v /usr/local/docker/es/data:/usr/share/elasticsearch/data \
-v /usr/local/docker/es/plugins:/usr/share/elasticsearch/plugins \
-d elasticsearch:7.6.2
6. 访问Elasticsearch
http://192.168.43.143:9200/
访问网址查看版本信息
{"name" : "d33a8f9523dc","cluster_name" : "elasticsearch","cluster_uuid" : "Gzf3tkYRRyuHlkSiBzkQyA","version" : {"number" : "7.6.2","build_flavor" : "default","build_type" : "docker","build_hash" : "ef48eb35cf30adf4db14086e8aabd07ef6fb113f","build_date" : "2020-03-26T06:34:37.794943Z","build_snapshot" : false,"lucene_version" : "8.4.0","minimum_wire_compatibility_version" : "6.8.0","minimum_index_compatibility_version" : "6.0.0-beta1"},"tagline" : "You Know, for Search"
}
7. 启动Kibana
docker run --name kibana -e ELASTICSEARCH_HOSTS=http://192.168.43.143:9200 -p 5601:5601 -d kibana:7.6.2
三、Elasticsearch、Kibana使用
http://192.168.43.143:5601
可能出现Kibana Is Not Ready Yet字样，无需慌乱，闲暇片刻，喝喝水，溜溜神，回神后再次刷新，即可出现如下界面
点击上图Try our sample data按钮
点击左下角【≡+】（哈哈，赛博拟声词！）
点击Dev Tools，在弹出的页面里点击Dismiss
将如下代码写入左侧文本框
# 增 /student/_doc/1 student是表名，_doc是文档类型的记录，1是主键的值；
POST /student/_doc/1
{"id":"1","name":"张三","age":21,"scoreList":[{"id":"1","name":"数学", "score":95},{"id":"2","name":"语文", "score":98},{"id":"3","name":"外语", "score":90}]
}POST /student/_doc/2
{"id":"2","name":"李四","age":22,"scoreList":[{"id":"4","name":"数学", "score":85},{"id":"5","name":"语文", "score":88},{"id":"6","name":"外语", "score":80}]
}POST /student/_doc/3
{"id":"3","name":"王五","age":23,"scoreList":[{"id":"7","name":"数学", "score":75},{"id":"8","name":"语文", "score":78},{"id":"9","name":"外语", "score":70}]
}# 查
GET /student/_doc/3
# 查所有
GET /student/_search # 改
PUT /student/_doc/3
{"id":"3","name":"王六","age":26,"scoreList":[{"id":"7","name":"数学", "score":65},{"id":"8","name":"语文", "score":78},{"id":"9","name":"外语", "score":70}]
}# 删
DELETE /student/_doc/3
将鼠标放在第二行会出现两个按钮
点击运行（click to send request）按钮
四、Elasticsearch实现
1. 创建Maven项目
项目结构：
2. 导入依赖
<parent><groupId>org.springframework.boot</groupId><artifactId>spring-boot-starter-parent</artifactId><version>2.0.7.RELEASE</version></parent><properties><java.version>1.8</java.version><project.build.sourceEncoding>UTF-8</project.build.sourceEncoding><project.reporting.outputEncoding>UTF-8</project.reporting.outputEncoding><spring-boot.version>2.6.13</spring-boot.version><jwt.version>0.7.0</jwt.version><fastjson.version>1.2.60</fastjson.version><spring-cloud-alibaba.version>2.0.3.RELEASE</spring-cloud-alibaba.version><spring-cloud.version>Finchley.SR2</spring-cloud.version></properties><dependencies><dependency><groupId>org.springframework.session</groupId><artifactId>spring-session-data-redis</artifactId></dependency><dependency><groupId>org.springframework.boot</groupId><artifactId>spring-boot-starter-data-redis</artifactId></dependency><dependency><groupId>com.alibaba.cloud</groupId><artifactId>spring-cloud-starter-alibaba-nacos-discovery</artifactId></dependency><dependency><groupId>com.alibaba.cloud</groupId><artifactId>spring-cloud-starter-alibaba-nacos-config</artifactId></dependency><dependency><groupId>com.alibaba.cloud</groupId><artifactId>spring-cloud-starter-alibaba-sentinel</artifactId></dependency><dependency><groupId>org.elasticsearch.client</groupId><artifactId>elasticsearch-rest-high-level-client</artifactId><exclusions><exclusion><groupId>org.elasticsearch</groupId><artifactId>elasticsearch</artifactId></exclusion></exclusions><version>7.6.2</version></dependency><dependency><groupId>org.elasticsearch</groupId><artifactId>elasticsearch</artifactId><version>7.6.2</version></dependency><dependency><groupId>com.alibaba.csp</groupId><artifactId>sentinel-web-servlet</artifactId></dependency><!-- feign --><dependency><groupId>org.springframework.cloud</groupId><artifactId>spring-cloud-starter-openfeign</artifactId></dependency><dependency><groupId>org.springframework.boot</groupId><artifactId>spring-boot-starter-web</artifactId></dependency><dependency><groupId>org.springframework.boot</groupId><artifactId>spring-boot-starter-test</artifactId><scope>compile</scope></dependency><dependency><groupId>org.projectlombok</groupId><artifactId>lombok</artifactId></dependency><!--json--><dependency><groupId>com.alibaba</groupId><artifactId>fastjson</artifactId><version>${fastjson.version}</version><scope>compile</scope></dependency></dependencies><dependencyManagement><dependencies><dependency><groupId>org.springframework.cloud</groupId><artifactId>spring-cloud-dependencies</artifactId><version>${spring-cloud.version}</version><type>pom</type><scope>import</scope></dependency><dependency><groupId>com.alibaba.cloud</groupId><artifactId>spring-cloud-alibaba-dependencies</artifactId><version>${spring-cloud-alibaba.version}</version><type>pom</type><scope>import</scope></dependency></dependencies></dependencyManagement><build><plugins><plugin><groupId>org.springframework.boot</groupId><artifactId>spring-boot-maven-plugin</artifactId><configuration><classifier>exec</classifier></configuration></plugin></plugins><!--2.资源拷贝的插件 --><resources><resource><directory>src/main/java</directory><includes><include>**/*.xml</include></includes></resource><resource><directory>src/main/resources</directory><includes><include>**/*.yml</include><include>**/*.html</include><include>**/*.js</include><include>**/*.xml</include><include>**/*.properties</include></includes></resource></resources></build>
3. 创建EsConfig配置类
package com.jjy.config;import org.apache.http.HttpHost;
import org.elasticsearch.client.RestClient;
import org.elasticsearch.client.RestClientBuilder;
import org.elasticsearch.client.RestHighLevelClient;
import org.springframework.context.annotation.Bean;
import org.springframework.context.annotation.Configuration;@Configuration
public class EsConfig {@Beanpublic RestHighLevelClient restHighLevelClient() {RestClientBuilder restClientBuilder = RestClient.builder(new HttpHost("192.168.1.101", 9200, "http"));return new RestHighLevelClient(restClientBuilder);}
}
4. 创建Score实体类
package com.jjy.entry;import lombok.AllArgsConstructor;
import lombok.Data;
import lombok.NoArgsConstructor;
import lombok.ToString;
import org.springframework.stereotype.Component;@Data
@AllArgsConstructor
@NoArgsConstructor
@ToString
@Component
public class Score {private String id;private String name;private Double score;
}
5. 创建Student实体类
package com.jjy.entry;import lombok.AllArgsConstructor;
import lombok.Data;
import lombok.NoArgsConstructor;
import lombok.ToString;
import org.springframework.stereotype.Component;import java.util.List;@Data
@AllArgsConstructor
@NoArgsConstructor
@ToString
@Component
public class Student {private String name;private Integer age;private String id;private List<Score> scoreList;
}
6. 创建EsApplication启动类
package com.jjy;import org.springframework.boot.SpringApplication;
import org.springframework.boot.autoconfigure.SpringBootApplication;@SpringBootApplication
public class EsApplication {public static void main(String[] args) {SpringApplication.run(EsApplication.class, args);}
}
7. 创建EsTest测试类
package com.jjy.test;
import com.alibaba.fastjson.JSON;
import com.jjy.EsApplication;
import com.jjy.entry.Score;
import org.elasticsearch.action.index.IndexRequest;
import org.elasticsearch.action.index.IndexResponse;
import org.elasticsearch.action.search.SearchRequest;
import org.elasticsearch.action.search.SearchResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.common.xcontent.XContentType;
import org.elasticsearch.index.query.QueryBuilders;
import org.elasticsearch.index.query.TermQueryBuilder;
import org.elasticsearch.search.builder.SearchSourceBuilder;
import com.jjy.entry.Student;
import org.junit.Test;
import org.junit.runner.RunWith;
import org.springframework.beans.factory.annotation.Autowired;
import org.springframework.boot.test.context.SpringBootTest;
import org.springframework.test.context.junit4.SpringRunner;import java.io.IOException;
import java.util.ArrayList;
import java.util.List;@RunWith(SpringRunner.class)
@SpringBootTest(classes = EsApplication.class)
public class EsTest {@Autowiredprivate RestHighLevelClient client;/*** 保存数据*/@Testpublic void save() throws IOException {/*student相当于表名，将数据保存到哪里*/IndexRequest indexRequest = new IndexRequest("student");Student student = new Student();student.setAge(20);student.setId("5");student.setName("钱六");Score score1 = new Score();score1.setName("数学");score1.setScore(89.0);score1.setId("shuxue");Score score2 = new Score();score2.setName("语文");score2.setScore(121.0);score2.setId("yuwen");Score score3 = new Score();score3.setName("外语");score3.setScore(124.0);score3.setId("waiyu");List<Score> scoreList = new ArrayList<>();scoreList.add(score1);scoreList.add(score2);scoreList.add(score3);student.setScoreList(scoreList);/*保存数据也是向es发送了rest请求，保存需要一个json的数据，将对象转化成JSON串*/String studentJson = JSON.toJSONString(student);indexRequest.source(studentJson, XContentType.JSON);IndexResponse response = client.index(indexRequest, RequestOptions.DEFAULT);System.out.println(response);}/*** 查询数据*/@Testpublic void select() throws IOException {SearchRequest searchRequest = new SearchRequest();SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();/*查询的字段要加上keyword，表示按照数据中这个字段值查询，不加就查询不到；id主键除外！*/TermQueryBuilder termQuery = QueryBuilders.termQuery("name.keyword", "张三");searchSourceBuilder.query(termQuery);searchRequest.source(searchSourceBuilder);SearchResponse search = client.search(searchRequest, RequestOptions.DEFAULT);System.out.println(search);}}
8. 创建application.properties配置文件
spring.application.name=elasticsearch
9. 创建application.yml配置文件
server:port: 100
10. 创建bootstrap.yml配置文件
spring:cloud:nacos:discovery:server-addr: 192.168.43.143:8848config:server-addr: 192.168.43.143:8848 #file-extension: yamlnamespace: 7e56a725-f51a-4603-b421-49add0ae9c4b # 命名空间ID，粘贴复制过来即可。shared-configs:- data-id: redissession1.yaml # 配置详情内：Data ID，粘贴复制过来即可。group: DEFAULT_GROUP # 配置详情内：Group 粘贴复制过来即可。inetutils:preferred-networks: 192.168.56 # 服务管理内，public内点击详情，可以查看，需要项目启动后能查看，一般默认192.168.56
11. 启动虚拟机环境
需要启动nacos和redis
12. 测试运行
总结
本文讲述了：
Elasticsearch：用于存储分析数据；
Kibana：用于可视化使用Elasticsearch
在下攸攸太上，你们可能忘了，但我依然是ൠ♄§星的外星人。
