编程知识 cdmana.com

Kafka2.5 - > flink1.12 - > mysql8

############################################## The purpose and environment of the experiment ##############################################################

The purpose of this article is to reproduce... In the latest version [1], The environment is as follows :

Components edition
Zookeeper 3.6.0
Flink 1.12
Mysql 8.0.22-0ubuntu0.20.04.2
Kafka 2.5.0

 

############################################################################################################

Jark Documents for

Role of documents

kafka-common.sh

kafka Input data on the production side

 

kafka-consumer.sh kafka The consumer end

 

 

{"rowtime": "2018-03-12T08:00:00Z", "user_name": "Alice", "event": { "message_type": "WARNING", "message": "This is a warning."}}
{"rowtime": "2018-03-12T08:10:00Z", "user_name": "Alice", "event": { "message_type": "WARNING", "message": "This is a warning."}}
{"rowtime": "2018-03-12T09:00:00Z", "user_name": "Bob", "event": { "message_type": "WARNING", "message": "This is another warning."}}
{"rowtime": "2018-03-12T09:10:00Z", "user_name": "Alice", "event": { "message_type": "INFO", "message": "This is a info."}}
{"rowtime": "2018-03-12T09:20:00Z", "user_name": "Steve", "event": { "message_type": "INFO", "message": "This is another info."}}
{"rowtime": "2018-03-12T09:30:00Z", "user_name": "Steve", "event": { "message_type": "INFO", "message": "This is another info."}}
{"rowtime": "2018-03-12T09:30:00Z", "user_name": null, "event": { "message_type": "WARNING", "message": "This is a bad message because the user is missing."}}
{"rowtime": "2018-03-12T10:40:00Z", "user_name": "Bob", "event": { "message_type": "ERROR", "message": "This is an error."}}

############################################################################################################

 

 

Reference:

[1]Flink 1.9 actual combat : Use SQL Read Kafka And write MySQ

版权声明
本文为[Applied Sciences]所创,转载请带上原文链接,感谢
https://cdmana.com/2020/12/20201224214810586m.html

Scroll to Top