README.md · zky894064933/bigdata_learning

# 大数据学习文档、实战代码、源码解析、测试数据

#### 包含python、mysql、shell、 hadoop、hive、zookeeper、hbase、flume、kafka、spark、flink、dolphinscheduler、elasticsearch、sqoop、clickhouse、flinkcdc、canal、debezuim、datax、hudi、starrocks、iceberg、doris、cdh、superset、docker、kubernetes、strampark、maxwell等组件学习、实战、面试 持续更新中...

## 码字不易，路过的朋友们右上角请点个 ★star★ 鼓励一下~，感谢（抱拳）。

[【 cassandra 代码 持续更新中...】](https://github.com/WuZongYun/bigdata_learning/tree/main/cassandra_samples)

[【 doris 代码 持续更新中...】](https://github.com/WuZongYun/bigdata_learning/tree/main/doris_samples)

[【 flink 代码 持续更新中...】](https://github.com/WuZongYun/bigdata_learning/tree/main/flink_samples)

[【 hbase 代码 持续更新中...】](https://github.com/WuZongYun/bigdata_learning/tree/main/hbase-samples)

[【 hudi 代码 持续更新中...】](https://github.com/WuZongYun/bigdata_learning/tree/main/hudi-samples)

[【 presto 代码 持续更新中...】](https://github.com/WuZongYun/bigdata_learning/tree/main/presto_samples)

[【 spark 代码 持续更新中...】](https://github.com/WuZongYun/bigdata_learning/tree/main/spark_amples)

[【 storm 代码 持续更新中...】](https://github.com/WuZongYun/bigdata_learning/tree/main/storm_samples)

## [**一、python**]()

[【 1. python 基础 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484818&idx=1&sn=22891961bc946358592193d2376bd1c8&chksm=c0297e0df75ef71bd0bb3eb7468997311c839cf08b8cda4c383b9d52268463495a4831001af5#rd)

[【 2. python Numpy 】](http://t.csdn.cn/4mttz)

[【 3. python Pandas 】](http://t.csdn.cn/DQRGS)

[【 4. Anaconda 搭建pyflink开发环境 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484387&idx=1&sn=755e10001142e4737f5ba460f47b85a7&chksm=c029787cf75ef16a85afd9e7ab50fe3f02918e00ff99bbd0bc26271e2a3e90d41cce9a045579#rd)

[【 5. Anaconda Jupyter Notebook中配置多版本Python 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484373&idx=1&sn=a4bb3a362a8bf69e2aaf85c877ab1aca&chksm=c029784af75ef15c12a45cf4101f89fafc5a858b94db0b45c2616b0b38f52c6e0f8d3d1f75f3#rd)

## [**二、shell**]()

[【1. shell基础 】](http://t.csdn.cn/A0GkA)

[【2. 安装包下载 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484608&idx=1&sn=5d3b278d81cd11f518f2122e012f7436&chksm=c0297f5ff75ef649f093bc4d1a5a7a3e7e4e138ff125c917d55849200d4121dbefcb6521e9c4#rd)

[【 3. 一键搭建hive集群 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484544&idx=1&sn=cd889d3d946ad6ec21be60e37aee5d85&chksm=c0297f1ff75ef6090c82387e754c15febf86d0840bf73b9ba405b50db9ebedb4f2b8cfddf46d#rd)

[【 4. 一键搭建dolphinscheduler集群 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484589&idx=1&sn=d687acc586ad1cc5e40a5887f4255380&chksm=c0297f32f75ef62496cd3981116160aacb1d1532b691498740ea973dbe3dfe44d0a6e302eb6c#rd)

[【 5. 一键搭建flume集群 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484577&idx=1&sn=160dfe50896c903941e9fff75d040bd9&chksm=c0297f3ef75ef628681bc60a24f70e7aa21278c6cbd7cdd5196311c4b2294e26d006df00b778#rd)

[【 6. 一键搭建elasticsearch集群 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484571&idx=1&sn=16c1e005cbfd41531bfb0481155bf99f&chksm=c0297f04f75ef612f0e0dfac0c992506e07efa6c910ac992a8c28d4d88e31a1030a01622a50b#rd)

[【 7. 一键搭建flink集群 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484563&idx=1&sn=d919758b875e3fcf10b496b9d4faf946&chksm=c0297f0cf75ef61a66eac52758a72df06fa841022fb3ad1997aefcb0e019dc100b5a062a7bd9#rd)

[【 8. 一键搭建flink集群 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484563&idx=1&sn=d919758b875e3fcf10b496b9d4faf946&chksm=c0297f0cf75ef61a66eac52758a72df06fa841022fb3ad1997aefcb0e019dc100b5a062a7bd9#rd)

[【 9.  一键搭建hbase集群 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484556&idx=1&sn=3a8041ac1acdd6e1930f71878218c2b5&chksm=c0297f13f75ef60587a53d64db45827d94998d39a17ed4bcb646a9a9ac6f23f301f789a92cd0#rd)

[【 10.  一键搭建kafka集群 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484550&idx=1&sn=14115d7fd9e57b389bd18f43ec168915&chksm=c0297f19f75ef60fdce64f1e3ba9985eabf00825d26a8a256d39f83ee1cc3f877fa8dd0fbb5e#rd)

[【 11.  一键搭建hadoop集群 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484538&idx=1&sn=89cfa05ecfc152464530e485bfcbb871&chksm=c0297fe5f75ef6f3451d87d6e910456d58c746ff6766cd585fba1f85dc881f5c4f7a5682ad18#rd)

## [三、大数据基础环境准备]( )

[【 1. 安装虚拟机Centos7 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484120&idx=1&sn=02422623ee659ea5a8b5485e55f7b0fa&chksm=c0297947f75ef0514dea5ec0b1ae66d6909addb0f61cbae409e5d37b9880dbf0927910c6d764#rd)

[【 2. 安装MobaXterm 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484162&idx=1&sn=952292d88c4d0c73bb4521415af330d6&chksm=c029789df75ef18b3f831556080ba6b8ef219bfe54fa6f6a890b93dabde079b93c8a1882a35d#rd)

[【 3. centos7免密设置 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484176&idx=1&sn=cd0d8cdd59340ba15f00bbbed228b7b9&chksm=c029788ff75ef199dee21e7184c1c3f14965ed36403fe5518ab84df7e3ec1c5b33994e138e78#rd)

[【 4. centos7安装JDK1.8 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484190&idx=1&sn=a3a37ff5cf2f83e35825c8919336c6a9&chksm=c0297881f75ef1973e36f166d9c1b566a9e5756c70e2eaba0e2fd4ff49191b5e5ab565f00919#rd)

[【 5. centos7安装mysql 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484226&idx=1&sn=cb0738e5f53380c238fd67758145cb46&chksm=c02978ddf75ef1cb9e70c6df9b91ab6a886ca1982ecf21522c925193a094d5dc4dca34cf07ab#rd)

## [**四、hadoop**]()

[【 1. CentOS7安装hadoop集群 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484650&idx=1&sn=21016d7e2536098ab0e180dd92145665&chksm=c0297f75f75ef66359b8441d6cc2a0241828ffad4de197ff1f0911471fc79a5fc218d49c1eb6#rd)

[【 2. hadoop基于 HDFS HA 集群高可用安装 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484650&idx=1&sn=21016d7e2536098ab0e180dd92145665&chksm=c0297f75f75ef66359b8441d6cc2a0241828ffad4de197ff1f0911471fc79a5fc218d49c1eb6#rd)

[【 3. hadoop基于 YARN HA 集群高可用安装 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484774&idx=1&sn=a5789f9b1ed4976b85ada4b75191543c&chksm=c0297ef9f75ef7ef2d5c5b4d31ef9872db332cc706d96c9e93537a5b5a41c6cf9c95b191796f#rd)

[【 4. hadoop shell 命令 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484774&idx=2&sn=f8e6f39af37ef22c4b695a782d51cca1&chksm=c0297ef9f75ef7ef68cd7dac9d3838426d15d4ad9a7af195063967989d5fe36f56c33d18e3d1#rd)

[【 5. hadoop mapreduce实战 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484774&idx=3&sn=0b12044f71a0ca7382932006c431cde1&chksm=c0297ef9f75ef7effc2c04a43edae78a72bb8c600c2c65c9abb46697324282538790be35fbb0#rd)

## [**五、hive**]()

[【 1. CentOS7安装hive集群 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484250&idx=1&sn=e2aac10ac2886b07ecf8bf6f8ab009e2&chksm=c02978c5f75ef1d3a7c1258b3c2b1cee13246477787f4c33cf65145d42f5d0d9d567829cb9cb#rd)

[【 2. hive 基本概念 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484774&idx=4&sn=198f6c9b90813a38afd5e79c36a19db0&chksm=c0297ef9f75ef7ef031517ff6f995e1f76b764db656de195eac11083c5a685fc5255a83a8188#rd)

[【 3. hive 查询 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484906&idx=1&sn=28405d4c910cf0275f909d92ca91c5a6&chksm=c0297e75f75ef7633a0cc88075cbfc8e61a292aae4260d30330a50a394610ba639a3017ff347#rd)

[【 4. hive 窗口函数 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484906&idx=2&sn=6e80c0c8d073b4970ee57bdc9b148187&chksm=c0297e75f75ef7636c118b79870493db321f61d02f4a535beb8e87b7d0893807e8191932cd80#rd)

[【 5. hive 整合 hbase 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484906&idx=3&sn=b7d299e2f5b9679500bdfb9dda22247b&chksm=c0297e75f75ef763e15c003712094b6cb1fb76c7ac4f22f99a42fbcabe573baf6500d5302977#rd)

## [**六、zookeeper**]()

[【 1. CentOS7安装zookeeper集群 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484264&idx=1&sn=1aa7a75cf682b2a184641c65e061fdf3&chksm=c02978f7f75ef1e159a6ceb7656ace7d75bad1c945955fc8bb4a93c5cae4c835bc2361f4c197#rd)

[【 2. zookeeper基础 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484904&idx=1&sn=2c2036eab77a315f2cbe16a5cb0f28dc&chksm=c0297e77f75ef761bd3cdf0086f3b79ccc8755ec1bced166710720d8911c36198938f9de66aa#rd)

[【 3. zookeeper实战 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484904&idx=2&sn=af224b42a9953eac07dc6f7ae1e505d4&chksm=c0297e77f75ef76116e171b70c6feec7ac4bd907c41307cfe9c6425da6657bb372aaaa981ae4#rd)

## [**七、hbase**]()

[【 1. CentOS7安装Hbase集群 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484278&idx=1&sn=f27d19a6aeff811fe6e67d0f5acfea90&chksm=c02978e9f75ef1ffe1f5e76fd1ceaaa88239d1e93a1189ca5b9b682ab5926f4789244b2beaa0#rd)

[【 2. hbase原理 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484905&idx=1&sn=65582c0f5de30a2fa57cd7fd36f2c2b1&chksm=c0297e76f75ef7601c5385dbad7e369fffd3eaa3e65bd527fec9a1b401a82d78b0facfaf0f00#rd)

[【 3. hbase shell命令 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484905&idx=2&sn=d22845559f786ddd5af063a02708fe8d&chksm=c0297e76f75ef7605a8431ce2fb8196e8639acca71a50a17b2b21ded59560b7c3756474cad8f#rd)

[【 4. hbase 实时同步elasticsearch 案例 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484905&idx=3&sn=4c7dc3f44783fb0dfbef38221ac5ec6c&chksm=c0297e76f75ef760ee4dd2d2c16c9dbffb77cead508ee38458bb8a6c56aac9ce3372b1b149c0#rd)

## [**八、flume**]()

[【 1. CentOS7安装Flume集群 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484285&idx=1&sn=f33e5d1a597310c319d34187c6d5f7e5&chksm=c02978e2f75ef1f4913e832fd8630f4ef85ab0ee7a6f56f57a4b490ae6d9968e04a0cb2ec4cf#rd)

## [**九、kafka**](https://github.com/WuZongYun/bigdata_study/tree/main/kafka)

[【 1. kafka 安装（集群版）】](https://github.com/WuZongYun/bigdata_learning/blob/main/kafka/1_kafka%20%E5%AE%89%E8%A3%85%EF%BC%88%E9%9B%86%E7%BE%A4%E7%89%88%EF%BC%89.md)

[【 2. ★ kafka 面试之高可用 ★ 】](https://t.zsxq.com/0cfZmT8mi)

[【 3. kafka 面试30问 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484907&idx=1&sn=7de35f5877463de09308efbcf48df5a5&chksm=c0297e74f75ef762df74bd26363a67391fa5eb981ab7c29fc5a670aad4e0c2c9fb9e4b280a1c#rd)

[【 4. kafka 分区数真的越多越好吗 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484907&idx=2&sn=71fc376e7241392186d9cc76868b84c5&chksm=c0297e74f75ef7621628c14f376de7e61b2af428590cf032dc9a300ff2431fc9b7cbe9990912#rd)

[【 5. kafka 事务实现原理 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484907&idx=3&sn=025346e5ebcaab7f87a1c2c7304cda90&chksm=c0297e74f75ef7626ff2ca31e19fc3a9c91065acdd2d89ed91a9d7086a1e2006ba462814a52a#rd)

[【 6. kafka 常见故障处理 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484907&idx=5&sn=b6127c93afc94e624e2d9384b38ecefc&chksm=c0297e74f75ef762e591a9bb83f085727d80cc5cd2743f23007dd9671844d257ec862901e1a0#rd)

[【 7. kafka 真实项目最佳实践 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484907&idx=4&sn=ac3050dd4a424ac9157a631fcc44795f&chksm=c0297e74f75ef762b8f95126fddd4de06c3ab2e03274f4765faaf4ec9a09d86fa98adce7a022#rd)

[【 8. 超惊艳的Kafka可视化工具，用了以后效率翻倍！ 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485499&idx=1&sn=9482255cd1bcecf521e179b466ed6e6a&chksm=c02973a4f75efab27a52b765631a6327f46c004d953286431d69197227571a7839739b768dc2#rd)

## [**十、spark**](https://github.com/WuZongYun/bigdata_study/tree/main/shell)

## [**十一、flink**](https://github.com/WuZongYun/bigdata_study/tree/main/shell)

[【 1. ★ flink  面试 100 问 ★ 】](https://t.zsxq.com/0c70qqPLO)

[【 2. flink 消费kafka的四种起始位置 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484619&idx=1&sn=332aaf9cac741a58c190f5a280af3628&chksm=c0297f54f75ef642880d80a9e0e18110045c61faefe431d3a660d915e7f5340c0e95cfc346b8#rd)

[【 3. pyflink Table API 基本操作案例 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484496&idx=1&sn=e3028d9910109055a1a6acdc9802b79c&chksm=c0297fcff75ef6d98e46747b830a619455baa30071d2dbd2bb1df8dd27af553439add40d9553#rd)

[【 4. pyflink Table API wordcount案例 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484494&idx=1&sn=d14df58788e6b31a686f699e8314b870&chksm=c0297fd1f75ef6c74cf6fc7f3698826eeb5fd747838510e28b9b12d4a3c0f2916be3f459800a#rd)

[【 5. pyflink DataStream API wordcount案例 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484490&idx=1&sn=0515f3fe1576bcb1f40fcb3cd79ad84e&chksm=c0297fd5f75ef6c3b898f7f031c36e1a6f252c5d8c354867274042a84739b7119e392ef73db6#rd)

[【 6. pyflink 集成 hive catalog模式建设数仓 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484453&idx=1&sn=6f80b7a7510ca94af87c80dd040a9c16&chksm=c0297fbaf75ef6acbcd25c75484524c9fc65d58e5ef6abf7c3847f5fb5b2235a53244e59552a#rd)

[【 7. pyflink 集成 hive catalog模式读写数据 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484426&idx=1&sn=8ed88d9d4895d24cf80f7ee0617eed8a&chksm=c0297f95f75ef68359e5a827b1f40260cc05270e38e8db1ad3f70aec2d4e9641dcbb55cf6a44#rd)

[【 8. FlinkSql 集成 hive catalog模式进行读写数据 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484412&idx=1&sn=a4b3bbe74fcbca09a8c3bb40a524e3a9&chksm=c0297863f75ef1754f92a7371e1c043de5a70e4c399cb33a4734c4f09b0e7dd96b1f81d9a27f#rd)

[【 9. ★ Flink checkpoint 执行流程及优化方案 ★ 】](https://t.zsxq.com/0cktPlxgU)

[【 10. ★ Flink 内存优化方案 ★ 】](https://t.zsxq.com/0c2CV3ww7)

[【 11. Flink任务执行与资源划分 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485239&idx=1&sn=6878caef3d36276dfb009900c6a73feb&chksm=c0297ca8f75ef5be956785dfc1b217a3ee2b31b0105faf2cb9cf3fdb15b184629fab9b416ee7#rd)

[【 12. Flink 算子链与槽位共享 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485245&idx=1&sn=a08e611ef2f4501201baf6b2abf87e59&chksm=c0297ca2f75ef5b43899623be27204ced296be79e27815bf9dfd220043da7aaeefc6ab2854cc#rd)

[【 13. Flink 命令行工具 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485249&idx=1&sn=42079334365987b2580c497b53cace69&chksm=c0297cdef75ef5c8dd5ddc9e9f2111ff89ff97402476dda10ff3f6bda7cd0c734757a0dffbf4#rd)

[【 14. 拒绝背锅，FlinkCDC采集表操作日志 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485475&idx=1&sn=399ce1dcdbf0585af827fc23a4650304&chksm=c02973bcf75efaaa2c09c14a9d21534b36e91a7268717bcf0d572918161e7c3802aa7ec41928#rd)

[【 15. 还不会修改Flink源码？请看这篇教程→ 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487385&idx=1&sn=b46e8e069a30a3ff6f6129cec320b264&chksm=c0297406f75efd10911ae55ef90e5c629d385cd20cb22dfe90a72b2c15fe230ad301d732bc6d#rd)

[【 16. 这三种场景，建议使用Flink→ 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487385&idx=2&sn=18876b9aa025e9dc2b566c58b8a7dde8&chksm=c0297406f75efd10674962f806a21984fe72ef0eaa5020d8fa23443e812e728022b2cd5769ed#rd)

[【 16. FlinkSQL搭配Hive构建批流一体数仓完整过程 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487184&idx=1&sn=d540bf2538c6ddbe732ee53def5a2a06&chksm=c029754ff75efc59c44d4a1f4672ed4968f74f2b91c7739226e45c02897d0063e85d597878c9#rd)

[【 17. Flink实现运输公司车辆超速实时监测 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487090&idx=1&sn=0c131012d4cb469b6aa0dd4f8514d628&chksm=c02975edf75efcfb22535718521d3454a70ffe2ed7c87592026cc32ceea17968bb69de3af967#rd)

[【 18. 源码剖析 | Flink源码修改编译保姆级教程 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487382&idx=1&sn=e73d58103decd9be73d5078b4b14c583&chksm=c0297409f75efd1f6e92610ea5537de6d6cebda0105d1fc6c7e831f6025a2b496a1ee6805134#rd)

[【 19. 这三种场景，建议使用Flink 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487385&idx=2&sn=18876b9aa025e9dc2b566c58b8a7dde8&chksm=c0297406f75efd10674962f806a21984fe72ef0eaa5020d8fa23443e812e728022b2cd5769ed#rd)

[【 20. 还不会修改Flink源码？请看这篇教程 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487385&idx=1&sn=b46e8e069a30a3ff6f6129cec320b264&chksm=c0297406f75efd10911ae55ef90e5c629d385cd20cb22dfe90a72b2c15fe230ad301d732bc6d#rd)

[【 21. 万字长文 | 透过现象看本质 | 从WordCount 到Flink Streaming API 源码详细解读 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487400&idx=1&sn=c0513f759d656fa69a4a5baeff884d98&chksm=c0297437f75efd219f9afa3939327ee700fa9927a81b2ff786ea0f3019012688f3d7c7a5214a#rd)

[【 22. Flink Table Api 完整源码解析 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487414&idx=1&sn=e7ed18f8e35d1f05c27ccde0d40d6ec6&chksm=c0297429f75efd3fe2979c2bcf071b28f9e12ebeb599bb7d2c2959f080ddecd74ccadfc93737#rd)

[【 23. Flink《任务执行流程十步走》详细总结  】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487489&idx=1&sn=1d449d787565bb47f5e5594d095c84dd&chksm=c0296b9ef75ee2883c7f912738ed7203b7f6db740edab6a9bdc3265a084e89b8cbdb4414bcaa#rd)

[【 24. 翻遍Flink源码，发现Client任务提交之后运行步骤竟然还有45步之多...  】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487497&idx=1&sn=2ad01d2910b772b288019063a7d03046&chksm=c0296b96f75ee28094234169f4ab6e6a99d638fe8e0c3c85f4e42ae98d4fd4c80fb5316c501f#rd)

[【 25. 5000字彻底讲清什么是Flink状态与容错  】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487515&idx=1&sn=20318df56da1d3c15ef9333117f9b9d1&chksm=c0296b84f75ee292a02dd8ceadb5b5b01a9ec91b9fc5be2f08c8bb92a8c0c6d75b4bea924763#rd)

[【 26. 一张图彻底说清楚 Flink checkpoint 过程中 Coordinator 到底做了哪些事  】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487557&idx=1&sn=bd27521c2329a07ab73ce98d6a26d558&chksm=c0296bdaf75ee2cc84a28c26c225d656a7d8d31797f1677b950f304e0d33c605676553f78546#rd)

[【 27. Flink源码分析 | barrier(屏障) 如何传输  】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487567&idx=1&sn=495833126fb094cdab69a3ea6c32f4f1&chksm=c0296bd0f75ee2c6aa80d47d06779db6661c3f0639b8694ae60eeaee0501b1df3c00fcba7501#rd)

[【 28. Flink源码解析|状态的更新和存储流程详解  】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487576&idx=1&sn=e95afecc54623a2e9220f7e72d3b7afd&chksm=c0296bc7f75ee2d1a3229952afa626cdafd9792e976c4a88d512aa3323242f3a822243cb1b99#rd)

[【 29. Flink源码解析 | 元信息的存储  】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487585&idx=1&sn=0dc6c2e00e9c25c709049e17db60c944&chksm=c0296bfef75ee2e8c77c1ba484de6f19e47b59968f1cf55f87e98de052b4418a20f85d9e0717#rd)

[【 30. Flink源码解析 | 状态恢复如何进行元数据读取  】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487606&idx=1&sn=778f18b029085ddd3295800dc287b90e&chksm=c0296be9f75ee2ff358510d470573a0814a9968064e613033092febdc0864607985e01bba7f3#rd)

[【 31. Flink源码解析 | 状态的重分配  】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487646&idx=1&sn=9d9bc37b13b4d89877527f8826ed53a7&chksm=c0296b01f75ee217b99bd5d2139c1d777a4f8a31be30b37701728bf2b1276bdda784ef604da5#rd)

[【 32. Flink源码解析 | 状态数据的恢复  】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487647&idx=1&sn=0746f2a6b2ac2610c1f8a5208cf43886&chksm=c0296b00f75ee2161b1704573c19a0e85a3ddfced57b39a6ea60752431c8825c29875dbf8274#rd)

[【 33. Flink状态的重分配策略详解  】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487660&idx=1&sn=0aa4f419016313ba0680568ec1dcd519&chksm=c0296b33f75ee225edb8318409c5a0e2cd5e5b0e7b462e9625b41372f46b8e77da074dc0af6c#rd)

[【 34. Flink窗口基本概念和设计思想  】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487661&idx=1&sn=6bb66502840c8b15a6147d0771ebf9f0&chksm=c0296b32f75ee2241cac79237d2740e5bc18f8ab8c937d3a7bcb9047d37142615d8b62fc2556#rd)

[【 35. Flink调优 | 动态调整并行度  】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487686&idx=1&sn=4deaf652e1e385592804a02946d542e1&chksm=c0296b59f75ee24f33e5629c8e4394d91bd28101312ddbb8839df1e3545fd03dc8cd5c792480#rd)

[【 36. Flink调优 | 自适应查询执行  】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487688&idx=1&sn=f6d218f32743da08db7bd6310fbf5706&chksm=c0296b57f75ee241a6f6ef5a8d5482ee3aa38a094fce2523e007da73ea6a756e585be6f07c69#rd)

[【 37. Flink 反压机制详解  】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487710&idx=1&sn=424915f406fb40edf0a496545eea3a9e&chksm=c0296b41f75ee257ed5a629c2a57e337e681121daca2f63534579f0a17540d56a4c63297a76d#rd)

[【 38. FlinkSQL 用户自定义connector 扩展实战  】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487951&idx=1&sn=b9d386b86572946b54c0593083a13e9f&chksm=c0296a50f75ee346e9875f172c0fadc9b5e6dd7e372a6ce5bbe3499b30e4021bd753a73fcbb4#rd)

[【 39. Flink State Processor Api 读写 Flink State 实战  】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487968&idx=1&sn=d1b42bb30de289df4b5a5a4c6a42b272&chksm=c0296a7ff75ee369b8a67433d0ac0510ba4d1c165766bb1228f239c58952e647bed40d18095e#rd)

## [**十二、dolphinscheduler**]()

[【 1. dolphinscheduler 定时任务编写详细教程 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485001&idx=1&sn=783e8f9ee3dbcdd7b0dc7342f872ea7f&chksm=c0297dd6f75ef4c044efc506a854dfb57cd5a2ebb7a42e3de56e6b02a3ba6dea54080f542e27#rd)

[【 2. dolphinscheduler 定时任务编写详细教程 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485006&idx=1&sn=8909a71cd42e20b294f3e93b751954d5&chksm=c0297dd1f75ef4c740604bd39789e8acb302a8b30d1c2d2175faf885da1052c1d1b22b92d51c#rd)

[【 3. dolphinscheduler 文件/任务组/UDF管理 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485028&idx=1&sn=2623fd65cb1a20ec58d00878d49af83f&chksm=c0297dfbf75ef4ed31d9cfa17ab148033df85bfe6867a53a3d1fa6fa55c3d651a471a09a285e#rd)

[【 4. dolphinscheduler 配置DataX,Flink,Hive教程 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485044&idx=1&sn=ff96100ba75a0ae88613d596c6129213&chksm=c0297debf75ef4fdaaef3a2d055f84f5dbd890ace083abe29511050a9269351d1773c7470882#rd)

[【 5. dolphinscheduler 配置spark、SQL、Sqoop教程 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485061&idx=1&sn=e0ce54c652397cae8197c33b42e585d5&chksm=c0297d1af75ef40cc8783d03f50a30e4a13c003bc39bf01d02f8e044d4f87209f076a10b5e3b#rd)

## [**十三、elasticsearch**]()

[【 1. ES增删改查代码实战 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485327&idx=1&sn=b80ddd7700d246d9afb9dac3621cbe2c&chksm=c0297c10f75ef50619606682579a6ad0b8fd00ce2a5f3b5bfcf5205057c3183795b1fb3ab67d#rd)

## [**十四、sqoop**]()

## [**十五、clickhouse**]()

[【 1. clickhouse 简介、安装及实操 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484919&idx=1&sn=802530a927ff531a3601efdf8e8eaa23&chksm=c0297e68f75ef77e4c38f49ea37a2e0f4108f9ec5a583564d298d08247778dd207713706f4ba#rd)

[【 2. clickhouse 基本操作 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484919&idx=2&sn=42a6ce2bad6c7c452373bd8c5d0bd33e&chksm=c0297e68f75ef77e857c1224c3af7f20691521a4d6037106bcb589b00fa8f84d3dc594f0da3a#rd)

[【 3. clickhouse 物化视图 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484919&idx=3&sn=957584e856c18b5a082761d3073bfdb7&chksm=c0297e68f75ef77ef36b7b5550e26ec82068ec7c3155d35369cff314db3ef7d42efc32451312#rd)

[【 4. clickhouse字典操作 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484927&idx=1&sn=c521faf545877034c29bccb80afebaa2&chksm=c0297e60f75ef776cf520ed62abf996d1e048c943dbbe2ff76b51ca7ebcfd39375021aa21bcf#rd)

[【 5. clickhouse 测试数据集及SQL练习 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484927&idx=2&sn=f2a17e32233ca66595e01262eb020534&chksm=c0297e60f75ef7766ca06462a8994b36a0a228afa3b17fe4b8f8a1e058b0c7c97056ad3fdbbf#rd)

[【 6. clickhouse集成mysql 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247484927&idx=3&sn=d98a884e9986f2f05d2ca2f9ba220aec&chksm=c0297e60f75ef776764e2dff227e3fe7f4c21cc1c4fbd60e8ab8b4bf1da2e0bf0c6878e4e131#rd)

## [**十六、flinkcCDC**]()

[【 1. OceanBase CDC 导入 Elasticsearch 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485065&idx=1&sn=e4d223192eaa3f060b276130f5635d7d&chksm=c0297d16f75ef4000eec78ae594eaf356f612fb88c26a78738aaf418f58f3e1135f7ba6579ed#rd)

[【 2. MongoDB CDC 导入 Elasticsearch 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485069&idx=1&sn=cc4cf339a9a2e97956f20ddcec5ed2d4&chksm=c0297d12f75ef40442e0699a5eef97bcd1cfe02d65f54e179b2f5b7d45215a0145d69633272f#rd)

[【 3. Oracle CDC 导入 Elasticsearch 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485073&idx=1&sn=0a01d64ac549ed1487bdf490e054f375&chksm=c0297d0ef75ef418ef6eb6f79a1221fc6e7c0383a00df5b32415ef50d913bf3b188836e64b82#rd)

[【 4. PolarDB-X CDC 导入 Elasticsearch 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485116&idx=1&sn=0123b4e7a12ef9ebe5792c65ed7f370a&chksm=c0297d23f75ef435869ab5237d23ec1c50b8f6601ce6859d28db0e0beacf4d7f9a9efa09ffd5#rd)

[【 5. SqlServer CDC 导入 Elasticsearch 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485193&idx=1&sn=d01d2088ead1e3800923fa90a71788f1&chksm=c0297c96f75ef5808951bc6a7fc70fd578b1c16f48fa689c2a6b75f6251b0d37d19ef2b610cb#rd)

[【 6. TiDB CDC 导入 Elasticsearch 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485194&idx=1&sn=fdb5b164148ab6c63fcd50b0295f94f2&chksm=c0297c95f75ef583e6a2478ae4e178b9661aeb5d3a7bab0719ee161296c01c356abba200715b#rd)

[【 7. 涨知识！Flink旁侧流同步Mysql多表到Doris 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485538&idx=1&sn=900ff75b1e45e0dea093bd6262e03d66&chksm=c02973fdf75efaeb01da3a745f489b7a70e7cd03fb04aeebe664e347ef0854b157b2dc0e41aa#rd)

## [**十七、canal**](https://github.com/WuZongYun/bigdata_study/tree/main/shell)

## [**十八、debezium**](https://github.com/WuZongYun/bigdata_study/tree/main/shell)

## [**十九、datax**]()

[【 1. DataX Ftp远程文件读写操作 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485197&idx=1&sn=e29a9f70561e0ec435a7d228e0af2ded&chksm=c0297c92f75ef584363e435f3ae3fcea8f4fe2a7344bee219d596655414ef39a1b030f507686#rd)

[【 2. DataX Oracle 读写教程 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485198&idx=1&sn=76832674a668c9aadb4866c09fcaf230&chksm=c0297c91f75ef5870fbfcf22cc8a6e02607ef1a910c0fe9ccb3f19b0d088a60a8c67dbf177e8#rd)

[【 3. DataX MySQL读写教程 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485199&idx=1&sn=076afb8961e5fb8e1454a98371995218&chksm=c0297c90f75ef586dc3a94381adee52149cfd377daa0d09ded5de5c58dac09839962bb11188c#rd)

## [**二十、hudi**]()

## [**二十一、starrocks**]()

## [**二十二、iceberg**]()

[【 1. 基于Flink＋Iceberg构建准实时数仓 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487236&idx=1&sn=a753285285035bf38140652a17402f28&chksm=c029749bf75efd8ddd33fe4a6e3db4eea26187c7b2b4d8402c7c38231b8c3e3521d0c47ac81b#rd)

## [**二十三、doris**]()

[【 1. Doris安装与部署 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485204&idx=1&sn=5432bedc11f010e0dc94fd3de136a918&chksm=c0297c8bf75ef59dae780f654266918f722e6e345f2faa7665d9dd3978a1744b810420d93575#rd)

[【 2. doris如何导入本地数据？ 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485211&idx=1&sn=d0a319535d358af1ca2856acba8b0d0b&chksm=c0297c84f75ef5920a1349d2014759cae97ef88c936bb0292941e379ed982680aba382a98fce#rd)

[【 3. doris数据表的创建与数据导入 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485225&idx=1&sn=e6defe7ee4e1c84a5a3f0e9b6d6ec7aa&chksm=c0297cb6f75ef5a0d68b04e7d9400f4c3c607e28c4c86bebf54e082ff32069a12c61f60f69be#rd)

[【 4. doris 导入的数据转换、列映射及过滤 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485230&idx=1&sn=4089dce0b1288d9103b79c187ac2a661&chksm=c0297cb1f75ef5a785562b5d8b8bd764f71d8674c84ff807430d4c14822bb8b02c7b6b7b0495#rd)

[【 5. 再见Hive，新一代数仓Doris横空出世，真香！ 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485531&idx=1&sn=6219cfbdb2c2fc752d0522d1980d9e08&chksm=c02973c4f75efad22562f85d232ec0f6764a0422755444a416860da510177e889ff1cd961a88#rd)

[【 6. Doris真贴心，连测试数据都提供了，整整100G！建议收藏。 】](https://mp.weixin.qq.com/s/Qwr-b2uvJGOoA4gWpZ8KzQ)

[【 7. 这款Doris运维组件，同事用了都说香... 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487079&idx=1&sn=72208f47dce711cf9f2bcf37edd07fad&chksm=c02975f8f75efceec98f5e162b2d779de66f4807e2f9904124d819ba3c4deda91c5340c25825#rd)

[【 8. 基于Doris的OLAP查询和实时数据仓库实战 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487027&idx=1&sn=f6d6ab4596af15b252d4a0b3043b8386&chksm=c02975acf75efcba1b0d46dbfb57434345c14ff47fce79adc3b371abf85105d1928e4ea2f3b4#rd)

[【 9. Doris 集群扩缩容实战 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247486876&idx=1&sn=2622676651170245bb07a0d717d33d5f&chksm=c0297603f75eff15e0762cae61fa6403a0ef6768931749ecb395bbff0c0a79cfa17c72fd308e#rdd)

[【 10. Flink Doris Connector使用详解 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247486874&idx=1&sn=b1235b6356356129f7cb1d9cd98f6384&chksm=c0297605f75eff13fee1d1f180bce0385a640e0c711a312d483b279599877993ac813c737824#rd)

[【 11. 腾讯一面：Doris有哪几种方式连接外部表 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247486874&idx=1&sn=b1235b6356356129f7cb1d9cd98f6384&chksm=c0297605f75eff13fee1d1f180bce0385a640e0c711a312d483b279599877993ac813c737824#rd)

[【 12. Doris查询太慢？看一下这些优化方法... 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247486793&idx=1&sn=605a940c82f3b9e3bbd1eb71b64e4294&chksm=c02976d6f75effc05c97b49c20577f24c8e817b8f683273d00ecfc757d72ae1d7fb3a3be452a#rd)

[【 13. 网易一面：七种Doris数据导入方式你知道几种？ 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247486571&idx=1&sn=6e75b97c39787e0cbc955bd6ea54ecc6&chksm=c02977f4f75efee24aeed4c4dc9cc23b8ace63b2219043bdd259970955f453866cd83bf44c05#rd)

[【 14. 超级详细Doris安装部署教程 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247486249&idx=1&sn=3f2150a7a10b9f6902fe911821f8ea9f&chksm=c02970b6f75ef9a0ec3127eff29e3bdbfe12125ab237406d59f734dcd7d2ee615af46ec04976#rd)

[【 15. 万字长文 | 详解Doris数据对象 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247486395&idx=1&sn=07bf375077c83ee2ca4dc47768955d0d&chksm=c0297024f75ef932459cf87dd3357cd264dc88952f6c5e0e0d0e910a4bb82a729a2f423ba43d#rd)

## [**二十四、cdh centos**]()

[【 1. cdh6 搭建大数据集群（centos版本） 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485195&idx=1&sn=73df141ffc8937f33dd5f9c897500721&chksm=c0297c94f75ef5820cf7a1b21a67ad12f250036a8b798c71acc5c8dddc1a2907ddddc8d44130#rd)

## [**二十五、cdh ubuntu**]()

[【 1. CDH6搭建大数据平台（Ubuntu版） 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485196&idx=1&sn=158c936862e2f00bbebcc1809169bd89&chksm=c0297c93f75ef585f7fa72bb6fa5d3c80669f1c4bb63c63f444e8cbd5405825fe59e65cdfa77#rd)

## [**二十六、superset**]()

[【 1. Superset整合Doris进行报表开发实战 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247488355&idx=1&sn=5c1d1f30bb47f6b14f105fb0c57dddf9&chksm=c02968fcf75ee1ea7955cbc2fe69561041233e67ac179aac2bb8ae8ac36ec346dafb9e55e242#rd)

## [**二十七、docker**]()

## [**二十八、kubernetes**]()

## [**二十九、streampark**]()

## [**三十、maxwell**]()

## [**三十一、Github**]()

[【 1. 想参与开源，不懂怎么PR(Pull Request)，看这篇就够了 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485259&idx=1&sn=a751893997cc0f2e834ab1ebe505f969&chksm=c0297cd4f75ef5c2cd0d2f93481e2c99258b136a318c0b892103bc3006759a5d98c638670a25#rd)

[【 2. 超级详细的github操作教程（万字长文） 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485263&idx=1&sn=c8eaa443c98d8487af4d92757a8bf34c&chksm=c0297cd0f75ef5c624f3d7028cfb9ac55f31413b2f9011f0ac5ccddcd5c80984e0ade04a0cdc#rd)

## [**三十二、NIFI**]()

[【 1. NiFI实时同步MySQL数据到Kafka保姆级教程！ 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485583&idx=1&sn=863e60c86beedf9edfe658e1745bab59&chksm=c0297310f75efa066615660d20d27df921d7ade669bc6657847d7922b59550b0ebc74da0d34a#rd)

## [**三十三、SEATUNNEL**]()

[【 1. 完美替代DataX，Seatunnel初体验. 】](https://mp.weixin.qq.com/s/-TfAFLEpY_EqbMGRmZIqLw)

[【 2. 手搓一个全新 Seatunnel Connector 】](https://mp.weixin.qq.com/s/UHtDx5MynKhUb_2N_jOyTg)

[【 3. 共建开源】手把手教你贡献一个Seatunnel PR，超级详细教程！ 】](https://mp.weixin.qq.com/s/CBDnzNBartBd0RDamTBi0A)

[【 4. seatunnel配置写入Kafka任务，附300个案例demo 】](https://mp.weixin.qq.com/s/F8QSQzsFH3HlMuBeZKVyXA)

[【 5. dolphinscheduler+flink+seatunnel集成详细教程 】](https://mp.weixin.qq.com/s/CldBP03Pr35S3tq2mQoocA)

[【 6. Seatunnel 热门问题解答 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247488063&idx=2&sn=712687474fb002d1252346e81a8c6f8d&chksm=c02969a0f75ee0b62beb7f3d9e9c245deb844b99fb7133461182a3116527f4d5e1e8ae365f50#rd)

[【 7. SeaTunnel配置秘籍 | 400页文档详尽指南 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247488486&idx=1&sn=a163d9713691b8943f9a737fe4d981d1&chksm=c0296879f75ee16f26cc4e96c45eaa912236cb4f8e8a41844fea7eab52ec71f00fa404aa71a1#rd)

[【 8. SeaTunnel配置大全 | 50页详解Transform 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247488493&idx=1&sn=e791942b3ffe0c5616f15b95185f9990&chksm=c0296872f75ee164a96df5528f4746a4a63edd9b947afb4107b985484f65eea48a44d4d3f51c#rd)

## [**三十四、Dinky**]()

[【 1. Dinky0.7安装详细教程... 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487304&idx=1&sn=57b2e098e026921d3787bfb4c686ff30&chksm=c02974d7f75efdc132020f85756e2d460f2f5a658356c10c28cf0044ebb6d0a8bfa555e1ae6e#rd)

## [**三十五、Paimon**]()

[【 1. Paimon 初体验... 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487286&idx=1&sn=12b574ea26a9b1e41caa4263bc83820d&chksm=c02974a9f75efdbfaa79053ef55031f268aaf9c52d2b6b3b7a857c043ed5003c3478efdd26ab#rd)

## [**三十六、Datasophon**]()

[【 1. 国产大数据平台Datasophon安装详细教程！ 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485938&idx=1&sn=b89d1bb0ffdfc19fb607f41a8f71aeda&chksm=c029726df75efb7b34a1ceab2f92888509cf97f8dee1ff4088619cd721e1a27a36bee3564c13#rd)

## [**大数据面试系列**]()

[【 1. 百度一面：什么是Flink状态？ 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485276&idx=1&sn=1289f87f16face3682c8fd1184375524&chksm=c0297cc3f75ef5d56e350b930a9b5e48de1d291e62e43600b47981e3da93cd0325443a3c03fc#rd)

[【 2. 面试数据治理工程师，让介绍一下什么是数据治理 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485284&idx=1&sn=6c88ae8e2125557530288cb2c4177e9b&chksm=c0297cfbf75ef5ed2c38c5f0653900a09b8c5d90d04c9f1d905191489414af0cd8e61f9d7ad6#rd)

[【 3. Flink面试高频题：Flink两阶段提交 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485327&idx=1&sn=b80ddd7700d246d9afb9dac3621cbe2c&chksm=c0297c10f75ef50619606682579a6ad0b8fd00ce2a5f3b5bfcf5205057c3183795b1fb3ab67d#rd)

## [**三十七、Trino**]()

[【 1. 联邦查询神器Trino初体验 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487740&idx=1&sn=3186efe76781f391dee93362159562aa&chksm=c0296b63f75ee275ed853602d374263256f7c42d874b0ceb6060fd87f3365c038a9d4ab4ee47#rd)

[【 2. Trino联邦查询Mysql,Sqlserver,Kafka实战 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487930&idx=1&sn=c7ab4c44379f657bab24c93d69c5a81b&chksm=c0296a25f75ee3333cbb451b42f24af02e778933d39e7bd790bff64bc91a97ecdddd8c1d8900#rd)

## [**大数据技能总结**]()

[【 1. 一文讲透企业级大数据开发流程 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485317&idx=1&sn=62af367f0df66b34ab2884893e244760&chksm=c0297c1af75ef50c42530095e7d88b50607387cff7c0baf5758b9552abe3087ab6bf4b35b2de#rd)

[【 2. 智能风控系统架构 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485339&idx=1&sn=040f0697dd4a8b479ba2f465f527f092&chksm=c0297c04f75ef512de1049ec3238a1648dcff1d3169755a77dc4b9d77a9ced1887376bdc2974#rd)

[【 3. 7张图看懂用户画像 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485350&idx=1&sn=7f2b2287031521c34c80cbd23ec95dd1&chksm=c0297c39f75ef52f4563a2a3f4ee1ef638571f74ac48b61b5763fbf1b8555c316435ff088c14#rd)

[【 4. 推荐系统知多少 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485374&idx=1&sn=ff0ce941f54e700751be9f3ce41e19d3&chksm=c0297c21f75ef5371fe8856d66dd843e8060742dcd1b7fc1f6bd677b61731779901a6303869e#rd)

[【 5. 知识图谱经典总结 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485390&idx=1&sn=7c13392d45fbb8d44ededfe8f61605fe&chksm=c0297c51f75ef547de7dce999a7e0292aac52cbe74fc48d512898e76d67b29a6d038e2b13ab7#rd)

[【 6. 什么是数据中台？ 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485403&idx=1&sn=9e684bff0726b8e939050adf8b8bc53a&chksm=c0297c44f75ef5523d4b8aadbd422c5d775b1e5c5df3ed0d4199ef0bf2e4c32d5bc8b1d05cb8#rd)

[【 7. 云原生大数据如何实现？ 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485419&idx=1&sn=60f41e04f6ff3cdf15e90e851945ee97&chksm=c0297c74f75ef5620e2b297bf9da5659249b729f058e8725c1c11e56d564001e51d1e9373896#rd)

[【 8. 数据治理超强总结 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485437&idx=1&sn=4a6fb495b4a52bf16a780053d2c5fc29&chksm=c0297c62f75ef574dd2ea98d27068aaff478d7164b34fac711d9a8c2c0219447a6dd6974758a#rd)

[【 9. 数据仓库和数据湖 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485455&idx=1&sn=1ba1c0de011698642b1f851a6f93d20b&chksm=c0297390f75efa861caeee2f38f141e6a174d344b4bc475d2c22d57bb1a45b38e80b4be9e58d#rd)

[【 10. 数据集成方案总结 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485470&idx=1&sn=dbff8ee3c64d6baf043e1d8bdd8ac854&chksm=c0297381f75efa97c8721150025b754d6b79f9b3b704d6ac91a7e16a63292d782858ec09c0d6#rd)

[【 11. 数据仓库的起源，流行及未来 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247485470&idx=1&sn=dbff8ee3c64d6baf043e1d8bdd8ac854&chksm=c0297381f75efa97c8721150025b754d6b79f9b3b704d6ac91a7e16a63292d782858ec09c0d6#rd)

## [**实时离线数仓V1**]()

[【 1. 大数据版《上春山》 | 《实时/离线数仓实战》系列视频文章抢鲜发布 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487999&idx=1&sn=274e37100388f1235c11b9ffebd94430&chksm=c0296a60f75ee3763ed6d54246a9ffd8e13b303397510b260dbd48d4b056eeb23720d9252eef#rd)

[【 2. 建议收藏 | 《实时/离线数仓实战》配套组件安装文档 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247488026&idx=1&sn=371ce807d8a42b3c50a9c390070250e7&chksm=c0296985f75ee0931cbd1724862abff1b6ef661082dd1cecf4b30d57c8b221b1ca2f7c2b510b#rd)

[【 3. 视频 | 实时离线数仓实战NO.1 概览篇 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247488063&idx=1&sn=10ecc03fccfc90649e308aa8c357dcaf&chksm=c02969a0f75ee0b67769fba698b2a00746eb25ffcf19f1f56e324dea33a315703754f0736b2c#rd)

[【 4. 视频 | 实时离线数仓实战No.2 业务库设计及模拟数据一键生成 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247488112&idx=1&sn=61d41367a5f1ae2a21e4fb38627b82eb&chksm=c02969eff75ee0f9eed5d20c5b1f35613e67d9b180acd2722537e6bd7d5e0e2ca7843231f3b4#rd)

[【 5. 视频 | 实时离线数仓实战No.3 Flink消费Kafka实时写入 Paimon ods 层 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247488141&idx=1&sn=1e7e3c705d517a4e5b29c86fbd8b2043&chksm=c0296912f75ee00464fee21fa202447cbf4da6bb8c140a48878126d0a8fd414b0549531fc4ab#rd)

[【 6. 视频 | 实时离线数仓实战No.4 Dolphinscheduler搭配Seatunnel定时同步MySQL数据到Doris 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247488177&idx=1&sn=bac06c1fd0f5400f36dff41a1bf3c3c5&chksm=c029692ef75ee038e9dbbe47c5743d03ca7fa87871760fa02b2c0c4d9e8e3b92f931a99d4652#rd)

[【 7. 视频 | 实时离线数仓实战No.5 基于Dinky开发FlinkSQL清洗Paimon ODS层数据到DWD层 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247488198&idx=1&sn=b731e8ba24fd1a771af10dc928457172&chksm=c0296959f75ee04fe38081af57353efedf0eea35bc384bf260db1a18a7abea38d414116436ad#rd)

[【 8. 视频 | 实时离线数仓实战No.6 DS调度DorisSQL清洗ODS层数据到DWD层 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247488219&idx=1&sn=d46f68ac955f2bd49bb983a158d3961c&chksm=c0296944f75ee0529d1d063a7a55f128d78189cea207810e8797157170c8c385ffc4d2ed9629#rd)

[【 9. 视频 | 实时离线数仓实战No.7 基于Dinky开发Flink代码聚合Paimon DWD数据到DWS层 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247488237&idx=1&sn=5d1a9111ee7ffd876d042309e61c1bbc&chksm=c0296972f75ee064bc064f532f8dc5a971ab8080db1e09f9407fff1072f487e257bc82ab8881#rd)

[【 10. 实时离线数仓实战No.8 基于Dolphinscheduler调度DorisSQL聚合DWD数据到DWS层 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247488252&idx=1&sn=3f9aad63cf8f82849ba3c176ee65db85&chksm=c0296963f75ee07593c3ccf0a582eec28bb94ce9c5bbf7df65fc0c7b9aec2274087a8495fe6a#rd)

[【 11. 视频 | 实时离线数仓实战No.9 基于Dinky开发Flink代码关联DWS数据到ADS层 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247488291&idx=1&sn=0764ec2eaf2795f2f6df5012dadd9a63&chksm=c02968bcf75ee1aa671889f2a3ca263a354336eb1515da66e1aab65fddbf85d339ba04ec0162#rd)

[【 12. 实时离线数仓实战No.10 DolphinScheduler调度DorisSQL 关联DWS层到ADS层 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247488330&idx=1&sn=e6877da82eadeedefede7e1b1b148814&chksm=c02968d5f75ee1c38aa3088f235c7214d32115b464ae37a824c25d24c3d3d49cc9e667cdd098#rd)

[【 13. 视频 | 实时离线数仓实战No.10 dolphinscheduler任务编排 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247488410&idx=1&sn=e7f6b20cb4869b4ab414e9cd05a5fe51&chksm=c0296805f75ee1134495ac87af61d67ea63bdf2ad75219bd62c82880709b6ae73b89825ce023#rd)

[【 14. 《实时离线数仓实战》第一阶段总结及第二阶段展望 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247488426&idx=1&sn=6fe3666f5157c651c08a0c8862c1efad&chksm=c0296835f75ee123aea07d323cadaafdd8699a6e3c2263462d80e73d6efe3312ea454c4b9441#rd)

## [**实时离线数仓V2**]()

[【 1. 实时离线数仓实战V2 | 发布预告 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247488611&idx=1&sn=c5474d6765bb325ac096a5b808f528d5&chksm=c0296ffcf75ee6ea73c755520b63d04f4824813f6bea3e012d23a2d6ade03a19d1b8dfb59ec0#rd)

## [**AI应用开发**]()

[【 1. AI榜单开源啦！欢迎各位圈友体验 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247488315&idx=1&sn=0aef49281823f504b8b57a96b543244a&chksm=c02968a4f75ee1b249aae67a55e0e880c0be20013d6c08066b0f9b1504133cd87b802ea119df#rd)

[【 2. AI榜单使用手册 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247488315&idx=2&sn=dadc6c685fb1c55d8f18e431fb72dc94&chksm=c02968a4f75ee1b24969bc19c09cace788da1bf27538a02ee02ab1bbd6167902a19be300ee37#rd)

## [**其他**]()

[【 1. 超级惊艳的一款免费在线画图工具，完美适配程序员! 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487344&idx=1&sn=b0ea667c3e5ae137b8cf3f8479f57183&chksm=c02974eff75efdf9279353668616340ddfaa706f2ffeb480a3e27b5eb3f1f2eefa3d79239de3#rd)

[【 2. Snowflake算法个人魔改版... 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487329&idx=1&sn=5fff0248a2259542fd7f426ecc07c919&chksm=c02974fef75efde8f6f4cb08a7f7c308f4a277fbef8ad06f4eca22b41916ce827f8ee9f5f716#rd)

[【 3. FTP服务搭建教程（虚拟用户访问FTP服务） 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487323&idx=1&sn=5cb0e99dd89334460983b4fa9193c3f0&chksm=c02974c4f75efdd2fe43578387c6c698ff1365cfd37ae4c216f22ea03bc08feba7677435b80f#rd)

[【 4. 大数据精彩应用 | 催债也能有超高用户体验 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487323&idx=1&sn=5cb0e99dd89334460983b4fa9193c3f0&chksm=c02974c4f75efdd2fe43578387c6c698ff1365cfd37ae4c216f22ea03bc08feba7677435b80f#rd)

[【 5. 国内AI大模型已近200个，我心中的排名前十的是哪些？ 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247487235&idx=1&sn=01f6da2224f4e17dcdd9d625b75d61db&chksm=c029749cf75efd8a899ca8115767fb3b983cfae2e82ba0e471be54a16c8998de8843f702e942#rd)

[【 6. 自从用了这款开源大数据平台监控系统 HertzBeat ，睡觉超级香 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247488439&idx=1&sn=d77476bb2bcf81d2f32e59e40651730a&chksm=c0296828f75ee13e4f40f9fdddd17afb87dc2d701704032c762a97d1bf7b5d91bbe873dd376f#rd)

[【 7. 数据可视化新篇章：Superset之后，Datart如何重塑行业格局？ 】](https://mp.weixin.qq.com/s?__biz=Mzg5Mzg3MzkwNA==&mid=2247488465&idx=1&sn=c615f072c0c6c78fd44a2e227c23f7ab&chksm=c029684ef75ee1588005ffbd2202cfe264dbcb29a0aba717955c59c0c62d27dc1350c149f8cc#rd)

关注微信公众号《大数据技能圈》

![公众号](imges/gongzhonghao.jpg)

添加作者微信

![作者微信](imges/weixin.jpg)

zky894064933/bigdata_learning

简介

发行版

贡献者

近期动态

zky894064933/bigdata_learning .gitee-modal { width: 500px !important; }

简介

发行版

贡献者

近期动态

搜索帮助

zky894064933/bigdata_learning