数据建设实践之大数据平台(一)准备环境
大数据组件版本信息
- zookeeper-3.5.7
- hadoop-3.3.5
- mysql-5.7.28
- apache-hive-3.1.3
- spark-3.3.1
- datax
- apache-dolphinscheduler-3.1.9
大数据技术架构
大数据组件部署规划
| node101 | node102 | node103 | node104 | node105 |
| datax | datax | datax | ||
| ZK | ZK | ZK | ||
| RM | RM | |||
| NM |
| node101 | node102 | node103 | node104 | node105 |
| datax | datax | datax | ||
| ZK | ZK | ZK | ||
| RM | RM | |||
| NM |