Skip to content

Latest commit

 

History

History
49 lines (35 loc) · 886 Bytes

File metadata and controls

49 lines (35 loc) · 886 Bytes

使用flink-session模式首先进行如下配置

配置yarn-hadoop高可用:

cd conf/zoo.cfg

添加
# ZooKeeper quorum peers
server.0=hadoop102:2888:3888

cd conf/flink-conf.yaml

添加
yarn.application-attempts: 3
high-availability: zookeeper
high-availability.storageDir: hdfs://hadoop102:8020/flink/yarn/ha
high-availability.zookeeper.quorum: hadoop102:2181,hadoop103:2181,hadoop104:2181
high-availability.zookeeper.path.root: /flink-yarn

xsync分发脚本

xsync flink-conf.yaml 

启动zookeeper

cd flink-1.13.2/bin
./start-zookeeper-quorum.sh
关闭yarn虚拟内存检测(yarn-session不报错):
在hadoop01、hadoop02、hadoop03中的yarn-site.xml中配置如下:
<!--关闭nm的虚拟内存检测-->
<property>
         <name>yarn.nodemanager.vmem-check-enabled</name>
        <value>false</value>
</property>