当前位置: 首页 > news >正文

Flink UI部署jar包报错

错误描述:

通过Flink的UI中的Submit New Job菜单添加jar包的时候提示报错。报错信息的关键字是“The LocalStreamEnvironment cannot be used when submitting a program through a client, or running in a TestEnvironment context”,最关键的是“LocalStreamEnvironment”。

我的Flink服务是单机版启动。

问题原因就是以下这两行代码的区别,报错是因为我用的是“createLocalEnvironment()”

ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();
// ExecutionEnvironment env = ExecutionEnvironment.createLocalEnvironment();// getExecutionEnvironment()方法可以根据flink运用程序如何提交判断出是那种模式提交,Local本地提交,Cluster标是standalone提交,Yarn提交好像是YarnCluster

解决办法:使用ExecutionEnvironment.getExecutionEnvironment()

//StreamExecutionEnvironment env = StreamExecutionEnvironment.createLocalEnvironment();
StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();

以下是详细的内容。

FlinkUI中点击Submit后,弹出的Message完整异常信息参考:

org.apache.flink.runtime.rest.handler.RestHandlerException: Could not execute application. 
at org.apache.flink.runtime.webmonitor.handlers.JarRunHandler.lambda$handleRequest$1(JarRunHandler.java:110) 
at java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:822) 
at java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:797) 
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) 
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1595) 
at java.lang.Thread.run(Thread.java:748) Caused by: java.util.concurrent.CompletionException: org.apache.flink.util.FlinkRuntimeException: Could not execute application. 
at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273)
at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280) 
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1592) 
... 1 more Caused by: org.apache.flink.util.FlinkRuntimeException: Could not execute application. 
at org.apache.flink.client.deployment.application.DetachedApplicationRunner.tryExecuteJobs(DetachedApplicationRunner.java:88) 
at org.apache.flink.client.deployment.application.DetachedApplicationRunner.run(DetachedApplicationRunner.java:70) 
at org.apache.flink.runtime.webmonitor.handlers.JarRunHandler.lambda$handleRequest$0(JarRunHandler.java:104) 
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1590) 
... 1 more Caused by: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: The LocalStreamEnvironment cannot be used when submitting a program through a client, or running in a TestEnvironment context. 
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:372) 
at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) 
at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) 
at org.apache.flink.client.deployment.application.DetachedApplicationRunner.tryExecuteJobs(DetachedApplicationRunner.java:84) 
... 4 more Caused by: org.apache.flink.api.common.InvalidProgramException: The LocalStreamEnvironment cannot be used when submitting a program through a client, or running in a TestEnvironment context. 
at org.apache.flink.streaming.api.environment.LocalStreamEnvironment.validateAndGetConfiguration(LocalStreamEnvironment.java:57) 
at org.apache.flink.streaming.api.environment.LocalStreamEnvironment.<init>(LocalStreamEnvironment.java:52) 
at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.createLocalEnvironment(StreamExecutionEnvironment.java:2259) 
at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.createLocalEnvironment(StreamExecutionEnvironment.java:2247) 
at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.createLocalEnvironment(StreamExecutionEnvironment.java:2230) 
at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.createLocalEnvironment(StreamExecutionEnvironment.java:2218) 
at com.xx.XXApplication.main(XXApplication.java:39) 
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
at java.lang.reflect.Method.invoke(Method.java:498) 
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355)

其实异常信息里面已经提示了关键信息,但是初次接触Flink没有意识到,就是里面的

at com.xx.XXApplication.main(XXApplication.java:39) 

39行的代码就是

StreamExecutionEnvironment env = StreamExecutionEnvironment.createLocalEnvironment();

后来参考的网上的信息才意识到问题的根本原因。记录一下,以供参考。

网上还有很多类似的异常信息,需要仔细查看里面的关键字,一定要仔细,问题的原因就在异常信息里面。

以下信息给了我启发

“The RemoteEnvironment cannot be used when submitting a program through a client, or running in a TestEnvironment context.” 这个异常的关键字是“RemoteEnvironment ”

stackoverflow上的一个问答是关于这个异常的,给了我参考。

https://stackoverflow.com/questions/62876301/the-remoteenvironment-cannot-be-used-when-submitting-a-program-through-a-client

http://www.lryc.cn/news/14856.html

相关文章:

  • Linux就该这么学:RAID与LVM磁盘阵列技术
  • Prometheus+Grafana监控
  • 【JUC2022】第三章 线程中断与 LockSupport
  • 数据结构刷题(七):202快乐数、1两数之和、454四数相加II、15三数之和、18四树之和
  • 华为机试题:HJ80 整型数组合并(python)
  • spring boot——自定义依赖实现自动配置
  • QMap 判断是否value是否已经存在,结合Sleep函数测试
  • vue后台管理系统项目-table选择多行数据分页列表、一键全选重置功能
  • 论文解读 | [CVPR2019] 基于自适应文本区域表示的任意形状场景文本检测
  • 2月编程语言排行榜谁还没有看?
  • nginx.conf配置方法详细介绍
  • 【微信小程序】一文带你吃透开发中的常用组件
  • Nginx 部署 Vue 项目以及 Vue 项目刷新出现 404 的问题(完整步骤)(亲测有效)
  • leaflet 加载geojson数据,随机显示不同颜色的circleMarker
  • UL grant的分配(LCP)
  • 真我air笔记本电脑怎么重装Win10系统?
  • 【闲聊杂谈】深入剖析SpringCloud Alibaba之Nacos源码
  • MySQL删除或清空表内数据的方法
  • Android 权限(二): 动态权限讲解
  • 【C++】2.类和对象(上)
  • 扬帆优配|3300点半日游!上证指数冲高回落;再迎重磅利好!
  • 如何编写性能测试计划?一篇文章教你设计符合项目的性能测试计划
  • 第3章 Windows 下安装 Memcached教程
  • RXjava中的操作符
  • 前端页面jquery规范写法
  • 【HEC-RAS水动力】HEC-RAS 1D基本原理(恒定流及非恒定流)
  • 2.Gin内容介绍
  • python--matplotlib(3)
  • 从源码中探究React中的虚拟DOM
  • 容器架构概述