-
Notifications
You must be signed in to change notification settings - Fork 180
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
关于执行错误SQL会导致engine挂掉 #6
Comments
== SQL ==
19/04/11 13:47:21 WARN main.IqlMain$: SELECT DISTINCT(a.nsrsbh), a.nsrmc,a.scjydz,a.zcdz,a.zcdlxdh,a.scjydlxdh,a.sjgsdq from (SELECT top 3900 from sjjsq_db.dwa_djxx_nsrxx_1) line 1:135 extraneous input '' expecting {'load', 'LOAD', '.', 'where', 'WHERE', 'as', 'AS', 'save', 'SAVE', 'partitionBy', 'PARTITIONBY', 'coalesce', 'SELECT', ';', 'insert', 'INSERT', 'create', 'CREATE', 'drop', 'DROP', 'refresh', 'REFRESH', 'set', 'SET', 'train', 'TRAIN', 'register', 'REGISTER', 'show', 'SHOW', 'describe', 'DESCRIBE', 'import', 'IMPORT', 'include', 'INCLUDE', 'explain', 'EXPLAIN', 'overwrite', 'OVERWRITE', 'append', 'APPEND', 'errorIfExists', 'ignore', 'IGNORE', 'update', 'UPDATE', 'and', 'AND', '=', IDENTIFIER, BACKQUOTED_IDENTIFIER, SIMPLE_COMMENT, BRACKETED_EMPTY_COMMENT, BRACKETED_COMMENT, '/**/', UNRECOGNIZED, DIGIT} == SQL ==
19/04/11 13:47:22 WARN engine.ExeActor: Actor Stop ... |
@Rache555 我在我这边执行了你的语句,报了一样的错误但是engine没有挂,你那边每次都会挂吗? |
@Rache555 另外你的子查询中字段别名为什么用数字,还是说你想查出3900条数据?如果是可以这样写:
|
感谢你的回复 执行8-9次错误以后zookeeper中的/iql/valid_engine 目录中就丢失一个actor 然后 spark的8088页面就会报以下错误:
Caused by: |
这个SQL并不是我执行的,但是执行的SQL过程中经常出现以上情况,一个错误SQL执行多次以后就会导致192.168.222.83:2550_actor6 丢失 望指点一二 |
并且在IQL的页面中的错误提示为: org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:925) The currently active SparkContext was created at: (No active SparkContext.)
|
zookeeper中的actor: [zk: 192.168.222.83:2181(CONNECTED) 8] ls /iql/valid_engine |
@Rache555 加我微信sobigufo |
在执行包含 offset in top 等spark不支持 的SQL语句或者错误的SQL语句时,会导致 zookeeper中的/iql/valid_engine 的actor丢失 在并且在spark的8088端口访问出错
The text was updated successfully, but these errors were encountered: