千家信息网

azkaban提交job出错记录

发表于:2024-10-02 作者:千家信息网编辑
千家信息网最后更新 2024年10月02日,在UE中编写一个test.sql,用azkaban启动,报错18-02-2016 23:09:17 CST hivef ERROR - FAILED: ParseException line 1:0
千家信息网最后更新 2024年10月02日azkaban提交job出错记录

在UE中编写一个test.sql,用azkaban启动,报错

18-02-2016 23:09:17 CST hivef ERROR - FAILED: ParseException line 1:0 character '' not supported here

怎么查都查不出问题

进入hive的log目录

查看hive.log发现问题

2016-02-18 23:09:16,819 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: use default

2016-02-18 23:09:17,561 ERROR [main]: ql.Driver (SessionState.java:printError(960)) - FAILED: ParseException line 1:0 character '' not supported here

org.apache.hadoop.hive.ql.parse.ParseException: line 1:0 character '' not supported here

at org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:211)

at org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:166)

at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:396)

at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:308)

at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1122)

at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1170)

at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059)

at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049)


****原来是UE中的大坑,文件头自动加了不可见特殊文件头


另外,编写一个最简单的command类型job提交,直接提交就失败

Installation Failed. Error found in upload Cannot uploaded. Job doesn't have type set 'command'


后发现job描述文件中的第一行: # command.job 不能缺,很诡异


0