假設我們想要用Flink對hive進行讀寫,

并且其中一段代碼如下:

// 如果hive中已經存在了相應的表，則這段代碼省略String hiveSql = "CREATE external TABLE fs_table (\n" +" user_id STRING,\n" +" order_amount DOUBLE" +") partitioned by (dt string,h string,m string) " +"stored as ORC " +"TBLPROPERTIES (\n" +" 'partition.time-extractor.timestamp-pattern'='$dt $h:$m:00',\n" +" 'sink.partition-commit.delay'='0s',\n" +" 'sink.partition-commit.trigger'='partition-time',\n" +" 'sink.partition-commit.policy.kind'='metastore'" +")";tEnv.executeSql(hiveSql);

顯然這個代碼和原有的flink 代碼耦合性太強,

我們希望抽離出來,在hive的客戶端來運行.

為了調試打印上面的這個語句顯然用java太麻煩了.

用python代碼printsql.py如下(上面的整個代碼直接復制下來,然后+改成\即可):

a="CREATE external TABLE fs_table (\n" \" user_id STRING,\n" \" order_amount DOUBLE" \") partitioned by (dt string,h string,m string) " \"stored as ORC " \"TBLPROPERTIES (\n" \" 'partition.time-extractor.timestamp-pattern'='$dt $h:$m:00',\n" \" 'sink.partition-commit.delay'='0s',\n" \" 'sink.partition-commit.trigger'='partition-time',\n" \" 'sink.partition-commit.policy.kind'='metastore'" \")" print(a)

python printsql.py后得到sql語句,把該sql語句在hive中運行如下:

0: jdbc:hive2://Desktop:10000> CREATE external TABLE fs_table (
. . . . . . . . . . . . . . .> ? user_id STRING,
. . . . . . . . . . . . . . .> ? order_amount DOUBLE) partitioned by (dt string,h string,m string) stored as ORC TBLPROPERTIES (
. . . . . . . . . . . . . . .> ? 'partition.time-extractor.timestamp-pattern'='$dt $h:$m:00',
. . . . . . . . . . . . . . .> ? 'sink.partition-commit.delay'='0s',
. . . . . . . . . . . . . . .> ? 'sink.partition-commit.trigger'='partition-time',
. . . . . . . . . . . . . . .> ? 'sink.partition-commit.policy.kind'='metastore')
. . . . . . . . . . . . . . .>?
. . . . . . . . . . . . . . .> ;
No rows affected (4.864 seconds)

建表順利完成
?

?

總結

以上是生活随笔為你收集整理的小技巧:用python迅速打印Java写 的Flink代码中的hive建表语句的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。