生活随笔
收集整理的這篇文章主要介紹了
Java 读写 hdfs文件或者目录
小編覺得挺不錯的,現在分享給大家,幫大家做個參考.
1.讀取單個文件
?
?
[java]?view plain?copy
Date?date?=?DateUtil.getSpecifiedDayBefore();??String?yesterday?=?DateUtil.dateToStr(date,?"yyyy-MM-dd");??String?path?=?"hdfs://ip:9000/output_log/output_log_click"?+?yesterday;?????Configuration?conf?=?new?Configuration();??FileSystem?fs?=?FileSystem.get(URI.create(path),?conf);??FSDataInputStream?hdfsInStream?=?fs.open(new?Path(path));??InputStreamReader?isr?=?new?InputStreamReader(hdfsInStream,?"utf-8");??BufferedReader?br?=?new?BufferedReader(isr);??String?line;??//?int?k?=?0;??while?((line?=?br.readLine())?!=?null)?{??????System.out.println(line);??}?????
?
?
2.讀取文件夾
?
[java]?view plain?copy
Date?date?=?DateUtil.getSpecifiedDayBefore();??String?yesterday?=?DateUtil.dateToStr(date,?"yyyy-MM-dd");??String?path?=?"hdfs://ip:9000/output_log/output_log_click"?+?yesterday;????Configuration?conf?=?new?Configuration();??FileSystem?fs?=?FileSystem.get(URI.create(path),?conf);??FileStatus[]?status?=?fs.listStatus(new?Path(path));??for?(FileStatus?file?:?status)?{??????if?(!file.getPath().getName().startsWith("newsMap"))?{????????????????continue;????????????}??????FSDataInputStream?hdfsInStream?=?fs.open(file.getPath());??????InputStreamReader?isr?=?new?InputStreamReader(hdfsInStream,?"utf-8");??????BufferedReader?br?=?new?BufferedReader(isr);??????String?line;??????//?int?k?=?0;??????while?((line?=?br.readLine())?!=?null)?{??????????System.out.println(line);??????}????????}??
總結
以上是生活随笔為你收集整理的Java 读写 hdfs文件或者目录的全部內容，希望文章能夠幫你解決所遇到的問題。
如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。
