[hdfs] copyFromLocal 명령보다 더 많은 시간이 걸리는 Apache Flume
If you're looking simple at read and write operations flume is going to be at least 2x slower with your configuration as you're using a file channel - every file read from disk is encapsulated into a flume event (in memory) and then serialized back down to disk via the file channel. The sink then reads the event back from the file channel (disk) before pushing it up to hdfs. You also haven't set..
카테고리 없음
2021. 2. 19. 22:28
