如何检查存在哪些Compressor本机库
时间:2020-01-09 10:34:35 来源:igfitidea点击:
如果要检查Hadoop中存在哪些压缩器本机库,可以使用checknative -a命令来执行。
$ hadoop checknative -a 18/03/16 19:47:24 INFO bzip2.Bzip2Factory: Successfully loaded & initialized native-bzip2 library system-native 18/03/16 19:47:24 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library Native library checking: hadoop: true /usr/hadoop/hadoop-2.9.0/lib/native/libhadoop.so.1.0.0 zlib: true /lib/x86_64-linux-gnu/libz.so.1 snappy: true /usr/lib/x86_64-linux-gnu/libsnappy.so.1 zstd : false lz4: true revision:10301 bzip2: true /lib/x86_64-linux-gnu/libbz2.so.1 openssl: false Cannot load libcrypto.so (libcrypto.so: cannot open shared object file: No such file or directory)! 18/03/16 19:47:24 INFO util.ExitUtil: Exiting with status 1: ExitException
如我们所见,使用checknative命令可以检查hadoop中存在哪些本机库。对于zlib,snappy,lz4和bzip2,它为true,对于zstd为false。我们还可以查看Hadoop的本机库。