首页 文章

Hive进程内存大小

提问于
浏览
0

请问你能帮我理解Hive上下文中的512mb(以粗体显示)吗?它的内存大小是多少?我在 hive-site.xml 文件中设置了 export HADOOP_HEAPSIZE=4192

hadoop@master:~/hive/conf$ ps -ef | grep 'hive'

hadoop 5587 1 0 Feb14? 00:05:27 / usr / lib / jvm / default-jdk / bin / java -Xmx4192m -Djava.net.preferIPv4Stack = true -Dhadoop.log.dir = / home / hadoop / hadoop-2.7.3 / logs -Dhadoop .log.file = hadoop.log -Dhadoop.home.dir = / home / hadoop / hadoop-2.7.3 -Dhadoop.id.str = hadoop -Dhadoop.root.logger = INFO,console -Djava.library.path = /home/hadoop/hadoop-2.7.3/lib/native -Dhadoop.policy.file = hadoop-policy.xml -Djava.net.preferIPv4Stack = true -Xmx512m -Dhadoop.security.logger = INFO,NullAppender org.apache . hadoop.util.RunJar /home/hadoop/hive/lib/hive-metastore-2.3.2.jar org.apache.hadoop.hive.metastore.HiveMetaStore

hadoop 9903 8034 0 10:54 pts / 0 00:00:00 grep --color = auto hive

hadoop 21646 15918 1 07:37 pts / 3 00:03:02 / usr / lib / jvm / default-jdk / bin / java -Xmx4192m -Djava.net.preferIPv4Stack = true -Dhadoop.log.dir = / home / hadoop / hadoop-2.7.3 / logs -Dhadoop.log.file = hadoop.log -Dhadoop.home.dir = / home / hadoop / hadoop-2.7.3 -Dhadoop.id.str = hadoop -Dhadoop.root.logger = INFO,console -Djava.library.path = / home / hadoop / hadoop-2.7.3 / lib / native -Dhadoop.policy.file = hadoop-policy.xml -Djava.net.preferIPv4Stack = true -Xmx512m -Dproc_hivecli - Dlog4j.configurationFile = hive-log4j2.properties -Djava.util.logging.config.file = / home / hadoop / hive / conf / parquet-logging.properties -Dhadoop.security.logger = INFO,NullAppender org.apache.hadoop . util.RunJar /home/hadoop/hive/lib/hive-cli-2.3.2.jar org.apache.hadoop.hive.cli.CliDriver

1 回答

  • 1

    您编辑的变量适用于客户端,而不是服务器,并且您不会从XML文件中导出任何内容

    要配置HiveServer2和Hive Metastore的堆大小,请在/etc/hive/hive-env.sh中将HADOOP_OPTS变量中的-Xmx参数设置为所需的最大堆大小

    VS

    要配置Beeline CLI的堆大小,请在/etc/hive/hive-env.sh中设置HADOOP_HEAPSIZE环境变量

    除此之外,这两个值都是如此,所以你可能想看一下

    Duplicated Java runtime options : what is the order of preference?

相关问题