首页 文章

Hive - 运行Java代码时的依赖关系

提问于
浏览
-5

运行以下代码需要什么设置和jar文件 . 我有jdk1.8.0_05,Hadoop 2.2.0和Hive 0.12.0 . 请帮忙 . 我试图在eclipse上运行此代码,但它没有编译 . 我已经添加了大约15个外部 jar 但没有用

import java.sql.SQLException;
import java.sql.Connection;
import java.sql.ResultSet;
import java.sql.Statement;
import java.sql.DriverManager;

public class HiveJdbcClient {
  private static String driverName = "org.apache.hadoop.hive.jdbc.HiveDriver";

  public static void main(String[] args) throws SQLException {
    try {
      Class.forName(driverName);
    } catch (ClassNotFoundException e) {
      // TODO Auto-generated catch block
      e.printStackTrace();
      System.exit(1);
    }
    Connection con = DriverManager.getConnection("jdbc:hive://localhost:10000/default", "", "");
    Statement stmt = con.createStatement();
    String tableName = "testHiveDriverTable";
    stmt.executeQuery("drop table " + tableName);
    ResultSet res = stmt.executeQuery("create table " + tableName + " (key int, value string)");
    // show tables
    String sql = "show tables '" + tableName + "'";
    System.out.println("Running: " + sql);
    res = stmt.executeQuery(sql);
    if (res.next()) {
       System.out.println(res.getString(1));
    }
    // describe table
    sql = "describe " + tableName;
    System.out.println("Running: " + sql);
    res = stmt.executeQuery(sql);
    while (res.next()) {
      System.out.println(res.getString(1) + "\t" + res.getString(2));
    }

    // load data into table
    // NOTE: filepath has to be local to the hive server
    // NOTE: /tmp/a.txt is a ctrl-A separated file with two fields per line
    String filepath = "/tmp/a.txt";
    sql = "load data local inpath '" + filepath + "' into table " + tableName;
    System.out.println("Running: " + sql);
    res = stmt.executeQuery(sql);

    // select * query
    sql = "select * from " + tableName;
    System.out.println("Running: " + sql);
    res = stmt.executeQuery(sql);
    while (res.next()) {
      System.out.println(String.valueOf(res.getInt(1)) + "\t" + res.getString(2));
    }

    // regular hive query
    sql = "select count(1) from " + tableName;
    System.out.println("Running: " + sql);
    res = stmt.executeQuery(sql);
    while (res.next()) {
      System.out.println(res.getString(1));
    }
  }
}

错误::

java.lang.ClassNotFoundException:org.apache.hadoop.hive.jdbc.HiveDriver at java.net.URLClassLoader $ 1.run(URLClassLoader.java:372)at java.net.URLClassLoader $ 1.run(URLClassLoader.java:361)at at java.security.AccessController.doPrivileged(本机方法),位于java..LLCE文件管理器上的java.lang.ClassLoader.findClass(URLClassLoader.java:360),位于sun.misc.Launcher $ AppClassLoader的java.lang.ClassLoader.loadClass(ClassLoader.java:424) . loadClass(Launcher.java:308)at java.lang.ClassLoader.loadClass(ClassLoader.java:357)at java.lang.Class.forName0(Native Method)at java.lang.Class.forName(Class.java:259)在HiveJdbcClient.main(HiveJdbcClient.java:15)

2 回答

  • 0

    您必须将hive-jdbc-xxxx.jar添加到类路径中 . 我不知道你有什么Hadoop版本或Hadoop发行版,但是如果你使用的是最后一个Cloudera发行版,请从this archive下载 hive-0.12.0-cdh5.0.2.tar.gz 并将 /hive-0.12.0-cdh.5.0.2/hive-jdbc-0.12.0-cdh5.0.2.jar 包含到你的java类路径中 .

  • 0

    以下步骤将有助于解决问题:

    • 将驱动器类替换为 org.apache.hive.jdbc.HiveDriver

    • hive-jdbc-<version>.jarcommon-logging-<version>.jarhadoop-common-<version>.jar 添加到classpath

相关问题