Streaming Oracle Data to HBase

Question

Hi All,
I am trying to stream data from Oracle table to a HBase table. Below are the details :
Machine 1
This machine has Oracle GoldenGate 11.1 for Java, Oracle Database 11.2 and all necessary jar files of HBase, Hadoop, GoldenGate, etc.
I've compiled and created jar of the handler for GG for Java's pump process and placed in GG for Java's "dirprm" directory.
Properties file for GG for Java's pump process has also been placed in "dirprm" directory
Machine 2
This is where Hadoop and HBase is running.
The intend is the stream data from Machine 1 to Machine 2
This exercise is based on the attachment (OGG_HBase_Integration.docx) supplied with Doc ID 1586211.1. This attachment has the handler Java code, the properties file and GG commands. The portion of the Java handler code is listed below that raises exception.
    try {
         Configuration hbaseConf = HBaseConfiguration.create();
         hbaseConf.set("hbase.zookeeper.quorum", "192.168.1.10");
         hbaseAdmin = new HBaseAdmin(hbaseConf);
         HTableDescriptor tdesc = new HTableDescriptor (Bytes.toBytes(hbaseTableName));
         HColumnDescriptor cfDesc = new HColumnDescriptor(Bytes.toBytes(hbaseCfName));
         tdesc.addFamily(cfDesc);
         hpool = new HTablePool();
         if (hbaseAdmin.tableExists(hbaseTableName)) {
            htable = hpool.getTable(Bytes.toBytes(hbaseTableName));
         } else {
            hbaseAdmin.createTable(tdesc);
            htable = hpool.getTable(Bytes.toBytes(hbaseTableName));
    } catch (Exception e) {
       logger.info("Exception caught when initilizing the HBase Table " );
       throw new ConfigException("Could not initialize HBase table " + hbaseTableName, e);
In the Java handler, where should I specify the address of machine where HBase is running?
I am getting below error in pump's report file as well :
Error occured in javawriter.c[269]: Error occurred (Java exception): Error calling static void Method UserExitMain.main:
  org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'userExitDataSource' defined in class path resource [com/goldengate/atg/datasource/DataSource-context.xml]: Instantiation of bean failed; nested exception is org.springframework.beans.factory.BeanDefinitionStoreException: Factory method [public final com.goldengate.atg.datasource.GGDataSource com.goldengate.atg.datasource.factory.DataSourceFactory.getDataSource()] threw exception; nested exception is com.goldengate.atg.util.ConfigException: Could not initialize HBase table cinfo
Any idea that I am missing anything? Your help is most appreciated.
Thanks,

Answer 1

Hi All,
I am trying to stream data from Oracle table to a HBase table. Below are the details :
Machine 1
This machine has Oracle GoldenGate 11.1 for Java, Oracle Database 11.2 and all necessary jar files of HBase, Hadoop, GoldenGate, etc.
I've compiled and created jar of the handler for GG for Java's pump process and placed in GG for Java's "dirprm" directory.
Properties file for GG for Java's pump process has also been placed in "dirprm" directory
Machine 2
This is where Hadoop and HBase is running.
The intend is the stream data from Machine 1 to Machine 2
This exercise is based on the attachment (OGG_HBase_Integration.docx) supplied with Doc ID 1586211.1. This attachment has the handler Java code, the properties file and GG commands. The portion of the Java handler code is listed below that raises exception.
    try {
         Configuration hbaseConf = HBaseConfiguration.create();
         hbaseConf.set("hbase.zookeeper.quorum", "192.168.1.10");
         hbaseAdmin = new HBaseAdmin(hbaseConf);
         HTableDescriptor tdesc = new HTableDescriptor (Bytes.toBytes(hbaseTableName));
         HColumnDescriptor cfDesc = new HColumnDescriptor(Bytes.toBytes(hbaseCfName));
         tdesc.addFamily(cfDesc);
         hpool = new HTablePool();
         if (hbaseAdmin.tableExists(hbaseTableName)) {
            htable = hpool.getTable(Bytes.toBytes(hbaseTableName));
         } else {
            hbaseAdmin.createTable(tdesc);
            htable = hpool.getTable(Bytes.toBytes(hbaseTableName));
    } catch (Exception e) {
       logger.info("Exception caught when initilizing the HBase Table " );
       throw new ConfigException("Could not initialize HBase table " + hbaseTableName, e);
In the Java handler, where should I specify the address of machine where HBase is running?
I am getting below error in pump's report file as well :
Error occured in javawriter.c[269]: Error occurred (Java exception): Error calling static void Method UserExitMain.main:
  org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'userExitDataSource' defined in class path resource [com/goldengate/atg/datasource/DataSource-context.xml]: Instantiation of bean failed; nested exception is org.springframework.beans.factory.BeanDefinitionStoreException: Factory method [public final com.goldengate.atg.datasource.GGDataSource com.goldengate.atg.datasource.factory.DataSourceFactory.getDataSource()] threw exception; nested exception is com.goldengate.atg.util.ConfigException: Could not initialize HBase table cinfo
Any idea that I am missing anything? Your help is most appreciated.
Thanks,