hadoop - drill not showing hive or hbase tables -
I have created both an hbase and hive table to store some data logging information. Hbase and hive can query
hbase: scan MVLogger; // comes back with 9k plus record hive: * Choose from MVLogger; // comes back with 9k plus records
My Hbbes table definition
'MVLogger', {NAME = & gt; 'DbLogData', DATA_BLOCK_ENCODING = & gt; 'No', Bloomfilter = & gt; 'ROW', REPLICATION_SCOPE = & gt; '0', version correct = & gt; '1', compression = & gt; 'No', MIN_VERSIONS = & gt; '0', TTL = & gt; '2147483647', KEEP_DELETED_CELLS = & gt; 'False', BlocksAg = & gt; '65 536 ', IN_MEMORY = & gt; 'False', Blockcat = & gt; The definition of my hive (external) table is: create an external tab 'MVLogger` (`rowid` int,` id` int, `tablename` string,` created date' string, ` RADDATA string, 'client db' string) ROE format sort 'org.apache.hadoop.hive.hbase.HBaseSerDe' handle 'org.apache.hadoop.hive.hbase. HBaseStorageHandler with 'SERDEPROPERTIES' ('serialization.format' = '1', 'hbase.columns.mapping' = ': key, dblog tag: id, dbLogData: TableName, dbLogData: CreatedDate, dbLogData: RowData, dbLogData: ClientDB') TBLPROPERTIES ('Hbase.table.name' = 'MVLogger')
When I use sqlline and see the drill schema, this is what i see
0: JDBC: drill:. ZK = IP - * compu & gt; Show schema; + ------------- + | SCHEMA_NAME | + ------------- + | Hive.default | | Dfs.default | | Dfs.root | | Dfs.tmp | | Cp.default | | Hbase | | Sys | | INSUMS_SCHEMA | + ------------- +
And when I do a [schema] (any of them but sys) and then I get one Nothing to show table ... for example
0: jdbc: drill: zk = ip - *. Compu & gt; Use Hbase; + ------------ + ------------ + | Okay Summary | + ------------ + ------------ + | True | The default schema has been changed to 'hbase'. + ------------ + ------------ + 1 line selected (0.071 seconds) 0: jdbc: drill: zk = ip - *. Compu & gt; Show the table; + -------------- + ------------ + | TABLE_SCHEMA | TABLE_NAME | + -------------- + ------------ + -------------- + ----- ------- + No rows are selected (0.37 seconds)
Under the storage options for the Drill Web UI (Ambari) drill, I see an enabled hbase and hive Am The following is the configuration for the hive storage.
{"type": "hive", "enabled": true, "configProps": {"hive.metastore.uris": "Savings: //ip-.com.com Patinternal: 9 083 "," Hive Metastore .Ware House ":" / app / hive / warehouse / "," effsfault.name ":" hdfs: // ip- * .compute.internal: 8020 / "," hive.metastore .sasl.enabled ":" false "}}
Any ideas why I am not able to query hive / hbase?
UPDATE: Now the table is being displayed in the hive schema, but when I try to query it with a simple selection * ... it's just hanging and I'm in any log Can not find anything files The actual data store of the hive table is HBS BTW.
Hubble found .98 is not yet compatible with the drill / HBS plugin ...
It may have been too late but for other people who can see the post and get the problem.
0: jdbc: drill: zk = ip - * compu & gt; Use Hbase; + ------------ + ------------ + | Okay Summary | + ------------ + ------------ + | True | The default schema has been changed to 'hbase'. + ------------ + ------------ + 1 line selected (0.071 seconds) 0: jdbc: drill: zk = ip - *. Compu & gt; Show the table; + -------------- + ------------ + | TABLE_SCHEMA | TABLE_NAME | + -------------- + ------------ + -------------- + ----- ------- + No line is selected (0.37 seconds)
The user running the drill has no access permissions on the hbase. Provide drill user access on HBS and you will see tables.
Try to open the shuttle with the drill user and run the "list", unless you allow it, you will be empty and you will see the table. / P>
Comments
Post a Comment