little tips and tricks, which i stumbled upon randomly

Showing posts with label Cloudera. Show all posts
Showing posts with label Cloudera. Show all posts

Monday, July 27, 2015

Pig: ERROR 1070: Could not resolve org.apache.hcatalog.pig.HCatLoader - [Solved] - CDH 5.4.X+

Hi All;

With new CDH versions class name for HCatalog loader changed. Unfortunately this is not documented clearly.

Just change
org.apache.hcatalog.pig.HCatLoader to org.apache.hive.hcatalog.pig.HCatLoader
in your pig scripts to solve problem.

I hope, you wont waste too much time like me.

PS: You still need to specify hive-site.xml

Monday, March 2, 2015

Solution to Failed to execute command Create Sqoop Database on service Sqoop 2 error

Depending on java configuration Sqoop2 database creation may fail to update derby drivers and may get "Failed to execute command Create Sqoop Database on service Sqoop 2" error.

To solve this apply following steps:

1. Download derby derby client from db-derby-10.11.1.1-bin.zip
2. Extract and copy derby.jar and derbyclient.jar from zip file to /var/lib/sqoop2
3. Copy derby.jar to /opt/cloudera/parcels/CDH-<version>/jars/ as well
4. Delete /opt/cloudera/parcels/CDH-<version>/lib/sqoop2/webapps/sqoop/WEB-INF/lib/derby​-<version>.jar soft link.
5. Make /opt/cloudera/parcels/CDH-<version>/l​ib/sqoop2/webapps/sqoop/WEB-INF/lib/derby.jar to /opt/cloudera/parcels/CDH-<version>/jars/derby.jar