In the world of NoSQL

I got the following exceptions whenever running heavy map reduce jobs towards my HBase tables:

INFO mapred.JobClient: Task Id : attempt_201204240028_0048_m_000015_2, Status : FAILED
      lease '-8170712910260484725' does not exist
 at org.apache.hadoop.hbase.regionserver.Leases.removeLease(
 at sun.reflect.GeneratedMethodAccessor14.invoke(Unknown Source)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(
 at java.lang.reflect.Method.invoke(

Most oftenly they were severe enough to cause the entire job to fail. This indicated that I needed to raise, which says how long a scanner lives between calls to This however didn’t help, apparently you also need to raise hbase.rpc.timeout (the Exception that indicated this was hidden in log level DEBUG, so took a while to realise that).

So, adding the following to hbase-site.xml solved it:

    <value>900000</value> <!-- 900 000, 15 minutes -->
    <value>900000>/value> <!-- 15 minutes -->


§90 · May 2, 2012 · HBase · Comments Off · Tags: , , ,