开发者社区> 问答> 正文

RegionTooBusyException: Above memstore limit

Hbase 客户端抛出 RegionTooBusyException: Above memstore limit 异常,请问本次访问请求就会失败吗?如果是Kafka写数据到Hbase ,数据就会丢失吗?如何避免客户端报此异常?

Kafka写数据入Hbase报错,挺频繁的,隔断时间就会报。错误如下:
18/04/13 09:04:18 INFO client.AsyncProcess: #2758513, waiting for some tasks to finish. Expected max=0, tasksInProgress=11
18/04/13 09:04:28 INFO client.AsyncProcess: #2758513, waiting for some tasks to finish. Expected max=0, tasksInProgress=12
18/04/13 09:04:28 INFO client.AsyncProcess: #2758513, table=monitor_sql, attempt=12/35 failed=1ops, last exception: org.apache.hadoop.hbase.RegionTooBusyException: org.apache.hadoop.hbase.RegionTooBusyException: Above memstore limit, regionName=monitor_sql,000152357813618538,1523581185750.16d97b72e0329effd15a7c7f170213e4., server=yq-hadoop184136,60020,1519785020264, memstoreSize=268483248, blockingMemStoreSize=268435456
at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:3649)
at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2859)
at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2810)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:751)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:713)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2148)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33656)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2170)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:109)
at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108)
at java.lang.Thread.run(Thread.java:745)
on yq-hadoop184136,60020,1519785020264, tracking started null, retrying after=20046ms, replay=1ops
18/04/13 09:04:48 INFO client.AsyncProcess: #2758513, table=monitor_sql, attempt=13/35 failed=1ops, last exception: org.apache.hadoop.hbase.RegionTooBusyException: org.apache.hadoop.hbase.RegionTooBusyException: Above memstore limit, regionName=monitor_sql,000152357813618538,1523581185750.16d97b72e0329effd15a7c7f170213e4., server=yq-hadoop184136,60020,1519785020264, memstoreSize=268483248, blockingMemStoreSize=268435456
at org.apache.hadoop.hbase.regionserver.HRegion.checkResources(HRegion.java:3649)
at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2859)
at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2810)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:751)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:713)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2148)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33656)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2170)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:109)
at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108)
at java.lang.Thread.run(Thread.java:745)
on yq-hadoop184136,60020,1519785020264, tracking started null, retrying after=20013ms, replay=1ops
18/04/13 09:04:48 INFO client.AsyncProcess: #2758513, waiting for some tasks to finish. Expected max=0, tasksInProgress=13

展开
收起
hbase小能手 2018-11-07 11:31:57 6857 0
2 条回答
写回答
取消 提交回答
  • 前一个帐号wangccsy@126.com不知道怎么的就成了企业帐号,改不成个人。所以重新注册了一个个人帐号。老程序员。精通JAVA,C#,数据库,对软件开发过程和流程熟悉。考取系统分析师,项目管理师和系统架构设计师等软件资格考试认证。愿意和大家一起前进。

    都已经异常了。应该会失败。

    2019-07-17 23:12:40
    赞同 展开评论 打赏
  • 社区管理员

    本次请求会失败,客户端会重试。客户端有一定重试次数,重试次数全部耗尽就会向上层抛异常,表示写入失败。这时候用户需要再次调用接口才行。你看到的日志是

    你日志中的 attempt=12/35 就是你重试的次数,当重试达到一定次数时候,客户端会开始记录错误日志,所以你看到的这个日志只是说这次请求失败,还在继续重试。

    可以参考这篇文章,了解下原因:https://yq.aliyun.com/articles ... YlRjS

    2019-07-17 23:12:40
    赞同 展开评论 打赏
问答排行榜
最热
最新

相关电子书

更多
低代码开发师(初级)实战教程 立即下载
冬季实战营第三期:MySQL数据库进阶实战 立即下载
阿里巴巴DevOps 最佳实践手册 立即下载