Closed Bug 630305 Opened 14 years ago Closed 13 years ago

Change hbase.regionserver.maxlogs to 16 for Socorro hbase

Categories

(Mozilla Metrics :: Hadoop/HBase Operations, defect)

HP
Linux
defect
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED
Unreviewed

People

(Reporter: dre, Assigned: tmary)

Details

Currently defaults to 128. This is per server which means that we have a very long startup time for the master to churn through 128*30 hlog files. We need to test this setting with our secondary cluster to be sure it works properly, then we should deploy to production as soon as reasonable to cut down on downtimes for restart.
Assignee: nobody → xstevens
Blocks: 630310
Blocks: 630312
Blocks: 630314
Blocks: 630316
Blocks: 630317
Blocks: 630318
No longer blocks: 630310, 630312, 630314, 630316, 630317, 630318
Group: metrics-private
I did a shutdown and startup with this setting on secondary cluster twice, because I wasn't sure how the setting would take. First startup was 12 minutes and the second was 10 minutes to load all of the regions.
Also investigate modifying: <property> <name>zookeeper.session.timeout</name> <value>60000</value> <description>ZooKeeper session timeout. HBase passes this to the zk quorum as suggested maximum time for a session. See http://hadoop.apache.org/zookeeper/docs/current/zookeeperProgrammers.html#ch_zkSessions "The client sends a requested timeout, the server responds with the timeout that it can give the client. " In milliseconds. </description> </property>
Assignee: xstevens → tmeyarivan
What is the status of this one?
Changes merged with current config for both pri-phx1 and sec-phx1 HBase clusters. --
Status: NEW → RESOLVED
Closed: 13 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.