Closing notes
Unfortunately , we reached the conclusion that HBase is still not stable enough for us to use in production environment. I think it’s a great project , and I...
Unfortunately , we reached the conclusion that HBase is still not stable enough for us to use in production environment. I think it’s a great project , and I...
After a lengthy discussion with St.Ack (on the hbase channel in the mirc) and Jean Daniel about this bug , we currently believe that what we’re seeing is “ …...
We assumed that the bug was caused mainly because of the high load rate , and that once the bulk of the data will be in HBase and the load will drop consider...
As you remember , HBase tends to collapse (Return”NotServingRegionException”) after a few millions of files (Latest crash: 6 million). Since we (want to) bel...
We’ve been working on the previous bug (last post) for a few days now , but unfortunately nothing is working. We’ve suspected the error might be caused by wr...
We’ve tried loading the system with 10,000 , 100,000 and 200,000 files - everything worked perfectly.
Today we started the production-mode experiemnts.
We are planning to move on to production soon , and we intend to build a test environment that will resemble the production environment as close as possible.
As you can see in the previous blog , Hadoop successfully failover , but it fails to failback. Our solution to this problem is this:
I’ve been trying to cause the NN to recognize that it is inconsistent and turn to the SNN for data.
We’ve decided to test using linux HeartBeat together with hadoop , to enavle failover (and failback) capacbilities.
Hbase configuration and running is very similar to hadoops. Not surprisingly , they also have a nice Getting Started page. The tricky part , though , is to u...
First thing : It works. If you’re getting a lot error messages and you start thinking “well , maybe it’s crap. still 0.18 can’t be that good a version” Stop...
We have a very large amount of relatively small files (~5k avg , 41k max , 0k min) , that we access a lot (20M times a day) for various computations. Current...
Unfortunately , we reached the conclusion that HBase is still not stable enough for us to use in production environment. I think it’s a great project , and I...
After a lengthy discussion with St.Ack (on the hbase channel in the mirc) and Jean Daniel about this bug , we currently believe that what we’re seeing is “ …...
We assumed that the bug was caused mainly because of the high load rate , and that once the bulk of the data will be in HBase and the load will drop consider...
As you remember , HBase tends to collapse (Return”NotServingRegionException”) after a few millions of files (Latest crash: 6 million). Since we (want to) bel...
We’ve been working on the previous bug (last post) for a few days now , but unfortunately nothing is working. We’ve suspected the error might be caused by wr...
We’ve tried loading the system with 10,000 , 100,000 and 200,000 files - everything worked perfectly.
Today we started the production-mode experiemnts.
We are planning to move on to production soon , and we intend to build a test environment that will resemble the production environment as close as possible.
As you can see in the previous blog , Hadoop successfully failover , but it fails to failback. Our solution to this problem is this:
I’ve been trying to cause the NN to recognize that it is inconsistent and turn to the SNN for data.
We’ve decided to test using linux HeartBeat together with hadoop , to enavle failover (and failback) capacbilities.
Hbase configuration and running is very similar to hadoops. Not surprisingly , they also have a nice Getting Started page. The tricky part , though , is to u...
First thing : It works. If you’re getting a lot error messages and you start thinking “well , maybe it’s crap. still 0.18 can’t be that good a version” Stop...
We have a very large amount of relatively small files (~5k avg , 41k max , 0k min) , that we access a lot (20M times a day) for various computations. Current...
This is a part of my Scala tutorial . Read the first part & second part for a more general Scala intro. You can read here for an overview of how to write...
Another syntax sugar provided in Scala are the default values for parameters , and the named parameters. Its fairly stright forwards , so We’ll just start wi...
This is a part of my Scala tutorial . Read the first part & second part for a more general Scala intro. You can read here for an overview of how to write...
This is part 3 of my Scala tutorial – read the first part and the second part for a more general Scala intro. All the examples you see here were ran via the ...
Today I’ve started a 3 days course (sponsored by my work place ) in Scala. The prerequisites are just”Experienced in Java” .
XML is not native to Java. Many will disagree, but this is just the simple truth. It’s tedious, messy and generally ugly - specially compares to Groovy or Sc...
Problem:
Problem:
I came to Log4Net because I really loved Log4j , but I must say the documentation on this project is simply crappy, and half of the links in the project page...
I’m a Java programmer , and I’m starting to work on a production project written in C# , so this is a great time to start learning this language . I’ve neve...
I have a project that mixes Java and Groovy, and the main problem I ran into was that the jar was nicely built, but it only contained the Java classes, and n...
I wanted to create an executable jar in maven , s.t whenever I run”mvn install” , it will generate both the regular one and the executable one.
Problem:
Problem:
(Off topic)
(Off topic)
I came to Log4Net because I really loved Log4j , but I must say the documentation on this project is simply crappy, and half of the links in the project page...
I wanted to create an executable jar in maven , s.t whenever I run”mvn install” , it will generate both the regular one and the executable one.
http://cdevroe.com/notes/code-maintenance-dont-ask/
XML is not native to Java. Many will disagree, but this is just the simple truth. It’s tedious, messy and generally ugly - specially compares to Groovy or Sc...
I have a project that mixes Java and Groovy, and the main problem I ran into was that the jar was nicely built, but it only contained the Java classes, and n...