Node JS for backend programmers
I started working in a new and exciting start up, and the thought of using Java for development crushed my soul, so I began shopping around for a fast-develo...
Posts by Category
- Frameworks 22
- Programming 20
- Uncategorized 8
- Scala 5
- Off Topic 3
- Tiddy Bits 3
- Java 3
- Java 2 C# 2
- Soft Skills 1
- Swing 1
Frameworks
Maven: Building a Java-Groovy mixed project
I have a project that mixes Java and Groovy, and the main problem I ran into was that the jar was nicely built, but it only contained the Java classes, and n...
XMLing in Java? Use java-xmlbuilder
XML is not native to Java. Many will disagree, but this is just the simple truth. It’s tedious, messy and generally ugly - specially compares to Groovy or Sc...
Managing both Hebrew & English wordpress on the same host
I opened up a new blog about investments , and I wanted it to be in Hebrew. Problem is , WordPress is basically for ltr languages - and if you install the rt...
Maven - Creating an executable jar
I wanted to create an executable jar in maven , s.t whenever I run”mvn install” , it will generate both the regular one and the executable one.
Using Log4Net in a C# web application
I came to Log4Net because I really loved Log4j , but I must say the documentation on this project is simply crappy, and half of the links in the project page...
Closing notes
Unfortunately , we reached the conclusion that HBase is still not stable enough for us to use in production environment. I think it’s a great project , and I...
Bug Update
After a lengthy discussion with St.Ack (on the hbase channel in the mirc) and Jean Daniel about this bug , we currently believe that what we’re seeing is “ …...
Can’t live with it
We assumed that the bug was caused mainly because of the high load rate , and that once the bulk of the data will be in HBase and the load will drop consider...
We’ll try to live with it
As you remember , HBase tends to collapse (Return”NotServingRegionException”) after a few millions of files (Latest crash: 6 million). Since we (want to) bel...
Still unresolved
We’ve been working on the previous bug (last post) for a few days now , but unfortunately nothing is working. We’ve suspected the error might be caused by wr...
First Setback
We’ve tried loading the system with 10,000 , 100,000 and 200,000 files - everything worked perfectly.
Begin Experimenting
Today we started the production-mode experiemnts.
Testing update
We are planning to move on to production soon , and we intend to build a test environment that will resemble the production environment as close as possible.
Hadoop Failover and Failback Solution
As you can see in the previous blog , Hadoop successfully failover , but it fails to failback. Our solution to this problem is this:
When will hadoop NN recognize a failure?
I’ve been trying to cause the NN to recognize that it is inconsistent and turn to the SNN for data.
Hadoop failover (and hopefully failback)
We’ve decided to test using linux HeartBeat together with hadoop , to enavle failover (and failback) capacbilities.
Testing Hadoop - Starting HBase
Hbase configuration and running is very similar to hadoops. Not surprisingly , they also have a nice Getting Started page. The tricky part , though , is to u...
Testing Hadoop - Starting Hadoop
First thing : It works. If you’re getting a lot error messages and you start thinking “well , maybe it’s crap. still 0.18 can’t be that good a version” Stop...
Testing Hadoop - Problem Definition
We have a very large amount of relatively small files (~5k avg , 41k max , 0k min) , that we access a lot (20M times a day) for various computations. Current...
Programming
Node JS for backend programmers
I started working in a new and exciting start up, and the thought of using Java for development crushed my soul, so I began shopping around for a fast-develo...
XMLing in Java? Use java-xmlbuilder
XML is not native to Java. Many will disagree, but this is just the simple truth. It’s tedious, messy and generally ugly - specially compares to Groovy or Sc...
Comparison method violates its general contract!
java.lang.IllegalArgumentException: Comparison method violates its general contract!
SearchIndexer & TSVNCache : Two things that are hogging your hd - and your computer
I have a brand new Lenovo T510 , i7, 4G ,64bit , Windows 7 with an Nvidia GPU - and it sucks. In this price , with these specifications , it really shouldn’t...
Scala 101 - Scoping
This is a part of my Scala tutorial . Read the first part & second part for a more general Scala intro. You can read here for an overview of how to write...
Scala 101 - Named & Default parameters
Another syntax sugar provided in Scala are the default values for parameters , and the named parameters. Its fairly stright forwards , so We’ll just start wi...
Scala 101 - OOP : Getters & Setters
This is a part of my Scala tutorial . Read the first part & second part for a more general Scala intro. You can read here for an overview of how to write...
Scala 101– Basic OOP : Writing a class
This is part 3 of my Scala tutorial – read the first part and the second part for a more general Scala intro. All the examples you see here were ran via the ...
Scala 101 - Val, var, Arrays, Loops and Conditions
Today I’ve started a 3 days course (sponsored by my work place ) in Scala. The prerequisites are just”Experienced in Java” .
Why you should never ask permission to clean up code
http://cdevroe.com/notes/code-maintenance-dont-ask/
Swing - Closing the window and finalizing stuff in the background
I’m writing a program that is a little data intensive. At first , when the user clicked the X and choose”yes” at the”are you sure” box , I would do the clean...
Maven - Creating an executable jar
I wanted to create an executable jar in maven , s.t whenever I run”mvn install” , it will generate both the regular one and the executable one.
SVN Working Copy xxx locked and cleanup failed
This thing drives me insane every time . It almost always happens in the middle of a mega-update, and usually the only solution is to delete everything and r...
10 Developers For The Price Of One
“Programming managers have long recognized wide productivity variations between good programmers and poor ones”
Using Log4Net in a C# web application
I came to Log4Net because I really loved Log4j , but I must say the documentation on this project is simply crappy, and half of the links in the project page...
Mockito! Your unit test side-kick
Problem:
LinkedHashMap
Problem:
Testing Hadoop - Problem Definition
We have a very large amount of relatively small files (~5k avg , 41k max , 0k min) , that we access a lot (20M times a day) for various computations. Current...
Uncategorized
Web programming for server people
I’m mainly a back-end engineer - through my not-so-long career, I’ve dealt with sql, no-sql, offline processes, etl mechanisms, billing services, web-crawler...
Finally! What’s hogging your RAM?
Some of you may have noticed that the Windows Task Manager doesn’t show you the real memory consumption of the applications you’re running. It’s quite obviou...
Zorpia is a scam
I’ve been getting a lot of emails lately from a website called”Zorpia” claiming I have a message from someone named Katja. I’ve never signed into this websit...
Beware of Doubles, Floats, and generally floating points…
I’ve recently encountered few people who were naive about the representations of real (i.e not integers) numbers in computer languages , like double and floa...
Scala 101 - OOP : Getters & Setters
This is a part of my Scala tutorial . Read the first part & second part for a more general Scala intro. You can read here for an overview of how to write...
Consuming SOAP in Groovy
I’ve started using SOAP in Groovy. As I’m new both to SOAP and to Groovy , this is a little basic.
Grep on PowerShell
I must admit that I find the windows PowerShell a really-way-too-late pale substitution for the full capacity of the unix shell , but since I sometimes need ...
Scala
Scala 101 - Scoping
This is a part of my Scala tutorial . Read the first part & second part for a more general Scala intro. You can read here for an overview of how to write...
Scala 101 - Named & Default parameters
Another syntax sugar provided in Scala are the default values for parameters , and the named parameters. Its fairly stright forwards , so We’ll just start wi...
Scala 101 - OOP : Getters & Setters
This is a part of my Scala tutorial . Read the first part & second part for a more general Scala intro. You can read here for an overview of how to write...
Scala 101– Basic OOP : Writing a class
This is part 3 of my Scala tutorial – read the first part and the second part for a more general Scala intro. All the examples you see here were ran via the ...
Scala 101 - Val, var, Arrays, Loops and Conditions
Today I’ve started a 3 days course (sponsored by my work place ) in Scala. The prerequisites are just”Experienced in Java” .
Off Topic
SearchIndexer & TSVNCache : Two things that are hogging your hd - and your computer
I have a brand new Lenovo T510 , i7, 4G ,64bit , Windows 7 with an Nvidia GPU - and it sucks. In this price , with these specifications , it really shouldn’t...
How Sun planned to discontinue Java
Cool story about how sun almost ditched Java , and only by chance it became what it is today
Missing the whole point of a password
(Off topic)
Tiddy Bits
SearchIndexer & TSVNCache : Two things that are hogging your hd - and your computer
I have a brand new Lenovo T510 , i7, 4G ,64bit , Windows 7 with an Nvidia GPU - and it sucks. In this price , with these specifications , it really shouldn’t...
How Sun planned to discontinue Java
Cool story about how sun almost ditched Java , and only by chance it became what it is today
SVN Working Copy xxx locked and cleanup failed
This thing drives me insane every time . It almost always happens in the middle of a mega-update, and usually the only solution is to delete everything and r...
Java
Maven: Building a Java-Groovy mixed project
I have a project that mixes Java and Groovy, and the main problem I ran into was that the jar was nicely built, but it only contained the Java classes, and n...
XMLing in Java? Use java-xmlbuilder
XML is not native to Java. Many will disagree, but this is just the simple truth. It’s tedious, messy and generally ugly - specially compares to Groovy or Sc...
Comparison method violates its general contract!
java.lang.IllegalArgumentException: Comparison method violates its general contract!
Java 2 C#
Using Log4Net in a C# web application
I came to Log4Net because I really loved Log4j , but I must say the documentation on this project is simply crappy, and half of the links in the project page...
Learning C# with a Java background
I’m a Java programmer , and I’m starting to work on a production project written in C# , so this is a great time to start learning this language . I’ve neve...
Soft Skills
10 Developers For The Price Of One
“Programming managers have long recognized wide productivity variations between good programmers and poor ones”
Swing
Swing - Closing the window and finalizing stuff in the background
I’m writing a program that is a little data intensive. At first , when the user clicked the X and choose”yes” at the”are you sure” box , I would do the clean...