Looking at the pandaboard for better performance.
It comes with a price, but this looks hopeful;
For the +£100 difference, it may be worth hanging in there with the RPi for a bit. I think there are still gains to be made. Have a class 10 card to try... may experiment with swapfiles on USB HHDs.