I can't reproduce this on my system. I have a fairly recent GIT snapshot of Speakup. So, maybe it depends on some other kernel options. I know that there are a lot of options that can have an effect on kernel performance. Also, whether you have hyper-threading or a multi-core processor would probably have some bearing as well.