Speakup and Vi clones

[Zachary Kline]

Hiya,
    I've been wondering about the possibility of using Speakup with one of the VI clones--possibly Vim or the like.  I suppose the only trouble I have with it is that the H-J-K-L movement keys don't seem to track the cursor appropriately, for whatever reason.  Granted, it's a minor inconvenience, but I do enjoy my shortcuts when I can get them.
Any advice on what I can do to fix this, or at least use Speakup with the editors a little easier?
Thanks,
Zack.