Just go into the actions menu and re-assign the space bar to pause instead of stop. That will give you the behaviour you want. The standard Reaper way is actually very useful for those who want the edit cursor to stay put until manually moved. There are a variety of reasons to want that; I've always found the way Logic does it a little bit annoying.............if one hits play, then stop and wants to play from the same place again, one is forced to re-wind - this can be inconvenient.