If you are set on a small car, then I suppose your choices are between the SmartCar, the Yaris and the Fit. My understanding is that the Fit has the best crash test ratings, which should be important with small cars, so maybe think about looking into that as an option?
Then again, can a SmartCar be any less safe than being on a motorcycle? And we do not have problems with people taking risks with those.