When you think about it, the apps that don’t get along with sandboxing are doing things I now realize I don’t want my apps doing. TextExpander for example works by being a system-wide keylogger. Apps that can use stuff from your iPhoto library do so by just reading it, with or without permission.
Short post, but I think it is clear that sand boxing and the like is a fine restriction for many apps. It’s the edge cases that do odd stuff that really cause problems.