Admit permissions on issue for specific users or groups

How can I admit permissions on specific issue for specific user(s) or group of users?
Now I can only assigned to one person ;/ Don't work observers - because if person/group don't have permissions to project, they don't see that project / issue.