I have heard, that bad karma only affects you when you feel guilty about what you have done.

I already find that feeling guilty about something is a sign of bad karma.

So that would mean: That people who do sinful things that they do not realize/see as sinful, would not affect them. But they may still have to take another birth due to lack of Krishna Consciousness in that lifetime.