Gathering Non-Nobles

If you have a four person group, and the third person is not noble, the fourth person won't be gathered either.

Is this gathering in general or gathering in prestige specific areas?

Light, is this still an issue?