Yes, Ganondorf was banished. But the Dark Interlopers are plural because there is an "s", meaning that there was more than one person banished.
"Among those living in the light, interlopers who excelled at magic appeared. Wielding powerful sorcery, they tried to establish dominion over the...