Yeah I suppose it is possible, cuz I recall Zant saying the curse he placed on her by the magic of his god. But here is the winning quote that makes it more fact than theory to me that the Gerudo are the Twili. But still, we wont know for sure until a TP sequal or prequal releases.
Ganondorf : "Your people have long amused me, Midna. To defy the gods with such petty magic,
only to be cast aside... How very pathetic.
Pathetic as they were, though, THEY SERVED ME WELL. Their anguish was my
nourishment."
(Pretty much stating that Midnas people were also Ganondorfs followers, that being the Gerudo tribe. The Gerudo tribe has been stated to be an ancient tribe whom dwelled magic.)
Scene : [Ganon dissolves into twilight and uses Zelda's soulless body as his own]
Ganondorf : "Both of you, faithless fools who would dare to take up arms against the king of
light and shadow..." There you go...King of light and SHADOW.
MIDNA :
'Traitors, ha! You want to know why none would call you king? It was your eyes,
Zant.
All saw it, a lust for power burning in your pupils... Did you think we'd
forget our ancestors lost their king to such greed?"
Ok two key things here. The first and most obvious is "our ancestors lost their king to such greed"..comparing whoever this person was that attempted or may have in fact claimed the Triforce to Zant. This person more than likely being, Ganondorf. ALttP and OoT talk plenty of Ganondorfs greed for the sacred power known as the Triforce.
The second key thing here is...ancestors king. That could very well mean there wasnt a king of this tribe for quite some time since the last...my theory is this..'only one male Gerudo is born once every 100 years'. first King Gerudo being Ganondorf, but the second male Gerudo was Zant...he was seen as a King, but as Midna stated...he was a false idol.
Ok, the following quote, mainly towards the end pretty much says this. Zant was deinied such magic power that the King possesed,meaning he wasnt ever the true King of the Twilight. He believed he would be the next ruler of the tribe, but was denied and soon did he meet the true ruler known as Ganondorf.
Zant :
"You speak of magic? Still your tongue for a moment, whelp, and I will tell you
of both magic and the oppression of ages...
The people of our tribe...a tribe that mastered the arts of magic...were locked
away in this world like insects in a cage.
In the shadows we regressed, so much so that we soon knew neither anger nor
hatred...nor even the faintest bloom of desire.
And all of it was the fault of a useless, do-nothing royal family that had
resigned itself to this miserable half-existence!
I had served and endured in that depraved household for far too long, my
impudent princess.
And why, you ask? Because I believed I would be the next to rule our people!
THAT is why!
But would they acknowledge me as their king? No! And as such, I was denied the
magic powers befitting our ruler.
It was then, in the thrall of hatred and despair, that I turned my eyes to the
heavens...and found a god."
I would also like to point out that both Zant and Ganondorf always quote themselves saying something along the lines of helping or saving their people. Back when Ganondorf was the King of the Gerudo in OoT...he sought out for the triforce to not only rule Hyrule but too help the gerudo by giving them Hyrule itself pretty much...a selfish deed. Zant is doing the same...trying to take over Hyrule with the darkness of the twilight to give back the land. Heres another quote saying Ganondorf is the King of the Twilight.
Zant "This power is granted to me by my god! It is the magic of the King of Twilight,
and you WILL respect it!"
He says the power granted to him was from the magic of the King of Twilight (obviously being Ganondorf) Need I say more?