Because he wasn't able to keep the Lilies alive.
His lily died
So you would never know what side he was on.