Living in Texas, I heard this argument from both TAMU and UT fans when TAMU left for the SEC. TAMU fans hated that UT had their own TV network and dictated so much to the Big 12 conference. UT fans called TAMU backstabbers and said they had an overinflated view of themselves. Neither fanbase ever wanted to play the other ever again.
That lasted about 5 years. Now the annual UT vs TAMU game is the most anticipated game on both teams schedules again.
College football needs rivalries. Being angry at another program is entirely justified, but the answer isn’t to take your ball and go home. It’s to beat their ass on the field.