It's because Texas is the OG of human suffering. Texas gave up territory than end slavery: This is why Oklahoma looks so weird (the "panhandle"). After the so-called Missouri compromise, in order to remain a slave-state, Texas gave up that piece of land. Also, Texas declared independence not once, but twice, to remain a slave state. First, from Mexico: "Many Anglo-American settlers were from the southern United States and brought enslaved workers, using legal loopholes like indentured servitude to bypass Mexican restrictions against slavery. They feared Mexico would abolish the practice entirely". And then, famously, of course, fighting to remain independent during the Civil War.
Your point is valid, but it is worth noting that the panhandle territory was a notoriously inhospitable place to try and exist (for European settlers at least, who called it "no mans land"), so it wasn't like Texas was giving up a gem, none of the surrounding states wanted it.