UNC. It's easy for me. But again, hearkening back to the ACC days, when Mike Grosso was declared ineligible due to the back-room efforts of Eddie Cameron, and Duke canceled their game with us in Columbia because they were afraid to come to the Field House (I don't blame them) with emotions so high, every home USC game the rest of that year and leading to their visit the next year ended with the fans cheering, "Beat Duke. Beat Duke. Beat Hell Out of Duke! The hatred was intense, and never would have been abated had we stayed in the SEC. But Jim Weaver, a UNC man, also tried to get us not to hire Frank McGuire. There is plenty of animosity to go around, but I hate UNC worse.
I read recently that when USC made Vic Bubas an offer when he was looking around for a head coaching position after serving as Everett Case's assistant for several years at NCSU, he turned us down, believing that we were not sufficiently committed to basketball.
I believe that had we committed to building an arena 5 years before we did and Bubas had come to Columbia, there would not have been the animosity that resulted when we hired McGuire.
I really don't think the ACC was out to get USC in particular. I think they really didn't want to deal with McGuire, and we were guilty by association. However, if not for Paul Dietzel, I don't think we would have pulled out.
To be clear, I am in no way trying to denigrate McGuire's skills as a coach, his class, style, dedication, etc. He really brought a lot to the state. Alas, there was a trade-off.
The ACC didn't "go after" Maryland and Lefty. And remember, the Terps had won the ACC Tournament in 1958.
And it does make sense that the tournament was held in NC, being the geographic center of the conference. Where else would they have held it? Any decent facilities in SC in 1964? Any in Virginia? Yes, there was Cole Field House, but if Maryland had an early tournament exit, what about attendance at the rest of the games? I read somewhere that the tournament didn't become a sellout until 1965.
That's why, IMO, the SEC continues to hold the baseball tournament in Hoover - closest geographic proximity to as many league members as possible. More fans will travel for basketball and football, hence it's not as much of an issue.