Should I transfer from Temple University to UMASS Amherst?

I am a freshmen at Temple University in PA, but I am from Boston Mass. Temple and UMASS have given me almost the same financial aid so there is no real difference there. I might even save money if I find a cheap apartment to rent in Philly. A lot of my friends and my brother go to UMASS and so I think it would be a good fit for me socially, but the "zoo" is known for drinking and I don't know if that's all I want to do on the weekends. I've only been at Temple U for about 3 months, but I have been having trouble adjusting socially. I live in a 4 person suite, and I get along with the two girls in the other room well, but not my roommate. My roommate is a junior transfer so I guess they put her in our dorm because there was no other space, but we don't even say hello and goodbye and it has gotten very uncomfortable. The other two get dinner with me occasionally but they are close to home so they usually go there on the weekends and I have to find plans texting people I've only met once or twice. These people are generally welcoming but I get the sense that I don't fit in with most of them. I was taken off the waitlist at UMASS for the spring semester and was almost sure that I was going to go, but now that I am at Temple I'm having trouble imaging myself there. I don't have many friends but I think the city is really cool and I've gotten involved in some clubs and volunteer groups. I'm hoping some friendships will develop there but so far they haven't. Another aspect is that I don't feel challenged at Temple right now. I'm not sure if thats because I'm a first semester freshman and most of our classes are easier, or if i want to pick a more challenging major, or if it is really the nature of the school. Im trying to be optimistic that things will get better here, but I'm growing more introverted and lonely than I have ever felt and I don't want that to affect me too long. I'm really split on whether I want to go to a higher ranked school (if that matters) or if I want to stay in a new city and learn more about myself.