The ground, the American Express Community Stadium to give it it’s full name, is in Falmer which is right on the edge of the Brighton & Hove boundary. Thanks to the money grabbing b*stards that ran our club back in the mid 90s they decided to sell the Goldstone Ground but left the club with nowhere to play hence we had two seasons at Gillingham and twelve seasons at the Theatre of Trees aka Withdean Stadium - I would contest the term stadium.
Anyway, the choices were limited as to a suitable site. To the South you had the sea, to the North there were the South Downs which is now a National Park. The choice for Falmer was made and approved after five years or so of objections.
So, yes, your comment about being in the middle of nowhere is kind of apt - it is in Brighton but right on the outskirts. Part of the planning agreement was that it should only be accessed by public transport. Hence the huge emphasis on using trains, buses and Park and Ride operation. It can be a pain in the arse sometimes but nothing compared with having no ground at all.