Can’t go for that!

HALL & Oates singer Daryl Hall’s upstate eatery, Daryl’s House, is suing the sleepy town of Pawling, NY, over a dispute involving the venue, which features live music. Lawyers for Hall are seeking $3.2 million in compensation and claim the town illegally held up his plans to expand the venue to include an outdoor amphitheater, in an effort to force him to reduce capacity at the club. Hall says that if he has to do that, he’ll be forced to close the venue, which has hosted acts from Sharon Jones and the Dap Kings to Todd Rundgren. Town residents — a mix of farmers and hedge funders — say the discord threatens to disrupt the area’s beloved peace and quiet. One told Page Six: “Daryl’s new to the area — in fact, he doesn’t even live here — and this isn’t somewhere that needs disputes like this. People are upset that now the town — which is already struggling with high taxes — has to hire a lawyer to fight this case.” They add, “We don’t want this to become the Hamptons or ‘Celebrityville.’ ” Kenneth Stenger, town special counsel, told us: “There’s not anyone I know in Dutchess County who is not incredibly proud and respectful that [the] venue is in Pawling,” and added the town wants to work with Hall. Stenger also said the town’s baffled by the claim that it is trying to strong-arm Hall, saying the town is not even aware Hall made an application to open the new outdoor venue. “If they ever did file an application, I’d be the first one at the townhall door to accept it,” he said. A rep for Hall didn’t comment.