The Long Island Rail Road station in the town of East Hampton is a manicured place; the little white station house flanked by tidy trees almost looks like a child’s toy that just came out of the box. It is a short drive from the beach and steps from lavish boutiques, stores like John Varvatos and Coach. On any summer day, caravans of luxury cars can be spotted out front.


But on any workday, residents say, it is dotted with another sight as well: men in sturdy boots and dusty jeans, laborers looking to be picked up for work.


When one thinks of the Hamptons, what jumps to mind are masters of the universe and their mansions by the sea. But a strong, steady stream of immigrants has been flowing to the area for years, drawn by a service economy that demands hedges be trimmed and houses be cleaned. In the Springs, a hamlet in the town of East Hampton, where most of the houses are small and the year-round population is relatively large, the Hispanic population has tripled in the past 10 years — and tension has emerged.


Some longtime residents of the Springs and similar areas complain that homes are being illegally crowded, that houses with half a dozen cars parked outside are a blight on the street, and that the many children living inside are overwhelming the local schools and causing property taxes to rise.


“When you tell people you live in East Hampton, the first words out of their mouth are usually, ‘Do you live next to P. Diddy or Alec Baldwin?’ ” said Dennis Michael Lynch, an East Hampton resident and a filmmaker who made a documentary about illegal immigration called “They Come to America.”


“People have a perception of the Hamptons,” Mr. Lynch continued. “They don’t have an image of illegal immigrants packed like sardines into houses.”


The pockets of tension are concentrated in year-round communities, where the immigrants, legal and illegal, tend to live alongside the landscapers and the contractors with whom they are competing for business. These areas are far less affluent than the southern end of town, where Manhattanites spend the summer by the ocean, in homes hidden behind 12-foot hedges.


“South of the highway, the rich people, they don’t care,” said Ricardo Rodriguez, a carpenter from Colombia who has lived in East Hampton for 12 years. It is among “the working people, regular people like us,” he continued, where less welcoming sentiments can be found. “You can feel it.”


Most of the houses on the leafy, winding roads of the Springs are small, well kept but simple. Pickup trucks and modest cars are parked in driveways under fluttering American flags. Home prices and rents are relatively low. Most Springs residents are white, but according to the 2010 census, 37 percent are Hispanic.


Francisco Rafael Varela, an immigrant from Nicaragua who was waiting for a bus in East Hampton last week under a clear blue sky, said that when he came to this country, he came not to New York City or to Florida, but directly to the Hamptons to find work.


Mr. Lynch and others who have raised the issue of crowded houses — at Town Board meetings or in property owner association newsletters — say it has nothing to do with race or ethnicity, but rather enforcement of existing codes that designate homes for single-family use. If a house is crammed with several families, they say, or occupied like a rooming house, that can hurt a whole street. Or when neighbors pack houses full of children, their critics complain of ending up shouldering an unfair portion of the school tax burden.


“This is really about property values and the neighborhood,” said Carol Saxe Buda, who helped begin a group called Unoccupy Springs about a year and a half ago to address crowding.


“A substantial number of illegally occupied homes reflect a certain community,” she added, referring to immigrants, but she emphasized that where the residents came from was never the reason her group singled out a home. The group’s members highlight only places that are, by their crowding, straining the local schools or threatening neighboring property values, she said. “We report houses that are problems," she said. “We don’t care who’s in them.”