The proposal to add a $4 fee to every ride to and from the airports by Uber drivers and other for-hire vehicles and to every pickup at the airports by taxis would be in line with existing fees at airports in Los Angeles, Chicago, Washington and San Francisco, according to agency officials.

But representatives of ride-share drivers said the proposal was unfair to app-based drivers who struggle to earn a living.

“ It is patently unfair to tax Uber and Lyft trips in both directions while taxing taxis in only one direction,” said Brendan Sexton, executive director of the Independent Drivers Guild.

Harry Hartfield, a spokesman for Uber, which already pays the City of Newark $1 million a year for access to Newark Liberty, said, “We want to continue to work with the Port Authority, but riders deserve to know that the tens of millions of dollars in new fees the authority has proposed won’t be wasted.”

Bhairavi Desai, executive director of the New York Taxi Workers Alliance, said in a statement: “Drivers are in crisis but the Port Authority underestimates our resolve. If they want a fight, they got one. Drivers: get ready to shut down the airports.”

At the start of next year, the cash toll at six bridges and tunnels that connect New Jersey to the city would rise to $16, from $15, and the discount for using the E-ZPass electronic tolling system would shrink. The agency also is proposing eliminating discounts for E-ZPass devices that are registered in states other than New York or New Jersey.

The toll increases would be the first since 2015.

Nick Sifuentes, executive director of the Tri-State Transportation Campaign, an advocacy group, said he worried that toll increases might raise opposition to congestion pricing, which he said is needed to fund subway repairs. “We need to make sure that if we’re increasing tolls that it’s for something that has a tangible, regular benefit for commuters,” Mr. Sifuentes said.