WASHINGTON—The Trump administration is exploring ways to break Russia’s military and diplomatic alliance with Iran in a bid to both end the Syrian conflict and bolster the fight against Islamic State, said senior administration, European and Arab officials involved in the policy discussions.

The emerging strategy seeks to reconcile President Donald Trump’s seemingly contradictory vows to improve relations with Russian President Vladimir Putin and to aggressively challenge the military presence of Iran—one of Moscow’s most...