Family First senator Steve Fielding has defended his controversial remarks linking Labor's paid parental leave scheme with abortion.

The senator was roundly criticised for suggesting some women might rort the scheme by deliberately falling pregnant and then having a late-term abortion.

Loophole ... Senator Steve Fielding. Credit:Andrew Meares

"All I was trying to do was close that loophole," Senator Fielding told ABC Television today, adding his approach was "fair and reasonable".

"I wasn't the only one to raise this issue in the Senate yesterday."