Jermain Defoe scored after 12 minutes of his Rangers debut, but the former England international could not prevent his new side losing 2-1 at Kilmarnock.