New government only seeking to put an end to the corrupt deals made by the previous administration, finance minister says