The Conservatives have ruled out doing a pact with "any other party" as questions swirl around who could win power at the next general election.