While you spend your tax bill, One more detail to take into account is using a tax-filing service that allows you to spend your taxes by credit card. This way you may at least get important credit card benefits and factors when you spend your bill. The IRS has licensed a few payment processors to collect tax payments by credit card: PayUSAtax, Pay1