I use Emigrant Direct and currently get 5.15% on a savings account, but they don't offer bill-pay. You connect with a regular checking account (from which you could do bill-pay).