I pay my bills online. The interface for the bill paying system is a tragedy, as you might expect from a bank. But it's not entirely accidental. Banks inconvenience their customers for a reason.
For example, I would like the option of automatically debiting my checking account every month to pay off my credit card balance just before it is due. The system could easily send me a courtesy e-mail warning me the transfer was about to happen, in case I changed my mind. And if I didn't have enough money in my checking account, it could warn me by e-mail and abort the transfer. This system would save me time and avoid late fees on my credit card.
You won't be seeing that feature anytime soon. Banks and credit card companies make a lot of money from late fees. They have a naked interest in keeping their service as inconvenient as possible. My bank doesn't even offer a check box option for paying the entire balance on my credit card. Instead I need to write down the balance from one screen, or try to memorize it, until the screen appears where I can enter that figure. In other words, they even make money from my typos. It's totally intentional. Bastards. That trap has worked on me several times.
If consumers mattered, your bank would offer one retail product. It would be part checking account and part credit card. And by that I mean your balance could either be above zero or below zero at any given point. When your balance is below zero, you pay interest to the bank. When it is above zero, the bank pays you interest. You'd have one plastic card that does what your ATM and your credit card does now.
If you needed more credit, you could secure your account with your home equity. That way you wouldn't have multiple types of credit with the same bank, where the bank hopes you misplace at least one of their bills so they get the late fee.
Banks might argue that they can't offer that sort of product for regulatory reasons. But I haven't seen a bank shy away from trying to influence regulators when it works for them.
Did I say bastards yet?
(P.S. I started my career at a bank. And that's where Dilbert was born.)