It depends on the program. If you buy Quickbooks, they just give you a file that when you run it, it expands and does the installation for you. You can put it on a USB stick and then take it to another computer and install it.

Yes, of course, many programmes leave an installer on the computer when you download them, of course there are others that don't, but they are few.