I can't say if all Linux distros have this tool, it's likely that the one you use has that drawback, but most have the equivalent of the recycle bin.

This is Ubuntu with the option to restore from the recycle bin:

I'm not sure I understand the question, because any Linux desktop environment has a recycle bin that works exactly the same as the Windows one.