Once you’ve created a bootable media for the Linux distro and loaded it, you’ll be taken to a full-fat version of the OS.
The simplest and most direct way to permanently delete files or folders is by using the Shift + Delete keyboard shortcut.