You need to enter your BIOS/UEFI settings (usually by pressing F2, F12, DEL , or ESC during startup) and change the boot order so your USB drive is the first priority.