Yes. We do not lock the USB sticks so you are free to add to or remove the content from the USB sticks. Where possible we offer the audiobook you purchased as a digital download too. So if you remove the audiobook from the USB stick without backing it up first you can always download it again from our site.
If this is not the case, we will let you know.