Go to File maintenance then 'corrections' and find the invoice, then you can delete it. If it has had VAT reconciled against it then you will have to put a credit on to get rid of it.
This doesn't seem to be an option as the invoices are not showing in corrections (although they are showing as outstanding on debtors report). Any thoughts of what else I could do?