Yes, you can undo an import as long as it's within 7 days of approving it.  Simply open the relevant import and click Undo as shown below (click to enlarge the screenshot).  Remember, this will remove all the records you imported, even ones that users have modified.