Go to CMD, and write del C:\UltimateZip\Pesky.dlls

Or well, write the path that fits, with the file name in it too. CMD doesn't ignore permissions, but sometimes it can do more than Windows can.