Apparently this is a "Feature" from Safari.
You need to disable the option to automatically open files on download: