Having a material name with one or more of the following illegal windows characters in it will fail on the DXF/PNG export with an error message "Error Exporting: Illegal characters in path".
\ / : * ? " < > |
As a workaround, removing these characters from the material name fixes the export