You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We should strive to give a more informative message regarding incorrect input encoding. Minimally, we should point the user to the fileand recode utilities. We could also consider allowing them to specify the input encoding as in ./parser_wrapper.sh -e latin1 and pass that to the input sanitizer script.
I would not attempt to autodetect the encoding, though. The libraries needed for that don't seem to be available by default:
We should strive to give a more informative message regarding incorrect input encoding. Minimally, we should point the user to the
file
andrecode
utilities. We could also consider allowing them to specify the input encoding as in./parser_wrapper.sh -e latin1
and pass that to the input sanitizer script.I would not attempt to autodetect the encoding, though. The libraries needed for that don't seem to be available by default:
http://stackoverflow.com/questions/436220/python-is-there-a-way-to-determine-the-encoding-of-text-file
@jmnybl @fginter
The text was updated successfully, but these errors were encountered: