You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
If we load an invalid URL, it may return the wrong HTML.
But, if the input is expected to be a text file, spider_feeder will just return the HTML rows.
We should add something to avoid it.
It can be a filtering function/regex (and the user can override it) or it can just ignore the URLs that don't start with http/https and log warnings.
The text was updated successfully, but these errors were encountered:
If we load an invalid URL, it may return the wrong HTML.
But, if the input is expected to be a text file,
spider_feeder
will just return the HTML rows.We should add something to avoid it.
It can be a filtering function/regex (and the user can override it) or it can just ignore the URLs that don't start with http/https and log warnings.
The text was updated successfully, but these errors were encountered: