yooli.com: Loginform is not working for a given website

[oltarasenko]

Looks like the problem is that this website does not have form element. Do you think there is a way to handle such cases?

Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/twisted/internet/base.py", line 1178, in mainLoop
self.runUntilCurrent()
File "/usr/lib/python2.7/dist-packages/twisted/internet/base.py", line 800, in runUntilCurrent
call.func(_call.args, *_call.kw)
File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 362, in callback
self._startRunCallbacks(result)
File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 458, in _startRunCallbacks
self._runCallbacks()
--- ---
File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 545, in _runCallbacks
current.result = callback(current.result, _args, *_kw)
File "/usr/lib/pymodules/python2.7/slybot/spider.py", line 119, in parse_login_page
args, url, method = fill_login_form(response.url, response.body, username, password)
File "/usr/lib/python2.7/dist-packages/loginform.py", line 74, in fill_login_form
form = _pick_form(doc.xpath('//form'))
File "/usr/lib/python2.7/dist-packages/loginform.py", line 42, in _pick_form
return sorted(forms, key=_form_score, reverse=True)[0]
exceptions.IndexError: list index out of range

[dangra]

we need more details to debug this issue, a sample html or at least the url to reproduce the error.

[oltarasenko]

Yes, sorry: https://www.yooli.com/secure/login/
And the html is in gist: https://gist.github.com/oltarasenko/2b136b2e3791c0d27f75

[JFluo2011]

Hey man, did you solve this problem? @oltarasenko

[dangra]

The page doesn't contain a FORM element, we can workaround it but the site seems to use javascript to submit the form and includes a verification (captcha?) step. It is unlikely we can automate it in loginform without lot of work.