Ruby tests breaking

[jackkamm]

When I tried to run the unit tests today, the ruby tests all broke with errors like:

    (ert-test-failed
     ((should
       (progn
	 (org-babel-execute-src-block)
	 (sleep-for 0 400)
	 (string= ... ...)))
      :form
      (progn
	(org-babel-execute-src-block)
	(sleep-for 0 400)
	(string=
	 (concat src-block result)
	 (buffer-string)))
      :value nil))

When I last tried in October (#2) the tests worked.

I'm running on Archlinux, ruby 2.6.5, irb 1.1.0. When I tried on a Debian VM, the tests still worked. So I suspect a Ruby or IRB update broke something.

Perhaps relatedly, when I run irb, I get the following message:

This version of IRB is drastically different from the previous version.
If you hit any issues, you can use "irb --legacy" to run the old version.
If you want to just erase this message, please use "irb --multiline".
irb(main):001:0> 

[jackkamm]

I think this is caused by this issue: nonsequitur/inf-ruby#128
As a temporary fix, I've pushed f78f898, which marks the ruby tests as expecting failure when irb version >= 1.2.

[tecosaur]

Does this help? nonsequitur/inf-ruby@e4ae089

[jackkamm]

Thanks for pointing out that update to inf-ruby. It seems to partially help, all the :results value tests pass now, but tests for :results output are still failing. I've updated ob-session-async-ruby-test.el accordingly in 0d05267.

An example of a still failing test is ob-session-async-ruby-simple-session-async-output which prints the following when I insert a (print (buffer-string) call:

#+begin_src ruby :async :session ruby :results output
p [1, 2, 3, 4]
#+end_src

#+RESULTS:
: [1, 2, 3, 4]
: => ...
: irb(main):022:0>

i.e., there is an extra trailing prompt in the result.

Strangely, when I execute that block in my normal Emacs config I don't see that error and the result looks correct. With emacs -Q, I initially see this error, but after I execute the block a few times the problem goes away. This is with emacs-27.1 and irb 1.2.7.

I don't normally use ruby (ob-session-async-ruby was contributed by @suonlight ) so any assisstance with testing, debugging, etc would be helpful.