fix rst option list at EOF (follow-up #17442)

[a-mr]

#17442 introduced a minor mistake when option list item is immediately finished with EOF without newline (e.g. on Windows) or when .. include directive is used.

Example:

Options:
  --deepcopy    description lastword

truncate -s 1 <file.rst>

[timotheecour]

LGTM, i checked it does fix the bug

@a-mr is this type of bug likely to occur in other parts of rst2html?

[a-mr]

@timotheecour ,

yes, IIRC there was a a few similar bugs. One of this is PR #17014 (easy part of #16990). Like here everything was good when tested manually, that is in standalone rst files hand-edited on Unix, but the bug manifested in docstrings (or on Windows) — where there is no newline character after last line. That's why it's that evasive.

Probably we need a more systematic testing for such edge cases.

Now I think that there is probably a point in adding newline manually to the seq of tokens (tkIndent before tkEof), that would solve most, if not all, such problems.

[timotheecour]

Now I think that there is probably a point in adding newline manually to the seq of tokens (tkIndent before tkEof), that would solve most, if not all, such problems.

that's exactly what i was going to suggest :) maybe followup PR?