I realized that the windows binaries (e.g. PHP 8.1.0 (cli) (built: Nov 23 2021 21:46:10) (NTS Visual C++ 2019 x64), downloaded from the official website do not contain all readline_ functions that are explained in the documentation.
It seems, the following are missing:

• readline_callback_handler_install
• readline_callback_handler_remove
• readline_callback_read_char
• readline_on_new_line
• readline_redisplay

I'm not sure if there is an issue with the compilated binary. Or if those functions are not available on windows. If so, this should be stated in the docs.