[ESP32-S3] GPIO High when configured as input regardless of PullUp/Down Setting

[ProfFan]

let mut int_pin = io.pins.gpio15.into_push_pull_output();
int_pin.set_low().unwrap(); // Low

let mut int_pin = int_pin.into_pull_down_input(); // Immediately goes high

On main branch of esp32s3-hal.

Also see #142

[ProfFan]

I guess it's just the internal pull-down is not strong enough in input mode?