Use unsigned bytes to back Buffer #2822

Job	Run time
doctests	1m 13s
os=ubuntu-latest, py=3.11, np=1.25, deps=minimal	5m 43s
os=ubuntu-latest, py=3.11, np=1.25, deps=optional	5m 43s
py=3.11-min_deps	3m 16s
os=ubuntu-latest, py=3.11, np=2.1, deps=minimal	5m 58s
py=3.13-upstream	5m 24s
os=ubuntu-latest, py=3.11, np=2.1, deps=optional	5m 45s
os=ubuntu-latest, py=3.12, np=1.25, deps=minimal	6m 22s
os=ubuntu-latest, py=3.12, np=1.25, deps=optional	6m 33s
os=ubuntu-latest, py=3.12, np=2.1, deps=minimal	6m 31s
os=ubuntu-latest, py=3.12, np=2.1, deps=optional	6m 5s
os=ubuntu-latest, py=3.13, np=1.25, deps=minimal	9m 1s
os=ubuntu-latest, py=3.13, np=1.25, deps=optional	9m 12s
os=ubuntu-latest, py=3.13, np=2.1, deps=minimal	6m 29s
os=ubuntu-latest, py=3.13, np=2.1, deps=optional	6m 17s
os=macos-latest, py=3.11, np=1.25, deps=optional	4m 12s
os=macos-latest, py=3.13, np=2.1, deps=optional	4m 13s
os=windows-latest, py=3.11, np=1.25, deps=optional	10m 34s
os=windows-latest, py=3.13, np=2.1, deps=optional	10m 38s
Test complete	1s
	1h 59m 10s

Provide feedback