Add text-only model support to M1 #4217

Job	Run time
format	50s
lint	51s
pyright (./packages/autogen-core)	58s
mypy (./packages/autogen-core)	1m 41s
pyright (./packages/agbench)	1m 7s
mypy (./packages/agbench)	1m 13s
pyright (./packages/autogen-ext)	1m 4s
mypy (./packages/autogen-ext)	1m 43s
check-proto-changes-python	1m 24s
pyright (./packages/autogen-agentchat)	1m 16s
mypy (./packages/autogen-agentchat)	1m 27s
pyright (./packages/magentic-one-cli)	1m 5s
mypy (./packages/magentic-one-cli)	1m 35s
docs (./packages/autogen-core)	1m 49s
docs-example-check (./packages/autogen-core)	3m 16s
markdown-code-lint	2m 22s
samples-code-check	1m 9s
test (./packages/autogen-core)	2m 25s
test (./packages/autogen-ext)	2m 55s
test (./packages/autogen-agentchat)	2m 40s
codecov	0s
	32m 50s

Provide feedback