Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Has anyone got this working? It seems not to #22

Open
CaelumF opened this issue Sep 8, 2024 · 1 comment
Open

Has anyone got this working? It seems not to #22

CaelumF opened this issue Sep 8, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@CaelumF
Copy link

CaelumF commented Sep 8, 2024

What is the issue?

I spent a lot of time trying to get this to work and it seems it just doesn't, others are having issues too. I am wondering what conditions it works under.

It seems unable to be built on mac, after adding fopenmp it shows set num thread errors. On linux the build can't run models. Has anyone at all got it working? under what conditions?

I am posting it in this issue page for visibility to avoid others from wasting time if it just doesn't work (to me the docs kind of imply a level of workingness which isn't there)

OS

Linux, macOS

GPU

Nvidia, Apple

CPU

Intel, AMD, Apple

Ollama version

No response
@CaelumF CaelumF added the bug Something isn't working label Sep 8, 2024
@sheldon123z
Copy link

same, not working at all. Gradio could not run, it prompts "connection errored out"

For further information visit https://errors.pydantic.dev/2.9/u/schema-for-unknown-type
ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/type_adapter.py", line 270, in _init_core_attrs
    self._core_schema = _getattr_no_parents(self._type, '__pydantic_core_schema__')
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/type_adapter.py", line 112, in _getattr_no_parents
    raise AttributeError(attribute)
AttributeError: __pydantic_core_schema__

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/uvicorn/protocols/http/h11_impl.py", line 408, in run_asgi
    result = await app(  # type: ignore[func-returns-value]
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 84, in __call__
    return await self.app(scope, receive, send)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/fastapi/applications.py", line 1054, in __call__
    await super().__call__(scope, receive, send)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/applications.py", line 113, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/middleware/errors.py", line 187, in __call__
    raise exc
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/middleware/errors.py", line 165, in __call__
    await self.app(scope, receive, _send)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/gradio/route_utils.py", line 733, in __call__
    await self.simple_response(scope, receive, send, request_headers=headers)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/gradio/route_utils.py", line 749, in simple_response
    await self.app(scope, receive, send)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app
    raise exc
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app
    await app(scope, receive, sender)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/routing.py", line 715, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/routing.py", line 735, in app
    await route.handle(scope, receive, send)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/routing.py", line 288, in handle
    await self.app(scope, receive, send)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/routing.py", line 76, in app
    await wrap_app_handling_exceptions(app, request)(scope, receive, send)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app
    raise exc
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app
    await app(scope, receive, sender)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/routing.py", line 73, in app
    response = await f(request)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/fastapi/routing.py", line 291, in app
    solved_result = await solve_dependencies(
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/fastapi/dependencies/utils.py", line 656, in solve_dependencies
    ) = await request_body_to_args(  # body_params checked above
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/fastapi/dependencies/utils.py", line 881, in request_body_to_args
    fields_to_extract = get_cached_model_fields(first_field.type_)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/fastapi/_compat.py", line 657, in get_cached_model_fields
    return get_model_fields(model)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/fastapi/_compat.py", line 284, in get_model_fields
    return [
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/fastapi/_compat.py", line 285, in <listcomp>
    ModelField(field_info=field_info, name=name)
  File "<string>", line 6, in __init__
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/fastapi/_compat.py", line 110, in __post_init__
    self._type_adapter: TypeAdapter[Any] = TypeAdapter(
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/type_adapter.py", line 257, in __init__
    self._init_core_attrs(rebuild_mocks=False)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/type_adapter.py", line 135, in wrapped
    return func(self, *args, **kwargs)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/type_adapter.py", line 277, in _init_core_attrs
    self._core_schema = _get_schema(self._type, config_wrapper, parent_depth=self._parent_depth)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/type_adapter.py", line 95, in _get_schema
    schema = gen.generate_schema(type_)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 655, in generate_schema
    schema = self._generate_schema_inner(obj)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 908, in _generate_schema_inner
    return self._annotated_schema(obj)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 2028, in _annotated_schema
    schema = self._apply_annotations(source_type, annotations)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 2107, in _apply_annotations
    schema = get_inner_schema(source_type)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_schema_generation_shared.py", line 83, in __call__
    schema = self._handler(source_type)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 2189, in new_handler
    schema = metadata_get_schema(source, get_inner_schema)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 2185, in <lambda>
    lambda source, handler: handler(source)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_schema_generation_shared.py", line 83, in __call__
    schema = self._handler(source_type)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 2088, in inner_handler
    schema = self._generate_schema_inner(obj)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 929, in _generate_schema_inner
    return self.match_type(obj)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 1029, in match_type
    return self._match_generic_type(obj, origin)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 1058, in _match_generic_type
    return self._union_schema(obj)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 1378, in _union_schema
    choices.append(self.generate_schema(arg))
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 655, in generate_schema
    schema = self._generate_schema_inner(obj)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 929, in _generate_schema_inner
    return self.match_type(obj)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 1038, in match_type
    return self._unknown_type_schema(obj)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 558, in _unknown_type_schema
    raise PydanticSchemaGenerationError(
pydantic.errors.PydanticSchemaGenerationError: Unable to generate pydantic-core schema for <class 'starlette.requests.Request'>. Set `arbitrary_types_allowed=True` in the model_config to ignore this error or implement `__get_pydantic_core_schema__` on your type to fully support it.

If you got this error by calling handler(<some type>) within `__get_pydantic_core_schema__` then you likely need to call `handler.generate_schema(<some type>)` since we do not call `__get_pydantic_core_schema__` on `<some type>` otherwise to avoid infinite recursion.

For further information visit https://errors.pydantic.dev/2.9/u/schema-for-unknown-type
ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/type_adapter.py", line 270, in _init_core_attrs
    self._core_schema = _getattr_no_parents(self._type, '__pydantic_core_schema__')
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/type_adapter.py", line 112, in _getattr_no_parents
    raise AttributeError(attribute)
AttributeError: __pydantic_core_schema__

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/uvicorn/protocols/http/h11_impl.py", line 408, in run_asgi
    result = await app(  # type: ignore[func-returns-value]
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 84, in __call__
    return await self.app(scope, receive, send)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/fastapi/applications.py", line 1054, in __call__
    await super().__call__(scope, receive, send)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/applications.py", line 113, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/middleware/errors.py", line 187, in __call__
    raise exc
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/middleware/errors.py", line 165, in __call__
    await self.app(scope, receive, _send)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/gradio/route_utils.py", line 733, in __call__
    await self.simple_response(scope, receive, send, request_headers=headers)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/gradio/route_utils.py", line 749, in simple_response
    await self.app(scope, receive, send)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app
    raise exc
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app
    await app(scope, receive, sender)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/routing.py", line 715, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/routing.py", line 735, in app
    await route.handle(scope, receive, send)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/routing.py", line 288, in handle
    await self.app(scope, receive, send)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/routing.py", line 76, in app
    await wrap_app_handling_exceptions(app, request)(scope, receive, send)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app
    raise exc
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app
    await app(scope, receive, sender)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/starlette/routing.py", line 73, in app
    response = await f(request)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/fastapi/routing.py", line 291, in app
    solved_result = await solve_dependencies(
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/fastapi/dependencies/utils.py", line 656, in solve_dependencies
    ) = await request_body_to_args(  # body_params checked above
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/fastapi/dependencies/utils.py", line 881, in request_body_to_args
    fields_to_extract = get_cached_model_fields(first_field.type_)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/fastapi/_compat.py", line 657, in get_cached_model_fields
    return get_model_fields(model)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/fastapi/_compat.py", line 284, in get_model_fields
    return [
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/fastapi/_compat.py", line 285, in <listcomp>
    ModelField(field_info=field_info, name=name)
  File "<string>", line 6, in __init__
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/fastapi/_compat.py", line 110, in __post_init__
    self._type_adapter: TypeAdapter[Any] = TypeAdapter(
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/type_adapter.py", line 257, in __init__
    self._init_core_attrs(rebuild_mocks=False)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/type_adapter.py", line 135, in wrapped
    return func(self, *args, **kwargs)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/type_adapter.py", line 277, in _init_core_attrs
    self._core_schema = _get_schema(self._type, config_wrapper, parent_depth=self._parent_depth)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/type_adapter.py", line 95, in _get_schema
    schema = gen.generate_schema(type_)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 655, in generate_schema
    schema = self._generate_schema_inner(obj)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 908, in _generate_schema_inner
    return self._annotated_schema(obj)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 2028, in _annotated_schema
    schema = self._apply_annotations(source_type, annotations)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 2107, in _apply_annotations
    schema = get_inner_schema(source_type)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_schema_generation_shared.py", line 83, in __call__
    schema = self._handler(source_type)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 2189, in new_handler
    schema = metadata_get_schema(source, get_inner_schema)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 2185, in <lambda>
    lambda source, handler: handler(source)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_schema_generation_shared.py", line 83, in __call__
    schema = self._handler(source_type)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 2088, in inner_handler
    schema = self._generate_schema_inner(obj)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 929, in _generate_schema_inner
    return self.match_type(obj)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 1029, in match_type
    return self._match_generic_type(obj, origin)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 1058, in _match_generic_type
    return self._union_schema(obj)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 1378, in _union_schema
    choices.append(self.generate_schema(arg))
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 655, in generate_schema
    schema = self._generate_schema_inner(obj)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 929, in _generate_schema_inner
    return self.match_type(obj)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 1038, in match_type
    return self._unknown_type_schema(obj)
  File "/home/zhengxiaodong/miniconda3/envs/MiniCPMV/lib/python3.10/site-packages/pydantic/_internal/_generate_schema.py", line 558, in _unknown_type_schema
    raise PydanticSchemaGenerationError(
pydantic.errors.PydanticSchemaGenerationError: Unable to generate pydantic-core schema for <class 'starlette.requests.Request'>. Set `arbitrary_types_allowed=True` in the model_config to ignore this error or implement `__get_pydantic_core_schema__` on your type to fully support it.

If you got this error by calling handler(<some type>) within `__get_pydantic_core_schema__` then you likely need to call `handler.generate_schema(<some type>)` since we do not call `__get_pydantic_core_schema__` on `<some type>` otherwise to avoid infinite recursion.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@CaelumF @sheldon123z