Skip to content

Commit

Permalink
docs: explain pending_items logic and doc vectorizer_queue_pending func
Browse files Browse the repository at this point in the history
  • Loading branch information
jgpruitt committed Jan 7, 2025
1 parent f283b6c commit 2f2ab9b
Showing 1 changed file with 10 additions and 0 deletions.
10 changes: 10 additions & 0 deletions docs/vectorizer.md
Original file line number Diff line number Diff line change
Expand Up @@ -293,3 +293,13 @@ Sample output:
| 1 | public.blog | public.blog_contents_embedding_store | public.blog_contents_embeddings | 1 |

The `pending_items` column indicates the number of items still awaiting embedding creation.
If the number of pending items exceeds 10,000, we return the maximum value of a bigint (`9223372036854775807`)
instead of exhaustively counting the items. This is done for performance.

Alternately, you can call the `ai.vectorizer_queue_pending` function to get the count of pending items
for a single vectorizer. The `exact_count` parameter is defaulted to `false`, but passing `true`
will exhaustively count the exact number of pending items.

```sql
select ai.vectorizer_queue_pending(1, exact_count=>true);
```

0 comments on commit 2f2ab9b

Please sign in to comment.