Skip to content

Commit

Permalink
fix: readme
Browse files Browse the repository at this point in the history
  • Loading branch information
FTAndy committed Nov 30, 2023
1 parent 5c505c7 commit 368cc96
Showing 1 changed file with 5 additions and 1 deletion.
6 changes: 5 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -71,7 +71,11 @@ type Config = {
/** URL to start the crawl, if sitemap is provided then it will be used instead and download all pages in the sitemap */
url: string;
/** Pattern to match against for links on a page to subsequently crawl */
match: string;
match: string | string[] | {
pattern: string;
selector?: string | undefined; // Selector to grab the inner text from
skip?: boolean | undefined; // Whether skip to not grab any content from this pattern
}[];
/** Selector to grab the inner text from */
selector: string;
/** Don't crawl more than this many pages */
Expand Down

0 comments on commit 368cc96

Please sign in to comment.