Code

feat: LLM Extraction (mvp)#90

Code

Merged

nickscamara merged 18 commits intomainmendableai/firecrawl:mainfrom llm-extractionmendableai/firecrawl:llm-extractionCopy head branch name to clipboardApr 30, 2024

+616-253

Commits

Commits on Apr 28, 2024

• Caleb: initially pulled inspiration code from https://github.com/mishushakov/llm-scraper

  calebpeffer

  committed
  6ee1f2d

  Copy full SHA for 6ee1f2d

• Caleb: got it to a testable state I believe

  calebpeffer

  committed
  0649772

  Copy full SHA for 0649772

Commits on Apr 29, 2024

• Caleb: first test passing

  calebpeffer

  committed
  2ad7a58

  Copy full SHA for 2ad7a58

• Caleb: converted llm response to json

  calebpeffer

  committed
  667f740

  Copy full SHA for 667f740

• Merge branch 'main' into llm-extraction

  nickscamara

  committed
  b69feab

  Copy full SHA for b69feab

• Caleb: added ajv json schema validation.

  calebpeffer

  committed
  4f7737c

  Copy full SHA for 4f7737c

• Merge branch 'llm-extraction' of https://github.com/mendableai/firecrawl into llm-extraction

  calebpeffer

  committed
  79cd7d2

  Copy full SHA for 79cd7d2

Commits on Apr 30, 2024

• Caleb: trying to get loggin workng

  calebpeffer

  committed
  3ca9e51

  Copy full SHA for 3ca9e51

• Caleb: logs work

  calebpeffer

  committed
  a32f2b3

  Copy full SHA for a32f2b3

• Caleb: commented out massive test

  calebpeffer

  committed
  ad9c8e7

  Copy full SHA for ad9c8e7

• Caleb: switched back to markdown for extraction

  calebpeffer

  committed
  d1235a0

  Copy full SHA for d1235a0

• Caleb:

  calebpeffer

  committed
  d9d206a

  Copy full SHA for d9d206a

• Nick: cleanup

  nickscamara

  committed
  4f526cf

  Copy full SHA for 4f526cf

• Merge branch 'main' into llm-extraction

  nickscamara

  committed
  cbd9e88

  Copy full SHA for cbd9e88

• Nick: improvements

  nickscamara

  committed
  3c7030d

  Copy full SHA for 3c7030d

• Update scrape.ts

  nickscamara

  committed
  dfcf39f

  Copy full SHA for dfcf39f

• Update scrape.ts

  nickscamara

  committed
  a386259

  Copy full SHA for a386259

• Update single_url.ts

  nickscamara

  committed
  768166b

  Copy full SHA for 768166b