Skip to content

Commit

Permalink
Built site for gh-pages
Browse files Browse the repository at this point in the history
  • Loading branch information
aisi-inspect committed Apr 30, 2024
1 parent 44502c4 commit 488f362
Show file tree
Hide file tree
Showing 12 changed files with 61 additions and 54 deletions.
2 changes: 1 addition & 1 deletion .nojekyll
Original file line number Diff line number Diff line change
@@ -1 +1 @@
c01810e3
f90a6aa6
Binary file modified Inspect.docx
Binary file not shown.
Binary file modified Inspect.epub
Binary file not shown.
Binary file modified Inspect.pdf
Binary file not shown.
2 changes: 1 addition & 1 deletion eval-logs.html
Original file line number Diff line number Diff line change
Expand Up @@ -1003,7 +1003,7 @@ <h3 class="anchored" data-anchor-id="reading-logs">Reading Logs</h3>
</div>
</div>
</footer>
<script>var lightboxQuarto = GLightbox({"selector":".lightbox","openEffect":"zoom","closeEffect":"zoom","loop":false,"descPosition":"bottom"});
<script>var lightboxQuarto = GLightbox({"loop":false,"descPosition":"bottom","openEffect":"zoom","selector":".lightbox","closeEffect":"zoom"});
window.onload = () => {
lightboxQuarto.on('slide_before_load', (data) => {
const { slideIndex, slideNode, slideConfig, player, trigger } = data;
Expand Down
34 changes: 17 additions & 17 deletions examples.html

Large diffs are not rendered by default.

Binary file added images/inspect-view-splash.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
41 changes: 24 additions & 17 deletions index.html
Original file line number Diff line number Diff line change
Expand Up @@ -114,7 +114,7 @@
<meta name="twitter:card" content="summary">
</head>

<body class="nav-sidebar floating">
<body class="nav-sidebar floating fullcontent">

<div id="quarto-search-results"></div>
<header id="quarto-header" class="headroom fixed-top">
Expand Down Expand Up @@ -274,25 +274,14 @@
</nav>
<div id="quarto-sidebar-glass" class="quarto-sidebar-collapse-item" data-bs-toggle="collapse" data-bs-target=".quarto-sidebar-collapse-item"></div>
<!-- margin-sidebar -->
<div id="quarto-margin-sidebar" class="sidebar margin-sidebar">
<nav id="TOC" role="doc-toc" class="toc-active">
<h2 id="toc-title">Table of contents</h2>

<ul>
<li><a href="#welcome" id="toc-welcome" class="nav-link active" data-scroll-target="#welcome">Welcome</a></li>
<li><a href="#getting-started" id="toc-getting-started" class="nav-link" data-scroll-target="#getting-started">Getting Started</a></li>
<li><a href="#sec-hello-inspect" id="toc-sec-hello-inspect" class="nav-link" data-scroll-target="#sec-hello-inspect">Hello, Inspect</a></li>
<li><a href="#learning-more" id="toc-learning-more" class="nav-link" data-scroll-target="#learning-more">Learning More</a></li>
</ul>
<div class="toc-actions"><ul><li><a href="https://github.com/UKGovernmentBEIS/inspect_ai/issues/new" class="toc-action"><i class="bi bi-github"></i>Report an issue</a></li></ul></div></nav>
</div>

<!-- main -->
<main class="content" id="quarto-document-content">

<header id="title-block-header" class="quarto-title-block default">
<div class="quarto-title">
<h1 class="title">Inspect</h1>
<p class="subtitle lead">A framework for large language model evaluations</p>
<p class="subtitle lead">An open-source framework for large language model evaluations</p>
</div>


Expand All @@ -309,6 +298,24 @@ <h1 class="title">Inspect</h1>
</header>


<div>

</div>
<div class="splash quarto-layout-panel" data-layout="[45,55]">
<div class="quarto-layout-row">
<div class="quarto-layout-cell" style="flex-basis: 45.0%;justify-content: flex-start;">
<ul>
<li><p>Easy creation of simple benchmark-style evaluations.</p></li>
<li><p>Scale up to more sophsisticated evals with multi-turn dialog, agent scaffolds and model grading.</p></li>
<li><p>Interactive workflows for researchers; production workflows for larger evaluation suites.</p></li>
<li><p>Adapt and extend the framework with custom Python components.</p></li>
</ul>
</div>
<div class="quarto-layout-cell" style="flex-basis: 55.0%;justify-content: center;">
<p><a href="images/inspect-view-splash.png" class="lightbox" data-gallery="quarto-lightbox-gallery-1"><img src="images/inspect-view-splash.png" class="border img-fluid"></a></p>
</div>
</div>
</div>
<section id="welcome" class="level2">
<h2 class="anchored" data-anchor-id="welcome">Welcome</h2>
<p>Welcome to Inspect, a framework for large language model evaluations created by the <a href="https://www.gov.uk/government/organisations/ai-safety-institute">UK AI Safety Institute</a>.</p>
Expand Down Expand Up @@ -429,7 +436,7 @@ <h2 class="anchored" data-anchor-id="sec-hello-inspect">Hello, Inspect</h2>
<p>By default, eval logs are written to the <code>./logs</code> sub-directory of the current working directory. When the eval is complete you will find a link to the log at the bottom of the task results summary.</p>
<p>You can also explore eval results using the Inspect log viewer. Run <code>inspect view</code> to open the viewer (you only need to do this once as the viewer will automatically updated when new evals are run):</p>
<div class="sourceCode" id="cb9"><pre class="sourceCode bash code-with-copy"><code class="sourceCode bash"><span id="cb9-1"><a href="#cb9-1" aria-hidden="true" tabindex="-1"></a><span class="ex">$</span> inspect view</span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
<p><a href="images/inspect-view-home.png" class="lightbox" data-gallery="quarto-lightbox-gallery-1"><img src="images/inspect-view-home.png" class="border img-fluid"></a></p>
<p><a href="images/inspect-view-home.png" class="lightbox" data-gallery="quarto-lightbox-gallery-2"><img src="images/inspect-view-home.png" class="border img-fluid"></a></p>
<p>See the <a href="log-viewer.html">Log Viewer</a> section for additional details on using Inspect View.</p>
<div class="callout callout-style-simple callout-note">
<div class="callout-body d-flex">
Expand Down Expand Up @@ -941,7 +948,7 @@ <h2 class="anchored" data-anchor-id="learning-more">Learning More</h2>
</a>
</li>
</ul>
<div class="toc-actions d-sm-block d-md-none"><ul><li><a href="https://github.com/UKGovernmentBEIS/inspect_ai/issues/new" class="toc-action"><i class="bi bi-github"></i>Report an issue</a></li></ul></div></div>
<div class="toc-actions"><ul><li><a href="https://github.com/UKGovernmentBEIS/inspect_ai/issues/new" class="toc-action"><i class="bi bi-github"></i>Report an issue</a></li></ul></div></div>
<div class="nav-footer-right">
<ul class="footer-items list-unstyled">
<li class="nav-item compact">
Expand All @@ -960,7 +967,7 @@ <h2 class="anchored" data-anchor-id="learning-more">Learning More</h2>
</div>
</div>
</footer>
<script>var lightboxQuarto = GLightbox({"closeEffect":"zoom","openEffect":"zoom","descPosition":"bottom","loop":false,"selector":".lightbox"});
<script>var lightboxQuarto = GLightbox({"closeEffect":"zoom","loop":false,"descPosition":"bottom","openEffect":"zoom","selector":".lightbox"});
window.onload = () => {
lightboxQuarto.on('slide_before_load', (data) => {
const { slideIndex, slideNode, slideConfig, player, trigger } = data;
Expand Down
2 changes: 1 addition & 1 deletion log-viewer.html
Original file line number Diff line number Diff line change
Expand Up @@ -911,7 +911,7 @@ <h2 class="anchored" data-anchor-id="task-information">Task Information</h2>
</div>
</div>
</footer>
<script>var lightboxQuarto = GLightbox({"openEffect":"zoom","closeEffect":"zoom","selector":".lightbox","loop":false,"descPosition":"bottom"});
<script>var lightboxQuarto = GLightbox({"closeEffect":"zoom","descPosition":"bottom","selector":".lightbox","loop":false,"openEffect":"zoom"});
window.onload = () => {
lightboxQuarto.on('slide_before_load', (data) => {
const { slideIndex, slideNode, slideConfig, player, trigger } = data;
Expand Down
2 changes: 1 addition & 1 deletion site_libs/bootstrap/bootstrap.min.css

Large diffs are not rendered by default.

30 changes: 15 additions & 15 deletions sitemap.xml
Original file line number Diff line number Diff line change
Expand Up @@ -2,62 +2,62 @@
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
<url>
<loc>https://UKGovernmentBEIS.github.io/inspect_ai/index.html</loc>
<lastmod>2024-04-28T15:26:03.659Z</lastmod>
<lastmod>2024-04-30T13:38:57.549Z</lastmod>
</url>
<url>
<loc>https://UKGovernmentBEIS.github.io/inspect_ai/workflow.html</loc>
<lastmod>2024-04-28T20:12:11.379Z</lastmod>
<lastmod>2024-04-29T08:50:25.135Z</lastmod>
</url>
<url>
<loc>https://UKGovernmentBEIS.github.io/inspect_ai/log-viewer.html</loc>
<lastmod>2024-04-28T20:12:14.619Z</lastmod>
<lastmod>2024-04-29T08:50:25.131Z</lastmod>
</url>
<url>
<loc>https://UKGovernmentBEIS.github.io/inspect_ai/examples.html</loc>
<lastmod>2024-04-28T20:46:49.664Z</lastmod>
<lastmod>2024-04-30T13:41:23.182Z</lastmod>
</url>
<url>
<loc>https://UKGovernmentBEIS.github.io/inspect_ai/solvers.html</loc>
<lastmod>2024-04-28T15:26:03.659Z</lastmod>
<lastmod>2024-04-29T08:50:25.131Z</lastmod>
</url>
<url>
<loc>https://UKGovernmentBEIS.github.io/inspect_ai/tools.html</loc>
<lastmod>2024-04-27T07:34:32.328Z</lastmod>
<lastmod>2024-04-29T08:48:40.155Z</lastmod>
</url>
<url>
<loc>https://UKGovernmentBEIS.github.io/inspect_ai/scorers.html</loc>
<lastmod>2024-04-26T17:03:35.127Z</lastmod>
<lastmod>2024-04-29T08:48:40.155Z</lastmod>
</url>
<url>
<loc>https://UKGovernmentBEIS.github.io/inspect_ai/datasets.html</loc>
<lastmod>2024-04-27T14:07:40.575Z</lastmod>
<lastmod>2024-04-29T08:50:25.111Z</lastmod>
</url>
<url>
<loc>https://UKGovernmentBEIS.github.io/inspect_ai/models.html</loc>
<lastmod>2024-04-28T20:12:14.623Z</lastmod>
<lastmod>2024-04-29T08:50:25.131Z</lastmod>
</url>
<url>
<loc>https://UKGovernmentBEIS.github.io/inspect_ai/eval-logs.html</loc>
<lastmod>2024-04-28T20:12:11.375Z</lastmod>
<lastmod>2024-04-29T08:50:25.111Z</lastmod>
</url>
<url>
<loc>https://UKGovernmentBEIS.github.io/inspect_ai/eval-suites.html</loc>
<lastmod>2024-04-28T15:26:03.635Z</lastmod>
<lastmod>2024-04-29T08:50:25.111Z</lastmod>
</url>
<url>
<loc>https://UKGovernmentBEIS.github.io/inspect_ai/eval-tuning.html</loc>
<lastmod>2024-04-22T06:29:19.918Z</lastmod>
<lastmod>2024-04-29T08:48:40.139Z</lastmod>
</url>
<url>
<loc>https://UKGovernmentBEIS.github.io/inspect_ai/Inspect.pdf</loc>
<lastmod>2024-04-28T20:47:41.476Z</lastmod>
<lastmod>2024-04-30T13:42:06.134Z</lastmod>
</url>
<url>
<loc>https://UKGovernmentBEIS.github.io/inspect_ai/Inspect.docx</loc>
<lastmod>2024-04-28T20:47:46.836Z</lastmod>
<lastmod>2024-04-30T13:42:10.902Z</lastmod>
</url>
<url>
<loc>https://UKGovernmentBEIS.github.io/inspect_ai/Inspect.epub</loc>
<lastmod>2024-04-28T20:47:53.080Z</lastmod>
<lastmod>2024-04-30T13:42:16.422Z</lastmod>
</url>
</urlset>
2 changes: 1 addition & 1 deletion workflow.html
Original file line number Diff line number Diff line change
Expand Up @@ -1056,7 +1056,7 @@ <h2 class="anchored" data-anchor-id="eval-suites">Eval Suites</h2>
</div>
</div>
</footer>
<script>var lightboxQuarto = GLightbox({"closeEffect":"zoom","selector":".lightbox","descPosition":"bottom","openEffect":"zoom","loop":false});
<script>var lightboxQuarto = GLightbox({"loop":false,"descPosition":"bottom","selector":".lightbox","openEffect":"zoom","closeEffect":"zoom"});
window.onload = () => {
lightboxQuarto.on('slide_before_load', (data) => {
const { slideIndex, slideNode, slideConfig, player, trigger } = data;
Expand Down

0 comments on commit 488f362

Please sign in to comment.