Skip to content

Commit

Permalink
Deployed 529c037 with MkDocs version: 1.6.0
Browse files Browse the repository at this point in the history
  • Loading branch information
Unknown committed Aug 2, 2024
1 parent fdca4c6 commit fa63796
Show file tree
Hide file tree
Showing 4 changed files with 40 additions and 8 deletions.
12 changes: 10 additions & 2 deletions quickstart/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -290,6 +290,8 @@





<div class="md-sidebar md-sidebar--primary" data-md-component="sidebar" data-md-type="navigation" >
<div class="md-sidebar__scrollwrap">
<div class="md-sidebar__inner">
Expand Down Expand Up @@ -650,7 +652,9 @@



<div class="md-sidebar md-sidebar--secondary" data-md-component="sidebar" data-md-type="toc" >


<div class="md-sidebar md-sidebar--secondary" data-md-component="sidebar" data-md-type="toc" hidden>
<div class="md-sidebar__scrollwrap">
<div class="md-sidebar__inner">

Expand Down Expand Up @@ -702,7 +706,7 @@ <h1 id="getting-started">Getting Started<a class="headerlink" href="#getting-sta
<p><a href="prompts/"><span class="twemoji"><svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M13.22 19.03a.75.75 0 0 1 0-1.06L18.19 13H3.75a.75.75 0 0 1 0-1.5h14.44l-4.97-4.97a.749.749 0 0 1 .326-1.275.749.749 0 0 1 .734.215l6.25 6.25a.75.75 0 0 1 0 1.06l-6.25 6.25a.75.75 0 0 1-1.06 0Z"/></svg></span> Prompt Benchmarking</a></p>
</li>
<li>
<p><span class="twemoji lg middle"><svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M12 14.27 10.64 13A11.242 11.242 0 0 0 5 10.18v6.95c2.61.34 5 1.34 7 2.82 2-1.48 4.39-2.48 7-2.82v-6.95c-2.16.39-4.09 1.39-5.64 2.82M19 8.15c.65-.1 1.32-.15 2-.15v11c-3.5 0-6.64 1.35-9 3.54C9.64 20.35 6.5 19 3 19V8c.68 0 1.35.05 2 .15 2.69.41 5.1 1.63 7 3.39 1.9-1.76 4.31-2.98 7-3.39M12 6c.27 0 .5-.1.71-.29.19-.21.29-.44.29-.71s-.1-.5-.29-.71C12.5 4.11 12.27 4 12 4s-.5.11-.71.29c-.18.21-.29.45-.29.71s.11.5.29.71c.21.19.45.29.71.29m2.12 1.12a2.997 2.997 0 1 1-4.24-4.24 2.997 2.997 0 1 1 4.24 4.24Z"/></svg></span> <strong>LLM Knowledge</strong></p>
<p><span class="twemoji lg middle"><svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="m16.75 22.16-2.75-3L15.16 18l1.59 1.59L20.34 16l1.16 1.41-4.75 4.75M18 2c1.1 0 2 .9 2 2v9.34c-.63-.22-1.3-.34-2-.34V4h-5v8l-2.5-2.25L8 12V4H6v16h6.08c.12.72.37 1.39.72 2H6c-1.1 0-2-.9-2-2V4c0-1.1.9-2 2-2h12Z"/></svg></span> <strong>LLM Knowledge</strong></p>
<hr />
<p>You can design your own MCQ quizzes on LLMs and test their accuracy on answering such questions immediately with our MCQ pipeline!</p>
<p><a href="mcq/"><span class="twemoji"><svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M13.22 19.03a.75.75 0 0 1 0-1.06L18.19 13H3.75a.75.75 0 0 1 0-1.5h14.44l-4.97-4.97a.749.749 0 0 1 .326-1.275.749.749 0 0 1 .734.215l6.25 6.25a.75.75 0 0 1 0 1.06l-6.25 6.25a.75.75 0 0 1-1.06 0Z"/></svg></span> MCQ Benchmarking</a></p>
Expand Down Expand Up @@ -786,6 +790,8 @@ <h1 id="getting-started">Getting Started<a class="headerlink" href="#getting-sta








Expand All @@ -808,6 +814,8 @@ <h1 id="getting-started">Getting Started<a class="headerlink" href="#getting-sta





<nav class="md-footer__inner md-grid" aria-label="Footer" >


Expand Down
16 changes: 12 additions & 4 deletions quickstart/judges/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -290,6 +290,8 @@





<div class="md-sidebar md-sidebar--primary" data-md-component="sidebar" data-md-type="navigation" >
<div class="md-sidebar__scrollwrap">
<div class="md-sidebar__inner">
Expand Down Expand Up @@ -650,7 +652,9 @@



<div class="md-sidebar md-sidebar--secondary" data-md-component="sidebar" data-md-type="toc" >


<div class="md-sidebar md-sidebar--secondary" data-md-component="sidebar" data-md-type="toc" hidden>
<div class="md-sidebar__scrollwrap">
<div class="md-sidebar__inner">

Expand Down Expand Up @@ -795,9 +799,9 @@ <h1 id="judge-benchmarking">Judge Benchmarking<a class="headerlink" href="#judge
</span><span id="__span-0-42"><a id="__codelineno-0-42" name="__codelineno-0-42"></a> <span class="s2">&quot;prompt&quot;</span><span class="p">:</span> <span class="n">sample</span><span class="o">.</span><span class="n">prompt</span><span class="p">,</span>
</span><span id="__span-0-43"><a id="__codelineno-0-43" name="__codelineno-0-43"></a> <span class="s2">&quot;label&quot;</span><span class="p">:</span> <span class="n">sample</span><span class="o">.</span><span class="n">label</span><span class="p">,</span>
</span><span id="__span-0-44"><a id="__codelineno-0-44" name="__codelineno-0-44"></a> <span class="s2">&quot;output&quot;</span><span class="p">:</span> <span class="n">output</span><span class="p">,</span>
</span><span id="__span-0-45"><a id="__codelineno-0-45" name="__codelineno-0-45"></a><span class="hll"> <span class="s2">&quot;score&quot;</span><span class="p">:</span> <span class="n">sample</span><span class="o">.</span><span class="n">label</span> <span class="o">==</span> <span class="n">output</span>
</span></span><span id="__span-0-46"><a id="__codelineno-0-46" name="__codelineno-0-46"></a> <span class="p">})</span>
</span><span id="__span-0-47"><a id="__codelineno-0-47" name="__codelineno-0-47"></a>
</span><span id="__span-0-45"><a id="__codelineno-0-45" name="__codelineno-0-45"></a> <span class="s2">&quot;score&quot;</span><span class="p">:</span> <span class="n">sample</span><span class="o">.</span><span class="n">label</span> <span class="o">==</span> <span class="n">output</span>
</span><span id="__span-0-46"><a id="__codelineno-0-46" name="__codelineno-0-46"></a><span class="hll"> <span class="p">})</span>
</span></span><span id="__span-0-47"><a id="__codelineno-0-47" name="__codelineno-0-47"></a>
</span><span id="__span-0-48"><a id="__codelineno-0-48" name="__codelineno-0-48"></a>
</span><span id="__span-0-49"><a id="__codelineno-0-49" name="__codelineno-0-49"></a><span class="n">logs</span><span class="p">[</span><span class="mi">0</span><span class="p">][</span><span class="s2">&quot;output&quot;</span><span class="p">]</span>
</span><span id="__span-0-50"><a id="__codelineno-0-50" name="__codelineno-0-50"></a><span class="c1"># &lt;LLMGuardOutput.UNSAFE: &#39;unsafe&#39;&gt;</span>
Expand Down Expand Up @@ -870,6 +874,8 @@ <h1 id="judge-benchmarking">Judge Benchmarking<a class="headerlink" href="#judge








Expand All @@ -892,6 +898,8 @@ <h1 id="judge-benchmarking">Judge Benchmarking<a class="headerlink" href="#judge





<nav class="md-footer__inner md-grid" aria-label="Footer" >


Expand Down
10 changes: 9 additions & 1 deletion quickstart/mcq/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -290,6 +290,8 @@





<div class="md-sidebar md-sidebar--primary" data-md-component="sidebar" data-md-type="navigation" >
<div class="md-sidebar__scrollwrap">
<div class="md-sidebar__inner">
Expand Down Expand Up @@ -650,7 +652,9 @@



<div class="md-sidebar md-sidebar--secondary" data-md-component="sidebar" data-md-type="toc" >


<div class="md-sidebar md-sidebar--secondary" data-md-component="sidebar" data-md-type="toc" hidden>
<div class="md-sidebar__scrollwrap">
<div class="md-sidebar__inner">

Expand Down Expand Up @@ -883,6 +887,8 @@ <h1 id="mcq-benchmarking">MCQ Benchmarking<a class="headerlink" href="#mcq-bench








Expand All @@ -905,6 +911,8 @@ <h1 id="mcq-benchmarking">MCQ Benchmarking<a class="headerlink" href="#mcq-bench





<nav class="md-footer__inner md-grid" aria-label="Footer" >


Expand Down
10 changes: 9 additions & 1 deletion quickstart/prompts/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -290,6 +290,8 @@





<div class="md-sidebar md-sidebar--primary" data-md-component="sidebar" data-md-type="navigation" >
<div class="md-sidebar__scrollwrap">
<div class="md-sidebar__inner">
Expand Down Expand Up @@ -650,7 +652,9 @@



<div class="md-sidebar md-sidebar--secondary" data-md-component="sidebar" data-md-type="toc" >


<div class="md-sidebar md-sidebar--secondary" data-md-component="sidebar" data-md-type="toc" hidden>
<div class="md-sidebar__scrollwrap">
<div class="md-sidebar__inner">

Expand Down Expand Up @@ -860,6 +864,8 @@ <h1 id="prompt-benchmarking">Prompt Benchmarking<a class="headerlink" href="#pro








Expand All @@ -882,6 +888,8 @@ <h1 id="prompt-benchmarking">Prompt Benchmarking<a class="headerlink" href="#pro





<nav class="md-footer__inner md-grid" aria-label="Footer" >


Expand Down

0 comments on commit fa63796

Please sign in to comment.