Skip to content

Instantly share code, notes, and snippets.

@sarony
Created October 22, 2023 21:09
Show Gist options
  • Save sarony/f447d8002567f5101f93ca5311c990c8 to your computer and use it in GitHub Desktop.
Save sarony/f447d8002567f5101f93ca5311c990c8 to your computer and use it in GitHub Desktop.
open_ai_list_style_nad_final
<ul>
<li class="mb-8 border-b-2 border-gray pb-8">
<h3>
<span class="font-bold mr-2">temperature</span>
<span class="text-gray-500 mr-2 bg-gray-100 px-2 rounded text-xs">number or null</span>
<span class="text-gray-500 mr-2 bg-gray-100 px-2 rounded text-xs">Optional</span>
<span class="text-gray-500 bg-gray-100 px-2 rounded text-xs">Defaults to 1</span>
</h3>
<p class="text-gray-600">
What sampling temperature to use, between 0 and 2. Higher values like 0.8 will make the output more random, while lower values like 0.2 will make it more focused and deterministic.
</p>
<p class="text-gray-600">
We generally recommend altering this or top_p but not both.
</p>
</li>
<li class="mb-8 border-b-2 border-gray pb-8">
<h3>
<span class="font-bold mr-2">top_p</span>
<span class="text-gray-500 mr-2 bg-gray-100 px-2 rounded text-xs">number or null</span>
<span class="text-gray-500 mr-2 bg-gray-100 px-2 rounded text-xs">Optional</span>
<span class="text-gray-500 bg-gray-100 px-2 rounded text-xs">Defaults to 1</span>
</h3>
<p class="text-gray-600">
An alternative to sampling with temperature, called nucleus sampling, where the model considers the results of the tokens with top_p probability mass. So 0.1 means only the tokens comprising the top 10% probability mass are considered.
</p>
<p class="text-gray-600">
We generally recommend altering this or temperature but not both.
</p>
</li>
<li class="mb-4">
<h3>
<span class="font-bold mr-2">user</span>
<span class="text-gray-500 mr-2 bg-gray-100 px-2 rounded text-xs">number or null</span>
<span class="text-gray-500 bg-gray-100 px-2 rounded text-xs">Optional</span>
</h3>
<p class="text-gray-500">
A unique identifier representing your end-user, which can help OpenAI to monitor and detect abuse. <a href="#">Learn more</a>.
</p>
</li>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment