Discovered this unexpected behavior while using Together AI as an OpenAI-compatible API with LlamaIndex:
Settings.llm = OpenAILike(
model="meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo",
api_base="https://api.together.xyz/v1",
temperature=0.1,
api_key=api_key,
is_function_calling_model=True,