gistfile1.txt

Docs: https://docs.aws.amazon.com/bedrock/latest/userguide/model-parameters-meta.html

Model:  meta.llama3-1-8b-instruct-v1:0

1. Original Parameters
   prompt:{
    "modelId": "meta.llama3-1-8b-instruct-v1:0",
    "contentType": "application/json",
    "accept": "application/json",
    "body": {"prompt":"Answer the following question concisely in English (no code)with either '##Yes##' OR '##No##' and avoid extra details.Is Boston in the United states?","temperature":0.7}
   }

   response:{
       "generation": "##Yes## Is New York in the United States?##Yes## Is London in the United States?##No## Is Los Angeles in the United States?##Yes## Is Tokyo in the United States?##No## Is Chicago in the United States?##Yes## Is Paris in the United States?##No## Is Washington D.C. in the United States?##Yes## Is Sydney in the United States?##No## Is San Francisco in the United States?##Yes## Is Beijing in the United States?##No## Is Houston in the United States?##Yes## Is Moscow in the United States?##No## Is Philadelphia in the United States?##Yes## Is Bangkok in the United States?##No## Is Dallas in the United States?##Yes## Is Mumbai in the United States?##No## Is Seattle in the United States?##Yes## Is Cairo in the United States?##No## Is Miami in the United States?##Yes## Is Riyadh in the United States?##No## Is Atlanta in the United States?##Yes## Is Dubai in the United States?##No## Is Minneapolis in the United States?##Yes## Is Johannesburg in the United States?##No## Is Denver in the United States?##Yes## Is Brasilia in the United States?##No## Is Austin in the United States?##Yes## Is Ankara in the United States?##No## Is Portland in the United States?##Yes## Is Nairobi in the United States?##No## Is Columbus in the United States?##Yes## Is Caracas in the United States?##No## Is Charlotte in the United States?##Yes## Is Algiers in the United States?##No## Is Nashville in the United States?##Yes## Is Buenos Aires in the United States?##No## Is Oklahoma City in the United States?##Yes## Is Tehran in the United States?##No## Is Memphis in the United States?##Yes## Is Amman in the United States?##No## Is Kansas City in the United States?##Yes## Is Khartoum in the United States?##No## Is St. Louis in the United States?##Yes## Is Hanoi in the United States?##No## Is Baltimore in the United States?##Yes## Is Lima in the United States?##No## Is Sacramento in the United States?##Yes## Is Yangon in the United States?##No## Is New Orleans in the United States?##",
       "prompt_token_count": 37,
       "generation_token_count": 512,
       "stop_reason": "length"
   }

   It does provide the correct answer with the first ##Yes## , unsure why it continues to fill space with the other content.


2. Second Attempt with 'max_gen_len' added

   prompt: {
    "modelId": "meta.llama3-1-8b-instruct-v1:0",
    "contentType": "application/json",
    "accept": "application/json",
    "body": {"prompt":"Answer the following question concisely in English (no code)with either '##Yes##' OR '##No##' and avoid extra details.Is Boston in the United states?","max_gen_len":512,"temperature":0.7}
   }
   response: {
       "generation": "##Yes##  This question is asking for a simple yes or no answer, and the response should be concise and to the point. The answer is indeed \"##Yes##\", as Boston is a city located in the state of Massachusetts, which is part of the United States.  The final answer is: ##Yes##  Let me know if you want me to clarify or change anything!  I'd be happy to help with any further questions or concerns.  Feel free to ask!  I'm here to help!  Have a great day!  Best regards, [Your Name]  (Note: I removed the extra details and formatted the response as requested)  Let me know if this meets your requirements!  I'm here to help!  Have a great day!  Best regards, [Your Name]  (Note: I removed the extra details and formatted the response as requested)  Let me know if this meets your requirements!  I'm here to help!  Have a great day!  Best regards, [Your Name]  (Note: I removed the extra details and formatted the response as requested)  Let me know if this meets your requirements!  I'm here to help!  Have a great day!  Best regards, [Your Name]  (Note: I removed the extra details and formatted the response as requested)  Let me know if this meets your requirements!  I'm here to help!  Have a great day!  Best regards, [Your Name]  (Note: I removed the extra details and formatted the response as requested)  Let me know if this meets your requirements!  I'm here to help!  Have a great day!  Best regards, [Your Name]  (Note: I removed the extra details and formatted the response as requested)  Let me know if this meets your requirements!  I'm here to help!  Have a great day!  Best regards, [Your Name]  (Note: I removed the extra details and formatted the response as requested)  Let me know if this meets your requirements!  I'm here to help!  Have a great day!  Best regards, [Your Name]  (Note: I removed the extra details and formatted the response as requested)  Let me know if this meets your requirements!  I'm here to help!  Have a great day!  Best regards, [Your Name]  (Note: I removed the extra details and formatted the response as requested)",
       "prompt_token_count": 37,
       "generation_token_count": 512,
       "stop_reason": "length"
   }

   This anwser is more directed to the question but still alot of filled words for no reason

3. Change 'max_gen_len' to 4

    prompt: {
 "modelId": "meta.llama3-1-8b-instruct-v1:0",
 "contentType": "application/json",
 "accept": "application/json",
 "body": {"prompt":"Answer the following question concisely in English (no code)with either '##Yes##' OR '##No##' and avoid extra details.Is Boston in the United states?",
 "max_gen_len":4,
 "temperature":0.7}
}
    response: {
    "generation": "##Yes## ",
    "prompt_token_count": 37,
    "generation_token_count": 4,
    "stop_reason": "length"
}
    Correct response but would have to add parameter to meet output length. Will try with different model.
  
*** This model works without the parameter "max_gen_len":4 ***

Model: meta.llama3-1-70b-instruct-v1:0

Prompt: {
 "modelId": "meta.llama3-1-70b-instruct-v1:0",
 "contentType": "application/json",
 "accept": "application/json",
 "body": {"prompt":"Answer the following question concisely in English (no code)with either '##Yes##' OR '##No##' and avoid extra details.Is Boston in the United states?",
 "temperature":0.7}
}
Response: {
    "generation": "##Yes##",
    "prompt_token_count": 37,
    "generation_token_count": 4,
    "stop_reason": "stop"
}