Function Code and JSON prompt for tutorial from Rob Shocks on AWS LLAMA 2

gistfile1.txt

## LAMNDA FUNCTION lambda_function.py

import boto3
import json

# grab environment variables
ENDPOINT_NAME = "jumpstart-dft-meta-textgeneration-llama-2-7b-rs"
runtime= boto3.client('runtime.sagemaker')

def lambda_handler(event, context):
    
    response = runtime.invoke_endpoint(EndpointName=ENDPOINT_NAME,
                                       ContentType='application/json',
                                       Body=event['body'],
                                       CustomAttributes="accept_eula=true")
    
    response_content = response['Body'].read().decode()
    result = json.loads(response_content)
    
    
    return {
        "statusCode": 200,
        "body": json.dumps(result)
    }
 
 ## POSTMAN JSON PAYLOAD
 
 {
    "inputs": [
        [
            {"role": "system", "content": "You are an expert in copywriting"},
            {"role": "user", "content": "Write me a tweet about super conductors"}
        ]
    ],
    "parameters": {"max_new_tokens": 256, "top_p": 0.9, "temperature": 0.6}
}

 
    

Hey, I get this error when running this code into a deployed AWS Sagemaker endpoint, can you help ? - '''[ERROR] ModelError: An error occurred (ModelError) when calling the InvokeEndpoint operation: Received client error (422) from primary with message "Failed to deserialize the JSON body into the target type: inputs: invalid type: sequence, expected a string at line 2 column 11".
Traceback (most recent call last):
  File "/var/task/lambda_function.py", line 11, in lambda_handler
    response = runtime.invoke_endpoint(EndpointName=ENDPOINT_NAME,
  File "/var/runtime/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/var/runtime/botocore/client.py", line 960, in _make_api_call
    raise error_class(parsed_response, operation_name)'''

{"inputs":"what is an abacus?",
"parameters": {"max_new_tokens": 128, "top_p": 0.9, "temperature": 1}
}

Try this idk why the role user format is not working with sage endpoint.

Hey, I get this error when running this code into a deployed AWS Sagemaker endpoint, can you help ? - '''[ERROR] ModelError: An error occurred (ModelError) when calling the InvokeEndpoint operation: Received client error (422) from primary with message "Failed to deserialize the JSON body into the target type: inputs: invalid type: sequence, expected a string at line 2 column 11". Traceback (most recent call last):   File "/var/task/lambda_function.py", line 11, in lambda_handler     response = runtime.invoke_endpoint(EndpointName=ENDPOINT_NAME,   File "/var/runtime/botocore/client.py", line 530, in _api_call     return self._make_api_call(operation_name, kwargs)   File "/var/runtime/botocore/client.py", line 960, in _make_api_call     raise error_class(parsed_response, operation_name)'''

I followed the tutorial closely and checked all of my code, but this is the only thing I get returned in Postman:
{"code": 424, "message": "Batch inference failed", "properties": {}, "content": {"keys": [], "values": []}, "cancelled": false}

Here is the error message from testing:
{
"errorMessage": "'body'",
"errorType": "KeyError",
"requestId": "7d147730-2007-4263-971b-77aaea8ddd76",
"stackTrace": [
" File "/var/task/lambda_function.py", line 11, in lambda_handler\n Body=event['body'],\n"
]
}

Function Logs
START RequestId: 7d147730-2007-4263-971b-77aaea8ddd76 Version: $LATEST
LAMBDA_WARNING: Unhandled exception. The most likely cause is an issue in the function code. However, in rare cases, a Lambda runtime update can cause unexpected function behavior. For functions using managed runtimes, runtime updates can be triggered by a function change, or can be applied automatically. To determine if the runtime has been updated, check the runtime version in the INIT_START log entry. If this error correlates with a change in the runtime version, you may be able to mitigate this error by temporarily rolling back to the previous runtime version. For more information, see https://docs.aws.amazon.com/lambda/latest/dg/runtimes-update.html
[ERROR] KeyError: 'body'
Traceback (most recent call last):
  File "/var/task/lambda_function.py", line 11, in lambda_handler
    Body=event['body'],END RequestId: 7d147730-2007-4263-971b-77aaea8ddd76
REPORT RequestId: 7d147730-2007-4263-971b-77aaea8ddd76 Duration: 10.39 ms Billed Duration: 11 ms Memory Size: 128 MB Max Memory Used: 74 MB Init Duration: 396.95 ms

i got 424 code error