AWS_log

## Input
{
	"starting_url": "https://www.landwatch.com/Oklahoma_land_for_sale/Osage_County/Land",
	"bucket": "landtoolsai"
}

## Output
Request: /scrape_landwatch
Status: 502
Latency: 1111 ms
Response Body
{
  "message": "Internal server error"
}

Response Headers
{"x-amzn-ErrorType":"InternalServerErrorException"}
Logs
Execution log for request 004b7fc2-78ac-4896-aebc-c366b67414b4
Wed May 27 21:56:39 UTC 2020 : Starting execution for request: 004b7fc2-78ac-4896-aebc-c366b67414b4
Wed May 27 21:56:39 UTC 2020 : HTTP Method: POST, Resource Path: /scrape_landwatch
Wed May 27 21:56:39 UTC 2020 : Method request path: {}
Wed May 27 21:56:39 UTC 2020 : Method request query string: {}
Wed May 27 21:56:39 UTC 2020 : Method request headers: {Accept=application/json}
Wed May 27 21:56:39 UTC 2020 : Method request body before transformations: {
	"starting_url": "https://www.landwatch.com/Oklahoma_land_for_sale/Osage_County/Land",
	"bucket": "landtoolsai"
}
Wed May 27 21:56:39 UTC 2020 : Endpoint request URI: https://lambda.us-east-1.amazonaws.com/2015-03-31/functions/arn:aws:lambda:us-east-1:962065141310:function:landtoolsai-dev-scrape_landwatch/invocations
Wed May 27 21:56:39 UTC 2020 : Endpoint request headers: {x-amzn-lambda-integration-tag=004b7fc2-78ac-4896-aebc-c366b67414b4, Authorization=************************************************************************************************************************************************************************************************************************************************************************************************************************d0a9b6, X-Amz-Date=20200527T215639Z, x-amzn-apigateway-api-id=73o7kz9712, X-Amz-Source-Arn=arn:aws:execute-api:us-east-1:962065141310:73o7kz9712/test-invoke-stage/POST/scrape_landwatch, Accept=application/json, User-Agent=AmazonAPIGateway_73o7kz9712, X-Amz-Security-Token=IQoJb3JpZ2luX2VjEG0aCXVzLWVhc3QtMSJGMEQCIE1H5W7lmqARniBjY/YXAkxkza4y3Ny69TrONQpy4ahYAiAI2sMxU2nM1/WpML1wMbB5oGRTQ+hkWGEfBsMoaS2iQiq9AwjG//////////8BEAAaDDM5MjIyMDU3NjY1MCIMHBl2zAcmN3gXjKIaKpEDn6JpzkP6g+kw/l/lV1vxmArawgbibEbgOB2574HsnQSE4UNsPzoi0gOrvczHjpIXvBCQSbUD2UFOfrYbkEeBBYvid0vHu8Y7n5spqgGwh2gxEBBsrbEsPOeJCSzGNlF7J/PMIl+psjZ [TRUNCATED]
Wed May 27 21:56:39 UTC 2020 : Endpoint request body after transformations: {"resource":"/scrape_landwatch","path":"/scrape_landwatch","httpMethod":"POST","headers":{"Accept":"application/json"},"multiValueHeaders":{"Accept":["application/json"]},"queryStringParameters":null,"multiValueQueryStringParameters":null,"pathParameters":null,"stageVariables":null,"requestContext":{"resourceId":"zam90x","resourcePath":"/scrape_landwatch","httpMethod":"POST","extendedRequestId":"NNhDrF3-oAMFsSg=","requestTime":"27/May/2020:21:56:39 +0000","path":"/scrape_landwatch","accountId":"962065141310","protocol":"HTTP/1.1","stage":"test-invoke-stage","domainPrefix":"testPrefix","requestTimeEpoch":1590616599478,"requestId":"004b7fc2-78ac-4896-aebc-c366b67414b4","identity":{"cognitoIdentityPoolId":null,"cognitoIdentityId":null,"apiKey":"test-invoke-api-key","principalOrgId":null,"cognitoAuthenticationType":null,"userArn":"arn:aws:iam::962065141310:root","apiKeyId":"test-invoke-api-key-id","userAgent":"aws-internal/3 aws-sdk-java/1.11.772 Linux/4.9.184-0.1.ac.2 [TRUNCATED]
Wed May 27 21:56:39 UTC 2020 : Sending request to https://lambda.us-east-1.amazonaws.com/2015-03-31/functions/arn:aws:lambda:us-east-1:962065141310:function:landtoolsai-dev-scrape_landwatch/invocations
Wed May 27 21:56:40 UTC 2020 : Received response. Status: 200, Integration latency: 1107 ms
Wed May 27 21:56:40 UTC 2020 : Endpoint response headers: {Date=Wed, 27 May 2020 21:56:40 GMT, Content-Type=application/json, Content-Length=336, Connection=keep-alive, x-amzn-RequestId=66a795d0-267f-480f-af3e-f41e50225939, X-Amz-Function-Error=Unhandled, x-amzn-Remapped-Content-Length=0, X-Amz-Executed-Version=$LATEST, X-Amzn-Trace-Id=root=1-5ecee217-6424af997cb85a4bc9b170c0;sampled=0}
Wed May 27 21:56:40 UTC 2020 : Endpoint response body before transformations: {"errorMessage": "'starting_url'", "errorType": "KeyError", "stackTrace": ["  File \"/var/task/serverless_sdk/__init__.py\", line 134, in wrapped_handler\n    return user_handler(event, context)\n", "  File \"/var/task/scrape_landwatch.py\", line 283, in scrape_landwatch\n    location = {\"landwatchurl\": event[\"starting_url\"]}\n"]}
Wed May 27 21:56:40 UTC 2020 : Lambda execution failed with status 200 due to customer function error: 'starting_url'. Lambda request id: 66a795d0-267f-480f-af3e-f41e50225939
Wed May 27 21:56:40 UTC 2020 : Method completed with status: 502