Skip to content

Instantly share code, notes, and snippets.

@tucotuco
Created July 3, 2014 01:32
Show Gist options
  • Select an option

  • Save tucotuco/bd68c868c2aed03c8bee to your computer and use it in GitHub Desktop.

Select an option

Save tucotuco/bd68c868c2aed03c8bee to your computer and use it in GitHub Desktop.
Errors deleting nmnh/amphibians&reptiles documents - VertNet indexer in AppEngine
Partial failure....
2014-07-02 20:05:08.126 /index-delete-resource 200 19020ms 0kb AppEngine-Google; (+http://code.google.com/appengine) module=default version=indexer
0.1.0.2 - - [02/Jul/2014:16:05:08 -0700] "POST /index-delete-resource HTTP/1.1" 200 457 "http://indexer.vertnet-portal.appspot.com/index-delete-resource" "AppEngine-Google; (+http://code.google.com/appengine)" "indexer.vertnet-portal.appspot.com" ms=19020 cpu_ms=93 cpm_usd=0.100051 queue_name=index-delete-resource task_name=8128078467183889543 app_engine_release=1.9.6 trace_id=9692b3bd02d15e1f816494e545edfd85 instance=00c61b117cbe5b1f090bf6a6aebe2d9fb29b27
I 2014-07-02 20:04:49.109
Deleting resource:<br>Namespace: index-2014-03-12<br>Index_name: dwc<br>Resource: nmnh/nmnh-amphibians-reptiles<br>Batch size: <br>Max delete: <br>Dry run: <br>
I 2014-07-02 20:04:49.109
Query: resource:nmnh/nmnh-amphibians-reptiles namespace: index-2014-03-12 index: dwc
E 2014-07-02 20:04:59.067
Search ERROR on query: resource:nmnh/nmnh-amphibians-reptiles limit: 200 namespace: index-2014-03-12 index: dwc error: Failed to complete request in 9996ms
E 2014-07-02 20:04:59.067
Search ERROR on query: resource:nmnh/nmnh-amphibians-reptiles limit: 200 namespace: index-2014-03-12 index: dwc error: Failed to complete request in 9996ms
Traceback (most recent call last):
File "/base/data/home/apps/s~vertnet-portal/indexer.376971254282112064/indexer.py", line 204, in get
docs = index.search(query)
File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/datastore/datastore_rpc.py", line 103, in positional_wrapper
return wrapped(*args, **kwds)
File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/search/search.py", line 2798, in search
_MakeSyncSearchServiceCall('Search', request, response, deadline)
File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/search/search.py", line 2989, in _MakeSyncSearchServiceCall
raise _ToSearchError(e)
Timeout: Failed to complete request in 9996ms
I 2014-07-02 20:05:07.736
Deleting 200 documents.
First: usnm/amphibians&reptiles/351686-6227772
Last: usnm/amphibians&reptiles/358248-6236092
I 2014-07-02 20:05:08.122
Queuing task index-delete-resource with params {'resource': u'nmnh/nmnh-amphibians-reptiles', 'ndeleted': 148200, 'max_delete': u'', 'namespace': u'index-2014-03-12', 'index_name': u'dwc', 'batch_size': u''}<br>
Followed by success...
2014-07-02 20:05:16.964 /index-delete-resource 200 8788ms 0kb AppEngine-Google; (+http://code.google.com/appengine) module=default version=indexer
0.1.0.2 - - [02/Jul/2014:16:05:16 -0700] "POST /index-delete-resource HTTP/1.1" 200 457 "http://indexer.vertnet-portal.appspot.com/index-delete-resource" "AppEngine-Google; (+http://code.google.com/appengine)" "indexer.vertnet-portal.appspot.com" ms=8788 cpu_ms=70 cpm_usd=0.050051 queue_name=index-delete-resource task_name=12537488089622304020 app_engine_release=1.9.6 trace_id=d004240d6f146d5a2cfdfca425542409 instance=00c61b117cbe5b1f090bf6a6aebe2d9fb29b27
I 2014-07-02 20:05:08.179
Deleting resource:<br>Namespace: index-2014-03-12<br>Index_name: dwc<br>Resource: nmnh/nmnh-amphibians-reptiles<br>Batch size: <br>Max delete: <br>Dry run: <br>
I 2014-07-02 20:05:08.179
Query: resource:nmnh/nmnh-amphibians-reptiles namespace: index-2014-03-12 index: dwc
I 2014-07-02 20:05:16.504
Deleting 200 documents.
First: usnm/amphibians&reptiles/351686-6227772
Last: usnm/amphibians&reptiles/358606-6236450
I 2014-07-02 20:05:16.959
Queuing task index-delete-resource with params {'resource': u'nmnh/nmnh-amphibians-reptiles', 'ndeleted': 148400, 'max_delete': u'', 'namespace': u'index-2014-03-12', 'index_name': u'dwc', 'batch_size': u''}<br>
Followed by complete failure...
2014-07-02 20:05:46.854 /index-delete-resource 200 29865ms 0kb AppEngine-Google; (+http://code.google.com/appengine) module=default version=indexer
0.1.0.2 - - [02/Jul/2014:16:05:46 -0700] "POST /index-delete-resource HTTP/1.1" 200 246 "http://indexer.vertnet-portal.appspot.com/index-delete-resource" "AppEngine-Google; (+http://code.google.com/appengine)" "indexer.vertnet-portal.appspot.com" ms=29866 cpu_ms=23 cpm_usd=0.150027 queue_name=index-delete-resource task_name=4512807763037683354 app_engine_release=1.9.6 trace_id=3ec4a355a42bd73241af13126e9326de instance=00c61b117cbe5b1f090bf6a6aebe2d9fb29b27
I 2014-07-02 20:05:16.991
Deleting resource:<br>Namespace: index-2014-03-12<br>Index_name: dwc<br>Resource: nmnh/nmnh-amphibians-reptiles<br>Batch size: <br>Max delete: <br>Dry run: <br>
I 2014-07-02 20:05:16.991
Query: resource:nmnh/nmnh-amphibians-reptiles namespace: index-2014-03-12 index: dwc
E 2014-07-02 20:05:26.941
Search ERROR on query: resource:nmnh/nmnh-amphibians-reptiles limit: 200 namespace: index-2014-03-12 index: dwc error: Failed to complete request in 9989ms
E 2014-07-02 20:05:26.942
Search ERROR on query: resource:nmnh/nmnh-amphibians-reptiles limit: 200 namespace: index-2014-03-12 index: dwc error: Failed to complete request in 9989ms
Traceback (most recent call last):
File "/base/data/home/apps/s~vertnet-portal/indexer.376971254282112064/indexer.py", line 204, in get
docs = index.search(query)
File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/datastore/datastore_rpc.py", line 103, in positional_wrapper
return wrapped(*args, **kwds)
File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/search/search.py", line 2798, in search
_MakeSyncSearchServiceCall('Search', request, response, deadline)
File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/search/search.py", line 2989, in _MakeSyncSearchServiceCall
raise _ToSearchError(e)
Timeout: Failed to complete request in 9989ms
E 2014-07-02 20:05:36.898
Search ERROR on query: resource:nmnh/nmnh-amphibians-reptiles limit: 200 namespace: index-2014-03-12 index: dwc error: Failed to complete request in 9997ms
E 2014-07-02 20:05:36.898
Search ERROR on query: resource:nmnh/nmnh-amphibians-reptiles limit: 200 namespace: index-2014-03-12 index: dwc error: Failed to complete request in 9997ms
Traceback (most recent call last):
File "/base/data/home/apps/s~vertnet-portal/indexer.376971254282112064/indexer.py", line 204, in get
docs = index.search(query)
File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/datastore/datastore_rpc.py", line 103, in positional_wrapper
return wrapped(*args, **kwds)
File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/search/search.py", line 2798, in search
_MakeSyncSearchServiceCall('Search', request, response, deadline)
File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/search/search.py", line 2989, in _MakeSyncSearchServiceCall
raise _ToSearchError(e)
Timeout: Failed to complete request in 9997ms
E 2014-07-02 20:05:46.852
Search ERROR on query: resource:nmnh/nmnh-amphibians-reptiles limit: 200 namespace: index-2014-03-12 index: dwc error: Failed to complete request in 9993ms
E 2014-07-02 20:05:46.852
Search ERROR on query: resource:nmnh/nmnh-amphibians-reptiles limit: 200 namespace: index-2014-03-12 index: dwc error: Failed to complete request in 9993ms
Traceback (most recent call last):
File "/base/data/home/apps/s~vertnet-portal/indexer.376971254282112064/indexer.py", line 204, in get
docs = index.search(query)
File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/datastore/datastore_rpc.py", line 103, in positional_wrapper
return wrapped(*args, **kwds)
File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/search/search.py", line 2798, in search
_MakeSyncSearchServiceCall('Search', request, response, deadline)
File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/search/search.py", line 2989, in _MakeSyncSearchServiceCall
raise _ToSearchError(e)
Timeout: Failed to complete request in 9993ms
I 2014-07-02 20:05:46.852
Too many search errors. Aborting delete for resource nmnh/nmnh-amphibians-reptiles, index dwc, namespace index-2014-03-12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment