samples.samples.backup_sample_test: test_delete_backup failed

[flaky-bot]

This test failed!

To configure my behavior, see the Flaky Bot documentation.

If I'm commenting on this issue too often, add the flakybot: quiet label and
I will stop commenting.

---

commit: 0d7722b
buildURL: Build Status, Sponge
status: failed

Test output

args = (parent: "projects/python-docs-samples-tests"
instance_id: "test-instance-a3beb9e7d1"
instance {
  name: "projects/pyt...ocs-samples-tests/instanceConfigs/regional-us-central1"
  display_name: "test-instance-a3beb9e7d1"
  node_count: 1
}
,)
kwargs = {'metadata': [('google-cloud-resource-prefix', 'projects/python-docs-samples-tests/instances/test-instance-a3beb9e7d1'...ent=projects/python-docs-samples-tests'), ('x-goog-api-client', 'gl-python/3.7.10 grpc/1.36.1 gax/1.26.1 gccl/3.2.0')]}
@six.wraps(callable_)
def error_remapped_callable(*args, **kwargs):
    try:


      return callable_(*args, **kwargs)


.nox/py-3-7/lib/python3.7/site-packages/google/api_core/grpc_helpers.py:73:

self = <grpc._channel._UnaryUnaryMultiCallable object at 0x7fc001763950>

request = parent: "projects/python-docs-samples-tests"

instance_id: "test-instance-a3beb9e7d1"

instance {

name: "projects/pyth...-docs-samples-tests/instanceConfigs/regional-us-central1"

display_name: "test-instance-a3beb9e7d1"

node_count: 1

}
timeout = None

metadata = [('google-cloud-resource-prefix', 'projects/python-docs-samples-tests/instances/test-instance-a3beb9e7d1'), ('x-goog-r...rent=projects/python-docs-samples-tests'), ('x-goog-api-client', 'gl-python/3.7.10 grpc/1.36.1 gax/1.26.1 gccl/3.2.0')]

credentials = None, wait_for_ready = None, compression = None
def __call__(self,
             request,
             timeout=None,
             metadata=None,
             credentials=None,
             wait_for_ready=None,
             compression=None):
    state, call, = self._blocking(request, timeout, metadata, credentials,
                                  wait_for_ready, compression)


  return _end_unary_response_blocking(state, call, False, None)


.nox/py-3-7/lib/python3.7/site-packages/grpc/_channel.py:923:

state = <grpc._channel._RPCState object at 0x7fc001763d10>

call = <grpc._cython.cygrpc.SegregatedCall object at 0x7fc00174b5f0>

with_call = False, deadline = None
def _end_unary_response_blocking(state, call, with_call, deadline):
    if state.code is grpc.StatusCode.OK:
        if with_call:
            rendezvous = _MultiThreadedRendezvous(state, call, None, deadline)
            return state.response, rendezvous
        else:
            return state.response
    else:


      raise _InactiveRpcError(state)


E           grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:

E           	status = StatusCode.RESOURCE_EXHAUSTED

E           	details = "Quota exceeded for quota metric 'Instance create requests' and limit 'Instance create requests per minute' of service 'spanner.googleapis.com' for consumer 'project_number:1012616486416'."

E           	debug_error_string = "{"created":"@1615460580.752305730","description":"Error received from peer ipv4:74.125.142.95:443","file":"src/core/lib/surface/call.cc","file_line":1067,"grpc_message":"Quota exceeded for quota metric 'Instance create requests' and limit 'Instance create requests per minute' of service 'spanner.googleapis.com' for consumer 'project_number:1012616486416'.","grpc_status":8}"

E           >
.nox/py-3-7/lib/python3.7/site-packages/grpc/_channel.py:826: _InactiveRpcError
The above exception was the direct cause of the following exception:
@pytest.fixture(scope="module")
def spanner_instance():
    spanner_client = spanner.Client()
    instance_config = "{}/instanceConfigs/{}".format(
        spanner_client.project_name, "regional-us-central1"
    )
    instance = spanner_client.instance(INSTANCE_ID, instance_config)


  op = instance.create()


backup_sample_test.py:54:

../../google/cloud/spanner_v1/instance.py:262: in create

metadata=metadata,

../../google/cloud/spanner_admin_instance_v1/services/instance_admin/client.py:837: in create_instance

response = rpc(request, retry=retry, timeout=timeout, metadata=metadata,)

.nox/py-3-7/lib/python3.7/site-packages/google/api_core/gapic_v1/method.py:145: in call

return wrapped_func(*args, **kwargs)

.nox/py-3-7/lib/python3.7/site-packages/google/api_core/grpc_helpers.py:75: in error_remapped_callable

six.raise_from(exceptions.from_grpc_error(exc), exc)

value = None

from_value = <_InactiveRpcError of RPC that terminated with:

status = StatusCode.RESOURCE_EXHAUSTED

details = "Quota exceeded for...uests per minute' of service 'spanner.googleapis.com' for consumer 'project_number:1012616486416'.","grpc_status":8}"



???

E   google.api_core.exceptions.ResourceExhausted: 429 Quota exceeded for quota metric 'Instance create requests' and limit 'Instance create requests per minute' of service 'spanner.googleapis.com' for consumer 'project_number:1012616486416'.

:3: ResourceExhausted

[flaky-bot]

Looks like this issue is flaky. 😟

I'm going to leave this open and stop commenting.

A human should fix and close this.

---

When run at the same commit (0d7722b), this test passed in one build (Build Status, Sponge) and failed in another build (Build Status, Sponge).

[larkee]

This was a transient issue. See #272 for more details.