Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
56 changes: 51 additions & 5 deletions sdk/eventgrid/azure-eventgrid/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -38,26 +38,37 @@ In order to interact with the Event Grid service, you will need to create an ins
A **topic_hostname** and **credential** are necessary to instantiate the client object.

#### Looking up the endpoint
You can find the endpoint and the hostname on the Azure portal.
You can find the topic endpoint within the Event Grid Topic resource on the Azure portal.
The topic hostname is the URL host component of this endpoint. (Everything up-to and including "eventgrid.azure.net".)

#### Create the client with AzureKeyCredential

To use an API key as the `credential` parameter,
To use an Access Key as the `credential` parameter,
pass the key as a string into an instance of [AzureKeyCredential][azure-key-credential].

> **Note:** The Access Key may be found in the azure portal in the "Access Keys" menu of the Event Grid Topic resource. They may also be obtained via the azure CLI, or the `azure-mgmt-eventgrid` library.

```python
from azure.core.credentials import AzureKeyCredential
from azure.eventgrid import EventGridPublisherClient

topic_hostname = "https://<name>.<region>.eventgrid.azure.net"
credential = AzureKeyCredential("<api_key>")
credential = AzureKeyCredential("<access_key>")
eg_publisher_client = EventGridPublisherClient(topic_hostname, credential)
```

> **Note:** A client may also be authenticated via SAS signature, using the `EventGridSharedAccessSignatureCredential`. A sample demonstrating this, as well as how to generate that signature utilizing `generate_shared_access_signature` is available [here][python-eg-sample-publish-sas-signature].

## Key concepts

Information about the key concepts on Event Grid, see [Concepts in Azure Event Grid][publisher-service-doc]

### Topic
A channel within the EventGrid service to send events. Must be of CloudEvent or EventGridEvent schema, (decided at creation time) and the corrosponding event type must be used.

### Domain Topic
A domain exists to rout arbitrary named topics within it. Topics must not exist beforehand if using a domain, topic name can be provided at send time. Simply provide the domain endpoint at client construction instead of topic endpoint.

### EventGridPublisherClient
`EventGridPublisherClient` provides operations to send event data to topic hostname specified during client initialization.
Either a list or a single instance of CloudEvent/EventGridEvent/CustomEvent can be sent.
Expand All @@ -71,12 +82,14 @@ The following sections provide several code snippets covering some of the most c

* [Send an Event Grid Event](#send-an-event-grid-event)
* [Send a Cloud Event](#send-a-cloud-event)
* [Send to a Domain](#send-to-a-domain)
* [Consume an eventgrid Event](#consume-an-event-grid-event)
* [Consume a cloud Event](#consume-a-cloud-event)

### Send an Event Grid Event

This example publishes an Event Grid event.
> **Note:** It is important to know if your topic supports Cloud or EventGrid events beforehand, otherwise send() will throw an exception.

```Python
import os
Expand All @@ -97,11 +110,13 @@ credential = AzureKeyCredential(key)
client = EventGridPublisherClient(topic_hostname, credential)

client.send(event)
# Note: Events may also be sent as a list, e.g: client.send([event])
```

### Send a Cloud Event

This example publishes a Cloud event.
> **Note:** It is important to know if your topic supports Cloud or EventGrid events beforehand, otherwise send() will throw an exception.

```Python
import os
Expand All @@ -121,6 +136,36 @@ credential = AzureKeyCredential(key)
client = EventGridPublisherClient(topic_hostname, credential)

client.send(event)
# Note: Events may also be sent as a list, e.g: client.send([event])
```

### Send to a Domain

This example illustrates sending to a Domain, whereas the earlier samples sent to a Topic.

The primary difference is that for `EventGridEvents` a topic must be defined in the event being sent, such that it can be routed within the Domain.

```Python
import os
from azure.core.credentials import AzureKeyCredential
from azure.eventgrid import EventGridPublisherClient, EventGridEvent

key = os.environ["EG_ACCESS_KEY"]
domain_hostname = os.environ["EG_DOMAIN_HOSTNAME"]

event = EventGridEvent(
subject="Door1",
data={"team": "azure-sdk"},
event_type="Azure.Sdk.Demo",
data_version="2.0",
topic="test"
)

credential = AzureKeyCredential(key)
client = EventGridPublisherClient(domain_hostname, credential)

client.send(event)
# Note: Events may also be sent as a list, e.g: client.send([event])
```

### Consume an Event Grid Event
Expand All @@ -143,7 +188,7 @@ eg_storage_dict = {
"dataVersion":"2.0",
"metadataVersion":"1",
"eventTime":"2020-08-07T02:28:23.867525Z",
"topic":"/subscriptions/{subscription-id}/resourceGroups/{resource-group}/providers/Microsoft.EventGrid/topics/eventgridegsub"
"topic":"/subscriptions/fake-subscription-id/resourceGroups/fake-resource-group/providers/Microsoft.EventGrid/topics/eventgridegsub"
}

deserialized_event = consumer.decode_eventgrid_event(eg_storage_dict)
Expand All @@ -164,7 +209,7 @@ consumer = EventGridConsumer()

cloud_storage_dict = {
"id":"a0517898-9fa4-4e70-b4a3-afda1dd68672",
"source":"/subscriptions/{subscription-id}/resourceGroups/{resource-group}/providers/Microsoft.Storage/storageAccounts/{storage-account}",
"source":"/subscriptions/fake-subscription-id/resourceGroups/fake-resource-group/providers/Microsoft.Storage/storageAccounts/fake-storage-account",
"data":{
"api":"PutBlockList",
},
Expand Down Expand Up @@ -250,6 +295,7 @@ This project has adopted the [Microsoft Open Source Code of Conduct][code_of_con
[python-eg-sample-consume-customevent]: https://github.com/Azure/azure-sdk-for-python/blob/master/sdk/eventgrid/azure-eventgrid/samples/champion_scenarios/cs4_consume_custom_events.py
[python-eg-sample-send-cloudevent]: https://github.com/Azure/azure-sdk-for-python/blob/master/sdk/eventgrid/azure-eventgrid/samples/champion_scenarios/cs5_publish_events_using_cloud_events_1.0_schema.py
[python-eg-sample-consume-cloudevent]: https://github.com/Azure/azure-sdk-for-python/blob/master/sdk/eventgrid/azure-eventgrid/samples/champion_scenarios/cs6_consume_events_using_cloud_events_1.0_schema.py
[python-eg-sample-publish-sas-signature]: https://github.com/Azure/azure-sdk-for-python/blob/master/sdk/eventgrid/azure-eventgrid/samples/publish_samples/publish_with_shared_access_signature_sample.py
[publisher-service-doc]: https://docs.microsoft.com/azure/event-grid/concepts

[cla]: https://cla.microsoft.com
Expand Down
18 changes: 12 additions & 6 deletions sdk/eventgrid/azure-eventgrid/azure/eventgrid/_models.py
Original file line number Diff line number Diff line change
Expand Up @@ -22,15 +22,15 @@ class EventMixin(object):
def _deserialize_data(event, event_type):
"""
Sets the data of the desrialized event to strongly typed event object if event type exists in _event_mappings.
Otherwise, sets it to None.
Otherwise, leaves it as-is.

:param str event_type: The event_type of the EventGridEvent object or the type of the CloudEvent object.
"""
# if system event type defined, set event.data to system event object
try:
event.data = (_event_mappings[event_type]).deserialize(event.data)
except KeyError: # else, if custom event, then event.data is dict and should be set to None
event.data = None
except KeyError: # else, if custom event, then event.data is dict and is left as-is.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

will tackle this in #16125

pass

@staticmethod
def _from_json(event, encode):
Expand All @@ -49,11 +49,13 @@ def _from_json(event, encode):

class CloudEvent(EventMixin): #pylint:disable=too-many-instance-attributes
"""Properties of an event published to an Event Grid topic using the CloudEvent 1.0 Schema.
Note: CloudEvents can only be sent to a topic of CloudEvent schema. For EventGrid schema, use EventGridEvent.

All required parameters must be populated in order to send to Azure.

:param source: Required. Identifies the context in which an event happened. The combination of id and source must
be unique for each distinct event. If publishing to a domain topic, source must be the domain name.
be unique for each distinct event, and otherwise can be any user-defined string.
If publishing to a domain topic, source must be the domain name.
:type source: str
:param data: Event data specific to the event type.
:type data: object
Expand Down Expand Up @@ -131,19 +133,23 @@ def _to_generated(self, **kwargs):

class EventGridEvent(InternalEventGridEvent, EventMixin):
"""Properties of an event published to an Event Grid topic using the EventGrid Schema.
Note: EventGridEvents can only be sent to a topic of EventGridEvent schema. For CloudEvent schema, use CloudEvent.

Variables are only populated by the server, and will be ignored when sending a request.

All required parameters must be populated in order to send to Azure.

:param topic: The resource path of the event source. If not provided, Event Grid will stamp onto the event.
Is required for Domain topics, and a domain topic may be specified which doesn't yet exist.
:type topic: str
:param subject: Required. A resource path relative to the topic path.
:param subject: Required. A resource path relative to the topic path. Can be any user-defined string.
:type subject: str
:param data: Event data specific to the event type.
:type data: object
:param event_type: Required. The type of the event that occurred.
:param event_type: Required. The type of the event that occurred. Can be any user-defined string.
:type event_type: str
:param data_version: Required. The schema version of the data object. Can be any user-defined string.
:type data_version: str
:ivar metadata_version: The schema version of the event metadata. If provided, must match Event Grid Schema exactly.
If not provided, EventGrid will stamp onto event.
:vartype metadata_version: str
Expand Down
2 changes: 1 addition & 1 deletion sdk/eventgrid/azure-eventgrid/dev_requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -2,4 +2,4 @@
-e ../../../tools/azure-sdk-tools
-e ../../core/azure-core
-e ../../identity/azure-identity
-e ../azure-mgmt-eventgrid
azure-mgmt-eventgrid==3.0.0rc8

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why?

8 changes: 8 additions & 0 deletions sdk/eventgrid/azure-eventgrid/tests/_mocks.py
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,14 @@
cloud_storage_string = json.dumps(cloud_storage_dict)
cloud_storage_bytes = cloud_storage_string.encode("utf-8")

# A representative sample from an E2E use case of storage queues, used because it once reprod a failure.
cloud_storage_queue_json = json.dumps({"id":"96ff7bc3-ff73-4eb9-aa1b-26f354610fe3",
"source":"datapoint",
"data":{"event":"added","SKU":"ABK8765","status":"success"},
"type":"test_data",
"time":"2020-12-09T21:14:40.000973Z",
"specversion":"1.0"})

# custom cloud event
cloud_custom_dict = {
"id":"de0fd76c-4ef4-4dfb-ab3a-8f24a307e033",
Expand Down
8 changes: 7 additions & 1 deletion sdk/eventgrid/azure-eventgrid/tests/test_eg_consumer.py
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@
cloud_storage_dict,
cloud_storage_string,
cloud_storage_bytes,
cloud_storage_queue_json,
cloud_custom_dict,
cloud_custom_string,
cloud_custom_bytes,
Expand Down Expand Up @@ -50,7 +51,12 @@ def test_eg_consumer_cloud_storage_bytes(self, **kwargs):
deserialized_event = client.decode_cloud_event(cloud_storage_bytes)
assert deserialized_event.__class__ == CloudEvent
assert deserialized_event.data.__class__ == StorageBlobCreatedEventData


def test_eg_consumer_cloud_storage_queue_json(self, **kwargs):
client = EventGridConsumer()
deserialized_event = client.decode_cloud_event(cloud_storage_queue_json)
assert deserialized_event.__class__ == CloudEvent
assert deserialized_event.data

def test_eg_consumer_cloud_custom_dict(self, **kwargs):
client = EventGridConsumer()
Expand Down