[Form Recognizer] "Could not access Azure blob storage account." in USGOV and China Clouds

[v-xuto]

We are running live Tests against other clouds like US Gov and Azure China Cloud. The goal is to check whether new azure sdk package work with other clouds or not.

Error Description:
When running the test test_custom_forms_from_url_async.py::TestCustomFormsFromUrlAsync::test_custom_form_continuation_token, it runs failed and the error message is shown as following, for more details please check here:

test(test_content_from_url.py::TestContentFromUrl::test_content_multipage_url) error message:

Expected Behavior:
Please create Azure storage account and upload blobs to the corresponding container in UsGov and China Clouds.

@benbp, @jameszliao-msft, @lmazuel, @meeraharidasa , @mayurid, @catalinaperalta for notification.

[catalinaperalta]

Hi @v-xuto! I'm checking whether we already have storage accounts available with these files for the USGov and China clouds. Will let you know soon!

[catalinaperalta]

Hi @v-xuto, if you leverage sub-config-gov-test-resources in your test configuration yaml instead of the current sub-config-azure-cloud-test-resources that should set everything up and work as expected with the test_resources.json if you're using that for testing. See how we set up our subscription configuration here in tests.yml.

NOTE: we do not have this set up for the China cloud yet.

[v-xuto]

@catalinaperalta I have already added sub-config-gov-test-resources and sub-config-cn-test-resources in formrecognizer/tests.yml in my PR. For more details about pipeline results please click here.

@catalinaperalta @benbp Through the error message and local testing, maybe because not all containers and blobs are created in the storage account (azuresdktrainingdata) in UsGov and China, please help to create containers and upload blobs, make it the same as the storage account(azuresdktrainingdata) on Public.

Or give me the subscription permission of the storage account (azuresdktrainingdata) on Public, and I will create the required containers and upload blobs in UsGov and China.

[v-xuto]

@benbp Who can help me to create containers and upload blobs in Usgov and china? Or give me the subscription permission of the storage account (azuresdktrainingdata) on Public.

[catalinaperalta]

Hey @v-xuto, I requested access myself to the USGov cloud, but I am still waiting for permission to access it. Once I have it, I can check whether the container has all of the necessary content uploaded. I will check with @benbp about who can be granted permission.

[benbp]

@catalinaperalta and I worked to grant access to USGov.

[catalinaperalta]

I've checked the storage container in USGov and there were several missing blobs. I have uploaded those blobs that were missing and are used in our tests. @v-xuto please let me know if the tests in USGov can pass now.

As for the storage container in the China cloud, I am still working with Ben to get access. Will let you know when I have an update with that one.

[v-xuto]

@catalinaperalta I rerun the weekly pipeline and found that there are still some missing blobs in UsGov cloud, such as: testingdata/label_table_variable_rows1.pdf. Please check again. For more details please click here.

@benbp Could you give me the subscription permission of the storage account (azuresdktrainingdata) on Public? I check and upload blobs, maybe more efficient. Because I have the permission of UsGov and China.

[catalinaperalta]

@v-xuto on Tuesday I updated the testingdata container to include missing files that weren't added from the public cloud. However, I did notice several other differences between the public cloud containers and the us gov containers. I will be correcting these differences today. I will let you know once those updates are complete.

[catalinaperalta]

@v-xuto sorry for the delay, the US Gov containers look complete to me now. I've been trying to upload blobs to the China cloud containers but I'm having access issues, I'll talk to Ben about it. If you already have access to both the USGov and China cloud accounts you could start copying the blobs from USGov to the China cloud containers.