Skip to content

Improve stability of Android ReactNative E2E test - #21969

Merged
edgchen1 merged 15 commits into
mainfrom
edgchen1/detox_stability
Sep 4, 2024
Merged

Improve stability of Android ReactNative E2E test#21969
edgchen1 merged 15 commits into
mainfrom
edgchen1/detox_stability

Conversation

@edgchen1

@edgchen1 edgchen1 commented Sep 3, 2024

Copy link
Copy Markdown
Contributor

Description

  • Remove redundant OnnxruntimeModuleExampleE2ETest CheckOutputComponentExists test
  • Attempt to close any Application Not Responding (ANR) dialog prior to running Android test
  • Add --take-screenshots failing option to detox test commands to save screenshots on failure

Motivation and Context

Reduce test flakiness.

@edgchen1
edgchen1 requested a review from a team September 3, 2024 18:31
@edgchen1

edgchen1 commented Sep 3, 2024

Copy link
Copy Markdown
Contributor Author

Test runs where the Android E2E test runs successfully 20/20 times:
https://dev.azure.com/onnxruntime/onnxruntime/_build/results?buildId=1482146&view=results (note that the failed job in this run is from the iOS test)
https://dev.azure.com/onnxruntime/onnxruntime/_build/results?buildId=1480682&view=results

@edgchen1
edgchen1 requested review from carzh and skottmckay September 3, 2024 18:37
@edgchen1
edgchen1 merged commit cbf3c50 into main Sep 4, 2024
@edgchen1
edgchen1 deleted the edgchen1/detox_stability branch September 4, 2024 15:41
@jchen351 jchen351 mentioned this pull request Sep 11, 2024
6 tasks
jchen351 added a commit that referenced this pull request Sep 17, 2024
### Description
See microsoft/onnxruntime-extensions#476
and actions/runner-images#7671

### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->

### Current issue
- [ ] For default xcode 15.2, that come with the MacOS-13, We Need to
update the boost container header boost/container_hash/hash.hpp version
to pass the build
- [x] For xcode 14.2 The Build passed but the `Run React Native Detox
Android e2e Test` Failed.
Possible flaky test, #21969
- [x] For xcode 14.3.1 We encountered following issue in `Build React
Native Detox iOS e2e Tests`
```
ld: file not found: /Applications/Xcode_14.3.1.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/lib/arc/libarclite_iphonesimulator.a
clang: error: linker command failed with exit code 1 (use -v to see invocation)
```
Applied following code to the eof in both ios/Podfile and fixed the
issue
```
post_install do |installer|
    installer.generated_projects.each do |project|
        project.targets.each do |target|
            target.build_configurations.each do |config|
                config.build_settings['IPHONEOS_DEPLOYMENT_TARGET'] = '13.0'
            end
        end
    end
end
```


- [x] react/react-native#32483

Applying changes to ios/Pofile
```
pre_install do |installer|
  # Custom pre-install script or commands
  puts "Running pre-install script..."

  # Recommended fix for react/react-native#32483
  # from react/react-native#32483 (comment)
  system("sed -i '' 's/typedef uint8_t clockid_t;//' \"${SRCROOT}/Pods/RCT-Folly/folly/portability/Time.h\"")
end
```

- [ ] Detox environment setting up exceeded time out of 120000ms during
iso e2e test


### dependent 

- [x] #21159

---------

Co-authored-by: Changming Sun <chasun@microsoft.com>
rohan11235813 pushed a commit to quadric-io/onnxruntime that referenced this pull request Aug 19, 2025
### Description
See microsoft/onnxruntime-extensions#476
and actions/runner-images#7671

### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->

### Current issue
- [ ] For default xcode 15.2, that come with the MacOS-13, We Need to
update the boost container header boost/container_hash/hash.hpp version
to pass the build
- [x] For xcode 14.2 The Build passed but the `Run React Native Detox
Android e2e Test` Failed.
Possible flaky test, microsoft/onnxruntime#21969
- [x] For xcode 14.3.1 We encountered following issue in `Build React
Native Detox iOS e2e Tests`
```
ld: file not found: /Applications/Xcode_14.3.1.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/lib/arc/libarclite_iphonesimulator.a
clang: error: linker command failed with exit code 1 (use -v to see invocation)
```
Applied following code to the eof in both ios/Podfile and fixed the
issue
```
post_install do |installer|
    installer.generated_projects.each do |project|
        project.targets.each do |target|
            target.build_configurations.each do |config|
                config.build_settings['IPHONEOS_DEPLOYMENT_TARGET'] = '13.0'
            end
        end
    end
end
```


- [x] react/react-native#32483

Applying changes to ios/Pofile
```
pre_install do |installer|
  # Custom pre-install script or commands
  puts "Running pre-install script..."

  # Recommended fix for react/react-native#32483
  # from react/react-native#32483 (comment)
  system("sed -i '' 's/typedef uint8_t clockid_t;//' \"${SRCROOT}/Pods/RCT-Folly/folly/portability/Time.h\"")
end
```

- [ ] Detox environment setting up exceeded time out of 120000ms during
iso e2e test


### dependent 

- [x] microsoft/onnxruntime#21159

---------

Co-authored-by: Changming Sun <chasun@microsoft.com>
rohan11235813 pushed a commit to quadric-io/onnxruntime that referenced this pull request Sep 15, 2025
### Description
See microsoft/onnxruntime-extensions#476
and actions/runner-images#7671

### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->

### Current issue
- [ ] For default xcode 15.2, that come with the MacOS-13, We Need to
update the boost container header boost/container_hash/hash.hpp version
to pass the build
- [x] For xcode 14.2 The Build passed but the `Run React Native Detox
Android e2e Test` Failed.
Possible flaky test, microsoft/onnxruntime#21969
- [x] For xcode 14.3.1 We encountered following issue in `Build React
Native Detox iOS e2e Tests`
```
ld: file not found: /Applications/Xcode_14.3.1.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/lib/arc/libarclite_iphonesimulator.a
clang: error: linker command failed with exit code 1 (use -v to see invocation)
```
Applied following code to the eof in both ios/Podfile and fixed the
issue
```
post_install do |installer|
    installer.generated_projects.each do |project|
        project.targets.each do |target|
            target.build_configurations.each do |config|
                config.build_settings['IPHONEOS_DEPLOYMENT_TARGET'] = '13.0'
            end
        end
    end
end
```


- [x] react/react-native#32483

Applying changes to ios/Pofile
```
pre_install do |installer|
  # Custom pre-install script or commands
  puts "Running pre-install script..."

  # Recommended fix for react/react-native#32483
  # from react/react-native#32483 (comment)
  system("sed -i '' 's/typedef uint8_t clockid_t;//' \"${SRCROOT}/Pods/RCT-Folly/folly/portability/Time.h\"")
end
```

- [ ] Detox environment setting up exceeded time out of 120000ms during
iso e2e test


### dependent 

- [x] microsoft/onnxruntime#21159

---------

Co-authored-by: Changming Sun <chasun@microsoft.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants