WebNN: Enable running WPT tests on ORT backend with default EPs [chromium/src : main]
จิตรกัญญา เลิศพันธ์ (Gerrit)
จิตรกัญญา เลิศพันธ์ added 1 comment![]( "Open in Gerrit")
Related details
- Miao, Bin
Code-Coverage
Code-Owners
Code-Review
Review-Enforcement
| Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. |
Hu, Ningxin (Gerrit)
Hu, Ningxin added 3 comments![]( "Open in Gerrit")
@bin....@intel.com, I uploaded a separate CL [1] to fix the GPU test failure / crash issue [2].
[1]: https://chromium-review.googlesource.com/c/chromium/src/+/7236019
[2]: https://issues.chromium.org/issues/466848120
const bool ignore_ihv_eps =
command_line->HasSwitch(switches::kWebNNOrtIgnoreIhvEps);
// If ignore IHV EPs, return empty list.
if (ignore_ihv_eps) {
return {};
}Could we skip calling `gpu_host_->EnsureWebNNExecutionProvidersReady` in service-side instead?
"--enable-features=WebMachineLearningNeuralNetwork,WebNNDirectML",
"--disable-features=WebNNOnnxRuntime"Should we also change NPU tests to ORT backend? At least we can test whether the NPU to CPU fallback path works.
Related details
- Miao, Bin
Code-Coverage
Code-Owners
Code-Review
No-Unresolved-Comments
Review-Enforcement
| Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. |
Miao, Bin (Gerrit)
Miao, Bin added 3 comments![]( "Open in Gerrit")
@bin....@intel.com, I uploaded a separate CL [1] to fix the GPU test failure / crash issue [2].
[1]: https://chromium-review.googlesource.com/c/chromium/src/+/7236019
[2]: https://issues.chromium.org/issues/466848120
I see that your CL has been merged. I have updated and rebased this CL and now I'm collecting WPT baseline results again.
const bool ignore_ihv_eps =
command_line->HasSwitch(switches::kWebNNOrtIgnoreIhvEps);
// If ignore IHV EPs, return empty list.
if (ignore_ihv_eps) {
return {};
}Could we skip calling `gpu_host_->EnsureWebNNExecutionProvidersReady` in service-side instead?
You are right, there is no need to call `gpu_host_->EnsureWebNNExecutionProvidersReady`.
"--enable-features=WebMachineLearningNeuralNetwork,WebNNDirectML",
"--disable-features=WebNNOnnxRuntime"Should we also change NPU tests to ORT backend? At least we can test whether the NPU to CPU fallback path works.
- Hu, Ningxin
Code-Coverage
Code-Owners
Code-Review
Review-Enforcement
| Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. |
Miao, Bin (Gerrit)
Miao, Bin added 1 comment![]( "Open in Gerrit")
Related details
- Hu, Ningxin
Code-Coverage
Code-Owners
Code-Review
Review-Enforcement
| Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. |
Hu, Ningxin (Gerrit)
Hu, Ningxin added 1 comment![]( "Open in Gerrit")
@rei...@chromium.org and @rafael....@microsoft.com, we found WebNN WPT results on win11-blink-rel trybots are varying and depending on the tasks (machines?).
For example [the pooling operators test](https://ci.chromium.org/ui/p/chromium/builders/try/win11-blink-rel/b8695183454377310561/test-results?q=ExactID%3A%3A%2F%2F%5C%3Ablink_wpt_tests%21webtest%3A%3Avirtual%2Fwebnn-service-with-gpu%2Fexternal%2Fwpt%2Fwebnn%2Fvalidation_tests%23pooling.https.any.html%3Fgpu+VHash%3Acab06a293434e127), when running on task [754863214a2faf11](https://chromium-swarm.appspot.com/task?id=754863214a2faf11&o=true&w=true), it fails to load ORT and falls back to TFLite.
```
[7740:7896:1217/195800.733:ERROR:services\webnn\ort\platform_functions_ort.cc:106] [WebNN] Failed to create package dependency for package: Microsoft.WindowsAppRuntime.1.8_8wekyb3d8bbwe
[7740:7896:1217/195800.735:ERROR:services\webnn\webnn_context_provider_impl.cc:451] [WebNN] Failed to create ONNX Runtime context: Failed to get ONNX Runtime platform functions.
```
However, when running on task [7548473783b52d11](https://chromium-swarm.appspot.com/task?id=7548473783b52d11&o=true&w=true), it loads and uses ORT successfully.
Do you know the difference between the two tasks? We may need Chrome infra team's help to install WinAppRuntime as Rafael shared in then email thread. Then we can get stable ORT backend test results and do the rebaseline.
WDYT?
Related details
- Miao, Bin
Code-Coverage
Code-Owners
Code-Review
Review-Enforcement
| Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. |
Reilly Grant (Gerrit)
Reilly Grant added 1 comment![]( "Open in Gerrit")
@rei...@chromium.org and @rafael....@microsoft.com, we found WebNN WPT results on win11-blink-rel trybots are varying and depending on the tasks (machines?).
For example [the pooling operators test](https://ci.chromium.org/ui/p/chromium/builders/try/win11-blink-rel/b8695183454377310561/test-results?q=ExactID%3A%3A%2F%2F%5C%3Ablink_wpt_tests%21webtest%3A%3Avirtual%2Fwebnn-service-with-gpu%2Fexternal%2Fwpt%2Fwebnn%2Fvalidation_tests%23pooling.https.any.html%3Fgpu+VHash%3Acab06a293434e127), when running on task [754863214a2faf11](https://chromium-swarm.appspot.com/task?id=754863214a2faf11&o=true&w=true), it fails to load ORT and falls back to TFLite.
```
[7740:7896:1217/195800.733:ERROR:services\webnn\ort\platform_functions_ort.cc:106] [WebNN] Failed to create package dependency for package: Microsoft.WindowsAppRuntime.1.8_8wekyb3d8bbwe
[7740:7896:1217/195800.735:ERROR:services\webnn\webnn_context_provider_impl.cc:451] [WebNN] Failed to create ONNX Runtime context: Failed to get ONNX Runtime platform functions.
```
However, when running on task [7548473783b52d11](https://chromium-swarm.appspot.com/task?id=7548473783b52d11&o=true&w=true), it loads and uses ORT successfully.Do you know the difference between the two tasks? We may need Chrome infra team's help to install WinAppRuntime as Rafael shared in then email thread. Then we can get stable ORT backend test results and do the rebaseline.
WDYT?
I have an open thread with the infra team to help get WinAppRuntime installed on the bots so we can get reliable results.
Related details
- Hu, Ningxin
- Miao, Bin
Code-Coverage
Code-Owners
Code-Review
Review-Enforcement
| Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. |