webnn: Migrate Cast validation tests to WPTs [chromium/src : main]

0 views
Skip to first unread message

Feng Dai (Gerrit)

unread,
Jul 1, 2024, 11:13:40 AM (2 days ago) Jul 1
to Shanxing Mei, Austin Sullivan, Dwayne Robinson, chromium...@chromium.org, Jiewei Qian, blink-revie...@chromium.org, blink-...@chromium.org
Attention needed from Austin Sullivan, Dwayne Robinson and Shanxing Mei

Feng Dai added 2 comments

Patchset-level comments
File-level comment, Patchset 3 (Latest):
Feng Dai . resolved

Sorry for slow response.

Thanks @shanxi...@intel.com! Please rebase code to fix conflict.

Austin, Dwayne, Would you please take a look? Thanks!

File third_party/blink/web_tests/external/wpt/webnn/validation_tests/cast.https.any.js
Line 16, Patchset 3 (Latest):const tests = [
Feng Dai . unresolved

These validation tests are only `cast`ing from `float32` here. But WPT WebNN Conformance tests of `cast` operator cover most supported type except tests of `uint64` type.
Is it ok to only casting from `float32` type for validation tests?

asu...@chromium.org, dwa...@microsoft.com Any suggestions? Thanks.

Open in Gerrit

Related details

Attention is currently required from:
  • Austin Sullivan
  • Dwayne Robinson
  • Shanxing Mei
Submit Requirements:
  • requirement satisfiedCode-Coverage
  • requirement is not satisfiedCode-Review
  • requirement is not satisfiedNo-Unresolved-Comments
Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. DiffyGerrit
Gerrit-MessageType: comment
Gerrit-Project: chromium/src
Gerrit-Branch: main
Gerrit-Change-Id: I3c3f215e721d3b4cea571d46bbc070a1dd015d6f
Gerrit-Change-Number: 5601723
Gerrit-PatchSet: 3
Gerrit-Owner: Shanxing Mei <shanxi...@intel.com>
Gerrit-Reviewer: Austin Sullivan <asu...@chromium.org>
Gerrit-Reviewer: Dwayne Robinson <dwa...@microsoft.com>
Gerrit-CC: Feng Dai <feng...@intel.com>
Gerrit-CC: Jiewei Qian <q...@chromium.org>
Gerrit-Attention: Shanxing Mei <shanxi...@intel.com>
Gerrit-Attention: Dwayne Robinson <dwa...@microsoft.com>
Gerrit-Attention: Austin Sullivan <asu...@chromium.org>
Gerrit-Comment-Date: Mon, 01 Jul 2024 15:13:28 +0000
Gerrit-HasComments: Yes
Gerrit-Has-Labels: No
satisfied_requirement
unsatisfied_requirement
open
diffy

Austin Sullivan (Gerrit)

unread,
Jul 1, 2024, 2:12:11 PM (2 days ago) Jul 1
to Shanxing Mei, Dwayne Robinson, Feng Dai, chromium...@chromium.org, Jiewei Qian, blink-revie...@chromium.org, blink-...@chromium.org
Attention needed from Dwayne Robinson, Feng Dai and Shanxing Mei

Austin Sullivan added 1 comment

File third_party/blink/web_tests/external/wpt/webnn/validation_tests/cast.https.any.js
Feng Dai . unresolved

These validation tests are only `cast`ing from `float32` here. But WPT WebNN Conformance tests of `cast` operator cover most supported type except tests of `uint64` type.
Is it ok to only casting from `float32` type for validation tests?

asu...@chromium.org, dwa...@microsoft.com Any suggestions? Thanks.

Austin Sullivan

Are validation tests for `cast` necessary? According to https://www.w3.org/TR/webnn/#api-mlgraphbuilder-cast the only way `cast` can throw an exception is if the input is from another builder, which is tested above. The tests added only check that the output descriptor is correct. This is already tested by the conformance tests. Since these tests don't provide any additional coverage... do we need them at all?

If there are input type -> output type combinations which are not already tested in the conformance tests, we should remedy that by adding conformance tests which actually assert that the casted values (not just the output descriptor) are correct

Open in Gerrit

Related details

Attention is currently required from:
  • Dwayne Robinson
  • Feng Dai
  • Shanxing Mei
Submit Requirements:
  • requirement satisfiedCode-Coverage
  • requirement is not satisfiedCode-Review
  • requirement is not satisfiedNo-Unresolved-Comments
Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. DiffyGerrit
Gerrit-MessageType: comment
Gerrit-Project: chromium/src
Gerrit-Branch: main
Gerrit-Change-Id: I3c3f215e721d3b4cea571d46bbc070a1dd015d6f
Gerrit-Change-Number: 5601723
Gerrit-PatchSet: 3
Gerrit-Owner: Shanxing Mei <shanxi...@intel.com>
Gerrit-Reviewer: Austin Sullivan <asu...@chromium.org>
Gerrit-Reviewer: Dwayne Robinson <dwa...@microsoft.com>
Gerrit-CC: Feng Dai <feng...@intel.com>
Gerrit-CC: Jiewei Qian <q...@chromium.org>
Gerrit-Attention: Shanxing Mei <shanxi...@intel.com>
Gerrit-Attention: Dwayne Robinson <dwa...@microsoft.com>
Gerrit-Attention: Feng Dai <feng...@intel.com>
Gerrit-Comment-Date: Mon, 01 Jul 2024 18:11:59 +0000
Gerrit-HasComments: Yes
Gerrit-Has-Labels: No
Comment-In-Reply-To: Feng Dai <feng...@intel.com>
satisfied_requirement
unsatisfied_requirement
open
diffy

Feng Dai (Gerrit)

unread,
Jul 2, 2024, 9:45:17 PM (9 hours ago) Jul 2
to Shanxing Mei, Austin Sullivan, Dwayne Robinson, chromium...@chromium.org, Jiewei Qian, blink-revie...@chromium.org, blink-...@chromium.org
Attention needed from Austin Sullivan, Dwayne Robinson and Shanxing Mei

Feng Dai added 1 comment

File third_party/blink/web_tests/external/wpt/webnn/validation_tests/cast.https.any.js
Line 16, Patchset 3:const tests = [
Feng Dai . resolved

These validation tests are only `cast`ing from `float32` here. But WPT WebNN Conformance tests of `cast` operator cover most supported type except tests of `uint64` type.
Is it ok to only casting from `float32` type for validation tests?

asu...@chromium.org, dwa...@microsoft.com Any suggestions? Thanks.

Austin Sullivan

Are validation tests for `cast` necessary? According to https://www.w3.org/TR/webnn/#api-mlgraphbuilder-cast the only way `cast` can throw an exception is if the input is from another builder, which is tested above. The tests added only check that the output descriptor is correct. This is already tested by the conformance tests. Since these tests don't provide any additional coverage... do we need them at all?

If there are input type -> output type combinations which are not already tested in the conformance tests, we should remedy that by adding conformance tests which actually assert that the casted values (not just the output descriptor) are correct

Feng Dai

Asutin, thank you for reviewing this CL. Yes, you're right. The conformance tests have already covered.
Shanxing, please abandon it. Thanks a lot for your contributions.

Open in Gerrit

Related details

Attention is currently required from:
  • Austin Sullivan
  • Dwayne Robinson
  • Shanxing Mei
Submit Requirements:
  • requirement satisfiedCode-Coverage
  • requirement is not satisfiedCode-Review
Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. DiffyGerrit
Gerrit-MessageType: comment
Gerrit-Project: chromium/src
Gerrit-Branch: main
Gerrit-Change-Id: I3c3f215e721d3b4cea571d46bbc070a1dd015d6f
Gerrit-Change-Number: 5601723
Gerrit-PatchSet: 4
Gerrit-Owner: Shanxing Mei <shanxi...@intel.com>
Gerrit-Reviewer: Austin Sullivan <asu...@chromium.org>
Gerrit-Reviewer: Dwayne Robinson <dwa...@microsoft.com>
Gerrit-CC: Feng Dai <feng...@intel.com>
Gerrit-CC: Jiewei Qian <q...@chromium.org>
Gerrit-Attention: Shanxing Mei <shanxi...@intel.com>
Gerrit-Attention: Dwayne Robinson <dwa...@microsoft.com>
Gerrit-Attention: Austin Sullivan <asu...@chromium.org>
Gerrit-Comment-Date: Wed, 03 Jul 2024 01:45:01 +0000
Gerrit-HasComments: Yes
Gerrit-Has-Labels: No
Comment-In-Reply-To: Austin Sullivan <asu...@chromium.org>
Comment-In-Reply-To: Feng Dai <feng...@intel.com>
satisfied_requirement
unsatisfied_requirement
open
diffy

Shanxing Mei (Gerrit)

unread,
4:06 AM (2 hours ago) 4:06 AM
to Austin Sullivan, Dwayne Robinson, Feng Dai, chromium...@chromium.org, Jiewei Qian, blink-revie...@chromium.org, blink-...@chromium.org

Shanxing Mei abandoned this change

Related details

Attention set is empty
Submit Requirements:
  • requirement satisfiedCode-Coverage
  • requirement is not satisfiedCode-Review
Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. DiffyGerrit
Gerrit-MessageType: abandon
satisfied_requirement
unsatisfied_requirement
open
diffy
Reply all
Reply to author
Forward
0 new messages