Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss
RFH: Packaging Intel's userspace tools for Data Streaming Accelerator
12 views
Skip to first unread message
Gunnar Wolf
Oct 21, 2022, 2:00:03 PM10/21/22
to
Hi all,
I was recently approached by Intel engineers Miguel and Jair (Cc:ed on
this mail). They asked for my help in getting Debian Bookworm and
higher to support the Data Streaming Accelerator, and we have
exchanged a couple of messages about this. I'm reproducing next part
of our conversation.
The purpose of this mail is to help find interested people in Debian
that can help review and sponsor uploads of the userspace tools; the
kernel-side modules have been enabled as of bug #1021337 (thanks for
the quick reply!)
It is quite probable Miguel and Jair can be the package maintainers,
and I'd be more than happy to welcome them in Debian, but they will
surely need some guidance to get the package (for which the work is
already started¹) in a state that can be uploaded to Debian. I've been
meaning to start helping them, but am quite time-strained and have
been unable to do so, so... anybody interested in getting this
technology supported in our distribution will be a good candidate to
help!
¹ The proposed debian/control file can be found at
https://github.com/intel/idxd-config/blob/stable/debian/control
I asked them for a description of Intel DSA. They say that:
The driver enables the Data Streaming Accelerator or DSA
capability for the 4th generation of the Intel Scalable Xeon
processor family, with code name Sapphire Rapids, and for future
Intel processors.
As stated in the DSA specification (which can be found at
https://software.intel.com/en-us/download/intel-data-streaming-accelerator-preliminary-architecture-specification
):
Intel DSA is a high-performance data copy and transformation
accelerator that will be integrated in future Intel® processors,
targeted for optimizing streaming data movement and transformation
operations common with applications for high-performance storage,
networking, persistent memory, and various data processing
applications.
Intel DSA replaces Intel® QuickData Technology, which is a part of
Intel® I/O Acceleration Technology.
I was also pointed at this very clear blog post in Intel Open Source's
space:
https://01.org/blogs/2019/introducing-intel-data-streaming-accelerator
The userspace software is already available in Fedora / CentOS / RHEL
under the name "accel-config" and "libaccel-config". They propose the
following description:
Utility for configuring the DSA subsystem
Intel Accelerator Utilities (accel-config) provides a user
interface to the Intel Data Streaming Accelerator (DSA). DSA is a
high-performance data copy and transformation accelerator
integrated into Intel Xeon processors. . This package contains a
utility for configuring the DSA (Data Stream Accelerator)
subsystem in the Linux kernel.
The first processor family to support the capability is Intel's fourth
generation of Scalable Xeon server processors, code-named Sapphire
Rapids. Currently some SPR products are planned to be launched on 2022
calendar week 42 and 2022 calendar week 45. High volume SPR processors
have a planned launch window on 2023 calendar week 6 to 9 (Feb. 6,
2023 to March 3, 2023).
The document at
https://01.org/blogs/2019/introducing-intel-data-streaming-accelerator
is a good introduction to the accelerator feature.
From it, we can extract additional details about the accel-config
tool's architecture and features:
accel-config is a utility that allows system administrators to
configure groups, work queues and engines. The utility parses the
topology and capabilities exposed via sysfs and provides a command
line interface to configure resources. Some of the capabilities of the
accel-config are listed below:
> Display the device hierarchy.
> Configure attributes and provide access for kernel or applications.
> Use API library (libaccel) that applications can link to to perform
> operations through a standard ‘C’ library.
> Control devices to stop, start interfaces.
> Create VFIO mediated devices to expose virtual Intel® DSA instances
> to Guest OSes.
So... Is anybody among debian-devel readers interested in helping
Debian support this hardware feature? Extra points for people that
_have_ the suitable hardware! (I don't)
Greetings,
I was recently approached by Intel engineers Miguel and Jair (Cc:ed on
this mail). They asked for my help in getting Debian Bookworm and
higher to support the Data Streaming Accelerator, and we have
exchanged a couple of messages about this. I'm reproducing next part
of our conversation.
The purpose of this mail is to help find interested people in Debian
that can help review and sponsor uploads of the userspace tools; the
kernel-side modules have been enabled as of bug #1021337 (thanks for
the quick reply!)
It is quite probable Miguel and Jair can be the package maintainers,
and I'd be more than happy to welcome them in Debian, but they will
surely need some guidance to get the package (for which the work is
already started¹) in a state that can be uploaded to Debian. I've been
meaning to start helping them, but am quite time-strained and have
been unable to do so, so... anybody interested in getting this
technology supported in our distribution will be a good candidate to
help!
¹ The proposed debian/control file can be found at
https://github.com/intel/idxd-config/blob/stable/debian/control
I asked them for a description of Intel DSA. They say that:
The driver enables the Data Streaming Accelerator or DSA
capability for the 4th generation of the Intel Scalable Xeon
processor family, with code name Sapphire Rapids, and for future
Intel processors.
As stated in the DSA specification (which can be found at
https://software.intel.com/en-us/download/intel-data-streaming-accelerator-preliminary-architecture-specification
):
Intel DSA is a high-performance data copy and transformation
accelerator that will be integrated in future Intel® processors,
targeted for optimizing streaming data movement and transformation
operations common with applications for high-performance storage,
networking, persistent memory, and various data processing
applications.
Intel DSA replaces Intel® QuickData Technology, which is a part of
Intel® I/O Acceleration Technology.
I was also pointed at this very clear blog post in Intel Open Source's
space:
https://01.org/blogs/2019/introducing-intel-data-streaming-accelerator
The userspace software is already available in Fedora / CentOS / RHEL
under the name "accel-config" and "libaccel-config". They propose the
following description:
Utility for configuring the DSA subsystem
Intel Accelerator Utilities (accel-config) provides a user
interface to the Intel Data Streaming Accelerator (DSA). DSA is a
high-performance data copy and transformation accelerator
integrated into Intel Xeon processors. . This package contains a
utility for configuring the DSA (Data Stream Accelerator)
subsystem in the Linux kernel.
The first processor family to support the capability is Intel's fourth
generation of Scalable Xeon server processors, code-named Sapphire
Rapids. Currently some SPR products are planned to be launched on 2022
calendar week 42 and 2022 calendar week 45. High volume SPR processors
have a planned launch window on 2023 calendar week 6 to 9 (Feb. 6,
2023 to March 3, 2023).
The document at
https://01.org/blogs/2019/introducing-intel-data-streaming-accelerator
is a good introduction to the accelerator feature.
From it, we can extract additional details about the accel-config
tool's architecture and features:
accel-config is a utility that allows system administrators to
configure groups, work queues and engines. The utility parses the
topology and capabilities exposed via sysfs and provides a command
line interface to configure resources. Some of the capabilities of the
accel-config are listed below:
> Display the device hierarchy.
> Configure attributes and provide access for kernel or applications.
> Use API library (libaccel) that applications can link to to perform
> operations through a standard ‘C’ library.
> Control devices to stop, start interfaces.
> Create VFIO mediated devices to expose virtual Intel® DSA instances
> to Guest OSes.
So... Is anybody among debian-devel readers interested in helping
Debian support this hardware feature? Extra points for people that
_have_ the suitable hardware! (I don't)
Greetings,
nick black
Oct 21, 2022, 4:41:40 PM10/21/22
to
Gunnar Wolf left as an exercise for the reader:
integrating it into my product if it proves itself, and this
kind of thing is directly up my alley besides. i'm one of the
newest DDs, but i'd be very happy to work with Jair and Miguel.
--
nick black -=- https://www.nick-black.com
to make an apple pie from scratch,
you need first invent a universe.
> So... Is anybody among debian-devel readers interested in helping
> Debian support this hardware feature? Extra points for people that
> _have_ the suitable hardware! (I don't)
my current professional plans include evaluating DSA and
> Debian support this hardware feature? Extra points for people that
> _have_ the suitable hardware! (I don't)
integrating it into my product if it proves itself, and this
kind of thing is directly up my alley besides. i'm one of the
newest DDs, but i'd be very happy to work with Jair and Miguel.
--
nick black -=- https://www.nick-black.com
to make an apple pie from scratch,
you need first invent a universe.
Paul Wise
Oct 21, 2022, 10:30:03 PM10/21/22
to
On Fri, 2022-10-21 at 12:48 -0500, Gunnar Wolf wrote:
> The purpose of this mail is to help find interested people in Debian
> that can help review and sponsor uploads of the userspace tools; the
> kernel-side modules have been enabled as of bug #1021337 (thanks for
> the quick reply!)
PS: once the userspace tools reach Debian, please add them here:
> The purpose of this mail is to help find interested people in Debian
> that can help review and sponsor uploads of the userspace tools; the
> kernel-side modules have been enabled as of bug #1021337 (thanks for
> the quick reply!)
https://wiki.debian.org/DebianKernel/UserspaceTools
> It is quite probable Miguel and Jair can be the package maintainers,
> and I'd be more than happy to welcome them in Debian, but they will
> surely need some guidance to get the package (for which the work is
> already started¹) in a state that can be uploaded to Debian.
involved in Debian. Our usual docs for new maintainers are here:
https://mentors.debian.net/intro-maintainers/
The basic procedure is to make a new package, polish it up with
lintian, piuparts, autopkgtest and other automated checking tools,
upload it to the mentors site and file a request for sponsor (RFS).
https://mentors.debian.net/sponsors/rfs-howto/
The Debian glossary may help with any unfamiliar jargon:
https://wiki.debian.org/Glossary
In case Intel are interested in supporting Debian more generally we
have some info on our website, inc about partnerships and sponsorship.
https://www.debian.org/intro/help#organizations
https://www.debconf.org/sponsors/
https://www.debian.org/partners/
--
bye,
pabs
https://wiki.debian.org/PaulWise
0 new messages