SG19 Jan 11 monthly webex

65 views
Skip to first unread message

Michael Wong

unread,
Jan 8, 2019, 11:42:06 AM1/8/19
to SG19 - Machine Learning

Hi all, here is the webex.  This week, we will mostly focus on any papers people would like to propose for Kona?


SG19 Machine Learning

Hosted by Michael Wong
Recurrence: Occurs every Friday effective 12/14/2018 until 3/1/2019 from 11:00 AM to 12:00 PM, (UTC-05:00) Eastern Time (US & Canada)
Meeting Information
Meeting link:
https://codeplay.webex.com/codeplay/j.php?MTID=md49c62b8d7c6c3a0d9476ded6d5395fd
Meeting number:
959 666 828
Password:
hc2hp73f (42247733 from phones)
More ways to join
Join by phone
+44-203-478-5289 United Kingdom toll
+1 631 267 4890 USA/Canada toll
Access code: 959 666 828







Agenda:

1. Opening and introductions

1.1 Roll call of participants


1.2 Adopt agenda


1.3 Approve minutes from previous meeting, and approve publishing  previously approved minutes to ISOCPP.org

1.4 Action items from previous meetings

2. Main issues (125 min)

2.1 General logistics

2 new SGs mailing lists for SG19 Machine Learning

https://groups.google.com/a/isocpp.org/forum/#!forum/sg19

and SG20 Education

https://groups.google.com/a/isocpp.org/forum/?fromgroups=#!forum/sg20

https://isocpp.org/std/forums

Any meeting rooms required for Kona?

EWG-I will meet Mon-Wed.
LEWG-I is penciled in for Mon-Thu, considering the outcome in San Diego.

SG12/WG23 will meet Wed-Fri - the last day being SG12-focused.


SG20 (education)  would like to meet on Thursday (all day)

SG14 Friday Morning, SG19 Friday  afternoon.

Who is coming?


2.2 Paper reviews


Any papers proposed for review at Kona? Deadline Jan 21 10 ET.

2.2.1 SG14 Linear Algebra progress
Different layers of proposal

Jan 3 minutes

https://11950069482448417429.googlegroups.com/attach/60d4bfb6a587d/02jan2019.txt?part=0.1&view=1&vt=ANaJVrEPWoxHPpZ54t6CiYjZtaaNNv6rM23380AXmdr0gyxB6X5rLNiYkVM65h1TPpvpjZoqeaUgjRnsRUTe3ZVwfPvQyBQl27VnYlaN-y4j8EEcf0jWCWY

2.2.2 any other proposal for reviews?



2.3 Other Papers and proposals


2.5 Future F2F meetings:


2.6 future C++ Standard meetings:

https://isocpp.org/std/meetings-and-participation/upcoming-meetings
  • 2019-02-18 to 23: Kona, HI, USA; Standard C++ Foundation, NVIDIA, Plum Hall, Jens Maurer
  • 2019-07-15 to 20: Cologne, Germany; Nicolai Josuttis
  • 2019-11-04 to 09: Belfast, Northern Ireland; Archer Yates

3. Any other business 
Reflector
https://groups.google.com/a/isocpp.org/forum/#!newtopic/sg19

Code and proposal Staging area

4. Review

4.1 Review and approve resolutions and issues [e.g., changes to SG's working draft]

4.2 Review action items (5 min)


5. Closing process


5.1 Establish next agenda 

Feb 8


5.2 Future meeting

Dec 14:logistics
Jan 11:this meeting
Jan 21: Kona mailing deadline
Feb 8:
Feb 18: C++ Std meeting Kona

Michael Wong

unread,
Jan 8, 2019, 11:42:52 AM1/8/19
to SG19 - Machine Learning
Please add any paper proposal here. Thanks.

Matthieu Brucher

unread,
Jan 8, 2019, 2:18:51 PM1/8/19
to Michael Wong, SG19 - Machine Learning
Hi,

I'm still working on the linear algebra feedback.

Cheers,

Matthieu

--
You received this message because you are subscribed to the Google Groups "SG19 - Machine Learning" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sg19+uns...@isocpp.org.
To post to this group, send email to sg...@isocpp.org.
Visit this group at https://groups.google.com/a/isocpp.org/group/sg19/.
To view this discussion on the web visit https://groups.google.com/a/isocpp.org/d/msgid/sg19/47bd50aa-6579-4822-a908-ec3407730f2b%40isocpp.org.


--

doss...@cs.uregina.ca

unread,
Jan 9, 2019, 5:57:57 PM1/9/19
to SG19 - Machine Learning
Thanks to all for the great work and progress on this new library. I see that Guy's work items for a linear algebra proposal includes a solve() function, namely

template<typename ENG> auto solve(array<ENG>, vector<ENG>);

This is great! Is it likely that eigenvalues/eigenvectors and the SVD will be included as part of the proposal at this time? By doing so, the library would include all features/operations found in a standard 2-term linear algebra course.

Matthieu Brucher

unread,
Jan 9, 2019, 6:05:00 PM1/9/19
to doss...@cs.uregina.ca, SG19 - Machine Learning
I think that solve is a mistake, because there are too many ways of computing this, depending on different properties of the matrix and different options.
SVD was mentioned more as something that could be managed to be written once the container and the basic operations are set.

But we are still very far from having something that works for SG19. We almost didn't get componentwise multiplication, and it's still not sure we will get it. If we don't, then I will consider the effort as a failure.

Cheers,

Matthieu

--
You received this message because you are subscribed to the Google Groups "SG19 - Machine Learning" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sg19+uns...@isocpp.org.
To post to this group, send email to sg...@isocpp.org.
Visit this group at https://groups.google.com/a/isocpp.org/group/sg19/.
To view this discussion on the web visit https://groups.google.com/a/isocpp.org/d/msgid/sg19/38ab89d8-c8cd-48af-a215-f324a96cc6e4%40isocpp.org.

Michael Wong

unread,
Jan 10, 2019, 9:18:39 PM1/10/19
to SG19 - Machine Learning, doss...@cs.uregina.ca
So indeed one of the thing we will have to discuss is feedback to LA as well as any other proposals.

Michael Wong

unread,
Jan 10, 2019, 9:39:51 PM1/10/19
to SG19 - Machine Learning
Updates from recent discussions.


On Tuesday, January 8, 2019 at 11:42:06 AM UTC-5, Michael Wong wrote:

Frequency of meetings, we are actually booked weekly.

2.2 Paper reviews


Any papers proposed for review at Kona? Deadline Jan 21 10 ET.

2.2.1 SG14 Linear Algebra progress Feedbacks
presentation by Matheiu
xtensor presentation

Graphs

Probability

A prioritized layer approach to ML


2.3 Other Papers and proposals


2.5 Future F2F meetings/Conferences:


  • 2019-06-10-15 ICML Long Beach US
  • 2019-06-15-21: CVPR Long Beach US
  • 2019-10-27-11-3 ICCV Seoul

2.6 future C++ Standard meetings:

https://isocpp.org/std/meetings-and-participation/upcoming-meetings
  • 2019-02-18 to 23: Kona, HI, USA; Standard C++ Foundation, NVIDIA, Plum Hall, Jens Maurer
  • 2019-07-15 to 20: Cologne, Germany; Nicolai Josuttis
  • 2019-11-04 to 09: Belfast, Northern Ireland; Archer Yates

Michael Wong

unread,
Jan 11, 2019, 12:01:40 PM1/11/19
to SG19 - Machine Learning
Meeting minutes. Recording available on demand.


On Thursday, January 10, 2019 at 9:39:51 PM UTC-5, Michael Wong wrote:
Updates from recent discussions.

On Tuesday, January 8, 2019 at 11:42:06 AM UTC-5, Michael Wong wrote:

Hi all, here is the webex.  This week, we will mostly focus on any papers people would like to propose for Kona?


SG19 Machine Learning

Hosted by Michael Wong
Recurrence: Occurs every Friday effective 12/14/2018 until 3/1/2019 from 11:00 AM to 12:00 PM, (UTC-05:00) Eastern Time (US & Canada)
Meeting Information
Meeting link:
https://codeplay.webex.com/codeplay/j.php?MTID=md49c62b8d7c6c3a0d9476ded6d5395fd
Meeting number:
959 666 828
Password:
hc2hp73f (42247733 from phones)
More ways to join
Join by phone
+44-203-478-5289 United Kingdom toll
+1 631 267 4890 USA/Canada toll
Access code: 959 666 828







Agenda:

1. Opening and introductions

1.1 Roll call of participants

Michael, David Gillies, David Lindelof, Frank Seide, Guiherme Hartmann, Sebastien Messmer, Sylvain Corlay, Johan Mabille, John Lawson, Uwe Dolinski, Vincent


1.2 Adopt agenda

Approve


1.3 Approve minutes from previous meeting, and approve publishing  previously approved minutes to ISOCPP.org

Approve

1.4 Action items from previous meetings

2. Main issues (125 min)

2.1 General logistics

2 new SGs mailing lists for SG19 Machine Learning

https://groups.google.com/a/isocpp.org/forum/#!forum/sg19

and SG20 Education

https://groups.google.com/a/isocpp.org/forum/?fromgroups=#!forum/sg20

https://isocpp.org/std/forums

Any meeting rooms required for Kona?

EWG-I will meet Mon-Wed.
LEWG-I is penciled in for Mon-Thu, considering the outcome in San Diego.

SG12/WG23 will meet Wed-Fri - the last day being SG12-focused.


SG20 (education)  would like to meet on Thursday (all day)

SG14 Friday Morning, SG19 Friday  afternoon.

Who is coming?

Frequency of meetings, we are actually booked weekly.

2.2 Paper reviews


Any papers proposed for review at Kona? Deadline Jan 21 10 ET.

2.2.1 SG14 Linear Algebra progress Feedbacks
presentation by Matheiu
with dynamic pytorch graph, it is harder to be added to C++ apps
can use torch script? but lib torch is more flexible but still need to rewrite the code
restrict it to a smaller set for torch script

also need 3 or 4d arrays, need specialization for 4d arrays from ONYX
baseline shoudl enable unlimited or very large numbers in reality
ONYX was on purpose to expose accelerators from CUDNN, specfically, but had exceptions for higher dimensions
simialr in xtensor, the primary is n-dim arrays
some of the API are optmizmed to the backend in ONYX
can this be adapted to major exchange interface libraries like ONYX and NNEF, we should ensure Linear algebra can do this

this is a potential paper for Kona, write as a google doc
expression template for n-d library, use numpy api, broadcast, reshape, 
3 type of containers
integrates with Blas, or MKL,
also have adaptors, for old-style C arrays

https://github.com/QuantStack/xtensor
from Johan Mabille to everyone:
https://xtensor.readthedocs.io/en/latest/numpy.html
from Sylvain Corlay & Johan Mabille to everyone:
*closure semantics*
from Sylvain Corlay & Johan Mabille to everyone:
https://xtensor.readthedocs.io/en/latest/closure-semantics.html
from Sylvain Corlay & Johan Mabille to everyone:
https://mybinder.org/v2/gh/QuantStack/xtensor/stable?filepath=notebooks/xtensor.ipynb

needs list expression access by generalizing cref and ref, only one type that is closure, so when taking a ref, it is kept as a ref
so when concat, will expand the lifetime,
plan for gpu in future, already suppord SIMD using xsimd like boost:simd can be competitive with eigen; pyThran is a python to C++ translator is trying to make xtensor a backend to numpy

memory space is different in GPU, so needs to be copied and moved a lot, how to deal with that? tensor added that is already in GPU may be loaded by batch,
but can you know if something is modified in oneside and reduce the copying
xFrame

sparse tensor? its an expression system, so can make the tensor for any data structure, CSD and CSR is in the plan
memory management? there are 2 : containers that we do provide are backed by std:vector internally using your own allocator, then there is the lifetime management



Graphs

Probability

A prioritized layer approach to ML

fundamental arrays, matrix, vectors, tensors, linear algebra
●
facilitate better support for interchange of in memory information/data between packages
●
basic graphing
●
optimization , quantization, parallelism, batching computations of vector, matrix, tensors
●
packaging to allow adding computation/data manipulation/scaling packages +
dependency
●
supporting portability to various hardware embedded inference engines, and up down
convert of different FP sizes between training and inference.
●
support of exchange formats (ONNX, NNEF)
●
support for kernel fusion on training and inference
●
support of accelerator dispatch to inference engines, GPUs, FPGAs, MPSoC, Tensor
Processing Units,
​
Coarse Grain Reconfigurable Arrays
​
, many of the newer ML boards
from Xilinx, Google, ARM, Wave Computing, Nvidia
●
do we need a graph extraction pass on top of C++
●
support interoperability with data formats from Python and R packages
●
Other C++ ML/Data Analysis libs : shark, MLpack, dlib, root [
​
root
​
]
●
Integration Xla, tvm, tensor-rt, glow
●
lazy evaluation execution graphs/workflows
●
graph and tree data structures
 


2.3 Other Papers and proposals


2.5 Future F2F meetings/Conferences:


  • 2019-06-10-15 ICML Long Beach US
  • 2019-06-15-21: CVPR Long Beach US
  • 2019-10-27-11-3 ICCV Seoul

2.6 future C++ Standard meetings:

https://isocpp.org/std/meetings-and-participation/upcoming-meetings
  • 2019-02-18 to 23: Kona, HI, USA; Standard C++ Foundation, NVIDIA, Plum Hall, Jens Maurer
  • 2019-07-15 to 20: Cologne, Germany; Nicolai Josuttis
  • 2019-11-04 to 09: Belfast, Northern Ireland; Archer Yates

2.7 Other Standard activities
Khronos ML
ISO SC 42 AI

3. Any other business 
Reflector
https://groups.google.com/a/isocpp.org/forum/#!newtopic/sg19

Code and proposal Staging area

4. Review

4.1 Review and approve resolutions and issues [e.g., changes to SG's working draft]

4.2 Review action items (5 min)


5. Closing process


5.1 Establish next agenda 
Graphs + prep Kona

Reply all
Reply to author
Forward
0 new messages