4.3 representer theorem

66 views
Skip to first unread message

zhuoc

unread,
Feb 16, 2013, 10:28:37 AM2/16/13
to 10-701-spri...@googlegroups.com
Hi,

It seems to me that in 4.3, f* is just one example that satisfies the conditions of representer theorem, and the statement we need to prove is the conclusion of the theorem. Can we just say that the representer theorem tells us ...?

Thanks,

Zhuo

Yitong Zhou

unread,
Feb 17, 2013, 12:49:28 PM2/17/13
to 10-701-spri...@googlegroups.com
I have the same question too. It seems that if we know the representer theorem, the question is already done.... Even does not need a proof or induction. Or say, we should write done the proof of the representer theorem?

Yitong

在 2013年2月16日星期六UTC-5上午10时28分37秒,zhuoc写道:

Barnabas Poczos

unread,
Feb 17, 2013, 12:54:32 PM2/17/13
to Yitong Zhou, 10-701-spri...@googlegroups.com
You don't need to write done the proof of the representer theorem.
The point of this exercise is to see that even ugly and scary
optimization problems over infinite dimensional function spaces can
be handled easily when the representer theorem holds.

You just need to show that the representer theorem holds.
Yes, I know it is very simple.

Best,
Barnabas
> --
> http://alex.smola.org/teaching/cmu2013-10-701 (course website)
> http://www.youtube.com/playlist?list=PLZSO_6-bSqHQmMKwWVvYwKreGu4b4kMU9
> (YouTube playlist)
> ---
> You received this message because you are subscribed to the Google Groups
> "10-701 Spring 2013 CMU" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to 10-701-spring-201...@googlegroups.com.
> To post to this group, send email to
> 10-701-spri...@googlegroups.com.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>

Alex Smola

unread,
Feb 17, 2013, 9:12:48 PM2/17/13
to Barnabas Poczos, Yitong Zhou, 10-701-spri...@googlegroups.com
hi yitong,

indeed. we proved the representer theorem in class for squared loss primarily. so yes, the proof is very easy. this assignment esentially just checks that you understood the proof.

cheers,

alex


--
                            ''~``
                           ( o o )
+----------------------.oooO--(_)--Oooo.---------------------------+
| Prof. Alexander J. Smola             http://alex.smola.org       |
| 5000 Forbes Ave                      phone: (+1) 408-759-1044    |
| Gates Hillman Center 8002            Carnegie Mellon University  |
| Pittsburgh 15213 PA    (   )   Oooo. Machine Learning Department |
+-------------------------\ (----(   )-----------------------------+                          
                          \_)    ) /
                                (_/

Shuchang Liu

unread,
Feb 17, 2013, 9:27:01 PM2/17/13
to 10-701-spri...@googlegroups.com, Barnabas Poczos, Yitong Zhou, al...@smola.org
Hi,

For this question, do we need to specify which risk function we use when applying Representer theorem? If so, how could we prove a given function is a risk function?

Thanks a lot!

> To post to this group, send email to

> For more options, visit https://groups.google.com/groups/opt_out.
>
>

--
http://alex.smola.org/teaching/cmu2013-10-701 (course website)
http://www.youtube.com/playlist?list=PLZSO_6-bSqHQmMKwWVvYwKreGu4b4kMU9 (YouTube playlist)
---
You received this message because you are subscribed to the Google Groups "10-701 Spring 2013 CMU" group.
To unsubscribe from this group and stop receiving emails from it, send an email to 10-701-spring-2013-cmu+unsub...@googlegroups.com.
To post to this group, send email to 10-701-spring-2013-cmu@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.


Victor Hwang

unread,
Feb 19, 2013, 1:02:48 PM2/19/13
to 10-701-spri...@googlegroups.com, Barnabas Poczos, Yitong Zhou, al...@smola.org
I'd like to know this as well! Thanks.

Barnabas Poczos

unread,
Feb 19, 2013, 1:25:36 PM2/19/13
to Victor Hwang, 10-701-spri...@googlegroups.com, Yitong Zhou, al...@smola.org
This problem is extremely simple.

All you need is to look at the 1st theorem on the webpage from the hint:
http://en.wikipedia.org/wiki/Representer_theorem
and using the notation there tell us what would be the function E and
g in this problem.
If you find E and g, it means that the representer theorem can be applied.


Best,
Barnabas


On Tue, Feb 19, 2013 at 1:02 PM, Victor Hwang <victor....@gmail.com> wrote:
> I'd like to know this as well! Thanks.
>
> --
> http://alex.smola.org/teaching/cmu2013-10-701 (course website)
> http://www.youtube.com/playlist?list=PLZSO_6-bSqHQmMKwWVvYwKreGu4b4kMU9
> (YouTube playlist)
> ---
> You received this message because you are subscribed to the Google Groups
> "10-701 Spring 2013 CMU" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to 10-701-spring-201...@googlegroups.com.
> To post to this group, send email to
> 10-701-spri...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages