[Sds-seminars] S&DS Seminar via Zoom : Lénaïc Chizat, 11/01 @ 4pm-5pm, "Analysis of gradient descent on wide two-layer ReLU neural networks"

[elizavette.torres at yale.edu]

   <https://statistics.yale.edu/> Department of Statistics and Data Science  

You are invited to a scheduled Zoom Seminar


LÉNAÏC CHIZAT, EPFL


Monday, November 01, 2021

4:00PM to 4:45PM

Zoom: https://yale.zoom.us/j/99169700816?pwd=SWEvWHI5d3dPNVdHMkZMZURMWWJPUT09 

Password: 24

 <https://lchizat.github.io/> Website

 

 

 

Title: Analysis of gradient descent on wide two-layer ReLU neural networks

 

Information and Abstract: 

In this talk, we propose an analysis of gradient descent on wide two-layer ReLU neural networks that leads to sharp characterizations of the learned predictor. The main idea is to study the training dynamics when the width of the hidden layer goes to infinity, which is a Wasserstein gradient flow. While this dynamics evolves on a non-convex landscape, we show that for appropriate initializations, its limit, when it exists, is a global minimizer. We also study the implicit regularization of this algorithm when the objective is the unregularized logistic loss, which leads to a max-margin classifier in a certain functional space. We finally discuss what these results tell us about the generalization performance, and in particular how these models compare to kernel methods.

 

Zoom is Yale’s audio and visual conferencing platform.

Topic: Yale S&DS Department Seminar

Time: 4:00pm - 5:00pm

Join from PC, Mac, Linux, iOS or Android:  <https://yale.zoom.us/j/99169700816?pwd=SWEvWHI5d3dPNVdHMkZMZURMWWJPUT09> https://yale.zoom.us/j/99169700816?pwd=SWEvWHI5d3dPNVdHMkZMZURMWWJPUT09

Password: 24

Or Telephone：203-432-9666 (2-ZOOM if on-campus) or 646 568 7788

Meeting ID: 991 6970 0816

International numbers available:  <https://yale.zoom.us/u/acBOaD1ic6> https://yale.zoom.us/u/acBOaD1ic6

For H.323 and SIP information for video conferencing units please click here:  <https://yale.service-now.com/it?id=support_article&sys_id=434b72d3db9e8fc83514b1c0ef961924> https://yale.service-now.com/it?id=support_article&sys_id=434b72d3db9e8fc83514b1c0ef961924

 


Department of Statistics and Data Science


Yale University
24 Hillhouse Avenue
New Haven, CT 06511

 

 

 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.yale.edu/pipermail/sds-seminars/attachments/20211027/bfa16e40/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 6496 bytes
Desc: not available
URL: <http://mailman.yale.edu/pipermail/sds-seminars/attachments/20211027/bfa16e40/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.jpg
Type: image/jpeg
Size: 26196 bytes
Desc: not available
URL: <http://mailman.yale.edu/pipermail/sds-seminars/attachments/20211027/bfa16e40/attachment.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.jpg
Type: image/jpeg
Size: 5446 bytes
Desc: not available
URL: <http://mailman.yale.edu/pipermail/sds-seminars/attachments/20211027/bfa16e40/attachment-0001.jpg>