<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Mallory;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-ligatures:standardcontextual;}
h1
{mso-style-priority:9;
mso-style-link:"Heading 1 Char";
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:24.0pt;
font-family:"Calibri",sans-serif;
font-weight:bold;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.Heading1Char
{mso-style-name:"Heading 1 Char";
mso-style-priority:9;
mso-style-link:"Heading 1";
font-family:"Calibri",sans-serif;
mso-ligatures:none;
font-weight:bold;}
span.odd
{mso-style-name:odd;}
span.date-display-single
{mso-style-name:date-display-single;}
span.date-display-range
{mso-style-name:date-display-range;}
span.date-display-start
{mso-style-name:date-display-start;}
span.date-display-end
{mso-style-name:date-display-end;}
span.fn
{mso-style-name:fn;}
span.map-icon
{mso-style-name:map-icon;}
span.locality
{mso-style-name:locality;}
span.region
{mso-style-name:region;}
span.postal-code
{mso-style-name:postal-code;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1027" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link="#0563C1" vlink="#954F72" style='word-wrap:break-word'><div class=WordSection1><p class=MsoNormal style='background:white'><span style='color:black'><a href="https://statistics.yale.edu/" title="Department of Statistics and Data Science
"><span style='font-size:22.0pt;font-family:"Arial",sans-serif;color:#286DC0;text-decoration:none'><img border=0 width=150 height=49 style='width:1.5625in;height:.5138in' id=logo src="cid:image001.jpg@01DA0805.9A2B7950" alt="Department of Statistics and Data Science
"></span></a></span><span style='font-family:"Arial",sans-serif;color:black;mso-ligatures:none'> <a href="https://statistics.yale.edu/" title=Home><b><span style='font-size:22.0pt;color:#286DC0'>Department of Statistics and Data Science </span></b></a></span><b><i><u><span style='font-size:22.0pt;font-family:"Arial",sans-serif;color:#286DC0;mso-ligatures:none'> <o:p></o:p></span></u></i></b></p><h1 style='mso-margin-top-alt:.1in;margin-right:0in;margin-bottom:0in;margin-left:0in;background:white'><span style='font-size:15.0pt;font-family:Mallory;color:#222222'>Tim G. J. Rudner, </span><span class=odd><span style='font-size:15.0pt;font-family:Mallory;color:#222222'>New York University</span></span><span style='font-size:15.0pt;font-family:Mallory;color:#222222;font-weight:normal'><o:p></o:p></span></h1><p class=MsoNormal style='background:white'><!--[if gte vml 1]><v:shapetype id="_x0000_t75" coordsize="21600,21600" o:spt="75" o:preferrelative="t" path="m@4@5l@4@11@9@11@9@5xe" filled="f" stroked="f">
<v:stroke joinstyle="miter" />
<v:formulas>
<v:f eqn="if lineDrawn pixelLineWidth 0" />
<v:f eqn="sum @0 1 0" />
<v:f eqn="sum 0 0 @1" />
<v:f eqn="prod @2 1 2" />
<v:f eqn="prod @3 21600 pixelWidth" />
<v:f eqn="prod @3 21600 pixelHeight" />
<v:f eqn="sum @0 0 1" />
<v:f eqn="prod @6 1 2" />
<v:f eqn="prod @7 21600 pixelWidth" />
<v:f eqn="sum @8 21600 0" />
<v:f eqn="prod @7 21600 pixelHeight" />
<v:f eqn="sum @10 21600 0" />
</v:formulas>
<v:path o:extrusionok="f" gradientshapeok="t" o:connecttype="rect" />
<o:lock v:ext="edit" aspectratio="t" />
</v:shapetype><v:shape id="Picture_x0020_2" o:spid="_x0000_s1026" type="#_x0000_t75" style='position:absolute;margin-left:0;margin-top:.15pt;width:118.35pt;height:142pt;z-index:251658240;visibility:visible;mso-wrap-style:square;mso-width-percent:0;mso-height-percent:0;mso-wrap-distance-left:9pt;mso-wrap-distance-top:0;mso-wrap-distance-right:9pt;mso-wrap-distance-bottom:0;mso-position-horizontal:absolute;mso-position-horizontal-relative:text;mso-position-vertical:absolute;mso-position-vertical-relative:text;mso-width-percent:0;mso-height-percent:0;mso-width-relative:page;mso-height-relative:page'>
<v:imagedata src="cid:image004.png@01DA0806.B54E3B40" o:title="" />
<w:wrap type="square"/>
</v:shape><![endif]--><![if !vml]><img width=158 height=189 style='width:1.6458in;height:1.9722in' src="cid:image002.png@01DA0807.DB40C7E0" align=left hspace=12 v:shapes="Picture_x0020_2"><![endif]><span class=date-display-single><span style='font-size:13.5pt;font-family:Mallory;color:black'>Date: Monday, October 30, 2023</span></span><span class=date-display-single><span style='font-size:13.5pt;font-family:Mallory'><o:p></o:p></span></span></p><p class=MsoNormal style='background:white'><span class=date-display-single><span style='font-size:13.5pt;font-family:Mallory;color:black'>Time: </span></span><span class=date-display-start><span style='font-size:13.5pt;font-family:Mallory;color:black'>4:00PM</span></span><span class=date-display-range><span style='font-size:13.5pt;font-family:Mallory;color:black'> to </span></span><span class=date-display-end><span style='font-size:13.5pt;font-family:Mallory;color:black'>5:00PM</span></span><span style='font-size:13.5pt;font-family:Mallory'><o:p></o:p></span></p><p class=MsoNormal style='background:white'><span class=fn><span style='font-size:13.0pt;font-family:Mallory;color:black'>Kline Tower</span></span><span style='font-size:13.0pt;font-family:Mallory;color:black'> </span><span class=map-icon><span style='font-size:12.0pt;font-family:Mallory;color:black;letter-spacing:.6pt'><a href="http://maps.google.com/?q=219+Prospect+Street%2C+13+floor%2C+Rm+1327%2C+New+Haven%2C+CT%2C+06511%2C+us"><span style='color:black'>see map</span></a> </span></span><span style='font-size:13.0pt;font-family:Mallory'><o:p></o:p></span></p><p class=MsoNormal style='background:white'><span style='font-size:13.0pt;font-family:Mallory;color:black'>219 Prospect Street, 13 floor, Rm 1327</span><span style='font-size:13.0pt;font-family:Mallory'><o:p></o:p></span></p><p class=MsoNormal style='background:white'><span class=locality><span style='font-size:13.0pt;font-family:Mallory;color:black'>New Haven</span></span><span style='font-size:13.0pt;font-family:Mallory;color:black'>, <span class=region>CT</span> <span class=postal-code>06511</span></span><span style='font-size:13.0pt;font-family:Mallory'><o:p></o:p></span></p><p class=MsoNormal style='background:white'><span style='font-size:12.0pt;font-family:Mallory;color:#222222'>Zoom Link: <a href="https://yale.zoom.us/j/94223816617">https://yale.zoom.us/j/94223816617</a> Meeting ID: 942 2381 6617<o:p></o:p></span></p><p class=MsoNormal style='background:white'><span style='font-size:13.0pt;font-family:Mallory;color:#222222'><a href="https://timrudner.com/"><span style='font-size:12.0pt;color:#003C76'>Website</span></a><o:p></o:p></span></p><p class=MsoNormal style='background:white'><span style='font-size:13.0pt;font-family:Mallory;color:#222222'><o:p> </o:p></span></p><p class=MsoNormal style='background:white'><span style='font-size:13.0pt;font-family:Mallory;color:#222222'><o:p> </o:p></span></p><p class=MsoNormal style='background:white'><b><span style='font-size:13.0pt;font-family:Mallory;color:#222222'>Title: Regularization in Neural Networks: A Probabilistic Perspective<o:p></o:p></span></b></p><p class=MsoNormal style='background:white'><span style='font-size:13.0pt;font-family:Mallory;color:#222222'><o:p> </o:p></span></p><p class=MsoNormal style='background:white'><b><span style='font-size:13.0pt;font-family:Mallory;color:#222222'>Information and Abstract: <o:p></o:p></span></b></p><p style='mso-margin-top-alt:0in;margin-right:0in;margin-bottom:12.0pt;margin-left:0in;background:white;box-sizing: inherit'><span style='font-size:13.0pt;font-family:Mallory;color:#222222'>Conventional regularization techniques for neural networks, such as L2 or L1 regularization, explicitly penalize divergence of the model parameters from specific parameter values. However, in most neural network models, specific parameter configurations bear little to no physical meaning, and it is difficult to incorporate domain knowledge or other relevant information into neural network training using conventional regularization techniques.<o:p></o:p></span></p><p style='mso-margin-top-alt:0in;margin-right:0in;margin-bottom:12.0pt;margin-left:0in;background:white;box-sizing: inherit'><span style='font-size:13.0pt;font-family:Mallory;color:#222222'>In this talk, I will show that we can address this shortcoming by using Bayesian principles to effectively incorporate domain knowledge or beliefs about desirable model properties into neural network training. To do so, I will approach regularization in neural networks from a probabilistic perspective and define a family of data-driven prior distributions that allows us to encode useful auxiliary information into the model. I will then show how to perform approximate inference in neural networks with such priors and derive a simple variational optimization objective with a regularizer that reflects the constraints implicitly encoded in the prior. This regularizer is mathematically simple, easy to implement, and can be used as a drop-in replacement for existing regularizers when performing supervised learning in neural networks of any size.<o:p></o:p></span></p><p style='mso-margin-top-alt:0in;margin-right:0in;margin-bottom:12.0pt;margin-left:0in;background:white;box-sizing: inherit'><span style='font-size:13.0pt;font-family:Mallory;color:#222222'>I will conclude the talk with an overview of applications of data-driven priors, including distribution shift detection, drug discovery, and medical diagnosis.<o:p></o:p></span></p><p style='mso-margin-top-alt:0in;margin-right:0in;margin-bottom:12.0pt;margin-left:0in;background:white;box-sizing: inherit'><span style='font-size:13.0pt;font-family:Mallory;color:#222222'>This is joint work with Sanyam Kapoor, Shikai Qiu, Xiang Pan, Lily Yucen Li, Ya Shi Zhang, Ravid Shwartz-Ziv, Julia Kempe, and Andrew Gordon Wilson.<o:p></o:p></span></p><p style='mso-margin-top-alt:0in;margin-right:0in;margin-bottom:12.0pt;margin-left:0in;background:white;box-sizing: inherit'><span style='font-size:13.0pt;font-family:Mallory;color:#222222'> Bio: Tim G. J. Rudner is an Assistant Professor and Faculty Fellow at New York University’s Center for Data Science and an AI Fellow at Georgetown University’s Center for Security and Emerging Technology. He conducted PhD research on probabilistic machine learning in the Department of Computer Science at the University of Oxford, where he was advised by Yee Whye Teh and Yarin Gal. The goal of his research is to develop methods and theoretical insights that enable the safe deployment of machine learning systems in safety-critical settings. Tim holds a master’s degree in statistics from the University of Oxford and an undergraduate degree in applied mathematics and economics from Yale University. He is also a Rhodes Scholar and a Qualcomm Innovation Fellow.<o:p></o:p></span></p><p class=MsoNormal style='background:white'><span style='font-size:13.0pt;font-family:Mallory;color:#222222'> 3:30pm - Pre-talk meet and greet teatime - 219 Prospect Street, 13 floor, there will be light snacks and beverages in the kitchen area.<o:p></o:p></span></p><p class=MsoNormal><span style='font-family:"Arial",sans-serif;mso-ligatures:none'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:12.0pt;font-family:"Arial",sans-serif;color:black;mso-ligatures:none'>For more details and upcoming events visit our website at <a href="http://statistics.yale.edu/"><span style='color:black'>http://statistics.yale.edu/</span></a></span><span style='mso-ligatures:none'><o:p></o:p></span></p><p class=MsoNormal><span style='font-family:"Arial",sans-serif;mso-ligatures:none'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:18.0pt;font-family:"Arial",sans-serif;mso-ligatures:none'>Department of Statistics and Data Science<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:9.0pt;font-family:"Arial",sans-serif;color:black;mso-ligatures:none'>Yale University<br>24 Hillhouse Avenue<br>New Haven, CT 06511<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:9.0pt;font-family:"Arial",sans-serif;color:black;mso-ligatures:none'>t 203.432.0666<br>f 203.432.0633<o:p></o:p></span></p><p class=MsoNormal><o:p> </o:p></p></div></body></html>