Loading Events

OR Seminar: Smart “Predict, then Optimize” with Adam Elmachtoub, Columbia University

This event is open to the public and registration is not required.

View all upcoming Operations Research Seminars

 

Abstract

Many real-world analytics problems involve two significant challenges: prediction and optimization. Due to the typically complex nature of each challenge, the standard paradigm is predict-then-optimize. By and large, machine learning tools are intended to minimize prediction error and do not account for how the predictions will be used in the downstream optimization problem. In contrast, we propose a new and very general framework, called Smart “Predict, then Optimize” (SPO), which directly leverages the optimization problem structure, i.e., its objective and constraints, for designing better prediction models. A key component of our framework is the SPO loss function which measures the decision error induced by a prediction. Training a prediction model with respect to the SPO loss is computationally challenging, and thus we derive, using duality theory, a convex surrogate loss function which we call the SPO+ loss. Most importantly, we prove that the SPO+ loss is statistically consistent with respect to the SPO loss under mild conditions. Our SPO+ loss function can tractably handle any polyhedral, convex, or even mixed-integer optimization problem with a linear objective. Numerical experiments on shortest path and portfolio optimization problems show that the SPO framework can lead to significant improvement under the predict-then-optimize paradigm, in particular when the prediction model being trained is misspecified.  This is joint work with Paul Grigas.

 

Speaker Bio

Adam Elmachtoub is an Assistant Professor of Industrial Engineering and Operations Research at Columbia University, where he is also a member of the Data Science Institute. In 2014-2015, he spent one year at the IBM T.J. Watson Research Center working in the area of Smarter Commerce. He previously received his B.S. degree from Cornell ORIE in 2009, and his Ph.D. from MIT ORC in 2014. In 2016, he received an IBM Faculty Award and was named Forbes 30 under 30 in science.

 

—————————————————————————————-

The Operations Research (OR) seminar series brings together graduate students, faculty and researchers from the University of Toronto community to interact with prominent scholars in the field of OR. Seminars feature visiting scholars from around the world as well as professors and post-docs. Topics include all variants of OR theory and their applications. Questions? Contact Merve Bodur at bodur@mie.utoronto.ca

OR Seminar: Smart “Predict, then Optimize” with Adam Elmachtoub, Columbia University

Event Details

Venue

December 5, 2019 @ 12:10 pm - 1:00 pm

Venue

Bahen Centre, Room 1200, 40 St. George Street, Toronto, Canada

This event is open to the public and registration is not required.

View all upcoming Operations Research Seminars

 

Abstract

Many real-world analytics problems involve two significant challenges: prediction and optimization. Due to the typically complex nature of each challenge, the standard paradigm is predict-then-optimize. By and large, machine learning tools are intended to minimize prediction error and do not account for how the predictions will be used in the downstream optimization problem. In contrast, we propose a new and very general framework, called Smart “Predict, then Optimize” (SPO), which directly leverages the optimization problem structure, i.e., its objective and constraints, for designing better prediction models. A key component of our framework is the SPO loss function which measures the decision error induced by a prediction. Training a prediction model with respect to the SPO loss is computationally challenging, and thus we derive, using duality theory, a convex surrogate loss function which we call the SPO+ loss. Most importantly, we prove that the SPO+ loss is statistically consistent with respect to the SPO loss under mild conditions. Our SPO+ loss function can tractably handle any polyhedral, convex, or even mixed-integer optimization problem with a linear objective. Numerical experiments on shortest path and portfolio optimization problems show that the SPO framework can lead to significant improvement under the predict-then-optimize paradigm, in particular when the prediction model being trained is misspecified.  This is joint work with Paul Grigas.

 

Speaker Bio

Adam Elmachtoub is an Assistant Professor of Industrial Engineering and Operations Research at Columbia University, where he is also a member of the Data Science Institute. In 2014-2015, he spent one year at the IBM T.J. Watson Research Center working in the area of Smarter Commerce. He previously received his B.S. degree from Cornell ORIE in 2009, and his Ph.D. from MIT ORC in 2014. In 2016, he received an IBM Faculty Award and was named Forbes 30 under 30 in science.

 

—————————————————————————————-

The Operations Research (OR) seminar series brings together graduate students, faculty and researchers from the University of Toronto community to interact with prominent scholars in the field of OR. Seminars feature visiting scholars from around the world as well as professors and post-docs. Topics include all variants of OR theory and their applications. Questions? Contact Merve Bodur at bodur@mie.utoronto.ca

Details

Date:
December 5, 2019
Time:
12:10 pm - 1:00 pm
Website:
https://www.mie.utoronto.ca/events/or-seminar-adam-elmachtoub-columbia-university/

Upcoming Events

All
  • All
  • Alumni events
  • Anti-Racism and Cultural Diversity Office events
  • Convocation events
  • Faculty & staff events
  • GEARS
  • Info sessions
  • Lectures, seminars and workshops
  • Socials
  • U of T holidays & closures

CEAB Accreditation Visit

Sun October 19, 2025 @ 8:00 am - Tue October 21, 2025 @ 5:00 pm
Members of the Canadian Engineering Accreditation Board (CEAB) will be visiting from October 19 - 21 to review University of Toronto's nine undergraduate engineering programs. The purpose of the visit...

Research Round: Breakthroughs in Silicon Neural Probes with Nanophotonic Phased Arrays

Wed October 22, 2025 @ 9:00 am - 9:30 am
Ankita Sharma is a PhD student at the Department of Electrical & Computer Engineering. She has worked closely with scientists at both the Max Planck Institute for Microstructure Physics in...

Cultural Day

Wed October 22, 2025 @ 10:00 am - 5:00 pm
The Skule™ International Transition Directorship will be hosting U of T Engineering's first-ever Cultural Day on October 22 (10AM - 5PM) at the Bahen Atrium. This year's theme is "Dress...

Wellness Wednesday at Myhal

Wed October 22, 2025 @ 11:30 am - 1:30 pm
Drop by Myhal to meet the student services that support your well-being at U of T! Each month, we will have different partners join to present their services and how...