ECE5984 Special topic: Optimization Theory for ML, Spring 2021

  • Description: Fundamentals of optimization theory for applications in machine learning. Overview of convex analysis and formulations (e.g., linear, quadratic, second-order cone, and semidefinite programs, and conic programming), first-order methods (e.g., gradient descent, stochastic gradient descent and variants, cutting plane methods, mirror descent), second-order methods (e.g., interior point method), as well as a subset of the advanced topics, such as online optimization and non-convex optimization.
  • Why take this course? With the rapid advancements in the field of machine learning, it is crucial to develop a systematic understanding of modern optimization theory to keep up with the state-of-the-art methods and to even push the boundaries and design new machine learning methods. Indeed, the interplay between optimization and machine learning is one of the most fascinating aspect of modern computational science. However, these recently developments have not been well-documented in textbooks and are often dispersed in research papers, which make it difficult for students to grasp the gist in a short amount of time. This course is designed to bridge this gap and introduce to students these advanced topics in optimization and ML.
  • Please visit Canvas for details and updates.

ECE4424/CS4824: Machine learning, Fall 2020

  • Description: Algorithms and principles involved in machine learning with applications to various engineering domains; fundamentals of representing uncertainty, learning from data, supervised learning, unsupervised learning, and learning theory; design and analysis of machine learning systems; design and implementation of a technical project applied to real-world datasets (energy, images, text, robotics, etc.).
  • Why take this course? We are witnessing an explosion in data - from billions of images shared online to Petabytes of tweets, medical records and sensor data, generated by companies, users and the infrastructures around us. Applications of machine learning are increasing rapidly as more techniques are developed and implemented to address a wide range of scientific and societal problems. Many universities are expanding programs in machine learning and perception, and employers are increasingly recognizing the importance of such knowledge. The course will give students a solid foundation in the basics of machine learning and an introduction to the opportunities in this rapidly maturing field.
  • Please visit Canvas for details and updates.
  • Term project page
  • Course reviews: ECE section, CS section