Postdoctoral Fellow in causal inference for monitoring machine learning algorithms

7 views
Skip to first unread message

jean feng

unread,
Apr 19, 2024, 9:15:13 AMApr 19
to COLT (Computational Learning Theory)
Dear all,

Dr. Fan Xia and our research groups are joint-hiring for a postdoctoral fellow. Please see job description below or at https://www.jeanfeng.com/joining.html

The project:
After a machine learning (ML)-based system is deployed, monitoring its performance is important to ensure the safety and effectiveness of the algorithm over time. When an ML algorithm interacts with its environment, the algorithm can affect the data-generating mechanism and be a major source of bias when evaluating its standalone performance, an issue known as performativity. Although prior work has shown how to validate models in the presence of performativity using causal inference techniques, there has been little work on how to monitor models in the presence of performativity. The goal of this project is to bring together techniques from causal inference and statistical process control to develop a comprehensive framework for post-market monitoring of ML algorithms. This work builds on a number of our previous works, including this paper that was published at the Conference of Causal Learning and Reasoning (CLeaR) and was presented at the NeurIPS Regulatable AI workshop.

We are seeking a postdoctoral researcher to join our lab. The primary responsibilities are:
  • Develop new statistical methods/frameworks for post-market monitoring of ML algorithms
  • Implement a software package that can be readily used by ML developers, health AI deployment teams, and ML auditors/regulators
  • Write, edit, and publish research manuscripts in collaboration with the team
Our team is highly collaborative and includes members with wide-ranging expertise (medicine, statistics, CS, AI regulation, etc). 

We are looking to hire a postdoctoral researcher to join the team. The position will be 100% funded for two years. Salary and benefits are competitive.

Qualifications:
  • The post-doctoral researcher position requires at least a PhD degree in (bio)statistics, computer science, data science, or another relevant field. We are looking for someone who:has experience in at least one of these fields: sequential monitoring, machine learning, and causal inference
  • has experience in methodological development and can perform independent research, with a strong and relevant publication record
  • has strong software engineering background (e.g. python, git-based workflows, high-performance computing)
  • is able to work collaboratively with a team
If you are interested, please submit the following materials to jean...@ucsf.edu:
  • A cover letter
  • A CV summarizing your education and work experience so far
  • The names and email addresses of three references
  • A code sample
  • One representative publication
Screening of applicants will begin immediately and will continue as needed throughout the recruitment period.

Jean Feng
Assistant Professor
Department of Epidemiology and Biostatistics
University of California, San Francisco
https://www.jeanfeng.com/
Reply all
Reply to author
Forward
0 new messages