I attended KAUST Rising Stars in AI Symposium organized by KAUST AI Initiatve. As a part of the symposium, I gave a talk on AsGrad project.

I am thrilled to announce that AsGrad paper has been accepted to AISTATS 2024. In this paper we propose a unified framework to analyze asynchronous SGD-type algorithms covering many existing versions.

I am happy to announce that Econtrol paper has been accepted to ICLR 2024. In this paper we develop new Error Feedback mechanism to properly handle the bias coming from the compression and noise of stochastic gradients.

New paper on Error Feedback is now on arXiv. We developed new method, EControl, which provably handles two sources of noise – stochastic gradients and error from contractive compression – in all standard regimes. Moreover, in all settings the convergence improves with the number of clients participating in the training.

I have participated in NTDS workshop where the members of University of Basel and close collaborators have given talks on various subjects. In particular, I have given a talk on Newton-3PC project which has recently been accepted to Transactions on Machine Learning Research.