Journal

The life as a grad student taught me that I should maintain this page very seriously.

2025

My path to publish a theory paper

2 minute read

Published: December 21, 2025

Some cool questions

27 minute read

Published: October 31, 2025

Convergence of Positive Supermartingales

26 minute read

Published: October 27, 2025

Some cool things about finite Markov chains and thereof

12 minute read

Published: September 23, 2025

A reminder on Student’s t-distribution and p-values

4 minute read

Published: September 14, 2025

Some reminders on Linear Algebra

2 minute read

Published: September 13, 2025

Induction by Contradiction

1 minute read

Published: September 12, 2025

When is a deterministic optimal policy in MDPs attainable?

10 minute read

Published: September 10, 2025

Stochastic Approximation Part 1

26 minute read

Published: September 07, 2025

The law of total variance in practice

8 minute read

Published: August 19, 2025

Sobolev spaces (not too wiggly functions), Hilbert spaces, and RHKS

11 minute read

Published: August 17, 2025

Random variables’ moments and thereof

5 minute read

Published: August 17, 2025

What to remember from RLC 2025

3 minute read

Published: August 06, 2025

What to remember from ICML 2025

less than 1 minute read

Published: August 06, 2025

1900

Why does Q-Learning and SARSA converge? (a.k.a Stochastic Approximation Part 4)

1 minute read

Published: August 20, 1900