Fourier Series: How to Solve the Fourier Coefficients?
In this article, we will be going through the process of solving the coefficients of Fourier Series.
Actor-Critic with Linear Function Approximation and Softmax Policy Parameterization: How to Prove the Eligibility Vector?
In this article, we will do an exercise to prove the eligibility vector of a policy parameterization using the softmax in action preferences with linear function approximations.
Solving a Polynomial Equation Raised to the Power of a Polynomial Equation?
In this article, we will discuss about how to solve a polynomial equation. This equation is a quadratic equation raised to the power of another quadratic equation.
Deterministic Continuous Review Inventory Model: The Formula
In this article, we will perform the derivation of several useful formula for EOQ (Economic Order Quantity) Model with and without planned shortages.
Bellman Equation: How to Derive?
In this article, we will perform the derivation of Bellman equation for both state-value and action-value functions. Then, we will go through a simple Grid World example on using Bellman equation to obtain the value of each state.