In this paper, different cases of the stability of Multiple Adaptive Notch Filter (MANF) are studied. The structure of MANF is composed of N parallel subfilters. Each subfilter estimates the parameters of one the components of quasi periodic signals including the sum of N periodic signals. For this structure, there are three different cases of stability for N=K, N>K and N<K, which include the exponential stability in the isolated equilibrium point, the semistability and the ultimate boundedness in the presence of disturbance. Among these cases, the second and the third cases are analyzed more specifically in this paper and therefore in this paper, in addition to the presentation of MANF, a new approach is proposed to prove the semistability based on the Lyapunov function definition. Also, according to the fact that the estimated frequency of subfiltersincludes a bias, a general form is obtained to determine the estimated frequency of subfilters in the case of the ultimate boundedness under disturbance. Additionally, in order to cancel this bias, a method is proposed based on the use of rectangular window functions in MANF. Simulations are carried out to demonstrate that using the rectangular window enhances the ANF performance.