Skip to main content

Comment on "Localization of the Maximal Entropy Random Walk"

Comment & Archival Record

Title: Comment on "Localization of the Maximal Entropy Random Walk"
Author: R. Fisher, Principal Investigator (ORCID: 0009-0006-2441-3282)
Affiliation: Braid Dynamics Group
Target Article: Z. Burda, J. Duda, J.-M. Luck, B. Wacław, Phys. Rev. Lett. 102, 160602 (2009)
Published / Received: June 21, 2026 · Status: Formal Commentary / Preprint (v1.0.0) · License: Creative Commons Attribution 4.0 (CC BY 4.0)
Classification: Statistical Mechanics · Spectral Graph Theory · Markov Chains
Replication Engine: Python 3.8+ reference simulation script with spectral analysis and lazy-walk recovery.

📁 Downloadable Publication & Replication Files

File NameDescriptionSizeAction
maximal-entropy-random-walk.pdfPhysical Review Letters Two-Column Comment (XeLaTeX)40 KBDownload PDF ↓
maximal_entropy_random_walk_simulation.pyStandalone Python Simulation & Spectral Analyzer4 KBDownload Python ↓
maximal-entropy-random-walk.mdComplete Markdown Source Document8 KBDownload MD ↓

Abstract​

Burda et al. [Phys. Rev. Lett. 102, 160602 (2009)] asserted that the discrete-time probability distribution πi(t)\pi_i(t) of the Maximal Entropy Random Walk (MERW) relaxes to the unique stationary profile πi∗=ψ0,i2\pi_i^* = \psi_{0,i}^2 as t→∞t \to \infty. While π∗\pi^* is the correct stationary measure and principal-eigenvector localization remains valid, this Comment shows that for any finite connected bipartite graph, the MERW transition matrix possesses a peripheral eigenvalue μ=−1\mu = -1, inducing period-two dynamics. Consequently, the unmodified discrete-time distribution does not converge to π∗\pi^* from initial conditions with nonzero parity imbalance; instead it approaches a persistent two-cycle. For the unmodified chain, convergence to π∗\pi^* holds if and only if the initial distribution has equal mass on the two bipartition classes. Cesàro or pairwise parity averaging, aperiodic lazy modifications, and continuous-time formulations recover convergence to π∗\pi^* in the appropriate sense.


I. Introduction​

The Maximal Entropy Random Walk (MERW) constructs stochastic trajectories by maximizing entropy globally over paths of fixed length. For a finite, connected graph G=(V,E)G=(V,E) with symmetric adjacency matrix AA, spectral radius λ0\lambda_0, and normalized principal right eigenvector ψ0\psi_0 (∥ψ0∥2=1\|\psi_0\|_2=1, ψ0,i>0\psi_{0,i}>0), the discrete-time stationary distribution is [1]: πi∗=ψ0,i2\pi_i^* = \psi_{0,i}^2 Specifically, Ref.[1], following Eq.(2), asserts: ``using spectral properties of the matrix PijP_{ij}, one can show that πi(t)\pi_i(t) reaches for t→∞t \to \infty a unique stationary state πi∗\pi_i^* obeying (2)''.

For a finite irreducible discrete-time Markov chain, convergence to stationarity from every initial state requires aperiodicity. If PP possesses peripheral eigenvalues on the unit circle other than unity, the chain fails to mix. On bipartite topologies commonly studied in MERW simulations (such as ladder networks and square lattices with open or even-periodic boundary conditions), PP possesses a peripheral eigenvalue μ=−1\mu = -1. Consequently, while π∗\pi^* remains stationary, the unmodified discrete-time chain fails to converge from generic initial conditions, settling into a persistent period-two oscillation.


II. Spectral Projection and Row-Stochasticity​

Let G=(V,E)G = (V,E) denote a finite, connected, bipartite graph with disjoint vertex partitions V=V1∪V2V = V_1 \cup V_2. Ordering vertices conformally yields the symmetric block adjacency matrix: A=(0BBT0)A = \begin{pmatrix} 0 & B \\ B^T & 0 \end{pmatrix} where BB is of dimension ∣V1∣×∣V2∣|V_1| \times |V_2|.

Let λ0\lambda_0 denote the spectral radius of AA. By the Perron-Frobenius theorem, λ0\lambda_0 is a simple, positive eigenvalue, and the corresponding principal right eigenvector ψ0\psi_0 satisfies ψ0,i>0\psi_{0,i} > 0 for all i∈Vi \in V. Conformal partitioning of ψ0=(ψ0(1),ψ0(2))T\psi_0 = (\psi_{0}^{(1)}, \psi_{0}^{(2)})^T under Aψ0=λ0ψ0A\psi_0 = \lambda_0\psi_0 yields the coupled linear system: Bψ0(2)=λ0ψ0(1),BTψ0(1)=λ0ψ0(2)B\psi_{0}^{(2)} = \lambda_0\psi_{0}^{(1)}, \quad B^T\psi_{0}^{(1)} = \lambda_0\psi_{0}^{(2)} Defining the spectral test vector ψ−=(ψ0(1),−ψ0(2))T\psi_- = (\psi_{0}^{(1)}, -\psi_{0}^{(2)})^T, direct matrix multiplication gives: Aψ−=(0BBT0)(ψ0(1)−ψ0(2))=(−Bψ0(2)BTψ0(1))=(−λ0ψ0(1)λ0ψ0(2))=−λ0ψ−A\psi_- = \begin{pmatrix} 0 & B \\ B^T & 0 \end{pmatrix} \begin{pmatrix} \psi_{0}^{(1)} \\ -\psi_{0}^{(2)} \end{pmatrix} = \begin{pmatrix} -B\psi_{0}^{(2)} \\ B^T\psi_{0}^{(1)} \end{pmatrix} = \begin{pmatrix} -\lambda_0\psi_{0}^{(1)} \\ \lambda_0\psi_{0}^{(2)} \end{pmatrix} = -\lambda_0\psi_- Thus, −λ0-\lambda_0 is an eigenvalue of AA with eigenvector ψ−\psi_-. Because the sign-flip mapping on V2V_2 components provides an invertible isometry between eigenspaces, simplicity of λ0\lambda_0 implies simplicity of −λ0-\lambda_0.

The discrete-time MERW transition matrix is defined via diagonal similarity transformation: P=1λ0D−1ADP = \frac{1}{\lambda_0} D^{-1} A D where D=diag⁡(ψ0)D = \operatorname{diag}(\psi_0). Under row probability conventions, PP is strictly row-stochastic: ∑jPij=1λ0ψ0,i∑jAijψ0,j=(Aψ0)iλ0ψ0,i=1\sum_j P_{ij} = \frac{1}{\lambda_0\psi_{0,i}}\sum_j A_{ij}\psi_{0,j} = \frac{(A\psi_0)_i}{\lambda_0\psi_{0,i}} = 1 Because AA is real and symmetric, AA is orthogonally diagonalizable, Jordan blocks do not occur, and spectra satisfy Spec⁡(P)=1λ0Spec⁡(A)\operatorname{Spec}(P) = \frac{1}{\lambda_0}\operatorname{Spec}(A). Since the peripheral spectrum of AA on a connected bipartite graph is strictly {λ0,−λ0}\{\lambda_0, -\lambda_0\}, the peripheral spectrum of PP is strictly {1,−1}\{1, -1\}.

The right eigenvector v2v_2 of PP corresponding to the peripheral eigenvalue μ2=−1\mu_2 = -1 (Pv2=−v2P v_2 = -v_2) is the parity vector: v2=D−1ψ−  ⟹  v2,i=ψ−,iψ0,i={+1if i∈V1−1if i∈V2v_2 = D^{-1}\psi_- \implies v_{2,i} = \frac{\psi_{-,i}}{\psi_{0,i}} = \begin{cases} +1 & \text{if } i \in V_1 \\ -1 & \text{if } i \in V_2 \end{cases} This yields an immediate parity diagnostic observable: π(t)v2=π(0)Ptv2=(−1)tπ(0)v2=(−1)tc\pi(t)v_2 = \pi(0)P^t v_2 = (-1)^t \pi(0)v_2 = (-1)^t c where c=∑i∈V1πi(0)−∑i∈V2πi(0)c = \sum_{i \in V_1}\pi_i(0) - \sum_{i \in V_2}\pi_i(0) is the initial parity imbalance. Since π∗v2=∑i∈V1ψ0,i2−∑i∈V2ψ0,i2=ψ0Tψ−=0\pi^* v_2 = \sum_{i \in V_1}\psi_{0,i}^2 - \sum_{i \in V_2}\psi_{0,i}^2 = \psi_0^T\psi_- = 0, convergence π(t)→π∗\pi(t) \to \pi^* requires (−1)tc→0(-1)^t c \to 0, which is impossible whenever c≠0c \neq 0.


III. Dual Basis Expansion and Asymptotic Oscillations​

Let π(t)\pi(t) represent the state probability row vector under iterated applications of PP. We decompose an arbitrary initial probability distribution π(0)\pi(0) into the dual basis of left and right eigenvectors {uαT,vα}\{u_\alpha^T, v_\alpha\} of PP, satisfying the biorthogonality condition uαTvβ=δαβu_\alpha^T v_\beta = \delta_{\alpha\beta}.

A. Subspace Biorthogonality Verification​

Let the stationary mode (μ1=1\mu_1 = 1) be defined by u1T=π∗u_1^T = \pi^* and v1=1v_1 = \mathbf{1}, where πi∗=ψ0,i2\pi_i^* = \psi_{0,i}^2 subject to ∑iψ0,i2=1\sum_i \psi_{0,i}^2 = 1. Let the oscillatory mode (μ2=−1\mu_2 = -1) have right eigenvector v2v_2 and left eigenvector u2T=wTu_2^T = w^T, where wi=ψ0,iψ−,iw_i = \psi_{0,i}\psi_{-,i} (satisfying wTP=−wTw^T P = -w^T via MERW reversibility with respect to π∗\pi^*). Element-wise: wi={ψ0,i2if i∈V1−ψ0,i2if i∈V2w_i = \begin{cases} \psi_{0,i}^2 & \text{if } i \in V_1 \\ -\psi_{0,i}^2 & \text{if } i \in V_2 \end{cases} Eigenvector orthogonality ψ0⊥ψ−\psi_0 \perp \psi_- establishes: wTv1=∑i∈Vwi=∑i∈V1ψ0,i2−∑i∈V2ψ0,i2=ψ0Tψ−=0w^T v_1 = \sum_{i \in V} w_i = \sum_{i \in V_1} \psi_{0,i}^2 - \sum_{i \in V_2} \psi_{0,i}^2 = \psi_0^T \psi_- = 0 Therefore, the L2L_2 mass of the Perron vector is split equally between the two partition classes. Biorthogonality constraints for the dominant subspace are satisfied: u1Tv2=∑i∈V1ψ0,i2−∑i∈V2ψ0,i2=0,wTv2=∑i∈Vψ−,i2=∑i∈Vψ0,i2=1u_1^T v_2 = \sum_{i \in V_1} \psi_{0,i}^2 - \sum_{i \in V_2} \psi_{0,i}^2 = 0, \quad w^T v_2 = \sum_{i \in V} \psi_{-,i}^2 = \sum_{i \in V} \psi_{0,i}^2 = 1

B. Eigenvalue Decay and Asymptotic Oscillation​

By the Perron-Frobenius theorem, all remaining subdominant eigenvalues satisfy ∣μα∣<1|\mu_\alpha| < 1 for α≥3\alpha \ge 3. State evolution from an arbitrary initial distribution π(0)\pi(0) follows: π(t)=(π(0)v1)(1)tπ∗+(π(0)v2)(−1)twT+∑α≥3(π(0)vα)μαtuαT\pi(t) = (\pi(0)v_1)(1)^t \pi^* + (\pi(0)v_2)(-1)^t w^T + \sum_{\alpha \ge 3} (\pi(0)v_\alpha)\mu_\alpha^t u_\alpha^T Taking t→∞t \to \infty, decaying modes vanish exponentially (∣μα∣t→0|\mu_\alpha|^t \to 0), yielding the leading asymptotic form: πi(t)=ψ0,i2+c(−1)tσiψ0,i2+o(1)\pi_i(t) = \psi_{0,i}^2 + c(-1)^t \sigma_i \psi_{0,i}^2 + o(1) where σi=+1\sigma_i = +1 for i∈V1i \in V_1 and σi=−1\sigma_i = -1 for i∈V2i \in V_2. Hence, for the unmodified discrete-time chain, lim⁡t→∞π(t)=π∗\lim_{t \to \infty}\pi(t) = \pi^* if and only if c=0c = 0.

For a point-mass distribution localized at node k∈V1k \in V_1 (π(0)=ekT\pi(0) = \mathbf{e}_k^T), we have c1=1c_1 = 1 and c=+1c = +1. The sequence alternates between two disjoint limits: lim⁡t→∞t evenπi(t)={2ψ0,i2if i∈V10if i∈V2,lim⁡t→∞t oddπi(t)={0if i∈V12ψ0,i2if i∈V2\lim_{\substack{t \to \infty \\ t \text{ even}}} \pi_i(t) = \begin{cases} 2\psi_{0,i}^2 & \text{if } i \in V_1 \\ 0 & \text{if } i \in V_2 \end{cases}, \quad \lim_{\substack{t \to \infty \\ t \text{ odd}}} \pi_i(t) = \begin{cases} 0 & \text{if } i \in V_1 \\ 2\psi_{0,i}^2 & \text{if } i \in V_2 \end{cases} Initializing at node k∈V2k \in V_2 yields c=−1c = -1, producing an identical, phase-inverted limit cycle. Although the chain is periodic, irreducibility and positive recurrence guarantee that the Cesàro time average 1T∑t=0T−1π(t)→π∗\frac{1}{T}\sum_{t=0}^{T-1} \pi(t) \to \pi^*, and the pairwise parity average 12[π(t)+π(t+1)]→π∗\frac{1}{2}[\pi(t)+\pi(t+1)] \to \pi^* as t→∞t \to \infty.


IV. Conclusion​

The universal statement that the discrete-time MERW distribution relaxes to π∗=ψ02\pi^* = \psi_{0}^2 is not valid on finite connected bipartite graphs. The stationary profile π∗\pi^* remains correct and is recovered by Cesàro or pairwise parity averaging. However, the instantaneous distribution converges to π∗\pi^* only when the initial parity imbalance cc vanishes; for c≠0c \neq 0, the distribution approaches a permanent period-two limit cycle. To obtain ordinary convergence of the instantaneous distribution, one must modify the dynamics, for example by using an aperiodic lazy walk Pα=(1−α)I+αPP_\alpha = (1-\alpha)I + \alpha P (0<α<10 < \alpha < 1) or transitioning to continuous-time dynamics with generator Q=P−IQ = P - I. A companion numerical simulation is provided in the Supplemental Material file maximal_entropy_random_walk_simulation.py [2].


References​

  1. Z. Burda, J. Duda, J.-M. Luck, and B. Wacław, Localization of the Maximal Entropy Random Walk, Phys. Rev. Lett. 102, 160602 (2009).
  2. R. Fisher, Maximal Entropy Random Walk Periodicity Simulation, Supplemental Material and Code Archive, Braid Dynamics Research Archive (2026).