iBet uBet web content aggregator. Adding the entire web to your favor.
iBet uBet web content aggregator. Adding the entire web to your favor.



Link to original content: https://doi.org/10.1007/s00332-017-9423-0
On Convergence of Extended Dynamic Mode Decomposition to the Koopman Operator | Journal of Nonlinear Science Skip to main content
Log in

On Convergence of Extended Dynamic Mode Decomposition to the Koopman Operator

  • Published:
Journal of Nonlinear Science Aims and scope Submit manuscript

Abstract

Extended dynamic mode decomposition (EDMD) (Williams et al. in J Nonlinear Sci 25(6):1307–1346, 2015) is an algorithm that approximates the action of the Koopman operator on an N-dimensional subspace of the space of observables by sampling at M points in the state space. Assuming that the samples are drawn either independently or ergodically from some measure \(\mu \), it was shown in Klus et al. (J Comput Dyn 3(1):51–79, 2016) that, in the limit as \(M\rightarrow \infty \), the EDMD operator \(\mathcal {K}_{N,M}\) converges to \(\mathcal {K}_N\), where \(\mathcal {K}_N\) is the \(L_2(\mu )\)-orthogonal projection of the action of the Koopman operator on the finite-dimensional subspace of observables. We show that, as \(N \rightarrow \infty \), the operator \(\mathcal {K}_N\) converges in the strong operator topology to the Koopman operator. This in particular implies convergence of the predictions of future values of a given observable over any finite time horizon, a fact important for practical applications such as forecasting, estimation and control. In addition, we show that accumulation points of the spectra of \(\mathcal {K}_N\) correspond to the eigenvalues of the Koopman operator with the associated eigenfunctions converging weakly to an eigenfunction of the Koopman operator, provided that the weak limit of the eigenfunctions is nonzero. As a by-product, we propose an analytic version of the EDMD algorithm which, under some assumptions, allows one to construct \(\mathcal {K}_N\) directly, without the use of sampling. Finally, under additional assumptions, we analyze convergence of \(\mathcal {K}_{N,N}\) (i.e., \(M=N\)), proving convergence, along a subsequence, to weak eigenfunctions (or eigendistributions) related to the eigenmeasures of the Perron–Frobenius operator. No assumptions on the observables belonging to a finite-dimensional invariant subspace of the Koopman operator are required throughout.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Notes

  1. We choose to work in the general setting of dynamical systems on arbitrary topological spaces which encompass dynamical systems on finite-dimensional manifolds (in which case one can regard \(\mathcal {M}\) as a subset of \(\mathbb {R}^n\)), as well as infinite-dimensional dynamical systems, arising, for example, from the study of partial differential equations or dynamical systems with control inputs (Korda and Mezić 2016).

  2. In general, the solution to (4) may not be unique; however, the matrix \(A_{N,M} = \varvec{\psi }(\varvec{Y})\varvec{\psi }(\varvec{X})^\dagger \), where \(\cdot ^ \dagger \) denotes the Moore–Penrose pseudoinverse, is always uniquely defined and \(A_{N,M}\) is always a minimizer in (4).

  3. Since \(\mathcal {K}{:}\,\mathcal {F}\rightarrow \mathcal {F}\), the assumption of \(\mathcal {F}= L_2(\mu )\) implies that the composition relation \(\phi \circ T\), \(\phi \in L_2(\mu )\), gives rise to a well-defined operator from \(L_2(\mu )\) to \(L_2(\mu )\). In particular, this implies that \(\Vert \phi _1\circ T - \phi _2\circ T\Vert _{L_2(\mu )} = 0\) whenever \(\Vert \phi _1-\phi _2 \Vert _{L_2(\mu )} = 0\) and that \(\int _{\mathcal {M}} |\phi \circ T|^2 \, \mathrm{d}\mu < \infty \) for all \(\phi \in L_2(\mu )\).

  4. To be more specific, if the matrix \(M_{{\hat{\mu }}_M}\) is not invertible, the solution to (10) may not be unique when viewed as a member of \( L_2(\mu )\). When viewed as a member of \(L_2({\hat{\mu }}_M)\), the solution is unique (since it is a projection onto a closed subspace of a Hilbert space). This is because in this case two functions from \(\mathcal {F}_N\) belonging to distinct \(L_2(\mu )\) equivalence classes may fall into the same \(L_2({\hat{\mu }}_M)\) equivalence class.

  5. A sequence of operators \(\mathcal {A}_i\) converges in the operator norm to an operator \(\mathcal {A}\) if \(\lim _{i\rightarrow \infty }\Vert \mathcal {A}_i -\mathcal {A}\Vert = 0 \).

  6. We choose to state the theorem for vector observables as this is the form of prediction typically encountered in practice. For a vector observable \(f\in \mathcal {F}^n\), the norm \(\Vert f\Vert \) is defined by \(\sum _{i=1}^n \Vert f_i \Vert _{L_2(\mu )}, \) where \(f_i\in \mathcal {F}\) is the \(i^{\mathrm {th}}\) component of f.

  7. In Sect. 7, we show how the matrix \(A_N\) can be constructed analytically.

  8. A sufficient condition for \(C(\mathcal {M})\) to be separable is \(\mathcal {M}\) compact and metrizable.

  9. A sequence of functionals \(L_i\in C(\mathcal {M})^\star \) converges in the weak\(^\star \) topology if \(\lim _{i\rightarrow \infty }L_i(f) = L(f)\) for all \(f\in C(\mathcal {M})\).

  10. A sequence of Borel measures \(\mu _i\) converges weakly to a measure \(\mu \) if \(\lim _{i\rightarrow \infty }\int f\,\mathrm{d}\mu _i = \int f\,\mathrm{d}\mu \) for all continuous bounded functions f. This convergence is also referred to as narrow convergence and it coincides with convergence in the weak\(^\star \) topology if the underlying space is compact (which is the case in our setting).

  11. A measure \( \mu \) on \(\mathcal {M}\) is invariant if \(\mu (T^{-1}(A)) = \mu (A)\) for all Borel sets \(A\subset \mathcal {M}\) or equivalently if \(\int _{\mathcal {M}} f\circ T \, \mathrm{d}\mu = \int _{\mathcal {M}} f \, \mathrm{d}\mu \) for all continuous bounded functions f.

References

  • Arbabi, H., Mezić, I.: Ergodic Theory, Dynamic Mode Decomposition and Computation of Spectral Properties of the Koopman Operator (2016). arXiv preprint arXiv:1611.06664

  • Brunton, B.W., Johnson, L.A., Ojemann, J.G., Kutz, J.N.: Extracting spatial-temporal coherent patterns in large-scale neural recordings using dynamic mode decomposition. J. Neurosci. Methods 258, 1–15 (2016a)

    Article  Google Scholar 

  • Brunton, S.L., Brunton, B.W., Proctor, J.L., Kutz, J.N.: Koopman invariant subspaces and finite linear representations of nonlinear dynamical systems for control. PLoS ONE 11(2), e0150171 (2016b)

    Article  MATH  Google Scholar 

  • Budisić, M., Mohr, R., Mezić, I.: Applied koopmanism. Chaos Interdiscip. J. Nonlinear Sci. 22(4), 047–510 (2012)

    MathSciNet  MATH  Google Scholar 

  • Dunford, N., Schwartz, J.T.: Linear Operators, Part 1. Wiley-interscience, New York (1971)

    MATH  Google Scholar 

  • Gelfand, I.M., Shilov, G.: Generalized Functions: Properties and Operations, vol. 1. Academic Press, New York (1964)

    Google Scholar 

  • Georgescu, M., Mezić, I.: Building energy modeling: a systematic approach to zoning and model reduction using Koopman mode analysis. Energy Build. 86, 794–802 (2015)

    Article  Google Scholar 

  • Giannakis, D.: Data-Driven Spectral Decomposition and Forecasting of Ergodic Dynamical Systems (2016). arXiv preprint arXiv:1507.02338

  • Giannakis, D., Slawinska, J., Zhao, Z.: Spatiotemporal feature extraction with data-driven Koopman operators. In: Proceedings of the 1st International Workshop on Feature Extraction: Modern Questions and Challenges, NIPS, pp. 103–115 (2015)

  • Glaz, B., Mezic, I., Fonoberova, M., Loire, S.: Quasi-Periodic Intermittency in Oscillating Cylinder Flow (2016). arXiv preprint arXiv:1609.06267

  • Klus, S., Koltai, P., Schütte, C.: On the numerical approximation of the Perron–Frobenius and Koopman operator. J. Comput. Dyn. 3(1), 51–79 (2016)

    MathSciNet  MATH  Google Scholar 

  • Koopman, B.O.: Hamiltonian systems and transformation in Hilbert space. Proc. Natl. Acad. Sci. USA. 17(5), 315 (1931)

    Article  MATH  Google Scholar 

  • Korda, M., Mezić, I.: Linear Predictors for Nonlinear Dynamical Systems: Koopman Operator Meets Model Predictive Control (2016). arXiv preprint arXiv:1611.03537

  • Mauroy, A., Goncalves, J.: Koopman-Based Lifting Techniques for Nonlinear Systems Identification (2017). arXiv preprint arXiv:1709.02003

  • Mezić, I.: Spectral properties of dynamical systems, model reduction and decompositions. Nonlinear Dyn. 41(1–3), 309–325 (2005)

    MathSciNet  MATH  Google Scholar 

  • Mezić, I.: Analysis of fluid flows via spectral properties of the Koopman operator. Annu. Rev. Fluid Mech. 45, 357–378 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  • Mezić, I., Banaszuk, A.: Comparison of systems with complex behavior. Phys. D Nonlinear Phenom. 197(1), 101–133 (2004)

    MathSciNet  MATH  Google Scholar 

  • Raak, F., Susuki, Y., Mezić, I., Hikihara, T.: On Koopman and dynamic mode decompositions for application to dynamic data with low spatial dimension. In: IEEE 55th Conference on Decision and Control (CDC), pp. 6485–6491 (2016)

  • Riseth, A.N., Taylor-King, J.P.: Operator Fitting for Parameter Estimation of Stochastic Differential Equations (2017). arXiv preprint arXiv:1709.05153

  • Rowley, C.W., Mezić, I., Bagheri, S., Schlatter, P., Henningson, D.: Spectral analysis of nonlinear flows. J. Fluid Mech. 641(1), 115–127 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  • Rudin, W.: Functional Analysis. McGraw-Hill, Inc., New York (1973)

    MATH  Google Scholar 

  • Schmid, P.J.: Dynamic mode decomposition of numerical and experimental data. J. Fluid Mech. 656, 5–28 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  • Sharma, A.S., Mezić, I., McKeon, B.J.: On the correspondence between Koopman mode decomposition, resolvent mode decomposition, and invariant solutions of the Navier–Stokes equations. Phys. Rev. Fluids 1(3), 032402(R) (2016)

    Article  Google Scholar 

  • Surana, A., Banaszuk, A.: Linear observer synthesis for nonlinear systems using Koopman operator framework. In: IFAC Symposium on Nonlinear Control Systems (NOLCOS) (2016)

  • Takeishi, N., Kawahara, Y., Yairi, T.: Subspace Dynamic Mode Decomposition for Stochastic Koopman Analysis (2017). arXiv preprint arXiv:1705.04908

  • Tu, J.H., Rowley, C.W., Luchtenburg, D.M., Brunton, S.L., Kutz, J.N.: On dynamic mode decomposition: theory and applications. J. Comput. Dyn. 1, 391–421 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  • Williams, M.O., Kevrekidis, I.G., Rowley, C.W.: A data-driven approximation of the Koopman operator: extending dynamic mode decomposition. J. Nonlinear Sci. 25(6), 1307–1346 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  • Wu, H., Noé, F.: Variational Approach for Learning Markov Processes from Time Series Data (2017). arXiv preprint arXiv:1707.04659

  • Wu, H., Nüske, F., Paul, F., Klus, S., Koltai, P., Noé, F.: Variational Koopman models: slow collective variables and molecular kinetics from short off-equilibrium simulations. J. Chem. Phys. 146(15), 154104 (2017)

    Article  Google Scholar 

Download references

Acknowledgements

The first author would like to thank Mihai Putinar for discussions on a related topic that sparked the work on this paper. We also thank Clancy Rowley for helpful comments on an earlier version of this manuscript as well as to Péter Koltai for pointing out the reference (Klus et al. 2016). This research was supported in part by the ARO-MURI Grant W911NF-14-1-0359 and the DARPA Grant HR0011-16-C-0116. The research of M. Korda was supported by the Swiss National Science Foundation under Grant P2ELP2_165166.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Milan Korda.

Additional information

Communicated by Bruno Eckhardt.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Korda, M., Mezić, I. On Convergence of Extended Dynamic Mode Decomposition to the Koopman Operator. J Nonlinear Sci 28, 687–710 (2018). https://doi.org/10.1007/s00332-017-9423-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00332-017-9423-0

Keywords

Mathematics Subject Classification

Navigation