The Living Thing / Notebooks :

Learning on manifolds

Finding the lowest bit of a krazy straw, from the inside

A placeholder for learning on curved spaces. Not discussed: learning OF curved spaces.

Also: learning where there is an a priori manifold seems to also be a usage here? See the work of, e.g. Nina Miolane and collaborators on the Geomstats project.

Girolami et al discuss Langevin Monte Carlo in this context.

The below headings may one day be filled in.

Information Geometry

The unholy offspring of Fisher information and differential geometry, about which I know little except that it sounds like it should be intuitive. See also information criteria. I also know that even though this sounds intuitive, it is not mainstream and it has also not been especially useful to me even in places where it seemed that it should, at least not beyond the basic delta method.

Hamiltonian Monte Carlo

You can also discuss Hamiltonian Monte Carlo in this setting. I will not.

Natural gradient

See natural gradients.

Homogeneous probability

Albert Tarantola’s framing, from his maybe forthcoming manuscript. How does it relate to information geometry? I don’t know yet. Haven’t had time to read. Also not a very common phrasing, which is a danger sign.

To Read

Refs