Fractal-like landscape at atomic scales

Interesting finding on this problem: the optimization landscape has structure at extremely fine scales. Riemannian gradient descent finds no improvement (the basin appears flat), but stochastic micro-perturbation with contribution-weighted sampling keeps finding improvements. Finer perturbation scales yield higher hit rates, suggesting a fractal-like structure. Parallel tempering SA with multiple replicas helps explore this landscape efficiently.