In the literature on the D'Auria-Fre formulation of supergravity (also called the “FDA-formalism”) what is called a (extended) “soft group manifold” is precisely a collection of ∞-Lie algebra valued differential forms on a smooth manifold.
See these links for further details.