Let Σ be a compact connected and oriented surface with nonempty boundary and let G be a Lie group equipped with a bi-invariant pseudo-Riemannian metric. The moduli space of flat principal G-bundles over Σ which are trivialized at a finite subset of ∂Σ carries a natural quasi-Hamiltonian structure which was introduced by Li-Bland and Severa. By a suitable restriction of the holonomy over ∂Σ and of the gauge action, which is called a coloring or a decoration of ∂Σ, it is possible to obtain a number of interesting Poisson structures as subquotients of this family of quasi-Hamiltonian structures. We can use these structures to construct Poisson and symplectic groupoids in a systematic fashion by means of two observations:

(1) gluing two copies of the same decorated surface along a suitable subset of their boundaries determines a groupoid structure on the moduli space associated to the new surface, this procedure can be iterated by sewing four copies of the same surface, thereby inducing a double Poisson groupoid structure;

(2) on the other hand, we can suppose that G is a Lie 2-group, then the groupoid structure on G descends to a groupoid structure on the moduli space of flat G-bundles over Σ.

These two observations can be combined to produce up to three distinct and compatible Poisson groupoid structures on the associated moduli spaces.