Towards a Scalable Quantum Computing Platform in the Ultrastrong Coupling Regime