The exterior is Romanesque, of Bath Stone rubble.[2] A three-arched loggia with Byzantine columns and capitals[1] surrounds it. The red roof tiles were imported from Lombardy.[2] The full-height campanile intended by Scott was not built, due to fears over the strength of the foundations.[1]
The interior columns have capitals with figurative carvings by William Drinkwater Gough. Those on the columns on the north side depict scenes from the life of the Virgin Mary, those on the columns on the south, scenes from the life of St Alphege and those supporting the choir and organ loft on the west end show persons associated with the church, including Scott himself.[3]
Scott wrote of the church, "It has always been one of my favourite works."[1] Relatively unknown since its construction, the church was overlooked by Sir Nikolaus Pevsner in his 1958 North Somerset and Bristol edition of The Buildings of England.[3] Its importance as an "accomplished composition by (a) nationally-renowned architect"[2] was recognised in 2010 when its listed building status was upgraded to Grade II*.[2] Michael Forsyth in the Pevsner Architectural Guide to Bath describes it as a building that "cannot fail to astonish and delight."[1]