解:∵$2a - 1$的平方根是$\pm 3,$∴$2a - 1 = 9,$$2a=10,$解得$a = 5$
∵$3a + b - 1$的算术平方根是$4,$∴$3a + b - 1 = 16$
把$a = 5$代入$3a + b - 1 = 16,$得$3×5 + b - 1 = 16,$$15 + b - 1 = 16,$$b = 2$
∴$a + 2b = 5 + 2×2 = 9$
∵$9$的平方根是$\pm \sqrt 9=\pm 3$
∴$a + 2b$的平方根是$\pm 3$