A low-rank factorization framework for building scalable algebraic solvers and preconditioners