This is needed because Ninja sees too many CPUs in Travis' container, and therefore spawns a lot of jobs which leads Travis to occasionally kill a ninja process. Limiting the jobs protects against that behavior.
Workaround for https://github.com/travis-ci/travis-ci/issues/8363 - the matrix feature does not make sense here, so having this workaround is acceptable.