The gradle daemon speeds up builds quite a bit and you do want to have it running on your local machine but not on the build server, that one should always re-build from scratch. This is actually quite easy to accomplish.
In your '~/.bashrc' add the following export so your local machine runs all builds with the gradle daemon:
export GRADLE_OPTS="-Dorg.gradle.daemon=true"
Since, by default, the gradle daemon is not started, it will not be used on your build server.