That's an idea, though can you pull from git to a number of rather spread out (as in spread out around the system) files? ... or would you need a separate git repository for each?
Quickest way would be to have a single git repo for your home directory, add the files you want explicitly and use a (rather large) .gitignore file to exclude everything else.
Cleanest way is to have a separate repo for each and have your script manage the pulls.
I'd go for the second option myself, mainly because a lot of the subdirectories under home contain git repositories and I'd just confuse myself if I had one in home as well. So the script would add a bit of complexity, but for me that would be worth it. YMMV.
You'd probably want to script the initial clone to speed the process for multiple machines.