Setup One: For the Impatient
If git is already working on your server (it was on mine), this will get you up and running ASAP.
# Setup SSH keys
[local ~]$ ssh-keygen -t rsa
[local ~]$ ssh-copy-id [user@]host
[local ~]$ eval `ssh-agent`
[local ~]$ ssh-add
# Create the local repository
[local ~]$ cd project
[local project]$ git init
[local project]$ touch .gitignore
[local project]$ git add .
[local project]$ git commit
# Create a bare remote repository
[local project]$ ssh [user@]host
[host ~]$ mkdir project.git
[host ~]$ cd project.git
[host project.git]$ git --bare init
[host project.git]$ exit
# Push to the remote repository
[local project]$ git remote add origin ssh://[user@]host/~/project.git
[local project]$ git push origin master
[local project]$ git branch --set-upstream master origin/master
# Clone from the remote repository
[other ~]$ git clone ssh://[user@]host/~/project.git