Today I configured a test machine to use windows domain accounts at the GIS tier for security. When I went to connect to the site using catalog, I noticed that if I included the '\' (backslash) in the user name it could not connect. After removing the backslash, the connection worked.
This means that if your user is 'domainname\name' you would use just the 'name' in the AGS connection string.