TTY colors are screwing up my output

I have been trying to get the output of an ssh session pushed to file... the problem is that there are colors in the output, and when I view the file the colors show up as "^[00m" or other such various nonsense

The weird part is that if I do this all manually, I have no problems, but if I try to do it via a script (which is my goal), I get all the extra colors.

I tried looking at the SSH man-pages, but came up with bupkis for how to turn off colors on an individual connection (rather than having to modify the remote host config)

Any ideas?