Contrary to the documentation here, character escapes in replacement patterns don't get translated to the corresponding character upon replace.
Eg:
Regex.Replace("abcDEFghi", "(DEF)", @"\t")
Expected: abc ghi
Actual: abc\tghi
Repro's on Visual Studio 2008, C#, .Net 3.5.