Have you tried the converter with other things to see if it works in general? Converters of this sort do have a reputation for being hit or miss. Also, you need to make sure you get the right kind of converter and going in the right direction. (The cheapest devices you can find don’t even actually convert – they are made only for a few specific devices that have the option to put analog signals on their HDMI connector – so those only "convert" the physical connector.)
And of course, you know that those red, yellow, white connectors only do SD. If your TV has component inputs, an HDMI to component converter would be better.