Released on Marianne Faithfull's 2005 compilation Collection, 'That's Right Baby' stands as a poignant example of her mid-career vocal prowess. The track captures the raw emotional vulnerability characteristic of her work during the 1960s, a period defined by her exploration of complex relationships and personal turmoil. Recorded with a stripped-down arrangement that highlights her distinctive voice, the song reflects the era's shift towards more intimate, confessional pop and folk styles. It serves as a testament to Faithfull's ability to convey deep narrative through music, resonating with listeners who appreciate the authenticity of her early recordings and the enduring legacy of her songwriting and performance style.