"One" is correct. The sentence starts out using the third person
pronoun, "one," so it needs to maintain that point of view
throughout. Note that IF you could change BOTH of the pronouns in
the sentence to the second person point of view, "you," that would
be correct as well.
When one sings in the choir, one should always control the volume so
that no particular voice overwhelms the others.