no, it's a tricky one in english, but the simple past conjugation 'gave' won't work here. the main verb in the english version of the sentence 'to do', has already been made past tense: 'did'.
you could technically say: 'when had she given birth?' to emphasise the action being in the past. but to be honest, that kind of emphasis doesn't really work well with this context.