Even if recommended by your doctor, it is always your choice whether or not to have surgery. But, it is important to understand the possible consequences involved with delaying or declining this surgery.
Although no one can truly predict the outcome of your particular situation, based on many years of experience it has been found that a consequence of delaying this procedure could be the worsening of symptoms and possible rupture of the ectopic pregnancy.
This could require a major abdominal surgery to control the bleeding and could result in having to remove the fallopian tube and/or ovaries. The risk of death or an inability to become pregnant increases dramatically if this occurs.
Of course, the final decision to have or not to have surgery rests with you. However, all concerns relating to this decision should be discussed with your doctor at length. You and your doctor can then come up with a treatment method that is comfortable for you.