The man has been in custody since October, after the woman reported the incidents to police, and investigators have been preparing criminal charges of aggravated procurement.
Investigators believe the husband ruthlessly exploited his wife on a large scale, prosecutor Ida Annerstedt said.
Prosecutors spoke publicly, on Monday, for the first time about the total number of men believed to be involved.
They have not identified the couple. The man, who is in his 60s, has denied any wrongdoing.
Sweden's Minister for Gender Equality, Nina Larsson, expressed immense shock over the case.
Annerstedt declined to discuss coercion in the case or comment on whether the wife was drugged during the sex.
Swedish law criminalises buying sex and procuring it, but does not criminalise the selling of sex by sex workers, who are considered exploited victims.
If the husband is convicted of aggravated procuring, he could face a prison sentence of two to 10 years.
Two men believed to have purchased sex with the woman have been charged and more suspects will likely be charged, the prosecutor said.
They face up to a year in prison if convicted.
The purchase of sexual services without physical contact, via the internet, is also criminalised in Sweden.
Annerstedt said the indictment against the husband will be brought on March 13, with the trial expected to start soon after.
1800 RESPECT (1800 737 732)
National Sexual Abuse and Redress Support Service 1800 211 028
27°C