I’d say that is ok (and the purpose of the policy in the first place, to deny criminals the opportunity to hide their ill-gotten gains)…but there needs to be a pretty quick - as in, like within 48 hours or 5 days - requirement to show cause to a court for them to keep the money. And then a periodic requirement - maybe every month, or even two weeks? - to get continued authorization from the court. With a limit of how many times they can re-authorize before they need to clearly establish the forfeiture should be permanent - so even if the victim is unable to mount a defense in those hearings, the case wont linger on indefinitely (or even require defense counsel be provided).
That alone should curb the speculative forfeitures, since it’ll come with an ongoing burdon and costs to seizing the money, instead of being a free source of funding. Right now, it only is what it is because about the worst consequence of seizing assets is receving a strongly worded letter.