Magento 2 Bulk Product Upload Problems

Hello Magento community,
I’m reaching out in hopes of finding a solution for a daunting challenge we’re encountering with our Magento 2 store.
Our product inventory is rapidly expanding and is soon set to surpass the 500K mark. We’ve been trying to use Magento’s Async Bulk Product API for the massive bulk upload. However, it’s turning out to be significantly slower than what we can work with.
We’ve already attempted to do our part with server optimization, increasing memory limits, operating during off-peak hours, and partitioning the product file into smaller chunks, but the performance improvement is still not sufficient.
Given the scale of our product database and the frequency of updates required, this process needs to be more efficient.
Has anyone here dealt with a similar issue and found a resolution? Are there other bulk upload methods or third-party tools that could handle such a volume more efficiently?
Any insights, advice or recommendations would be deeply appreciated.
Thanks in advance for your time!

submitted by /u/shure_rider
[link] [comments]