Bulk API consummer performances

Hello ! I’m currently using the bulk api to load data faster and I’m facing a lack or performance regarding the rabbitmq consummer.

The bulk API messages go into a rabbitmq queue called “async.operations.all” and with the following env.php, everytimg I’m running the consumer, I can process the messages.

env.php :

'queue' => [
'consumers_wait_for_messages' => 1,
'max_messages' => 0,
'amqp' => [
'host' => getenv('AMQP_HOST'),
'port' => getenv('AMQP_PORT'),
'user' => getenv('AMQP_USER'),
'password' => getenv('AMQP_PASS'),
'virtualhost' => '/'
]
],
'cron_consumers_runner' => [
'cron_run' => false

Problem : I got a message rate that is ~0.4 per second and I would like to know if we can set something to make it faster.

command used to process messages :

php bin/magento queue:consumers:start --batch-size=200 async.operations.all

Do you have any suggestion or best practice ?

submitted by /u/No-Appointment-3446
[link] [comments]