I am trying to index a huge CSV file (~35GB). I have kept the --docs-per-chunk as 500 and --bytes-per-chunk to 100000. But then the RAM gets filled up as and when the csv file is continuously read. Any thoughts on the same?
I am working on a 16GB RAM machine with 4 core processor.
Regards,
Vijay Raajaa G S
I am trying to index a huge CSV file (~35GB). I have kept the --docs-per-chunk as 500 and --bytes-per-chunk to 100000. But then the RAM gets filled up as and when the csv file is continuously read. Any thoughts on the same?
I am working on a 16GB RAM machine with 4 core processor.
Regards,
Vijay Raajaa G S