Is there a way to chunk the acquired content?

[ki-suzuki]

Is there a method to chunk the acquired content when committing it to Azure Search? If so, I would like to learn about it.

[ohtwadi]

If you are talking about batching multiple documents, then yes. In fact, this is done by default. Please take a look at the documentation.

<queue
      class="com.norconex.committer.core3.batch.queue.impl.FSQueue">
    <batchSize>
      (Optional number of documents queued after which we process a batch.
       Default is 20.)
    </batchSize>
...

[ki-suzuki]

@ohtwadi
Thank you for your prompt response.

I believe what I am looking for is not this method.

Here are the details.
For instance, I mean after retrieving the body of the HTML, and if the content of the body is so large that I want to divide it into several smaller chunks and submit them to the Azure Cognitive Search Index as separate records.

Is there some methods to achieve this?

Thank you.

[ohtwadi]

Does the DOMSplitter fit the bill for you?