Skip to content

Commit

Permalink
addressing PR review
Browse files Browse the repository at this point in the history
  • Loading branch information
shrshi committed Oct 11, 2024
1 parent e7996e1 commit 06fcfa8
Showing 1 changed file with 3 additions and 4 deletions.
7 changes: 3 additions & 4 deletions cpp/src/io/json/read_json.cu
Original file line number Diff line number Diff line change
Expand Up @@ -353,10 +353,9 @@ table_with_metadata read_json(host_span<std::unique_ptr<datasource>> sources,
std::size_t const total_source_size = sources_size(sources, 0, 0);

// Batching is enabled only for JSONL inputs, not regular JSON files
if (!reader_opts.is_enabled_lines()) {
CUDF_EXPECTS(total_source_size < std::numeric_limits<int32_t>::max(),
"Parsing Regular JSON inputs of size greater than INT_MAX bytes is not supported");
}
CUDF_EXPECTS(
reader_opts.is_enabled_lines() || total_source_size < std::numeric_limits<int32_t>::max(),
"Parsing Regular JSON inputs of size greater than INT_MAX bytes is not supported");

std::size_t chunk_offset = reader_opts.get_byte_range_offset();
std::size_t chunk_size = reader_opts.get_byte_range_size();
Expand Down

0 comments on commit 06fcfa8

Please sign in to comment.