Skip to content

Commit

Permalink
formatting
Browse files Browse the repository at this point in the history
  • Loading branch information
shrshi committed Sep 17, 2024
1 parent efd75b3 commit 85f5427
Showing 1 changed file with 4 additions and 2 deletions.
6 changes: 4 additions & 2 deletions cpp/src/io/json/json_normalization.cu
Original file line number Diff line number Diff line change
Expand Up @@ -338,8 +338,10 @@ std::
{
/*
* Algorithm:
1. Create a single buffer by concatenating the rows of the string column. Create segment offsets and lengths array for concatenated buffer
2. Run a 'complementary' whitespace normalization FST i.e. NOP for non-whitespace and quoted whitespace characters, and output indices of unquoted whitespace characters
1. Create a single buffer by concatenating the rows of the string column. Create segment offsets
and lengths array for concatenated buffer
2. Run a 'complementary' whitespace normalization FST i.e. NOP for non-whitespace and quoted
whitespace characters, and output indices of unquoted whitespace characters
3. Update segment lengths based on the number of output indices between segment offsets
4. Remove characters at output indices from concatenated buffer.
5. Return updated buffer, segment lengths and updated segment offsets
Expand Down

0 comments on commit 85f5427

Please sign in to comment.