Skip to content

Commit

Permalink
if not split documents then return after yield
Browse files Browse the repository at this point in the history
  • Loading branch information
pnadolny13 committed Aug 7, 2023
1 parent 03591dd commit eb0a2d3
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions map_gpt_embeddings/mappers.py
Original file line number Diff line number Diff line change
Expand Up @@ -106,6 +106,7 @@ def split_record(self, record: dict) -> t.Iterable[dict]:

if not self.config.get("split_documents", True):
yield record
return

splitter_config = self.config.get("splitter_config", {})
if "chunk_size" not in splitter_config:
Expand Down

0 comments on commit eb0a2d3

Please sign in to comment.