Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

--create_schemas_only should execute without specifying a source file #211

Open
salsferrazza opened this issue Aug 9, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@salsferrazza
Copy link
Collaborator

When running with the --create_schemas_only option, there should be no requirement for source file parameters to be specified.

undefined@Undefineds-MacBook-Pro src % txcode --create_schemas_only --schema_file FIX42-vanilla.xml --factory=fix  --source_file 42_order_single.txt --source_file_format_type line_delimited --output_type jsonl
INFO:root:Run in create_schemas_only mode
INFO:root:Total runtime in seconds: 0.020124
INFO:root:Total runtime in minutes: 0.000335
undefined@Undefineds-MacBook-Pro src % txcode --create_schemas_only --schema_file FIX42-vanilla.xml --factory=fix --output_type jsonl 
usage: txcode [-h] [--factory {cme,itch,memx,fix}] [--schema_file SCHEMA_FILE]
              [--source_file SOURCE_FILE] [--source_file_encoding SOURCE_FILE_ENCODING]
              --source_file_format_type {pcap,length_delimited,line_delimited,cme_binary_packet}
              [--base64 | --base64_urlsafe] [--fix_header_tags FIX_HEADER_TAGS]
              [--fix_separator FIX_SEPARATOR] [--message_handlers MESSAGE_HANDLERS]
              [--message_skip_bytes MESSAGE_SKIP_BYTES] [--prefix_length PREFIX_LENGTH]
              [--message_type_exclusions MESSAGE_TYPE_EXCLUSIONS | --message_type_inclusions MESSAGE_TYPE_INCLUSIONS]
              [--sampling_count SAMPLING_COUNT] [--skip_bytes SKIP_BYTES] [--skip_lines SKIP_LINES]
              [--source_file_endian {big,little}] [--output_path OUTPUT_PATH]
              [--output_type {diag,avro,fastavro,bigquery,pubsub,bigquery_terraform,pubsub_terraform,jsonl,length_delimited}]
              [--error_output_path ERROR_OUTPUT_PATH] [--lazy_create_resources] [--frame_only]
              [--stats_only] [--create_schemas_only] [--destination_project_id DESTINATION_PROJECT_ID]
              [--destination_dataset_id DESTINATION_DATASET_ID] [--output_encoding {binary,json}]
              [--create_schema_enforcing_topics | --no-create_schema_enforcing_topics]
              [--continue_on_error] [--log {notset,debug,info,warning,error,critical}] [-q] [-v]
txcode: error: the following arguments are required: --source_file_format_type

If you specified --create_schemas_only the only requirement should be --factory and --schema_file.

@salsferrazza salsferrazza added the bug Something isn't working label Aug 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant