8000 Python client ingest methods fail · Issue #5134 · gchq/sleeper · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
Python client ingest methods fail #5134
Closed
@patchwork01

Description

@patchwork01

Description

Command line arguments are not properly applied in the script python/test/ingest_files_from_s3.py.

Parameters are not properly handled in SleeperClient.write_single_batch or SleeperClient.ingest_parquet_files_from_s3.

Steps to reproduce

  1. Run python python/test/ingest_files_from_s3.py against a Sleeper table
  2. See error

Expected behaviour

Files should be ingested.

Screenshots/Logs

Error from Python:

Traceback (most recent call last):
  File "python/test/ingest_files_from_s3.py", line 30, in <module>
    sleeper_client.ingest_parquet_files_from_s3(args.table, args.files, args.jobid)
  File "/python/env/lib/python3.12/site-packages/sleeper/client.py", line 115, in ingest_parquet_files_from_s3
    _ingest(table_name, files, self._instance_properties, job_id)
TypeError: _ingest() missing 1 required positional argument: 'job_id'

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions

    0