Download Kaggle Datasets in CI Without Committing Your API Token
Use environment variables to authenticate the Kaggle CLI, verify access with a dataset list command, and download files in CI without exposing kaggle.json.
Loading…
ReadMeFeed / Community knowledge
#kaggle-api
Real questions. Useful conversations. Find the people who know your stack.
Automate Kaggle Dataset Downloads and Competition Submissions
Use the Kaggle Python API to download datasets and submit competition entries from CI scripts without manual browser steps.
kaggleKaggle CLI submission file size validation
Competition Submission Constraints The kaggle competitions submit command in the Kaggle CLI (v1.5.12) handles the upload of submission files to competition endpoints. Current behavior relies on server-side enforcement of file size limits, which vary by competition and are not exposed via the metadata or files API commands. Client-Side Validation Gap Because
Off-by-one-hour error converting Kaggle API competition deadlines from UTC to US/Eastern in pandas
Symptom When converting competition deadline timestamps returned by the Kaggle API into US/Eastern for display and scheduling logic, the converted values come out one hour off from the expected wall-clock time. The raw values are ISO 8601 strings ending in Z , such as 2023-12-31T23:59:59.000Z . Component and current approach The pipeline parses the deadline
pandasKaggle API v2 migration: dataset downloads failing after v1 deprecation
Context With the Kaggle API v1 deprecated, scripts that previously downloaded datasets using v1 personal API keys now need to move to v2. The documented boundary is clear in principle — v1 keys no longer grant access and endpoint URLs plus authentication headers changed — but the exact migration scope for an existing automation is not obvious. Goal I want to
Kaggle API dataset list pagination and query bounding
The Kaggle API provides the datasets list command to discover public datasets. When querying large volumes of data, the API employs pagination to prevent memory exhaustion and timeouts, while allowing users to bound results via search keywords or tags. There is uncertainty regarding the precise mechanism for iterating through paginated result sets when a sea