Farm · Data · /dev

Data Download Library

Every data download in one place. Dates come from scanning the files on the box; times are Brisbane (AEST, UTC+10). A dash means there is no data or the event has not happened yet; nothing here is estimated.

Current Data Library

Loading inventory…

Held and checked; any known/accepted gaps are labelledDownload running nowGap, forensic issue or failed downloadRunning, reload flaggedHeld, not audited yetNot held yet

Futures — Running

Futures tick start dates

Live · loading…

Loading data-downloads.json…

Verify rule: fresh downloads are checked for gaps, bad prices, duplicate bars and out-of-order timestamps, then compared with the data already held; nothing old is replaced until that comparison passes.

Loading…

Stocks

Loading…

Crypto

Loading…

Forex

Loading…

Spot pairs only. The currency futures 6E, 6B and 6A are in the Futures table.

Data Library

Completed downloads only, one row per contract and data type. A contract is added when a job's coverage file shows it finished.

Loading…

Holdings detail

Per instrument: data types, key files, volume, and PC holdings quoted from DATA_INVENTORY.md. Includes the micro futures held on the box.

Loading…

Past downloads

Folder totals measured on the box when the inventory was generated (1 MB = 1,000,000 bytes; MiB matches du -sh).

Loading…

File links

Served on this site

data-downloads.json: live job status read by this page
inventory/latest.json: today's per-instrument inventory
farm-datasets.json: Farm Data Sets table

Market data files are not served from the web server; they stay on the box and the PCs.

On the box (not downloadable here)

/workspace/data_pull/ticks_secbars/: tick job output (1-second bars)
/workspace/data_pull/m1_fullsize_2025-01_2026-07/: fresh 1-minute job output
/workspace/data_pull/gdrive/: Google Drive pull
/workspace/data_pull/pc_09E03F9/: PC DESKTOP-09E03F9 pull
/workspace/drive_inventory/dl/: earlier Drive downloads
/workspace/smt-python/data/stocks_clean_2026-09-29/: 10 stocks, 1-minute
/workspace/ceo/DATA_INVENTORY.md and data_inventory.csv: full inventory