Agriculture QC clean AI-training-safe

US Crop Progress & Condition (11 crops: Corn / Soy / Wheat / Cotton / Rice / Sorghum / Barley / Oats / Peanuts / Sugarbeets / Sunflower)

Weekly USDA crop progress and condition for 11 crops - corn, soybeans, wheat, cotton, rice, sorghum, barley, oats, peanuts, sugarbeets and sunflower - % planted, emerged, silking, harvested and (where surveyed) the very-poor→excellent condition split - nationally and per state. The raw QuickStats API caps queries at 50k rows, hides the calendar date and ships values as comma-strings with (D)/(NA) sentinels; this is one clean per state × crop × series × week Parquet.

667K
rows
49
zones
1999-2026
coverage
2.8 MB
download
Source
USDA
Licence
Redistributable open data
Updates
Weekly
Data through
2026-07-26
Quality
QC clean · 0 failures
Format
Apache Parquet + dictionary

Safe to train on

Built only from a named, redistributable official source under a documented open licence - not scraped web data. No copyright grey zone, no personal data. Ships machine-readable Croissant metadata (ML Commons - loads in Hugging Face / Kaggle / Google), an AI training-licence manifest documenting source, licence and provenance for your model's data governance, and a machine-readable data dictionary (drop it into an agent / RAG prompt so the model knows every column) - all inspectable before you buy.

What's included

  • Weekly progress (+ condition where surveyed) for 11 crops (corn, soy, wheat, cotton, rice, sorghum, barley, oats, peanuts, sugarbeets, sunflower), US + every reporting state
  • series = crop + the PCT measure (e.g. Corn - Pct planted / Corn - Pct good)
  • one row per state × crop × series × week; week-ending Sunday timestamp
  • Source: U.S. Department of Agriculture, NASS QuickStats (public domain)

Schema

ColumnTypeDescriptionFilledDistinct
zone str State (USPS alpha; 'US' for national) 100.0% 49
ts timestamp (UTC) Week-ending Sunday 100.0% 1,138
series str Crop + PCT measure 100.0% 142
pct float Percent (0-100) 100.0% 101
unit str Unit 100.0% 1
res_min int Native resolution (weekly = 10080) 100.0% 1

Sample & preview

Every purchase ships as Apache Parquet with a data dictionary and the full QC report. A free sample (first rows + schema) is downloadable here - confirm fit before you buy. Source: USDA (redistributable open data; attribution passes through - see our Licence).

Don't trust screenshots - drop the sample into your notebook right now.

import pandas as pd
df = pd.read_parquet("us-crop-progress-condition_sample.parquet")
df.info()   # typed columns, gap-aware, ready to join
⬇ Download free Parquet sample or CSV for Excel
Coverage: 49 zones

AL · AR · AZ · CA · CO · CT · DE · FL · GA · IA · ID · IL · IN · KS · KY · LA · MA · MD · ME · MI · MN · MO · MS · MT · NC · ND · NE · NH · NJ · NM · NV · NY · OH · OK · OR · PA · RI · SC · SD · TN · TX · US · UT · VA · VT · WA · WI · WV · WY

Related datasets

Agriculture

Agri Positioning Matrix (crop condition × COT)

Physical crop reality vs paper positioning: USDA Good+Excellent condition momentum joined to CFTC speculative-positioning z-score per crop, weekly, across 8 crops - corn, soybeans, wheat, cotton, rice, oats (all with both condition and the dominant CFTC futures market) plus barley and sorghum (condition only, no listed futures). Crops deteriorating while funds are net-short flags short-squeeze setups in food commodities.

16K rows· 9 zones· 1987-2026 (weekly)
19 View
Agriculture

EU CAP Subsidy Flows

Common Agricultural Policy expenditure, cleaned to analysis-ready Parquet: EUR paid per EU member state x CAP instrument (direct payments, market measures, rural development) x year, 2003-2022. Fully aggregated (member-state level, no beneficiary individuals) - the GDPR-safe view of where CAP money goes. Source: DG AGRI 'Financing the CAP' indicators.

CAPFLOWS· 6K rows· 28 zones· 2003-2022 (annual)
29 View
Agriculture

European Agricultural Output Prices

The real output-price index of Europe's major crops - cereals, wheat, barley, grain maize, industrial crops and oilseeds - deflated to 2020=100, per country, annual. Cleaned from Eurostat's agricultural price statistics into one tidy panel: the farm-gate price signal, in real terms, that agri-commodity traders, food manufacturers and ag-lenders track. Distinct from our global crop-production volumes - this is PRICE, not tonnage.

Eurostat· 884 rows· 26 zones· 2020-2025 (annual)
Free View