All datasets
246 cleaned, analysis-ready datasets and reference tables - every one QC-verified and AI-training-safe.
Showing 13 of 246 datasets
Agri Positioning Matrix (crop condition × COT)
Physical crop reality vs paper positioning: USDA Good+Excellent condition momentum joined to CFTC speculative-positioning z-score per crop, weekly, across 8 crops - corn, soybeans, wheat, cotton, rice, oats (all with both condition and the dominant CFTC futures market) plus barley and sorghum (condition only, no listed futures). Crops deteriorating while funds are net-short flags short-squeeze setups in food commodities.
EU CAP Subsidy Flows
Common Agricultural Policy expenditure, cleaned to analysis-ready Parquet: EUR paid per EU member state x CAP instrument (direct payments, market measures, rural development) x year, 2003-2022. Fully aggregated (member-state level, no beneficiary individuals) - the GDPR-safe view of where CAP money goes. Source: DG AGRI 'Financing the CAP' indicators.
European Agricultural Output Prices
The real output-price index of Europe's major crops - cereals, wheat, barley, grain maize, industrial crops and oilseeds - deflated to 2020=100, per country, annual. Cleaned from Eurostat's agricultural price statistics into one tidy panel: the farm-gate price signal, in real terms, that agri-commodity traders, food manufacturers and ag-lenders track. Distinct from our global crop-production volumes - this is PRICE, not tonnage.
European Agriculture
The European agriculture picture in one clean annual panel, per country: crop OUTPUT PRICES (real index, 2020=100 - cereals, wheat, barley, maize, industrial crops, oilseeds), MEAT production (bovine, pig, sheep & goat, thousand tonnes), MILK & DAIRY (cows', ewes', goats' milk + cream) and FISHERIES catches (by species group). Assembled from Eurostat's agricultural statistics into one tidy long file - the whole EU farm-and-sea supply-and-price signal that agri-commodity traders, food manufacturers and ag-lenders track, without stitching a dozen cubes. The `indicator` column selects the series.
European Fisheries Catches
Fishery catches for every European country, split by species group - total, freshwater & diadromous fish, shellfish and finfish - in live-weight tonnes across all fishing areas. Cleaned from Eurostat's fisheries statistics into one tidy annual panel: the catch-volume signal for seafood traders, aquaculture firms and marine-policy researchers.
European Meat Production
Meat production (slaughterings) for every European country, split by type - bovine, pigmeat and sheep & goat - in thousand tonnes, annual. Cleaned from Eurostat's agricultural production statistics into one tidy panel: the livestock-output signal for food manufacturers, agri-commodity traders and ag-lenders. Complements our crop-production and agri-price sets.
European Milk & Dairy Production
Milk and dairy output for every European country, split by animal - cows', ewes' and goats' milk - plus cream, in thousand tonnes, annual. Cleaned from Eurostat's agricultural production statistics into one tidy panel: the dairy-supply signal for food manufacturers, dairy co-operatives and agri-commodity analysts. Completes our EU livestock picture beside meat production and agricultural prices.
Global Crop Production & Yield
Sixty-plus years of FAOSTAT crop statistics, cleaned into one continuous table: harvested area, yield, and production for 143 single-commodity crops across ~200 countries - grains (wheat, maize, rice, barley, sorghum, millet, oats, rye, triticale, quinoa, fonio), the full oilseed complex (soya, rapeseed/canola, sunflower, oil palm, groundnuts, sesame, linseed), soft commodities (coffee, cocoa, tea, tobacco, natural rubber), the entire fruit & nut estate (apples, grapes, bananas, citrus, berries, mangoes, avocados, almonds, walnuts, pistachios…), vegetables & pulses (tomatoes, onions, cabbages, beans, lentils, chickpeas, peas), roots (potatoes, cassava, yams, sweet potatoes), sugar (cane + beet) and fibres/spices. The raw FAO drop is a 545 MB normalized dump of every item back to 1961 - we stream it down to real single commodities (FAO super-aggregates dropped, no double-counting) and serve a tidy per-country, per-series Parquet with country names correctly UTF-8 encoded.
Global Livestock & Animal Products
Sixty-plus years of FAOSTAT livestock statistics, cleaned into one continuous table: production, animals slaughtered / milked, and per-animal yield for 23 animal products across ~200 countries - meat by species (cattle, buffalo, pig, sheep, goat, chicken, duck, goose, turkey, rabbit, camel, horse, ass, mule…), hen & other-bird eggs, and raw milk by species (cattle, buffalo, sheep, goat, camel). The global counterpart to our EU-only meat & dairy panels - head counts, carcass weights and output tonnage in one tidy per-country, per-series Parquet. FAO 'primary'/'Total'/'Poultry' super-aggregates dropped so nothing double-counts.
US Crop Condition Momentum (Good+Excellent, weekly Δ)
Week-over-week change in the combined Good+Excellent condition share for 11 crops - corn, soybeans, wheat, cotton, rice, sorghum, barley, oats, peanuts, sugarbeets and sunflower - per state and nationally. +ve = the crop is improving, -ve = deteriorating - the weekly USDA condition surprise grains desks trade, pre-computed from the crop progress & condition feed.
US Crop Progress & Condition (11 crops: Corn / Soy / Wheat / Cotton / Rice / Sorghum / Barley / Oats / Peanuts / Sugarbeets / Sunflower)
Weekly USDA crop progress and condition for 11 crops - corn, soybeans, wheat, cotton, rice, sorghum, barley, oats, peanuts, sugarbeets and sunflower - % planted, emerged, silking, harvested and (where surveyed) the very-poor→excellent condition split - nationally and per state. The raw QuickStats API caps queries at 50k rows, hides the calendar date and ships values as comma-strings with (D)/(NA) sentinels; this is one clean per state × crop × series × week Parquet.
US Harvest Delay Anomaly (vs 5
How far ahead of or behind normal this year's harvest is: current Pct-harvested minus the 5-year average for that same week-of-year, per state and crop. +ve = ahead of schedule, -ve = behind - the 'are we early or late' number grain logistics and basis traders watch each fall.
EU Food & Feed Safety Alerts (RASFF)
Every EU food, feed and food-contact-material safety alert from 1979 to 2020 in one clean table - the cross-border early-warning record importers, QA teams and food-safety researchers want but can't get from the portal. The live RASFF Window is presentation-only with no reuse licence; the Commission (DG SANTE) instead published the full pre-2021 back-catalogue as an OPEN CC-BY-4.0 distribution on data.europa.eu (the 'restored_rasff' dataset). One tidy row per notification-line: reference and date, notifying and origin country, notification type (Food/Feed/Food-contact) and class, the notification basis, product / subject / product category, hazard category + substance + full hazard text, any analytical result, the action taken and the market-distribution status. Keyed by (reference, line_no). No complainant or company-contact personal data. CC-BY-4.0 ((c) European Union).