A Data Lake for
E-commerce Product Intelligence
Production-grade product datasets delivered as partitioned Apache Parquet in a cloud-native lake architecture. Built for analytics teams, consultants, and builders who need repeatable, query-ready data.
🎯 Lead magnet: guide + updates
Get our competitive analysis guide and product updates (separate from the 10K Parquet sample above).
Data lake architecture
Partitioned Parquet in R2, served by an API layer
Your deliverable is not “a CSV download.” It’s a lake-style layout you can ingest into DuckDB, Polars, Spark, BigQuery, Snowflake, or any Parquet-native workflow.
Partitioning
data/year=YYYY/quarter=Q#/month=M/category=Category_Slug/
Manifests + catalog
Each dataset includes metadata (row counts, schema version, checksums) for repeatable ingestion.
Secure access
Customers authenticate, entitlement is checked, then Parquet is streamed from R2.
What you get
data/year=2026/…/category=Electronics/*.parquet/api/catalog /api/me /api/downloadread_parquet(\"*.parquet\")Designed for repeatability: stable schemas, predictable keys, and an API-backed catalog.
Production format
10,000-row Apache Parquet sample
The same column layout and file format as commercial drops: partitioned product-link datasets delivered as Parquet for analytics pipelines (Spark, DuckDB, Polars, BigQuery load, and more).
- Exactly 10,000 rows in one
.parquetfile - Schema aligned with monthly
year=/quarter=/month=/category=releases - Marketing use only — see license note on download
See the Data Quality
Below is a tiny HTML preview (five rows). Your real deliverable is Parquet at scale—start with the 10,000-row sample file. All data is collected from publicly visible product pages.
Representative rows (5 of many millions in production)
| product_url | site_domain | title | brand | price | currency | availability | category | extraction_timestamp |
|---|---|---|---|---|---|---|---|---|
| …/guess-laptop-bag/ | 99percents.com | Guess Laptop Bag | — | 50000.00 | NGN | out_of_stock | Bags_Travel | 2026-04-09T…Z |
| …/once-upon-a-wrinkle | 100percentpure.com | Once Upon a Wrinkle | — | 34.00 | — | unknown | Footwear | 2026-04-09T…Z |
| …/turntable-cartridges… | 2001audiovideo.com | Turntable Cartridges and Stylus | — | 249.00 | — | unknown | Gaming_Peripherals | 2026-04-07T…Z |
What's In Our Product Datasets
Product Information
Names, descriptions, SKUs, categories, specifications, and detailed product attributes
Pricing Data
Current prices, sale prices, discounts, price history, and competitive pricing intelligence
Reviews & Ratings
Star ratings, review counts, review sentiment, and customer feedback analysis
Availability Status
Stock levels, availability indicators, shipping information, and inventory tracking
Retailer Information
Store names, URLs, seller details, and marketplace identifiers for complete attribution
Market Analytics
Trend data, category insights, seasonal patterns, and competitive positioning metrics
Current Product Data Collections
Each dataset is updated daily with fresh product information from major retailers.
Electronics & Tech Products
Comprehensive product data from Best Buy, Amazon, Newegg, and 12 other major electronics retailers. Includes smartphones, laptops, gaming, and smart home devices.
Products: 85k | Size: 120MB | Updated: 2 hours ago
Fashion & Apparel Products
Product catalogs from Nike, Adidas, Zara, H&M, and 25+ fashion retailers. Includes pricing, sizes, colors, seasonal trends, and style categories.
Products: 150k | Size: 280MB | Updated: 4 hours ago
Home & Kitchen Products
Furniture, appliances, and home goods from Wayfair, Home Depot, IKEA, and 18 specialty retailers. Perfect for market analysis and competitive research.
Products: 200k | Size: 350MB | Updated: 1 hour ago
How Businesses Use Our Product Data
Competitive Price Analysis
Track competitor pricing strategies, identify pricing gaps, and optimize your own pricing for maximum profitability.
Market Research
Analyze product trends, seasonal patterns, and consumer preferences to inform product development and marketing strategies.
Product Sourcing
Discover new products, identify popular items, and find profitable niches in various retail categories.
Brand Monitoring
Track how your brand and products are positioned across different retailers and marketplaces.
Professional-Grade Product Intelligence
Comprehensive product data that would cost $50,000+ to collect manually. Choose the scale that fits your research needs.
How We Collect Product Data
Ethical Web Scraping
We only collect publicly visible product information using respectful scraping practices. All robots.txt files are honored and rate limits are strictly followed.
Data Validation & Cleaning
Every product record goes through automated validation: price format checking, duplicate removal, and data completeness scoring to ensure high quality.
Privacy Compliant
We only collect product information visible to any website visitor. No personal data, no customer information, no backend systems - just public product catalogs.
Regular Updates
Product data is refreshed daily to capture price changes, new products, and availability updates. You always get the most current market information.
Ready to Get Started?
Questions about our product data? Need a custom dataset for your industry? Let's talk.
Typical response time: Under 2 hours during business hours