Data Collection
Data Providers
Section titled “Data Providers”Quantum Trader supports multiple data providers for redundancy and coverage.
Polygon.io (Primary)
Section titled “Polygon.io (Primary)”Features:
- Real-time and historical data
- 2+ years of minute data on free tier
- Reliable and fast
Rate Limits:
- Free: 5 calls/minute
- Starter: 100 calls/minute
Setup:
POLYGON_API_KEY=your_key_hereAlpha Vantage (Backup)
Section titled “Alpha Vantage (Backup)”Features:
- 20+ years of daily data
- Fundamental data available
- Good for historical backfills
Rate Limits:
- Free: 25 calls/day
- Premium: 75 calls/minute
Setup:
ALPHA_VANTAGE_API_KEY=your_key_hereyfinance (Fallback)
Section titled “yfinance (Fallback)”Features:
- No API key required
- Good for quick tests
- May be rate-limited
Collection Strategies
Section titled “Collection Strategies”Manual Collection
Section titled “Manual Collection”Trigger data collection on-demand:
- Go to Tickers
- Click Collect on a ticker
- Select interval and date range
Scheduled Collection
Section titled “Scheduled Collection”Set up automatic data collection:
- Daily data: After market close (4:30 PM ET)
- Intraday: Every 15 minutes during market hours
Bulk Collection
Section titled “Bulk Collection”For initial setup or backfills:
- Go to Tickers > Bulk Collect
- Select tickers
- Choose intervals
- Start collection
Rate Limit Management
Section titled “Rate Limit Management”The system automatically manages rate limits:
- Queues requests when limit reached
- Rotates between providers
- Retries failed requests
Host-Based Collectors
Section titled “Host-Based Collectors”For advanced users, run collectors outside Docker:
from quantum_trader import DataCollector
collector = DataCollector(api_url="http://localhost:8501")collector.collect("AAPL", interval="1d", start="2020-01-01")Next Steps
Section titled “Next Steps”- Custom Indicators - Process collected data
- API Bulk Data - Upload external data