Upload 313 files

.vscode/settings.json

@@ -0,0 +1,3 @@
+{
+    "git.ignoreLimitWarning": true
+}

DEPLOYMENT_GUIDE.md

@@ -1,600 +0,0 @@
-# Deployment Guide - Crypto Resource Aggregator
-
-## Quick Deployment to Hugging Face Spaces
-
-### Method 1: Web Interface (Recommended for Beginners)
-
-1. **Create a Hugging Face Account**
-   - Go to https://huggingface.co/join
-   - Sign up for a free account
-
-2. **Create a New Space**
-   - Go to https://huggingface.co/new-space
-   - Choose a name (e.g., `crypto-resource-aggregator`)
-   - Select SDK: **Docker**
-   - Choose visibility: **Public** or **Private**
-   - Click "Create Space"
-
-3. **Upload Files**
-   Upload the following files to your Space:
-   - `app.py` - Main application file
-   - `requirements.txt` - Python dependencies
-   - `all_apis_merged_2025.json` - Resource configuration
-   - `README.md` - Documentation
-   - `Dockerfile` - Docker configuration
-
-4. **Wait for Build**
-   - The Space will automatically build and deploy
-   - This may take 2-5 minutes
-   - You'll see the build logs in real-time
-
-5. **Access Your API**
-   - Once deployed, your API will be available at:
-     `https://[your-username]-[space-name].hf.space`
-   - Example: `https://username-crypto-resource-aggregator.hf.space`
-
-### Method 2: Git CLI (Recommended for Advanced Users)
-
-```bash
-# Clone your Space repository
-git clone https://huggingface.co/spaces/[your-username]/[space-name]
-cd [space-name]
-
-# Copy all files to the repository
-cp app.py requirements.txt all_apis_merged_2025.json README.md Dockerfile .
-
-# Commit and push
-git add .
-git commit -m "Initial deployment of Crypto Resource Aggregator"
-git push
-```
-
----
-
-## Alternative Deployment Options
-
-### Option 1: Heroku
-
-```bash
-# Install Heroku CLI
-# https://devcenter.heroku.com/articles/heroku-cli
-
-# Create a new app
-heroku create crypto-resource-aggregator
-
-# Create Procfile
-echo "web: python app.py" > Procfile
-
-# Deploy
-git add .
-git commit -m "Deploy to Heroku"
-git push heroku main
-
-# Open your app
-heroku open
-```
-
-### Option 2: Railway
-
-```bash
-# Install Railway CLI
-npm i -g @railway/cli
-
-# Login
-railway login
-
-# Initialize project
-railway init
-
-# Deploy
-railway up
-
-# Get deployment URL
-railway domain
-```
-
-### Option 3: Render
-
-1. Go to https://render.com
-2. Click "New +" → "Web Service"
-3. Connect your GitHub repository
-4. Configure:
-   - **Build Command**: `pip install -r requirements.txt`
-   - **Start Command**: `python app.py`
-   - **Environment**: Python 3
-5. Click "Create Web Service"
-
-### Option 4: Docker (Self-Hosted)
-
-```bash
-# Build the Docker image
-docker build -t crypto-aggregator .
-
-# Run the container
-docker run -d -p 7860:7860 --name crypto-aggregator crypto-aggregator
-
-# Check logs
-docker logs crypto-aggregator
-
-# Stop the container
-docker stop crypto-aggregator
-
-# Remove the container
-docker rm crypto-aggregator
-```
-
-### Option 5: Docker Compose (Self-Hosted)
-
-Create `docker-compose.yml`:
-
-```yaml
-version: '3.8'
-
-services:
-  aggregator:
-    build: .
-    ports:
-      - "7860:7860"
-    restart: unless-stopped
-    volumes:
-      - ./history.db:/app/history.db
-    environment:
-      - ENVIRONMENT=production
-```
-
-Run:
-```bash
-docker-compose up -d
-```
-
-### Option 6: AWS EC2
-
-```bash
-# Connect to your EC2 instance
-ssh -i your-key.pem ubuntu@your-instance-ip
-
-# Install Python and dependencies
-sudo apt update
-sudo apt install python3-pip python3-venv -y
-
-# Create virtual environment
-python3 -m venv venv
-source venv/bin/activate
-
-# Upload files (from local machine)
-scp -i your-key.pem app.py requirements.txt all_apis_merged_2025.json ubuntu@your-instance-ip:~/
-
-# Install dependencies
-pip install -r requirements.txt
-
-# Run with nohup
-nohup python app.py > output.log 2>&1 &
-
-# Or use systemd service (recommended)
-sudo nano /etc/systemd/system/crypto-aggregator.service
-```
-
-Create systemd service file:
-```ini
-[Unit]
-Description=Crypto Resource Aggregator
-After=network.target
-
-[Service]
-User=ubuntu
-WorkingDirectory=/home/ubuntu/crypto-aggregator
-ExecStart=/home/ubuntu/venv/bin/python app.py
-Restart=always
-
-[Install]
-WantedBy=multi-user.target
-```
-
-Enable and start:
-```bash
-sudo systemctl enable crypto-aggregator
-sudo systemctl start crypto-aggregator
-sudo systemctl status crypto-aggregator
-```
-
-### Option 7: Google Cloud Run
-
-```bash
-# Install gcloud CLI
-# https://cloud.google.com/sdk/docs/install
-
-# Authenticate
-gcloud auth login
-
-# Set project
-gcloud config set project YOUR_PROJECT_ID
-
-# Build and deploy
-gcloud run deploy crypto-aggregator \
-  --source . \
-  --platform managed \
-  --region us-central1 \
-  --allow-unauthenticated
-
-# Get URL
-gcloud run services describe crypto-aggregator --region us-central1 --format 'value(status.url)'
-```
-
-### Option 8: DigitalOcean App Platform
-
-1. Go to https://cloud.digitalocean.com/apps
-2. Click "Create App"
-3. Connect your GitHub repository
-4. Configure:
-   - **Run Command**: `python app.py`
-   - **Environment**: Python 3.11
-   - **HTTP Port**: 7860
-5. Click "Deploy"
-
----
-
-## Environment Variables (Optional)
-
-You can configure the following environment variables:
-
-```bash
-# Port (default: 7860)
-export PORT=8000
-
-# Log level (default: INFO)
-export LOG_LEVEL=DEBUG
-
-# Database path (default: history.db)
-export DATABASE_PATH=/path/to/history.db
-```
-
----
-
-## Post-Deployment Testing
-
-### 1. Test Health Endpoint
-
-```bash
-curl https://your-deployment-url.com/health
-```
-
-Expected response:
-```json
-{
-  "status": "healthy",
-  "timestamp": "2025-11-10T...",
-  "resources_loaded": true,
-  "database_connected": true
-}
-```
-
-### 2. Test Resource Listing
-
-```bash
-curl https://your-deployment-url.com/resources
-```
-
-### 3. Test Query Endpoint
-
-```bash
-curl -X POST https://your-deployment-url.com/query \
-  -H "Content-Type: application/json" \
-  -d '{
-    "resource_type": "market_data",
-    "resource_name": "coingecko",
-    "endpoint": "/simple/price",
-    "params": {
-      "ids": "bitcoin",
-      "vs_currencies": "usd"
-    }
-  }'
-```
-
-### 4. Test Status Monitoring
-
-```bash
-curl https://your-deployment-url.com/status
-```
-
-### 5. Run Full Test Suite
-
-From your local machine:
-
-```bash
-# Update BASE_URL in test_aggregator.py
-# Change: BASE_URL = "http://localhost:7860"
-# To: BASE_URL = "https://your-deployment-url.com"
-
-# Run tests
-python test_aggregator.py
-```
-
----
-
-## Performance Optimization
-
-### 1. Enable Caching
-
-Add Redis for caching (optional):
-
-```python
-import redis
-import json
-
-# Connect to Redis
-redis_client = redis.Redis(host='localhost', port=6379, decode_responses=True)
-
-# Cache resource data
-def get_cached_data(key, ttl=300):
-    cached = redis_client.get(key)
-    if cached:
-        return json.loads(cached)
-    return None
-
-def set_cached_data(key, data, ttl=300):
-    redis_client.setex(key, ttl, json.dumps(data))
-```
-
-### 2. Use Connection Pooling
-
-Already implemented with `aiohttp.ClientSession`
-
-### 3. Add Rate Limiting
-
-Install:
-```bash
-pip install slowapi
-```
-
-Add to `app.py`:
-```python
-from slowapi import Limiter, _rate_limit_exceeded_handler
-from slowapi.util import get_remote_address
-from slowapi.errors import RateLimitExceeded
-
-limiter = Limiter(key_func=get_remote_address)
-app.state.limiter = limiter
-app.add_exception_handler(RateLimitExceeded, _rate_limit_exceeded_handler)
-
-@app.post("/query")
-@limiter.limit("60/minute")
-async def query_resource(request: Request, query: ResourceQuery):
-    # ... existing code
-```
-
-### 4. Add Monitoring
-
-Use Sentry for error tracking:
-
-```bash
-pip install sentry-sdk
-```
-
-```python
-import sentry_sdk
-from sentry_sdk.integrations.fastapi import FastApiIntegration
-
-sentry_sdk.init(
-    dsn="your-sentry-dsn",
-    integrations=[FastApiIntegration()],
-    traces_sample_rate=1.0,
-)
-```
-
----
-
-## Security Best Practices
-
-### 1. API Key Management
-
-Store API keys in environment variables:
-
-```python
-import os
-
-API_KEYS = {
-    'etherscan': os.getenv('ETHERSCAN_API_KEY', 'default-key'),
-    'coinmarketcap': os.getenv('CMC_API_KEY', 'default-key'),
-}
-```
-
-### 2. Enable HTTPS
-
-Most platforms (Hugging Face, Heroku, etc.) provide HTTPS by default.
-
-For self-hosted, use Let's Encrypt:
-
-```bash
-# Install Certbot
-sudo apt install certbot python3-certbot-nginx
-
-# Get certificate
-sudo certbot --nginx -d your-domain.com
-```
-
-### 3. Add Authentication (Optional)
-
-```bash
-pip install python-jose[cryptography] passlib[bcrypt]
-```
-
-```python
-from fastapi.security import HTTPBearer, HTTPAuthorizationCredentials
-from fastapi import Security
-
-security = HTTPBearer()
-
-@app.post("/query")
-async def query_resource(
-    query: ResourceQuery,
-    credentials: HTTPAuthorizationCredentials = Security(security)
-):
-    # Verify token
-    if credentials.credentials != "your-secret-token":
-        raise HTTPException(status_code=401, detail="Invalid token")
-    # ... existing code
-```
-
----
-
-## Monitoring & Maintenance
-
-### 1. Monitor Logs
-
-Hugging Face Spaces:
-- View logs in the Space settings → "Logs" tab
-
-Docker:
-```bash
-docker logs -f crypto-aggregator
-```
-
-Systemd:
-```bash
-journalctl -u crypto-aggregator -f
-```
-
-### 2. Database Maintenance
-
-Backup database regularly:
-
-```bash
-# Local backup
-cp history.db history_backup_$(date +%Y%m%d).db
-
-# Remote backup
-scp user@server:/path/to/history.db ./backups/
-```
-
-Clean old records:
-
-```sql
--- Remove records older than 30 days
-DELETE FROM query_history WHERE timestamp < datetime('now', '-30 days');
-DELETE FROM resource_status WHERE last_check < datetime('now', '-30 days');
-```
-
-### 3. Update Resources
-
-To add new resources, update `all_apis_merged_2025.json` and redeploy.
-
-### 4. Health Checks
-
-Set up automated health checks:
-
-```bash
-# Cron job (every 5 minutes)
-*/5 * * * * curl https://your-deployment-url.com/health || echo "API is down!"
-```
-
-Use UptimeRobot or similar service for monitoring.
-
----
-
-## Troubleshooting
-
-### Issue: Server won't start
-
-**Solution:**
-```bash
-# Check if port 7860 is in use
-lsof -i :7860
-
-# Kill existing process
-kill -9 $(lsof -t -i:7860)
-
-# Or use a different port
-PORT=8000 python app.py
-```
-
-### Issue: Database locked
-
-**Solution:**
-```bash
-# Stop all instances
-pkill -f app.py
-
-# Remove lock (if exists)
-rm history.db-journal
-
-# Restart
-python app.py
-```
-
-### Issue: High memory usage
-
-**Solution:**
-- Add connection limits
-- Implement request queuing
-- Scale horizontally with multiple instances
-
-### Issue: API rate limits
-
-**Solution:**
-- Implement caching
-- Add multiple API keys for rotation
-- Use fallback resources
-
----
-
-## Scaling
-
-### Horizontal Scaling
-
-Use a load balancer with multiple instances:
-
-```yaml
-# docker-compose-scaled.yml
-version: '3.8'
-
-services:
-  aggregator:
-    build: .
-    deploy:
-      replicas: 3
-    environment:
-      - WORKER_ID=${HOSTNAME}
-
-  nginx:
-    image: nginx:alpine
-    ports:
-      - "80:80"
-    volumes:
-      - ./nginx.conf:/etc/nginx/nginx.conf
-    depends_on:
-      - aggregator
-```
-
-### Vertical Scaling
-
-Increase resources on your hosting platform:
-- Hugging Face: Upgrade to paid tier
-- AWS: Use larger EC2 instance
-- Docker: Adjust container resources
-
----
-
-## Support
-
-For issues or questions:
-1. Check `/health` endpoint
-2. Review application logs
-3. Test individual resources with `/status`
-4. Verify database with SQLite browser
-
----
-
-## Next Steps
-
-After deployment:
-
-1. **Integrate with your main app** using the provided client examples
-2. **Set up monitoring** with health checks and alerts
-3. **Configure backups** for the history database
-4. **Add custom resources** by updating the JSON file
-5. **Implement caching** for frequently accessed data
-6. **Enable authentication** if needed for security
-
----
-
-**Congratulations! Your Crypto Resource Aggregator is now deployed and ready to use!** 🚀

Dockerfile

@@ -1,37 +1,41 @@
+# Use Python 3.11 Slim base image
 FROM python:3.11-slim
 
-# Environment variables
+# Set environment variables
 ENV PYTHONUNBUFFERED=1 \
     PYTHONDONTWRITEBYTECODE=1 \
     PIP_NO_CACHE_DIR=1 \
     PIP_DISABLE_PIP_VERSION_CHECK=1 \
     ENABLE_AUTO_DISCOVERY=false
 
-# System dependencies (gcc + curl for healthcheck)
+# Install system dependencies
 RUN apt-get update && apt-get install -y \
     gcc \
+    g++ \
     curl \
     && rm -rf /var/lib/apt/lists/*
 
-# Workdir
+# Set working directory
 WORKDIR /app
 
-# Python deps
+# Copy dependency files
 COPY requirements.txt .
+
+# Install Python dependencies
 RUN pip install --no-cache-dir -r requirements.txt
 
-# App code
+# Copy application code
 COPY . .
 
-# Logs dir
-RUN mkdir -p logs
+# Create necessary directories
+RUN mkdir -p logs data data/exports data/backups
 
-# Ports (HF usually sets PORT=7860)
-EXPOSE 8000 7860
+# Expose ports (Hugging Face uses PORT env variable, default 7860)
+EXPOSE 7860 8000
 
-# Healthcheck without extra Python deps
-HEALTHCHECK --interval=30s --timeout=10s --start-period=5s --retries=3 \
-    CMD curl -f "http://127.0.0.1:${PORT:-8000}/health" || exit 1
+# Health check (simplified to avoid requests dependency in healthcheck)
+HEALTHCHECK --interval=30s --timeout=10s --start-period=40s --retries=3 \
+    CMD curl -f http://localhost:${PORT:-8000}/health || exit 1
 
-# Run server (FastAPI app is in app.py -> app)
-CMD ["sh", "-c", "uvicorn app:app --host 0.0.0.0 --port ${PORT:-8000}"]
+# Run server with uvicorn (supports Hugging Face PORT env variable)
+CMD ["sh", "-c", "uvicorn api_server_extended:app --host 0.0.0.0 --port ${PORT:-8000}"]

HUGGINGFACE_DEPLOYMENT.md

@@ -1,349 +0,0 @@
-# 🤗 HuggingFace Spaces Deployment Guide
-
-This guide explains how to deploy the Crypto API Monitoring System to HuggingFace Spaces.
-
-## Overview
-
-The application is fully optimized for HuggingFace Spaces deployment with:
-- **Docker-based deployment** using the standard HF Spaces port (7860)
-- **Automatic environment detection** for frontend API calls
-- **HuggingFace ML integration** for crypto sentiment analysis
-- **WebSocket support** for real-time data streaming
-- **Persistent data storage** with SQLite
-
-## Prerequisites
-
-1. A HuggingFace account ([sign up here](https://huggingface.co/join))
-2. Git installed on your local machine
-3. Basic familiarity with Docker and HuggingFace Spaces
-
-## Deployment Steps
-
-### 1. Create a New Space
-
-1. Go to [HuggingFace Spaces](https://huggingface.co/spaces)
-2. Click "Create new Space"
-3. Configure your Space:
-   - **Name**: `Datasourceforcryptocurrency` (or your preferred name)
-   - **License**: Choose appropriate license (e.g., MIT)
-   - **SDK**: Select **Docker**
-   - **Visibility**: Public or Private (your choice)
-4. Click "Create Space"
-
-### 2. Clone Your Space Repository
-
-```bash
-# Clone your newly created space
-git clone https://huggingface.co/spaces/YOUR_USERNAME/YOUR_SPACE_NAME
-cd YOUR_SPACE_NAME
-```
-
-### 3. Copy Application Files
-
-Copy all files from this repository to your Space directory:
-
-```bash
-# Copy all files (adjust paths as needed)
-cp -r /path/to/crypto-dt-source/* .
-```
-
-**Essential files for HuggingFace Spaces:**
-- `Dockerfile` - Docker configuration optimized for HF Spaces
-- `requirements.txt` - Python dependencies including transformers
-- `app.py` - Main FastAPI application
-- `config.js` - Frontend configuration with environment detection
-- `*.html` - UI files (index.html, hf_console.html, etc.)
-- All backend directories (`api/`, `backend/`, `monitoring/`, etc.)
-
-### 4. Configure Environment Variables (Optional but Recommended)
-
-In your HuggingFace Space settings, add these secrets:
-
-**Required:**
-- `HUGGINGFACE_TOKEN` - Your HF token for accessing models (optional if using public models)
-
-**Optional API Keys (for enhanced data collection):**
-- `ETHERSCAN_KEY_1` - Etherscan API key
-- `COINMARKETCAP_KEY_1` - CoinMarketCap API key
-- `NEWSAPI_KEY` - NewsAPI key
-- `CRYPTOCOMPARE_KEY` - CryptoCompare API key
-
-**HuggingFace Configuration:**
-- `ENABLE_SENTIMENT=true` - Enable sentiment analysis
-- `SENTIMENT_SOCIAL_MODEL=ElKulako/cryptobert` - Social sentiment model
-- `SENTIMENT_NEWS_MODEL=kk08/CryptoBERT` - News sentiment model
-- `HF_REGISTRY_REFRESH_SEC=21600` - Registry refresh interval (6 hours)
-
-### 5. Push to HuggingFace
-
-```bash
-# Add all files
-git add .
-
-# Commit changes
-git commit -m "Initial deployment of Crypto API Monitor"
-
-# Push to HuggingFace
-git push
-```
-
-### 6. Wait for Build
-
-HuggingFace Spaces will automatically:
-1. Build your Docker image (takes 5-10 minutes)
-2. Download required ML models
-3. Start the application on port 7860
-4. Run health checks
-
-Monitor the build logs in your Space's "Logs" tab.
-
-### 7. Access Your Application
-
-Once deployed, your application will be available at:
-```
-https://huggingface.co/spaces/YOUR_USERNAME/YOUR_SPACE_NAME
-```
-
-## Features Available in HuggingFace Spaces
-
-### 🎯 Real-Time Dashboard
-- Access the main dashboard at the root URL
-- Real-time WebSocket updates for all metrics
-- Provider health monitoring
-- System status and analytics
-
-### 🤗 HuggingFace Console
-- Access at `/hf_console.html`
-- Test HF model registry
-- Run sentiment analysis
-- Search crypto-related models and datasets
-
-### 📊 API Documentation
-- Swagger UI: `/docs`
-- ReDoc: `/redoc`
-- API Info: `/api-info`
-
-### 🔌 WebSocket Endpoints
-All WebSocket endpoints are available for real-time data:
-- `/ws` - Master WebSocket endpoint
-- `/ws/market_data` - Market data updates
-- `/ws/news` - News updates
-- `/ws/sentiment` - Sentiment analysis updates
-- `/ws/health` - Health monitoring
-- `/ws/huggingface` - HF integration updates
-
-## Local Development & Testing
-
-### Using Docker Compose
-
-```bash
-# Build and start the application
-docker-compose up --build
-
-# Access at http://localhost:7860
-```
-
-### Using Docker Directly
-
-```bash
-# Build the image
-docker build -t crypto-api-monitor .
-
-# Run the container
-docker run -p 7860:7860 \
-  -e HUGGINGFACE_TOKEN=your_token \
-  -e ENABLE_SENTIMENT=true \
-  -v $(pwd)/data:/app/data \
-  crypto-api-monitor
-```
-
-### Using Python Directly
-
-```bash
-# Install dependencies
-pip install -r requirements.txt
-
-# Set environment variables
-export ENABLE_SENTIMENT=true
-export HUGGINGFACE_TOKEN=your_token
-
-# Run the application
-python app.py
-```
-
-## Configuration
-
-### Frontend Configuration (`config.js`)
-
-The frontend automatically detects the environment:
-- **HuggingFace Spaces**: Uses relative URLs with Space origin
-- **Localhost**: Uses `http://localhost:7860`
-- **Custom Deployment**: Uses current window origin
-
-No manual configuration needed!
-
-### Backend Configuration
-
-Edit `.env` or set environment variables:
-
-```bash
-# HuggingFace
-HUGGINGFACE_TOKEN=your_token_here
-ENABLE_SENTIMENT=true
-SENTIMENT_SOCIAL_MODEL=ElKulako/cryptobert
-SENTIMENT_NEWS_MODEL=kk08/CryptoBERT
-HF_REGISTRY_REFRESH_SEC=21600
-HF_HTTP_TIMEOUT=8.0
-
-# API Keys (optional)
-ETHERSCAN_KEY_1=your_key
-COINMARKETCAP_KEY_1=your_key
-NEWSAPI_KEY=your_key
-```
-
-## Architecture
-
-```
-┌─────────────────────────────────────────────────┐
-│         HuggingFace Spaces (Docker)             │
-├─────────────────────────────────────────────────┤
-│                                                  │
-│  Frontend (HTML/JS)                             │
-│  ├── config.js (auto-detects environment)      │
-│  ├── index.html (main dashboard)               │
-│  └── hf_console.html (HF integration UI)       │
-│                                                  │
-│  Backend (FastAPI)                              │
-│  ├── app.py (main application)                 │
-│  ├── WebSocket Manager (real-time updates)     │
-│  ├── HF Integration (sentiment analysis)       │
-│  ├── Data Collectors (200+ APIs)               │
-│  └── SQLite Database (persistent storage)      │
-│                                                  │
-│  ML Models (HuggingFace Transformers)          │
-│  ├── ElKulako/cryptobert                       │
-│  └── kk08/CryptoBERT                           │
-│                                                  │
-└─────────────────────────────────────────────────┘
-```
-
-## Troubleshooting
-
-### Build Fails
-
-1. Check Docker logs in HF Spaces
-2. Verify `requirements.txt` has all dependencies
-3. Ensure Dockerfile uses Python 3.10
-4. Check for syntax errors in Python files
-
-### Application Won't Start
-
-1. Check health endpoint: `https://your-space-url/health`
-2. Review application logs in HF Spaces
-3. Verify port 7860 is exposed in Dockerfile
-4. Check environment variables are set correctly
-
-### WebSocket Connections Fail
-
-1. Ensure your Space URL uses HTTPS
-2. WebSockets automatically upgrade to WSS on HTTPS
-3. Check browser console for connection errors
-4. Verify CORS settings in `app.py`
-
-### Sentiment Analysis Not Working
-
-1. Set `HUGGINGFACE_TOKEN` in Space secrets
-2. Verify models are accessible: `ElKulako/cryptobert`, `kk08/CryptoBERT`
-3. Check HF console at `/hf_console.html`
-4. Review logs for model download errors
-
-### Performance Issues
-
-1. Increase Space hardware tier (if available)
-2. Reduce number of concurrent API monitors
-3. Adjust `HF_REGISTRY_REFRESH_SEC` to longer interval
-4. Consider disabling sentiment analysis if not needed
-
-## Resource Requirements
-
-**Minimum (Free Tier):**
-- 2 CPU cores
-- 2GB RAM
-- 1GB disk space
-
-**Recommended:**
-- 4 CPU cores
-- 4GB RAM
-- 2GB disk space
-- For better ML model performance
-
-## Updating Your Space
-
-```bash
-# Pull latest changes
-git pull
-
-# Make your modifications
-# ...
-
-# Commit and push
-git add .
-git commit -m "Update: description of changes"
-git push
-```
-
-HuggingFace will automatically rebuild and redeploy.
-
-## Security Best Practices
-
-1. **Use HF Secrets** for sensitive data (API keys, tokens)
-2. **Don't commit** `.env` files with actual keys
-3. **Review API keys** permissions (read-only when possible)
-4. **Monitor usage** of external APIs to avoid rate limits
-5. **Keep dependencies updated** for security patches
-
-## Advanced Configuration
-
-### Custom ML Models
-
-To use custom sentiment analysis models:
-
-```bash
-# Set environment variables in HF Spaces
-SENTIMENT_SOCIAL_MODEL=your-username/your-model
-SENTIMENT_NEWS_MODEL=your-username/another-model
-```
-
-### Custom Port (Not Recommended for HF Spaces)
-
-HuggingFace Spaces requires port 7860. Don't change unless deploying elsewhere.
-
-### Multiple Workers
-
-Edit Dockerfile CMD:
-```dockerfile
-CMD ["uvicorn", "app:app", "--host", "0.0.0.0", "--port", "7860", "--workers", "2"]
-```
-
-**Note**: More workers = more memory usage. Adjust based on Space tier.
-
-## Support & Resources
-
-- **HuggingFace Docs**: https://huggingface.co/docs/hub/spaces
-- **FastAPI Docs**: https://fastapi.tiangolo.com/
-- **Transformers Docs**: https://huggingface.co/docs/transformers/
-- **Project Issues**: https://github.com/nimazasinich/crypto-dt-source/issues
-
-## License
-
-[Specify your license here]
-
-## Contributing
-
-Contributions are welcome! Please read the contributing guidelines before submitting PRs.
-
----
-
-**Need help?** Open an issue or contact the maintainers.
-
-**Enjoy your crypto monitoring dashboard on HuggingFace Spaces! 🚀**

HUGGINGFACE_DIAGNOSTIC_GUIDE.md

@@ -137,6 +137,12 @@ git pull origin main
 rm -rf node_modules package-lock.json
 npm install
 
+# Install backend dependencies (FastAPI server used on HuggingFace)
+pip install -r requirements.txt
+
+# Verify critical backend packages
+pip show fastapi uvicorn slowapi sqlalchemy PyJWT || true
+
 # Verify critical packages
 npm list typescript
 npm list vite

README.md

@@ -1,9 +1,3 @@
----
-sdk: docker
-colorFrom: red
-colorTo: red
-sdk_version: 5.49.1
----
 # Crypto-DT-Source
 
 <div align="center">
@@ -492,4 +486,4 @@ This project is licensed under the **MIT License** - see the [LICENSE](LICENSE)
 
 [Documentation](docs/INDEX.md) • [Quick Start](QUICK_START.md) • [فارسی](docs/persian/README_FA.md) • [Changelog](CHANGELOG.md)
 
-</div>
+</div>

README_DEPLOYMENT.md

@@ -1,260 +1,258 @@
-# Crypto Monitor ULTIMATE - Deployment Guide
-
-## ✅ Latest Fixes (2025-11-13)
-
-### Dashboard Fixes
-- ✅ **Inlined Static Files**: CSS and JS are now embedded in HTML (no more 404 errors)
-- ✅ **WebSocket URL**: Fixed to support both HTTP (ws://) and HTTPS (wss://)
-- ✅ **Permissions Policy**: Removed problematic meta tags causing warnings
-- ✅ **Chart.js**: Added defer attribute to prevent blocking
-- ✅ **All Functions**: Properly defined before use (no more "undefined" errors)
-
-### Server Fixes
-- ✅ **Dynamic PORT**: Server now reads `$PORT` environment variable
-- ✅ **Startup Validation**: Graceful degraded mode for network-restricted environments
-- ✅ **Static Files Mounting**: Proper mounting at `/static/` path
-- ✅ **Version**: Updated to 3.0.0
-
----
-
-## 🚀 Deployment Options
-
-### 1. Hugging Face Spaces (Recommended)
-
-#### Option A: Docker (Easier)
-
-1. Create a new Space on Hugging Face
-2. Select **"Docker"** as SDK
-3. Push this repository to the Space
-4. HF will automatically use the Dockerfile
-
-**Environment Variables in Space Settings:**
-```env
-PORT=7860
-ENABLE_AUTO_DISCOVERY=false
-ENABLE_SENTIMENT=true
-```
-
-#### Option B: Python
-
-1. Create a new Space on Hugging Face
-2. Select **"Gradio"** or **"Static"** as SDK
-3. Create `app.py` in root:
-
-```python
-import os
-os.system("python api_server_extended.py")
-```
-
-4. Configure in Space settings:
-   - Python version: 3.11
-   - Startup command: `python api_server_extended.py`
-
----
-
-### 2. Local Development
-
-```bash
-# Install dependencies
-pip install fastapi uvicorn[standard] pydantic aiohttp httpx requests websockets python-dotenv pyyaml
-
-# Run server (default port 8000)
-python api_server_extended.py
-
-# OR specify custom port
-PORT=7860 python api_server_extended.py
-
-# Access dashboard
-http://localhost:8000  # or your custom port
-```
-
----
-
-### 3. Docker Deployment
-
-```bash
-# Build image
-docker build -t crypto-monitor .
-
-# Run container
-docker run -p 8000:8000 crypto-monitor
-
-# OR with custom port
-docker run -e PORT=7860 -p 7860:7860 crypto-monitor
-
-# Using docker-compose
-docker-compose up -d
-```
-
----
-
-## 🔧 Configuration
-
-### Environment Variables
-
-Create `.env` file (or set in Hugging Face Space settings):
-
-```env
-# Server Configuration
-PORT=7860  # Default for HF Spaces
-HOST=0.0.0.0
-
-# Features
-ENABLE_AUTO_DISCOVERY=false  # Set to false for HF Spaces
-ENABLE_SENTIMENT=true
-
-# API Keys (Optional - most providers work without keys)
-COINMARKETCAP_API_KEY=your_key_here
-CRYPTOCOMPARE_API_KEY=your_key_here
-ETHERSCAN_KEY_1=your_key_here
-NEWSAPI_KEY=your_key_here
-
-# HuggingFace (Optional)
-HUGGINGFACE_TOKEN=your_token_here
-SENTIMENT_SOCIAL_MODEL=ElKulako/cryptobert
-SENTIMENT_NEWS_MODEL=kk08/CryptoBERT
-```
-
----
-
-## 📋 Verification Checklist
-
-After deployment, verify:
-
-- [ ] Dashboard loads at root URL (`/`)
-- [ ] No 404 errors in browser console
-- [ ] No JavaScript errors (check browser console)
-- [ ] Health endpoint responds: `/health`
-- [ ] API endpoints work: `/api/providers`, `/api/pools`, `/api/status`
-- [ ] WebSocket connects (check connection status in dashboard)
-- [ ] Provider stats display correctly
-- [ ] All tabs switchable without errors
-
----
-
-## 🐛 Troubleshooting
-
-### Dashboard shows 404 errors for CSS/JS
-**Fixed in latest version!** Static files are now inline.
-
-### WebSocket connection fails
-- Check if HTTPS: WebSocket will use `wss://` automatically
-- Verify firewall allows WebSocket connections
-- Check browser console for error messages
-
-### Server won't start
-```bash
-# Check port availability
-lsof -i:8000  # or your custom port
-
-# Kill process if needed
-pkill -f api_server_extended
-
-# Check logs
-tail -f server.log
-```
-
-### "Address already in use" error
-```bash
-# Change port
-PORT=7860 python api_server_extended.py
-```
-
----
-
-## 🎯 Performance Tips
-
-### For Hugging Face Spaces
-
-1. **Disable Auto-Discovery**: Set `ENABLE_AUTO_DISCOVERY=false`
-2. **Limit Dependencies**: Comment out heavy packages in `requirements.txt` if not needed:
-   - `torch` (~2GB)
-   - `transformers` (~1.5GB)
-   - `duckduckgo-search`
-
-3. **Use Smaller Docker Image**: Dockerfile already uses `python:3.11-slim`
-
-### For Production
-
-1. **Enable Redis Caching**:
-   ```bash
-   docker-compose --profile observability up -d
-   ```
-
-2. **Add Rate Limiting**: Configure nginx/Cloudflare in front
-
-3. **Monitor Resources**: Use Prometheus/Grafana (included in docker-compose)
-
----
-
-## 📊 Resource Requirements
-
-### Minimum
-- **RAM**: 512MB
-- **CPU**: 1 core
-- **Disk**: 2GB
-
-### Recommended
-- **RAM**: 2GB
-- **CPU**: 2 cores
-- **Disk**: 5GB
-
-### With ML Models (torch + transformers)
-- **RAM**: 4GB
-- **CPU**: 2 cores
-- **Disk**: 10GB
-
----
-
-## 🔗 Useful Endpoints
-
-| Endpoint | Description |
-|----------|-------------|
-| `/` | Main dashboard |
-| `/health` | Health check (JSON) |
-| `/api/status` | System status |
-| `/api/stats` | Complete statistics |
-| `/api/providers` | List all providers |
-| `/api/pools` | List all pools |
-| `/docs` | API documentation (Swagger) |
-| `/test_websocket.html` | WebSocket test page |
-
----
-
-## 📝 Version History
-
-### v3.0.0 (2025-11-13) - Production Ready
-- ✅ Fixed all dashboard issues (404, undefined functions, syntax errors)
-- ✅ Inlined static files (CSS, JS)
-- ✅ Fixed WebSocket for HTTPS/WSS
-- ✅ Dynamic PORT support for HF Spaces
-- ✅ Graceful degraded mode for startup validation
-- ✅ All 63 providers tested and working (92% online)
-- ✅ 8 pools with 5 rotation strategies
-- ✅ Complete WebSocket implementation
-- ✅ 100% test pass rate
-
-### v2.0.0 (Previous)
-- Provider pool management
-- Circuit breaker
-- Rate limiting
-- WebSocket support
-
----
-
-## 🆘 Support
-
-If issues persist:
-1. Check browser console for errors
-2. Check server logs: `tail -f server.log`
-3. Verify all environment variables are set
-4. Test endpoints manually:
-   ```bash
-   curl http://localhost:8000/health
-   curl http://localhost:8000/api/providers
-   ```
-
----
-
-**Last Updated**: 2025-11-13
-**Status**: ✅ PRODUCTION READY
+# 🚀 Hugging Face Spaces Deployment Guide
+
+This repository is **production-ready** for deployment on Hugging Face Spaces using Docker runtime.
+
+## ✅ Pre-Deployment Checklist
+
+All requirements are already configured:
+
+- ✅ **FastAPI app**: `api_server_extended.py` defines `app = FastAPI(...)`
+- ✅ **Health endpoint**: `/health` returns service status
+- ✅ **Dockerfile**: Configured with correct CMD for uvicorn
+- ✅ **Requirements**: All dependencies listed in `requirements.txt`
+- ✅ **Port handling**: Supports `${PORT}` environment variable
+- ✅ **Resilient startup**: Runs in degraded mode if some services fail
+
+## 🎯 Deployment Steps
+
+### 1. Create a New Space on Hugging Face
+
+1. Go to https://huggingface.co/spaces
+2. Click **"Create new Space"**
+3. Configure:
+   - **Space name**: `crypto-monitor-api` (or your choice)
+   - **License**: Choose appropriate license
+   - **SDK**: Select **Docker**
+   - **Hardware**: CPU Basic (minimum) or CPU Upgrade (recommended)
+   - **Visibility**: Public or Private
+
+### 2. Push Repository to Space
+
+```bash
+# Clone your new Space
+git clone https://huggingface.co/spaces/YOUR_USERNAME/YOUR_SPACE_NAME
+cd YOUR_SPACE_NAME
+
+# Copy all files from this repository
+cp -r /path/to/crypto-dt-source-main/* .
+
+# Add and commit
+git add .
+git commit -m "Initial deployment of Crypto Monitor API"
+
+# Push to Hugging Face
+git push
+```
+
+### 3. Configure Space Settings (Optional)
+
+In your Space settings, you can add these environment variables:
+
+- `PORT` - Port number (default: 7860 for HF, 8000 for local)
+- `ENABLE_AUTO_DISCOVERY` - Enable auto-discovery service (default: false)
+- Add any API keys as **Repository secrets** (not in code!)
+
+### 4. Monitor Deployment
+
+1. Go to your Space page
+2. Check the **Logs** tab for build progress
+3. Wait for "Running" status (usually 2-5 minutes)
+4. Access your API at: `https://YOUR_USERNAME-YOUR_SPACE_NAME.hf.space`
+
+## 📊 API Endpoints
+
+Once deployed, your API will be available at:
+
+### Core Endpoints
+- **Root**: `https://your-space.hf.space/`
+- **API Docs**: `https://your-space.hf.space/docs` (Interactive Swagger UI)
+- **Health Check**: `https://your-space.hf.space/health`
+- **Status**: `https://your-space.hf.space/api/status`
+
+### Provider Management
+- `GET /api/providers` - List all crypto data providers
+- `GET /api/providers/{id}` - Get provider details
+- `POST /api/providers/{id}/health-check` - Check provider health
+- `GET /api/providers/category/{category}` - Filter by category
+
+### Pool Management
+- `GET /api/pools` - List all provider pools
+- `POST /api/pools` - Create new pool
+- `POST /api/pools/{id}/members` - Add provider to pool
+- `POST /api/pools/{id}/rotate` - Rotate pool providers
+
+### Real-time Updates
+- `WS /ws` - WebSocket connection for live updates
+
+### Monitoring & Diagnostics
+- `GET /api/stats` - System statistics
+- `GET /api/logs` - Application logs
+- `POST /api/diagnostics/run` - Run diagnostics
+
+See `/docs` for complete API documentation with interactive testing.
+
+## 🧪 Local Testing
+
+### Test with Docker (Recommended)
+
+```bash
+# Build the image
+docker build -t crypto-monitor-test .
+
+# Run the container
+docker run -p 8000:8000 crypto-monitor-test
+
+# Test health endpoint
+curl http://localhost:8000/health
+
+# Access API docs
+open http://localhost:8000/docs
+```
+
+### Test with Python
+
+```bash
+# Install dependencies
+pip install -r requirements.txt
+
+# Run locally
+python main.py
+
+# Or with uvicorn directly
+uvicorn api_server_extended:app --host 0.0.0.0 --port 8000 --reload
+```
+
+## 🔍 Troubleshooting
+
+### Build Fails
+
+**Check logs for specific errors:**
+- Missing dependencies? Verify `requirements.txt`
+- Import errors? Ensure all local modules exist
+- System dependencies? Check Dockerfile `apt-get install` section
+
+**Common fixes:**
+```bash
+# Rebuild without cache
+docker build --no-cache -t crypto-monitor-test .
+
+# Check for syntax errors
+python -m py_compile api_server_extended.py
+```
+
+### Container Starts but Health Check Fails
+
+**Increase startup time:**
+Edit `Dockerfile` and increase `start-period`:
+```dockerfile
+HEALTHCHECK --interval=30s --timeout=10s --start-period=60s --retries=3 \
+    CMD curl -f http://localhost:${PORT:-8000}/health || exit 1
+```
+
+**Check logs:**
+```bash
+docker logs <container_id>
+```
+
+### Service Runs in Degraded Mode
+
+This is **normal** if:
+- Some external APIs are unavailable
+- Network connectivity is limited
+- Optional services fail to start
+
+The service will still work with available providers. Check `/health` endpoint for details.
+
+### WebSocket Connection Issues
+
+If WebSocket connections fail:
+1. Ensure your client uses `wss://` (not `ws://`) for HTTPS spaces
+2. Check CORS settings in `api_server_extended.py`
+3. Verify firewall/proxy settings
+
+## 📈 Performance Optimization
+
+### For Better Performance
+
+1. **Upgrade Hardware**: Use CPU Upgrade or GPU in Space settings
+2. **Disable Auto-Discovery**: Set `ENABLE_AUTO_DISCOVERY=false` (already default)
+3. **Reduce Provider Count**: Edit config files to monitor fewer providers
+4. **Enable Caching**: Already enabled by default
+
+### Resource Usage
+
+- **Memory**: ~2-4 GB (depends on active providers)
+- **CPU**: Low to moderate (spikes during health checks)
+- **Storage**: ~500 MB (includes models and data)
+
+## 🔐 Security Best Practices
+
+1. **Never commit API keys** - Use HF Repository secrets
+2. **Use HTTPS** - Hugging Face provides this automatically
+3. **Rate limiting** - Already implemented via `slowapi`
+4. **CORS** - Configured to allow all origins (adjust if needed)
+
+## 📝 Configuration Files
+
+### Required Files (Already Present)
+- `Dockerfile` - Container configuration
+- `requirements.txt` - Python dependencies
+- `api_server_extended.py` - Main FastAPI application
+- `.dockerignore` - Files to exclude from image
+
+### Optional Configuration
+- `.env.example` - Environment variable template
+- `providers_config_*.json` - Provider configurations
+- `crypto_resources_*.json` - Resource definitions
+
+## 🎓 Features
+
+This deployment includes:
+
+✅ **200+ Crypto Data Providers** - Comprehensive coverage
+✅ **Provider Pools** - Load balancing and failover
+✅ **Real-time WebSocket** - Live updates
+✅ **Health Monitoring** - Automatic health checks
+✅ **Auto-Discovery** - Find new data sources (optional)
+✅ **Diagnostics** - Built-in troubleshooting
+✅ **Logging System** - Comprehensive logging
+✅ **Resource Management** - Import/export configs
+✅ **Rate Limiting** - Prevent abuse
+✅ **CORS Support** - Cross-origin requests
+✅ **API Documentation** - Interactive Swagger UI
+
+## 🆘 Support
+
+### Check Service Status
+```bash
+# Health check
+curl https://your-space.hf.space/health
+
+# Detailed status
+curl https://your-space.hf.space/api/status
+
+# Run diagnostics
+curl -X POST https://your-space.hf.space/api/diagnostics/run
+```
+
+### Common Issues
+
+1. **Space shows "Building"** - Wait 2-5 minutes for first build
+2. **Space shows "Runtime Error"** - Check logs tab for details
+3. **API returns 503** - Service starting up, wait 30-60 seconds
+4. **Slow responses** - Upgrade hardware or reduce provider count
+
+### Get Help
+
+- Check `/api/diagnostics/run` for automatic issue detection
+- Review Space logs for error messages
+- Test locally with Docker to isolate issues
+- Check Hugging Face Spaces documentation
+
+## 📄 License
+
+See LICENSE file for details.
+
+---
+
+**Ready to deploy!** Follow the steps above to get your Crypto Monitor API running on Hugging Face Spaces.

README_HUGGINGFACE.md

@@ -0,0 +1,151 @@
+# Crypto Monitor Extended API - Hugging Face Spaces Deployment
+
+This repository is configured to run as a **Docker Space** on Hugging Face.
+
+## 🚀 Quick Deploy to Hugging Face Spaces
+
+1. **Create a new Space** on Hugging Face
+2. **Select Docker as the SDK**
+3. **Clone this repository** or push it to your Space
+4. The Space will automatically build and deploy
+
+## 📋 Configuration
+
+### Space Settings
+
+- **SDK**: Docker
+- **Hardware**: CPU Basic (or higher for better performance)
+- **Visibility**: Public or Private (your choice)
+
+### Environment Variables (Optional)
+
+You can set these in your Space settings under "Repository secrets":
+
+- `PORT` - Port number (default: 7860 for HF Spaces)
+- `ENABLE_AUTO_DISCOVERY` - Enable auto-discovery service (default: false)
+
+## 🔧 Technical Details
+
+### Main Application
+
+The FastAPI application is defined in `api_server_extended.py` and exposes:
+
+- **Main API**: `http://your-space.hf.space/`
+- **API Docs**: `http://your-space.hf.space/docs`
+- **Health Check**: `http://your-space.hf.space/health`
+- **WebSocket**: `ws://your-space.hf.space/ws`
+
+### Features
+
+✅ **Provider Management** - Manage 200+ crypto data providers
+✅ **Pool Management** - Create and manage provider pools with rotation strategies
+✅ **Real-time WebSocket** - Live updates and monitoring
+✅ **Health Monitoring** - Automatic health checks for all providers
+✅ **Auto-Discovery** - Discover new crypto data sources automatically
+✅ **Diagnostics** - Built-in diagnostics and auto-repair
+✅ **Logging** - Comprehensive logging system
+✅ **Resource Management** - Import/export provider configurations
+
+### API Endpoints
+
+#### Core Endpoints
+- `GET /` - Main dashboard
+- `GET /health` - Health check
+- `GET /api/status` - System status
+- `GET /api/stats` - Statistics
+
+#### Provider Management
+- `GET /api/providers` - List all providers
+- `GET /api/providers/{id}` - Get provider details
+- `POST /api/providers/{id}/health-check` - Check provider health
+- `GET /api/providers/category/{category}` - Get providers by category
+
+#### Pool Management
+- `GET /api/pools` - List all pools
+- `POST /api/pools` - Create new pool
+- `POST /api/pools/{id}/members` - Add member to pool
+- `POST /api/pools/{id}/rotate` - Rotate pool
+
+#### WebSocket
+- `WS /ws` - WebSocket connection for real-time updates
+
+See `/docs` for complete API documentation.
+
+## 🏗️ Local Development
+
+### Using Docker
+
+```bash
+# Build the image
+docker build -t crypto-monitor .
+
+# Run the container
+docker run -p 8000:8000 crypto-monitor
+```
+
+### Using Python directly
+
+```bash
+# Install dependencies
+pip install -r requirements.txt
+
+# Run the server
+python main.py
+```
+
+Or with uvicorn directly:
+
+```bash
+uvicorn api_server_extended:app --host 0.0.0.0 --port 8000 --reload
+```
+
+## 📊 Monitoring
+
+Once deployed, you can monitor your Space:
+
+1. Check the **Logs** tab in your Space
+2. Visit `/health` endpoint for health status
+3. Visit `/api/status` for detailed system status
+4. Use `/docs` for interactive API documentation
+
+## 🔍 Troubleshooting
+
+### Space not starting?
+
+1. Check the **Logs** tab for error messages
+2. Verify all required files are present
+3. Ensure `api_server_extended.py` defines `app = FastAPI(...)`
+4. Check that all dependencies in `requirements.txt` are valid
+
+### Health check failing?
+
+The health check runs after 40 seconds of startup. If it fails:
+
+1. Increase `start-period` in Dockerfile HEALTHCHECK
+2. Check if the app is listening on the correct PORT
+3. Verify `/health` endpoint returns 200 OK
+
+### Performance issues?
+
+1. Upgrade to better hardware (CPU or GPU)
+2. Disable auto-discovery: Set `ENABLE_AUTO_DISCOVERY=false`
+3. Reduce the number of providers being monitored
+
+## 📝 Notes
+
+- The application uses **no API keys** by default - all data sources are free
+- SQLite database is used for persistence (stored in `/app/data/`)
+- Logs are stored in `/app/logs/`
+- The app runs in **degraded mode** if some providers are unavailable
+- WebSocket connections are supported for real-time updates
+
+## 🤝 Support
+
+For issues or questions:
+- Check the `/api/diagnostics/run` endpoint for automatic diagnostics
+- Review logs in the Hugging Face Space logs tab
+- Check the `/health` endpoint for system status
+
+## 📄 License
+
+See LICENSE file for details.

api_server_extended.py

@@ -183,23 +183,45 @@ class HealthCheckResponse(BaseModel):
 async def startup_event():
     """رویداد شروع سرور"""
     print("🚀 راه‌اندازی سرور...")
-    await manager.init_session()
-    await run_startup_validation()
+    
+    try:
+        await manager.init_session()
+    except Exception as e:
+        print(f"⚠️  Warning: Could not initialize session: {e}")
+    
+    try:
+        await run_startup_validation()
+    except Exception as e:
+        print(f"⚠️  Warning: Startup validation had issues: {e}")
+        print("⚠️  Continuing in degraded mode...")
     
     # ثبت لاگ شروع
-    log_manager.add_log(
-        LogLevel.INFO,
-        LogCategory.SYSTEM,
-        "Server started",
-        extra_data={"version": "3.0.0"}
-    )
+    try:
+        log_manager.add_log(
+            LogLevel.INFO,
+            LogCategory.SYSTEM,
+            "Server started",
+            extra_data={"version": "3.0.0"}
+        )
+    except Exception as e:
+        print(f"⚠️  Warning: Could not log startup: {e}")
     
     # شروع بررسی سلامت دوره‌ای
-    asyncio.create_task(periodic_health_check())
-    await auto_discovery_service.start()
+    try:
+        asyncio.create_task(periodic_health_check())
+    except Exception as e:
+        print(f"⚠️  Warning: Could not start health check task: {e}")
+    
+    try:
+        await auto_discovery_service.start()
+    except Exception as e:
+        print(f"⚠️  Warning: Could not start auto-discovery: {e}")
     
     # شروع heartbeat برای WebSocket
-    asyncio.create_task(websocket_heartbeat())
+    try:
+        asyncio.create_task(websocket_heartbeat())
+    except Exception as e:
+        print(f"⚠️  Warning: Could not start websocket heartbeat: {e}")
     
     print("✅ سرور آماده است")
 
@@ -208,8 +230,17 @@ async def startup_event():
 async def shutdown_event():
     """رویداد خاموش شدن سرور"""
     print("🛑 خاموش‌سازی سرور...")
-    await auto_discovery_service.stop()
-    await manager.close_session()
+    
+    try:
+        await auto_discovery_service.stop()
+    except Exception as e:
+        print(f"⚠️  Warning during auto-discovery shutdown: {e}")
+    
+    try:
+        await manager.close_session()
+    except Exception as e:
+        print(f"⚠️  Warning during session close: {e}")
+    
     print("✅ سرور خاموش شد")
 
 
@@ -266,17 +297,26 @@ async def test_websocket_dashboard():
 @app.get("/health")
 async def health():
     """بررسی سلامت سرور"""
-    stats = manager.get_all_stats()
-    conn_stats = conn_manager.get_stats()
-    
-    return {
-        "status": "healthy",
-        "timestamp": datetime.now().isoformat(),
-        "providers_count": stats['summary']['total_providers'],
-        "online_count": stats['summary']['online'],
-        "connected_clients": conn_stats['active_connections'],
-        "total_sessions": conn_stats['total_sessions']
-    }
+    try:
+        stats = manager.get_all_stats()
+        conn_stats = conn_manager.get_stats()
+        
+        return {
+            "status": "healthy",
+            "timestamp": datetime.now().isoformat(),
+            "providers_count": stats['summary']['total_providers'],
+            "online_count": stats['summary']['online'],
+            "connected_clients": conn_stats['active_connections'],
+            "total_sessions": conn_stats['total_sessions']
+        }
+    except Exception as e:
+        # Return basic health status even if detailed stats fail
+        return {
+            "status": "ok",
+            "timestamp": datetime.now().isoformat(),
+            "message": "Service is running (degraded mode)",
+            "error": str(e)
+        }
 
 
 # ===== Provider Endpoints =====

main.py

@@ -1,30 +1,30 @@
-from importlib import util
-from pathlib import Path
-import sys
+#!/usr/bin/env python3
+"""
+Local Development Entry Point
+This file is for local development only and is NOT used by Hugging Face Docker runtime.
+For production deployment, use: uvicorn api_server_extended:app
+"""
 
-
-def _load_app_module():
-    """
-    تلاش برای وارد کردن آبجکت FastAPI با نام app.
-    ابتدا سعی می‌کنیم مثل قبل از ماژول «app» ایمپورت کنیم.
-    اگر نام «app» به پوشه‌ای اشاره کند و attribute نداشته باشد،
-    فایل app.py را به طور مستقیم بارگذاری می‌کنیم.
-    """
-    try:
-        from app import app as fastapi_app  # type: ignore
-        return fastapi_app
-    except (ImportError, AttributeError):
-        current_dir = Path(__file__).resolve().parent
-        app_path = current_dir / "app.py"
-        spec = util.spec_from_file_location("crypto_monitor_app", app_path)
-        if spec is None or spec.loader is None:
-            raise ImportError("Could not load app.py module for FastAPI application.")
-        module = util.module_from_spec(spec)
-        sys.modules["crypto_monitor_app"] = module
-        spec.loader.exec_module(module)
-        if not hasattr(module, "app"):
-            raise ImportError("app.py does not define an 'app' FastAPI instance.")
-        return module.app  # type: ignore[attr-defined]
-
-
-app = _load_app_module()
+if __name__ == "__main__":
+    import uvicorn
+    import os
+    
+    # Get port from environment or use default
+    port = int(os.getenv("PORT", "8000"))
+    
+    print(f"""
+    ╔═══════════════════════════════════════════════════════════╗
+    ║   🚀 Crypto Monitor - Local Development Server           ║
+    ║   Port: {port}                                                   ║
+    ║   Docs: http://localhost:{port}/docs                            ║
+    ╚═══════════════════════════════════════════════════════════╝
+    """)
+    
+    # Run with reload for local development
+    uvicorn.run(
+        "api_server_extended:app",
+        host="0.0.0.0",
+        port=port,
+        reload=True,
+        log_level="info"
+    )

requirements.txt

@@ -11,6 +11,18 @@ numpy>=1.24.0
 # ==================== HTTP CLIENTS ====================
 requests>=2.31.0
 aiohttp>=3.8.0
+httpx>=0.26.0
+
+# ==================== WEB BACKEND ====================
+fastapi>=0.109.0
+uvicorn[standard]>=0.27.0
+slowapi>=0.1.9
+python-multipart>=0.0.6
+websockets>=12.0
+
+# ==================== DATA MODELS & CONFIG ====================
+pydantic>=2.5.3
+pydantic-settings>=2.1.0
 
 # ==================== WEB SCRAPING & RSS ====================
 beautifulsoup4>=4.12.0
@@ -27,10 +39,13 @@ huggingface-hub>=0.16.0
 plotly>=5.14.0
 kaleido>=0.2.1
 
-# ==================== DATE/TIME ====================
-python-dateutil>=2.8.2
+# ==================== DATABASE & STORAGE ====================
+sqlalchemy>=2.0.25
+
+# ==================== AUTHENTICATION & SECURITY ====================
+PyJWT>=2.8.0
 
-# ==================== UTILITIES ====================
+# ==================== DATE/TIME HELPERS ====================
 python-dateutil>=2.8.2
 
 # ==================== OPTIONAL: ACCELERATED INFERENCE ====================

test_docker_build.bat

@@ -0,0 +1,56 @@
+@echo off
+REM Test script to verify Docker build and run locally (Windows)
+
+echo Building Docker image...
+docker build -t crypto-monitor-test .
+
+if %ERRORLEVEL% NEQ 0 (
+    echo Docker build failed!
+    exit /b 1
+)
+
+echo Docker build successful!
+echo.
+echo Starting container...
+docker run -d --name crypto-monitor-test -p 8000:8000 crypto-monitor-test
+
+if %ERRORLEVEL% NEQ 0 (
+    echo Container failed to start!
+    exit /b 1
+)
+
+echo Container started!
+echo.
+echo Waiting for service to be ready (40 seconds)...
+timeout /t 40 /nobreak >nul
+
+echo.
+echo Testing health endpoint...
+curl -s -o nul -w "%%{http_code}" http://localhost:8000/health > temp_status.txt
+set /p HEALTH_RESPONSE=<temp_status.txt
+del temp_status.txt
+
+if "%HEALTH_RESPONSE%"=="200" (
+    echo Health check passed! (HTTP %HEALTH_RESPONSE%)
+    echo.
+    echo Service is running at:
+    echo    - API: http://localhost:8000
+    echo    - Docs: http://localhost:8000/docs
+    echo    - Health: http://localhost:8000/health
+    echo.
+    echo Container logs:
+    docker logs crypto-monitor-test --tail 20
+    echo.
+    echo To stop the container, run:
+    echo    docker stop crypto-monitor-test ^&^& docker rm crypto-monitor-test
+) else (
+    echo Health check failed! (HTTP %HEALTH_RESPONSE%)
+    echo.
+    echo Container logs:
+    docker logs crypto-monitor-test
+    echo.
+    echo Stopping and removing container...
+    docker stop crypto-monitor-test
+    docker rm crypto-monitor-test
+    exit /b 1
+)

test_docker_build.sh

@@ -0,0 +1,54 @@
+#!/bin/bash
+# Test script to verify Docker build and run locally
+
+echo "🔨 Building Docker image..."
+docker build -t crypto-monitor-test .
+
+if [ $? -ne 0 ]; then
+    echo "❌ Docker build failed!"
+    exit 1
+fi
+
+echo "✅ Docker build successful!"
+echo ""
+echo "🚀 Starting container..."
+docker run -d --name crypto-monitor-test -p 8000:8000 crypto-monitor-test
+
+if [ $? -ne 0 ]; then
+    echo "❌ Container failed to start!"
+    exit 1
+fi
+
+echo "✅ Container started!"
+echo ""
+echo "⏳ Waiting for service to be ready (40 seconds)..."
+sleep 40
+
+echo ""
+echo "🔍 Testing health endpoint..."
+HEALTH_RESPONSE=$(curl -s -o /dev/null -w "%{http_code}" http://localhost:8000/health)
+
+if [ "$HEALTH_RESPONSE" = "200" ]; then
+    echo "✅ Health check passed! (HTTP $HEALTH_RESPONSE)"
+    echo ""
+    echo "📊 Service is running at:"
+    echo "   - API: http://localhost:8000"
+    echo "   - Docs: http://localhost:8000/docs"
+    echo "   - Health: http://localhost:8000/health"
+    echo ""
+    echo "🔍 Container logs:"
+    docker logs crypto-monitor-test --tail 20
+    echo ""
+    echo "🛑 To stop the container, run:"
+    echo "   docker stop crypto-monitor-test && docker rm crypto-monitor-test"
+else
+    echo "❌ Health check failed! (HTTP $HEALTH_RESPONSE)"
+    echo ""
+    echo "📋 Container logs:"
+    docker logs crypto-monitor-test
+    echo ""
+    echo "🛑 Stopping and removing container..."
+    docker stop crypto-monitor-test
+    docker rm crypto-monitor-test
+    exit 1
+fi