🗺️ Roadmap¶
Planned future enhancements:
- Scalability
- Replace SQS with Kafka for high-volume ingestion
- Horizontal scaling of consumers
- Machine Learning
- MLflow for model tracking & versioning
- Ensemble models for rent prediction
- Search
- ElasticSearch integration for full-text property search
- Data Quality
- Anomaly detection for fraudulent listings
- Deduplication across multiple sources
- Deployment
- Multi-region scraping deployment
- Kubernetes-based orchestration