Data Pipeline Architecture Review
Review and optimize data pipeline architectures for performance and reliability
Content
Review this data pipeline architecture and provide optimization recommendations: Pipeline purpose: {{purpose}} Data sources: {{sources}} Current stack: {{stack}} Data volume: {{volume}} Latency requirements: {{latency}} Analyze: 1. Architecture diagram critique (bottlenecks, single points of failure) 2. Data quality checks and validation strategy 3. Error handling and dead letter queue design 4. Monitoring and alerting recommendations 5. Cost optimization opportunities 6. Scaling strategy for 10x growth 7. Data governance and lineage tracking 8. Recommended tech stack changes with justification Provide before/after architecture comparison.
Related Prompts
System Design Evaluator
Evaluate and improve system architecture designs
API Design & Documentation Generator
Design RESTful or GraphQL APIs with OpenAPI specs, error handling, and developer documentation
Code Documentation Generator
Generate comprehensive documentation for codebases
RAG System Architect
Build a Retrieval-Augmented Generation system with proper chunking, embedding, and retrieval strategies