Back to Data Science & Analysis

Python Data Pipeline Builder

Build a complete data pipeline in Python with error handling and logging.

Updated Feb 20, 2026

ShareLinkedIn

Variables to Customize

0/5 filled

Prompt

You are a senior data engineer. Build a Python data pipeline for:

Task: {{task_description}}

Requirements:
1) Use pandas/polars for data manipulation
2) Include proper error handling (try/except with specific exceptions)
3) Add logging at each stage (use Python's logging module)
4) Include data validation checks (null counts, type checks, range checks)
5) Make it idempotent (safe to re-run)
6) Include a simple CLI interface (argparse)
7) Add docstrings and type hints throughout
8) Include a requirements.txt

Data source: {{source}} (CSV/API/Database/etc.)
Data destination: {{destination}}
Schedule: {{one_time/daily/hourly}}
Expected data volume: {{volume}}

Powered by Hugging Face Inference API

Pro Tips

  • Enforces production-quality patterns (idempotency, logging, validation) that most quick scripts miss.

References

More Data Science & Analysis Prompts

📊Data Science & Analysis

Data Analysis Pipeline Builder

Build complete data analysis pipelines with cleaning, exploration, visualization, and insights extraction.

You are a senior data scientist. Build a complete analysis pipeline for the foll...

Gemini 2.5 Pro
IntermediateView prompt
📊Data Science & Analysis

ML Model Selection Advisor

Get expert guidance on choosing the right machine learning model for your specific problem and dataset.

You are a machine learning expert. Help me select the right model for my problem...

📊Data Science & Analysis

SQL Query Optimizer

Optimize slow SQL queries with explain plan analysis, indexing suggestions, and rewrite recommendations.

You are a database performance specialist. Optimize the following SQL query. **...

Claude Sonnet 4
AdvancedView prompt

You Might Also Like

✍️Writing & Content

Blog Post Architect

Create SEO-optimized, engaging blog posts with structured outlines, compelling hooks, and strategic keyword placement.

You are an expert content strategist and SEO specialist. Create a comprehensive ...

Claude Opus 4
IntermediateView prompt
📚Education

Socratic Method Tutor

Learn any concept through guided questioning that builds deep understanding instead of memorization.

You are a Socratic tutor. Your role is to help me deeply understand a concept th...

Claude Opus 4
BeginnerView prompt
🚀Product Management

Product Requirements Document (PRD)

Generate comprehensive PRDs with user stories, acceptance criteria, technical requirements, and success metrics.

You are a senior product manager at a top tech company. Write a comprehensive PR...

Claude Opus 4
IntermediateView prompt